KR101404751B1 - Mobile terminal and its method for controlling of user interface menu - Google Patents

Abstract

The present invention relates to a method for detecting movement such as tilting, rotation, or movement of a mobile terminal and controlling the display of a predetermined content or menu according to the movement, controlling the execution of a specific function or a menu, A memory for receiving an image and outputting the image to a memory, a memory for storing an image input through the camera at a specific time interval, and a direction for tilting, rotating or moving the mobile terminal by analyzing the stored image And a control unit for automatically executing a predetermined function or a user interface menu preset according to the calculated direction.

Tilt, rotate, move, control menu

Description

[0001] MOBILE TERMINAL AND ITS METHOD FOR CONTROLLING OF USER INTERFACE MENU [0002]

The present invention relates to a method for detecting movement such as tilting, rotation, or movement of a mobile terminal and controlling the display of a predetermined content or menu according to the movement, controlling the execution of a specific function or a menu, .

The mobile terminal may be configured to perform various functions.

Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some mobile terminals include additional functions to execute games, and some other mobile terminals are also implemented as multimedia devices. Moreover, recent mobile terminals can receive a broadcast or multicast signal to view a video or television program.

Further, efforts for supporting and increasing the functions of the mobile terminal continue. Such efforts include not only changes and improvements in structural components that form the mobile terminal, but also improvements in software or hardware. As such a design, a folder type, a slide type, a bar type, or a rotation type design is applied to a mobile terminal.

However, conventionally, in order to scroll the content displayed on the screen in a specific direction, the user has to repeatedly press a specific key, and the user has to repeatedly press a specific key in order to call up the menu and select the called menu item .

The present invention provides a method for detecting inclination or rotation of a mobile terminal and scrolling contents displayed on the screen according to a tilted or rotated direction and a mobile terminal having the method.

The present invention also provides a method for detecting a tilt or a rotation of a mobile terminal and displaying a specific menu according to the tilted or rotated direction and moving the menu item, and a mobile terminal having the method.

The present invention also provides a method for detecting a skew or a rotation of a mobile terminal and re-executing a previously performed specific function or menu according to the skewed or rotated direction, and a mobile terminal having the method.

In order to accomplish the above object, a mobile terminal according to an embodiment of the present invention includes a camera for receiving an image and outputting the image to a memory, a memory for storing an image input through the camera at specific time intervals, And a control unit for calculating a tilting, rotation, or moving direction of the mobile terminal, and automatically executing a preset function or a user interface menu according to the calculated direction.

According to another aspect of the present invention, there is provided an image processing method including storing an image input through a camera at specific time intervals, calculating a motion of the terminal by analyzing the stored image, And to automatically execute the set specific function or menu.

The mobile terminal according to the present invention configured as described above has the effect of improving the convenience by scrolling the content displayed on the screen according to the tilted or rotated direction even if the user does not repeatedly input a specific key.

In addition, according to the present invention configured as described above, even if a specific key is not repeatedly input, a specific menu is called and displayed according to a tilted or rotated direction of the mobile terminal, and each item of the menu can be easily moved, So that the convenience is improved.

In addition, the present invention configured as described above allows a user to directly execute a previously-performed specific function or menu even if a menu call is not repeatedly performed according to a tilted or rotated direction of the mobile terminal without repeatedly inputting a specific key. There is an effect of improving convenience.

Hereinafter, various embodiments according to the present invention will be described in detail with reference to the accompanying drawings. It should be understood, however, that the detailed description of known technologies and configurations thereof, which may be detracted from the gist of the present invention, will be omitted. In describing the present invention with reference to the drawings, the same reference numerals are used to denote components performing the same function.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal may be implemented in various forms. For example, the mobile terminal described in this specification may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) have.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. 1 shows a mobile terminal having various components. However, not all illustrated components are required. A mobile terminal may be implemented by more components than the illustrated components, or a mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more components that allow wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network on which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115 have.

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and the wireless Internet module 113 can be built in or externally.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. One example is the GPS (Global Position System) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude. For example, the GPS module can accurately calculate the current position according to the triangulation method by measuring the precise time and distance from three or more satellites and measuring three different distances. A method of obtaining distance and time information from three satellites and correcting the error by one satellite may be used. In particular, the GPS module can acquire latitude, longitude and altitude as well as three-dimensional velocity information and accurate time from the position information received from the satellite.

An audio / video (A / V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151, which will be described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. Also, it is responsible for a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, Video input / output (I / O) ports, earphone ports, and the like.

Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) ), A Universal Subscriber Identity Module (" USIM "), and the like. In addition, an apparatus having an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 152, and an alarm unit 153.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. If the mobile terminal 100 is in the video communication mode or the photographing mode, the captured image and / or the received image or UI and GUI are displayed.

Meanwhile, as described above, when the display unit 13 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display). In addition, there may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When the call signal is received or a message is received, the alarm unit 153 can output a vibration to notify it. Alternatively, when the key signal is input, the alarm unit 153 can output the vibration by the feedback to the key signal input. The user can recognize the occurrence of an event through the vibration output as described above. Of course, a signal for notifying the occurrence of an event may also be output through the display unit 151 or the audio output module 152.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, .

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read- And an optical disc. In addition, the mobile terminal 100 may operate a web storage for storing the memory 150 on the Internet.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. In addition, the software codes may be stored in the memory 160 and executed by the control unit 180. [

 In the foregoing, the mobile terminal related to the present invention has been described in terms of components according to functions. Hereinafter, the mobile terminal related to the present invention will be further described with reference to FIGS. 2 and 3 in view of the components according to the outline. Hereinafter, for simplicity of explanation, a slider type mobile terminal will be described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like. Therefore, the present invention is not limited to a slider type mobile terminal but can be applied to all types of mobile terminals including the above-mentioned type.

2 is a perspective view of a mobile terminal according to an embodiment of the present invention.

The mobile terminal of the present invention includes a first body 200 and a second body 205 configured to be slidable along at least one direction on the first body 200.

The state where the first body 200 is disposed in a state of being overlapped with the second body 205 may be referred to as a closed configuration and the first body 200 may be referred to as a second body 205 ) May be referred to as an open configuration.

The mobile terminal operates mainly in the standby mode in the closed state, but the standby mode is also released by the operation of the user. The mobile terminal operates mainly in a communication mode in an open state, but is also switched to a standby mode by a user's operation or a predetermined period of time.

The casing (casing, housing, cover, etc.) constituting the outer appearance of the first body 200 is formed by the first front case 220 and the first rear case 225. Various electronic components are installed in a space formed by the first front case 220 and the first rear case 225. At least one intermediate case may be additionally disposed between the first front case 220 and the first rear case 225.

The cases may be formed by injection molding of a synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

A display module 151, an audio output module 152, a camera 121, or a first user input unit 210 may be disposed in the first body 200, specifically, the first front case 220.

The display module 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), and the like, which visually represent information.

In addition, the display module 151 is overlapped with the touch pad in a layer structure, so that the display module 151 may operate as a touch screen to enable information input by a user's touch.

The sound output module 152 may be implemented in the form of a speaker.

The camera 121 may be implemented to suitably photograph an image or a moving image for a user and the like.

As in the case of the first body 200, the case constituting the outer appearance of the second body 205 is formed by the second front case 230 and the second rear case 235.

The second user input unit 215 may be disposed on the front surface of the second body 205, specifically, the second front case 230.

The third user input unit 245, the microphone 122, and the interface unit 170 may be disposed in at least one of the second front case 230 and the second rear case 235.

The first to third user input units 210, 215, and 245 may be collectively referred to as a manipulating portion 130. In a tactile manner in which the user operates with a tactile impression, Can be employed.

For example, the user input unit may be implemented by a dome switch or a touch pad capable of receiving a command or information by a push or a touch operation of a user, or may be a wheel, a jog type, a joystick, or the like Can also be implemented.

In a functional aspect, the first user input unit 210 is for inputting commands such as start, end, scrolling, etc., and the second user input unit 215 is for inputting numbers, letters, symbols and the like.

Also, the third user input unit 245 may operate as a hot-key for activating a special function in the portable terminal.

The microphone 122 may be implemented in a form suitable for receiving voice, sound, etc. of the user.

The interface unit 170 is a path for allowing a mobile terminal related to the present invention to exchange data with an external device. For example, the interface unit 170 may be a wired or wireless connection terminal for connecting to an earphone, a port for short-range communication (for example, an IrDA port, a Bluetooth port, (wireless Lan port), etc.), or power supply terminals for supplying power to the mobile terminal.

The interface unit 170 may be a card socket for accommodating an external card such as a subscriber identification module (SIM) or a user identity module (UIM) or a memory card for storing information.

And a power supply unit 190 for supplying power to the mobile terminal is mounted on the second rear case 235 side.

The power supply unit 190 may be detachably coupled to a rechargeable battery, for example, for charging.

3 is a rear perspective view of the mobile terminal of FIG.

Referring to FIG. 3, a camera 121 may further be mounted on the rear surface of the second rear case 235 of the second body 205. The camera 121 of the second body 205 has a photographing direction which is substantially opposite to that of the camera 121 of the first body 200. The camera 121 of the first body 200 and the camera 121 of the first body 200, And different pixels.

For example, the camera 121 of the first body 200 has low pixels so that it is easy to capture a face of a user in the case of a video call or the like and transmit it to the other party, Since it is often the case that a subject is photographed and not immediately transferred, it is preferable to have a high pixel.

A flash 250 and a mirror 255 may be additionally disposed adjacent to the camera 121 of the second body 205. The flash 250 illuminates the subject when the subject of the subject is photographed by the camera 121 of the second body 205. The mirror 255 allows the user to illuminate the user's own face or the like when the user intends to take a picture of himself / herself (self-photographing) using the camera 121 of the second body 205.

The second rear case 235 may further include an acoustic output module 152.

The sound output module 152 of the second body 205 may implement a stereo function together with the sound output module 152 of the first body 200 and may be used for a call in a speakerphone mode.

In addition, an antenna 260 for receiving broadcast signals may be disposed on one side of the second rear case 235 in addition to the antenna for communication. The antenna 260 may be installed to be detachable from the second body 205.

A portion of the slide module 265 that slidably couples the first body 200 and the second body 205 is disposed on the first rear case 225 side of the first body 200.

The other part of the slide module 265 may be disposed on the second front case 230 side of the second body 205 and may not be exposed to the outside as in this figure.

In the above description, the second camera 121 and the like are disposed on the second body 205, but the present invention is not limited thereto.

For example, at least one of the configurations 260, 121 to 250, and 152 described as being disposed in the second rear case 235, such as the camera 121 of the second body, It is also possible that the first rear case 225 is mounted to the rear case 225. In such a case, there is an advantage that the configuration (s) disposed in the first rear case 225 in the closed state is protected by the second body 205. Further, even if the camera 121 of the second body is not separately provided, the camera 121 of the first body may be configured to be rotatable so that the camera 121 of the second body can be photographed up to the photographing direction .

The terminal 100 shown in Figs. 1 to 3 is operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system .

Hereinafter, a communication system capable of operating a terminal according to the present invention will be described with reference to FIG.

The communication system may use different air interfaces and / or physical layers. For example, wireless interfaces that can be used by communication systems include, but are not limited to, Frequency Division Multiple Access ('FDMA'), Time Division Multiple Access ('TDMA'), Code Division Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE)), Global System for Mobile Communications (GSM) . Hereinafter, for the sake of convenience of description, the description will be limited to CDMA. However, the present invention is applicable to all communication systems including CDMA wireless communication systems.

4, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275 , And a mobile switching center ('MSC') 280. MSC 280 is configured to be coupled to a Public Switched Telephone Network (" PSTN ") 290, and is also configured to be coupled to BSCs 275. BSCs 275 may be coupled in pairs with BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may comprise at least one sector, and each sector may comprise an omnidirectional antenna or an antenna pointing to a particular direction of radial from BS 270. [ In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments and each of the plurality of frequency assignments has a specific spectrum (e.g., 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency assignment may be referred to as a CDMA channel. BS 270 may be referred to as a Base Station Transceiver Subsystem (BTSs). In this case, the word "base station" may be referred to as a combination of one BSC 275 and at least one BS 270. [ The base station may also indicate a "cell site ". Alternatively, each of the plurality of sectors for a particular BS 270 may be referred to as a plurality of cell sites.

4, a broadcasting transmitter (BT) 295 transmits a broadcasting signal to the terminals 100 operating in the system. The broadcast module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295. In addition, FIG. 4 illustrates several Global Positioning System ('GPS') satellites 300. The satellites 300 help to locate at least one of the plurality of terminals 100.

Although two satellites are shown in Figure 4, useful location information may be obtained by two or more satellites. The GPS module 115 shown in FIG. 1 cooperates with satellites 300 to obtain desired location information. Here, you can track your location using all of the technologies that can track your location, as well as your GPS tracking technology. Also, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

Among the typical operations of a wireless communication system, the BS 270 receives a reverse link signal from the various terminals 100. At this time, the terminals 100 are in the process of connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by the particular base station 270 is processed by the particular base station 270.

The data resulting from the processing is transmitted to the connected BSC 275. The BSC 275 provides call resource allocation and mobility management functions, including the organization of soft handoffs between the base stations 270. The BSC 275 also transmits the received data to the MSC 280 and the MSC 280 provides additional transmission services for connection with the PSTN 290. [ Similarly, the PSTN 290 connects to the MSC 280, the MSC 280 connects to the BSCs 275, and the BSCs 275 communicate with the BSs 270 ).

5 is a flowchart illustrating a method of controlling a user interface menu in a mobile terminal according to the present invention.

The controller 180 of the mobile terminal according to the present invention may perform a menu control function by inclining a specific button or a touch input (S101). In other words, it is possible to enter a mode for controlling the operation of a specific function or menu by tilting (S102).

The mode can be entered even when a specific function or menu has already been executed.

For example, the user can enter the mode by receiving a specific button or touch input while the album viewing menu is running, or may enter the mode by receiving a specific button or touch input while the web browsing menu is being executed.

Hereinafter, the mode is referred to as a 'tilting operation mode' in order to distinguish it from a 'call mode' or a 'photographing mode' for the sake of convenience.

When the mobile terminal enters the tilting operation mode, the controller 180 detects that the display position of the subject is changed in the image input through the camera 121, and tilts the mobile terminal using the changed position information The direction of rotation or movement can be calculated. The control unit 180 can calculate not only the tilting direction but also the moving direction (moving direction).

In order to detect or calculate the inclination, rotation, or movement direction, a sensor for attitude detection such as a gyro sensor may be provided in the sensing unit 140. Hereinafter, a description of a method of detecting the tilting, rotation, or moving direction by the sensing unit will be omitted.

In the present invention, a tilt, a rotation, or a moving direction can be calculated using an image input through the camera 121 already provided in the terminal (S103). A specific method of calculating the tilting or moving direction using the camera 121 will be described with reference to FIG.

When the information related to the tilting, rotation, or movement is calculated as described above, the controller 180 controls the operation of the function or the menu that is already performed in the mobile terminal according to the calculated tilting, rotation, or movement direction. At this time, even if the inclination, the rotation or the movement occurs in the same direction, another operation can be performed according to the function or menu being executed at that time.

For example, when the album view menu is executed, when the user tilts or moves in the left direction, the control unit 180 may control to move the displayed picture to the left direction or to display another picture. However, when the user tilts or moves in the left direction while the web browsing menu is executed, the controller 180 can control to display the previous page. Even if the tilting or movement occurs in the same direction as described above, another operation can be performed according to the function or menu being executed at that time.

The control unit 180 analyzes the image at specific time intervals to detect the display position of the subject (S103), and calculates the direction in which the mobile terminal is tilted, rotated, or moved (S104). Further, the angle at which the position of the subject is tilted, rotated or moved according to the changed distance, path, or direction can be calculated (S105). It is also possible to calculate the speed at which it tilts, rotates, or moves. Here, the directions, angles, and velocities are relative values.

The control unit 180 may control the user interface menu by the calculated inclination, rotation, or movement information (S106). However, the functions that are executed when the information is detected or the operations that can be controlled according to the menus can be individually set for each mobile terminal.

Hereinafter, a method of calculating the inclination and the moving direction using the camera provided in the mobile terminal according to the present invention will be described.

6A is an exemplary diagram illustrating a method of detecting a direction when the mobile terminal according to the present invention is tilted or moved about a first axis.

As shown in the figure, the control unit 180 can detect a subject input through the camera 121 in an image when the mobile terminal is not moving, that is, in a still image. The control unit 180 may use the characteristic outline of a straight line such as a desk, a box, or a gate to detect the overall contour of the subject.

The control unit 180 detects whether the position of a subject input through the camera is shifted at a specific time interval. The specific time may vary depending on the movement of the mobile terminal. For example, the faster the motion, the shorter the detection time, and the longer the motion, the longer the detection time.

When the position of the subject moves to the left, the controller 180 may determine that the mobile terminal is tilted to the left (320). Similarly, when the position of the subject moves to the right, it can be determined that the mobile terminal is tilted to the right (330).

6B is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or moved about the second axis. As shown in the figure, when the mobile terminal is tilted or moved, the position of the subject also moves in the image input through the camera 121. [

Accordingly, when the position of the subject moves upward, the controller 180 may determine that the mobile terminal is also tilted upward (420). Similarly, when the position of the subject moves downward, the mobile terminal may also be determined to be tilted downward (430).

6C is an exemplary diagram for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or rotated about a third axis.

As shown in the figure, when the position of the subject rotates in the clockwise direction about the display unit 151, the controller 180 determines that the mobile terminal is tilted or rotated in the counterclockwise direction (520). Similarly, when the position of the subject rotates in the counterclockwise direction, the mobile terminal may determine that the mobile terminal is tilted or rotated in the counterclockwise direction (530).

6D is an exemplary diagram for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or rotated about a fourth axis.

6C, a method of detecting inclination and rotational movement of the body of the mobile terminal, particularly the display unit 151, has been described. However, as shown in FIG. 6D, the controller 180 may detect a rotational movement of the body of the mobile terminal about an arbitrary position other than the body part or the body, except for the display part 151. That is, as shown in FIG. 6D, the controller 180 can detect the inclination of the lower portion of the body to the left or right direction of the predetermined angle (620, 630).

6A to 6D can be implemented in a complex manner.

That is, the mobile terminal can be tilted or rotated about any one of the axes, and the controller 180 can analyze the image input through the camera and calculate the tilting and rotation movement information. The control unit 180 may calculate an angle and a velocity that are inclined or rotated according to a distance at which the display position of the subject is changed in the image.

6A to 6D illustrate a method of analyzing an image input through a camera and calculating a direction, and an image input through the camera is actually displayed on the display unit 151 Note that this is not the case. That is, the control unit 180 stores an image input through the camera in a specific area of the memory 160, and analyzes the images stored in the memory 160 to calculate an inclined or rotated motion.

Depending on the configuration of the circuit, the image input through the camera may be directly stored in the specific area of the memory 160 without being controlled by the controller 180 in the 'tilting operation mode'. The specific region is a capacity capable of storing an image required for skewing analysis. For example, assuming that the time required for image analysis is 5 seconds, a 5-second image is maintained in a first in first out (FIFO) manner in the memory area.

Note that the controller 180 does not detect the tilted state of the mobile terminal but detects the tilted or moving operation.

Hereinafter, a method for controlling a user interface menu using information related to the inclination or rotation of the mobile terminal analyzed by the image input through the camera will be described.

FIG. 7 is a diagram illustrating a method of displaying a picture according to movement of a terminal in an album view mode of a mobile terminal according to the present invention.

As shown in the figure, in the state where the album view menu is executed, when the mobile terminal is tilted or rotated in a certain direction, even if a specific button for changing and displaying a picture is not inputted, The photos stored in the folder can be displayed in the order of the previous photo or the next photo, or the photo stored in the other folder (folder) can be displayed. For example, when the mobile terminal is tilted to the left or right, the controller 180 displays a previous photo or a next photo in the same folder. If the mobile terminal is tilted upward or downward, Display the picture.

8 is a diagram illustrating a method of displaying a web page according to movement of a terminal in a web browsing mode of the mobile terminal according to the present invention.

As shown in the figure, the control unit 180 displays the previous web page or the next web page in accordance with the direction in which the mobile terminal is tilted or rotated, even if no specific button or menu is input. can do. For example, if the mobile terminal is tilted to the left in step 710 while using a second visited web page through the mobile terminal, the first visited web page is displayed in step 720, and if the mobile terminal is tilted to the right side The third visited web page can be displayed (730).

9 is a diagram illustrating a method of displaying a menu on one side of a display unit according to movement of a mobile terminal according to the present invention.

As shown, when the mobile terminal is in the standby state, the control unit 180 displays a specific menu in one side area of the display unit according to the direction of the mobile terminal when the mobile terminal is tilted or rotated in a specific direction, It can be executed automatically. The displayed menu may be a menu related to the function being executed when the specific function has already been executed.

Even if a tilt or rotation occurs in the same direction as described above, another operation can be performed according to the function or menu being executed at that time. Also, the direction in which the menu is displayed may be changed depending on the direction in which the mobile terminal is tilted or rotated.

FIG. 10 is a diagram illustrating an example of a method for re-executing a function that has already been executed in the order of history according to the movement of the mobile terminal according to the present invention.

For example, suppose that a user uses 'schedule', 'bluetooth', 'camera', 'album view', and 'calculator' functions through a mobile terminal. When the mobile terminal is tilted or rotated in a specific direction, the control unit 180 can automatically re-execute the previously performed function according to the direction.

For example, when the mobile terminal is tilted to the left in the state of performing the 'view album' function 810, the 'Bluetooth' function is automatically executed (820), while the 'viewing album' function is being executed The 'calculator' function may be automatically performed (830) if the mobile terminal is tilted to the right.

On the other hand, the menu or function being executed may include a 'game' function and may be used to control the movement of a specific character or item within the 'game'.

In the foregoing, preferred embodiments of the present invention have been described with reference to the accompanying drawings.

Here, the terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary meanings, but should be construed as meaning and concept consistent with the technical idea of the present invention.

Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It should be understood that various equivalents and modifications may be present.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention;

FIG. 2 is a perspective view of an example of a mobile terminal according to the present invention. FIG.

Figure 3 is a rear perspective view of the mobile terminal of Figure 2;

4 is an exemplary view of a communication system in which a terminal according to the present invention is operable.

5 is a flowchart illustrating a method of controlling a user interface menu in a mobile terminal according to the present invention.

6A is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or moved about a first axis.

FIG. 6B is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or moved about a second axis; FIG.

FIG. 6C is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or rotated about a third axis. FIG.

FIG. 6D is an exemplary view for explaining a method of detecting a direction when the mobile terminal according to the present invention is tilted or rotated about a fourth axis. FIG.

FIG. 7 is a first exemplary view for explaining an operation according to a motion of a mobile terminal according to the present invention; FIG.

FIG. 8 is a second exemplary view for explaining an operation according to a motion of a mobile terminal according to the present invention; FIG.

FIG. 9 is a third example for explaining an operation of the mobile terminal according to the present invention. FIG.

FIG. 10 is a fourth exemplary view for explaining an operation according to a motion of a mobile terminal according to the present invention; FIG.

Claims (10)

A camera for receiving an image and outputting the image to a memory; A memory for storing images input through the camera at specific time intervals; And a controller for analyzing the stored image to calculate a tilting, rotating, or moving direction of the mobile terminal, and automatically executing a preset function or a user interface menu according to the calculated direction . The apparatus of claim 1, Wherein the mobile terminal detects the change of the position of the subject in the image stored in the memory at a specific time interval and calculates the direction in which the mobile terminal is tilted, rotated or moved using the changed position information. 3. The apparatus of claim 2, According to the distance, route or direction in which the position of the subject is changed, And calculates at least one of a direction in which the mobile terminal is tilted, rotated or moved, an angle, and a speed. The apparatus of claim 1, As the movement of the mobile terminal becomes faster or slower Wherein the predetermined time is short or long. 3. The apparatus of claim 2, When the position of the subject moves, And determines that the terminal is moved in a direction opposite to the moving direction. 3. The apparatus of claim 2, When the position of the subject rotates, And determines a direction in which the terminal is tilted or a direction in which the terminal is rotated according to the rotating direction. The apparatus of claim 1, Depending on the calculated inclination, rotation or direction of movement, And controls the movement of a specific character or item in a currently executed function. Storing images input through a camera at specific time intervals; Analyzing the stored image to calculate a motion of the terminal; And automatically executing a preset specific function or menu in accordance with the calculated movement of the terminal. 9. The method according to claim 8, According to the distance, route or direction in which the position of the subject is changed in the image, And calculating at least one of a direction in which the terminal is tilted, rotated, or moved, an angle, and a speed of the terminal. 10. The method according to claim 9, When the position of the subject rotates or moves, And determines a direction in which the terminal is tilted, rotated, or moved according to the direction of the rotation or movement of the terminal.

Images