KR20120115620A - Method for controlling user interface of portable termianl using movement sensing device and apparatus therefof - Google Patents

Abstract

PURPOSE: A method for controlling a user interface of a portable terminal with a motion sensing device and a device thereof are provided to easily and quickly confirm, access, execute, and control lower or detailed data related to directory items included in a directory list by using the motion sensing device. CONSTITUTION: A touch screen(110) displays a directory list including directory items selected by touch. A control unit(160) determines a touch coordinate signal according to the touch or finger motion sensing signal received from a motion sensing device(100). If the finger motion sensing signal is inputted, the control unit displays a file list corresponding to the directory items included in the directory list through a pop-up menu or a pull-down menu. [Reference numerals] (100) Motion sensing device; (110) Touch screen; (130) Memory; (140) Communication unit; (150) Audio processing unit; (160) Control unit

Description

METHOD FOR CONTROLLING USER INTERFACE OF PORTABLE TERMIANL USING MOVEMENT SENSING DEVICE AND APPARATUS THEREFOF}

The present invention relates to a method for controlling a user interface of a portable terminal using a motion detection device and a portable terminal thereof.

In more detail, the user interface control of the portable terminal enables the user to more quickly and easily identify, access, and execute each relevant data regarding a plurality of directory items included in the directory list in the portable terminal using the motion sensor. A method and apparatus are disclosed.

In general, various electronic devices are being made through the development of electronic communication technology, and these devices are increasingly emphasizing the user's ease of operation and the beautifulness of the design. Highlighted by this trend is the shift from input devices, represented by keyboards or keypads, to input devices such as touch screens.

In particular, in the case of a mobile terminal such as a smart phone, a tablet PC, a portable multimedia player, and a mobile phone, an additional hardware keyboard is provided for intuitive user input, user convenience, and user aesthetics. Minimizing the number of keypads, buttons, etc., user input devices such as touch screens are being adopted as main input devices.

The touch screen is an input device in which a sensor is embedded in a screen and a user input is made by a method in which a sensor detects this by touching a specific object on the touch screen using a hand or a stylus pen.

Meanwhile, various functions of portable electronic devices are integrated into one portable terminal, and intelligent high-performance portable terminals that support computer functions such as the Internet and communication information retrieval such as smart phones are rapidly becoming common. Accordingly, there is a demand for an input method capable of using, checking, accessing, and controlling detailed data related to various specific contents or programs more easily and quickly.

However, in the case of a mobile terminal employing a user input device such as a touch screen as a main input device, a user input interface corresponding to various operation modes is provided to the user in various ways, and the user can intuitively perform the corresponding input. Although there is an advantage in that it is possible, detailed methods related to various contents or files, etc. are not presenting an effective way for a user to more easily and quickly use, view, access, and control.

1 to 4 are diagrams for explaining a user interface environment provided by a general music player application in a mobile terminal having a touch screen.

Here, FIG. 3 is a diagram illustrating a method of touching a music file item with a finger when a music file item desired by a user exists in a specific album item, and FIG. 4 is a screen of the mobile terminal according to the touch of FIG. 3. It is a figure which shows the general reproduction control screen displayed on the screen.

Referring to FIGS. 1 and 4, when the music player application is executed and used in an existing touch screen-based smartphone, the user displays the corresponding album item in order to check the music file list included in any album item. After touching a specific area 1 on the screen with a finger, it is necessary to check the details included in any album item through a list of music files displayed by page transition on the screen.

That is, in the case of the album list 9 composed of a plurality of album items 3 as shown in FIG. 1, in order for the user to check the music file list of the album items displayed on the screen, the user selects a specific album item from the album list. -> Check the list of music files that are displayed by page switching-> Select (2) button-> Check the album list that is displayed by page switching-> Select a specific album item in the album list-> Check the list of music files that are displayed by page switching- > Select the revert button (2)-> Check the album list displayed by page switching-> ... ', page switching according to the upper and lower directory movement (Depth move) must be repeated several times.

In other words, in the existing touch-based user interface environment, the user had to repeat unnecessary 'depth movement' in order to check or control subordinate or detailed data related to a large number of contents or files stored in the mobile terminal. There was a lot of inconvenience in checking or controlling data quickly and easily.

Accordingly, there is a need for a user interface control method of a portable terminal capable of quickly and conveniently accessing, checking, and controlling data desired by a user while minimizing the above-described 'depth movement'.

The present invention provides a mobile terminal having a touch screen for recognizing a user's touch and a motion detecting device for detecting a user's finger movement, wherein the user detects lower or detailed data regarding a plurality of directory items included in a directory list. It aims to be able to access, check, execute, and control quickly and conveniently using.

The present invention relates to a method for controlling a user interface of a mobile terminal having a touch screen for detecting a user's touch and a motion sensing device for detecting a user's finger movement, the method including a plurality of directory items selectable by the user's touch. Displaying a directory list on the touch screen; Determining whether a touch coordinate signal according to a user's touch or a motion detection signal corresponding to a user's finger movement is input from the motion detection device from the touch screen; And a file list (including a plurality of file items) corresponding to any one directory item included in the directory list when a motion detection signal is input from the motion detection device. A pop-up menu or a pull-down menu. (Pull-down menu) to display to the user.

In particular, when a touch coordinate signal corresponding to a user's touch is input from the touch screen, detecting a specific directory item corresponding to the touch coordinate signal on the directory list; And page switching a file list corresponding to the detected specific directory item and displaying the same to the user.

The motion detection signal may include a push detection signal according to a press gesture of a user finger and a swipe detection signal according to a swipe gesture of a user finger, and may include any of the directories included in the directory list. Determining whether the push detection signal or the swipe detection signal is input from the motion detection device in a state in which a file list corresponding to one directory item is displayed to the user as a pop-up menu or a pull-down menu. It is characterized by.

In addition, when the push detection signal is input from the motion sensor, the popup menu or pull-down menu may be selected so that a user may sequentially select a specific file item through the motion sensor operation on the pop-up menu or the pull-down menu. Activating and deactivating the directory list.

The method may further include determining whether a swipe detection signal is input from the motion detection device while the pop-up menu or the pull-down menu is activated; Detecting a swipe displacement of a user's finger based on the swipe detection signal when the swipe detection signal is input; And sequentially activating file items belonging to the activated pop-up menu or the pull-down menu according to the detected swipe displacement on the activated pop-up menu or the pull-down menu.

The method may further include detecting a swipe displacement of a user's finger based on the swipe detection signal when a swipe detection signal is input from the motion detection device; And sequentially displaying a file list (including a plurality of file items) corresponding to a directory item located after the one directory item in the pop-up menu or the pull-down menu according to the detected swipe displacement. It further comprises a step.

The touch coordinates corresponding to the display area on the touch screen on which the pop-up menu or the pull-down menu is displayed while the file list corresponding to any one directory item included in the directory list is displayed to the user as a pop-up menu or a pull-down menu. Determining whether a signal is input from the touch screen; And when the touch coordinate signal corresponding to the display area is input from the touch screen, the pop-up menu or the pop-up menu or the pull-down menu to allow a user to sequentially select a specific file item through the motion sensor operation. Activating a pull-down menu and deactivating the directory list.

In addition, the push detection signal is characterized in that the dome click (Dome click) signal.

The motion sensing device may be any one of a touch pad, a touch screen, a trackball, a scroll wheel, and a mobile pointing device.

The one directory item may be a directory item located first among a plurality of directory items included in the directory list.

The directory list may include a plurality of directory items including album art and album names for the album of a specific singer, and identification information of at least one of the name of the specific singer, and a motion detection signal is received from the motion detection apparatus. When input, displaying the file list corresponding to any one directory item included in the directory list to the user as a pop-up menu or a pull-down menu may include a music file list corresponding to the directory item including the one or more identification information. A control item for controlling the execution of the music file items included in the music file list together with the plurality of music file items is displayed to the user as a pop-up menu or a pull-down menu.

The control item may include an individual selection item for individually selecting a music file item included in the music file list, a total selection item for selecting all of the music file items included in the music file list, and a selected music file item. Play item that can be played immediately, and Enqueue item that can add the selected music file item to the playlist.

The method may further include detecting a specific directory item corresponding to the touch coordinate signal on the directory list when a touch coordinate signal corresponding to a user's touch is input from the touch screen; And converting a list of music files corresponding to the detected specific directory item into a page and displaying the same to the user.

The motion detection signal may include a push detection signal according to a press gesture of a user finger and a swipe detection signal according to a swipe gesture of a user finger, and includes the at least one identification information. Determining whether the push detection signal or the swipe detection signal is input from the motion detection device while the music file list corresponding to the directory item is displayed to the user as a pop-up menu or a pull-down menu. It is characterized by.

In addition, when a push detection signal is input from the motion sensor, the pop-up menu or pull-down menu allows a user to sequentially select a specific music file item through the motion sensor operation on the pop-up menu or pull-down menu. Activate and the directory list further comprises the step of deactivating.

The method may further include determining whether a swipe detection signal is input from the motion detection device while the pop-up menu or the pull-down menu is activated; Detecting a swipe displacement of a user's finger based on the swipe detection signal when the swipe detection signal is input; And sequentially activating music file items belonging to the activated popup menu or the pulldown menu according to the detected swipe displacement on the activated popup menu or the pulldown menu.

The method may further include detecting a swipe displacement of a user's finger based on the swipe detection signal when a swipe detection signal is input from the motion detection device; And a music file list (including a plurality of music file items) corresponding to the directory item located after the one directory item in the pop-up menu or the pull-down menu sequentially on the directory list according to the detected swipe displacement. Characterized in that it further comprises the step of displaying.

On the other hand, the present invention relates to a user interface control device of a mobile terminal having a touch screen for detecting a user's touch and a motion detection device for detecting a user's finger movement, a plurality of directory items selectable by the user touch A touch screen displaying a list of directories to include; And determining whether a touch coordinate signal according to a user's touch or a motion detection signal according to a user's finger movement is input from the motion detection device from the touch screen, and when the motion detection signal is input from the motion detection device, And a control unit which controls to display a file list (including a plurality of file items) corresponding to any one directory item included to the user through a pop-up menu or a pull-down menu. Device for controlling a user interface of a mobile terminal.

In particular, when a touch coordinate signal corresponding to a user's touch is input from the touch screen, the controller detects a specific directory item corresponding to the touch coordinate signal on the directory list, and a file corresponding to the detected specific directory item. It is characterized by displaying the list by page switching to the user.

The motion detection signal may include a push detection signal according to a press gesture of a user finger and a swipe detection signal according to a swipe gesture of a user finger. The control unit may include the directory list. Determining whether the push detection signal or the swipe detection signal is input from the motion detection device while displaying a file list corresponding to any one of the directory items included in the pop-up menu or a pull-down menu to the user. It features.

The control unit may control the pop-up menu so that a user may sequentially select a specific file item through the motion sensor operation on the pop-up menu or the pull-down menu when a push detection signal is input from the motion sensor. Or activate the pull-down menu and deactivate the directory list.

The controller may determine whether a swipe detection signal is input from the motion detection device while the pop-up menu or the pull-down menu is activated, and when the swipe detection signal is input, the controller detects a swipe detection signal. Detecting a swipe displacement of the user's finger based on the sequence, and sequentially activating file items belonging to the activated pop-up menu or pull-down menu according to the detected swipe displacement on the activated pop-up menu or pull-down menu. It features.

The controller may detect a swipe displacement of a user's finger based on the swipe detection signal when a swipe detection signal is input from the motion detection device, and, according to the detected swipe displacement, the directory list. In the above, the file list corresponding to the directory item located next to the one directory item is sequentially displayed as a pop-up menu or a pull-down menu.

In addition, the push detection signal is characterized in that the dome click (Dome click) signal.

The motion sensing device may be any one of a touch pad, a touch screen, a trackball, a scroll wheel, and a mobile pointing device.

The directory list may include a plurality of directory items including album art and album names for the album of a specific singer and identification information of at least one of the name of the specific singer, and the control unit may further include a plurality of directory items. When a motion detection signal is input, control the execution of music file items included in the music file list together with a music file list (including a plurality of music file items) corresponding to the directory item including the one or more identification information. The control item may be displayed to the user as a pop-up menu or a pull-down menu.

The control item may include an individual selection item for individually selecting a music file item included in the music file list, a total selection item for selecting all of the music file items included in the music file list, and a selected music file item. Play item that can be played immediately, and Enqueue item that can add the selected music file item to the playlist.

The controller may display a file list corresponding to any one directory item included in the directory list as a pop-up menu or a pull-down menu to a user on a display area on the touch screen where the pop-up menu or pull-down menu is displayed. It is determined whether a corresponding touch coordinate signal is input from the touch screen, and when a touch coordinate signal corresponding to the display area is input from the touch screen, a user operates the motion sensing device on the pop-up menu or a pull-down menu. And activating the pop-up menu or the pull-down menu so as to sequentially select a specific file item, and deactivating the directory list.

According to an embodiment of the present invention, in a mobile terminal having a touch screen for detecting a user's touch and a motion sensing device for detecting a user's finger movement, the lower or detailed data regarding a plurality of directory items included in the directory list may be stored. The user can check, access, execute and control the motion sensor quickly and easily.

1 to 4 are diagrams for explaining a user interface environment provided by a general music player application in a mobile terminal having a touch screen.
5 is a perspective view of a mobile terminal according to an embodiment of the present invention.
6 is a view for explaining a user interface device applied to a mobile terminal according to an embodiment of the present invention.
7 to 9 are flowcharts for explaining a user interface control method of a mobile terminal using a motion detection apparatus according to the present invention;
10 to 21 are exemplary views for explaining a case where the user interface control method according to the present invention is applied to a music player application as an example.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to 'include' a certain component, it means that it can further include other components, except to exclude other components unless otherwise stated.

A mobile terminal according to an embodiment of the present invention is a terminal for generating a directory list in which respective functional elements are linked to each other, where a directory list includes a plurality of directory items selectable by a user's touch or a user's motion sensing device manipulation. Preferably, a smartphone, a tablet PC, a mobile phone, a personal digital assistant (PDA), a code division multiple access (CDMA) terminal, a wideband code division multiple access (WCDMA) terminal, a global system for mobile (GSM) It will be apparent that the present invention can be applied to a mobile terminal such as a communication terminal, an IMT-2000 terminal, and an application thereof.

Hereinafter, an apparatus and method for controlling a user interface of a mobile terminal according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

5 is a perspective view of a portable terminal according to an embodiment of the present invention, Figure 6 is a view for explaining a user interface device applied to the portable terminal according to an embodiment of the present invention. Here, in FIG. 5, reference numeral 11 denotes a housing of the portable terminal, reference numeral 12 denotes a display unit of a touch screen, and reference numeral 100 denotes a motion detection apparatus.

Referring to FIG. 6, the mobile terminal 10 according to the present invention includes a motion detection apparatus 100, a touch screen 110, a memory 130, a communication unit 140, an audio processor 150, and a controller 160. It is provided.

The touch screen 110 is controlled by the controller 160 to display a series of operation states, operation results, and a plurality of information of the mobile terminal 10. For example, it displays the full browsing, VOD (Video on Demand), Map, MP3 playback, and Mail service screens. The touch screen 110 visually provides a menu of the portable terminal, user data input by the user, function setting information, and various information to the user. In particular, the touch screen 110 of the present invention displays a directory list selectable by the user's touch or the user's motion sensing device 100 operation.

Here, the directory list is composed of a plurality of directory items, each directory item including a file list consisting of one or more file items. For example, the directory item may be an album directory item 211 having album art, album name, and artist name as identification information, and a file list belonging to the album directory item 211 may be one or more. It may be a music file list 217 composed of music file items (see FIG. 11). The album art described above is image data associated with each album directory item.

The touch screen 110 is formed by combining the display unit 12 and a touch panel (not shown), and detects an input signal according to a user's touch operation on the display unit 12 and transmits the input signal to the controller 160. That is, when the user's finger touches a specific position on the display unit 12, the touch screen 110 transmits a position coordinate corresponding to the touched position to the controller 160.

The touch screen 110 may be configured as a display device such as an LCD, an OLED, and an LED. In addition, the touch screen 110 may detect an input signal according to a user's touch position, touch intensity, and touch direction on the display unit 12, and may be implemented in various forms such as a current sensing method and a pressure sensing method. In addition, depending on the applied method, the operation state may be detected only by the user's proximity rather than in direct contact.

The memory 130 stores an application program for operating a function according to an embodiment of the present invention. The memory 130 includes a program area and a data area. The program area may be a program that generates a directory list including a plurality of directory items selectable by a user's touch or a user's motion sensing device in association with an operating system (OS) and functional elements for booting the mobile terminal. Stored. The data area is an area in which data generated according to the use of the mobile terminal 10 is stored, and data of functional elements for each service item and an executable menu list (directory list and file list) are stored.

The communication unit 140 establishes a communication channel between the mobile terminal 10 and the base station and is responsible for a series of communication for transmitting and receiving necessary signals. In addition, the communication unit 140 may include a radio frequency (RF) transmitter for upconverting and amplifying a frequency of a transmitted signal, and an RF receiver for low noise amplifying and downconverting a received signal. In particular, the communication unit 140 performs communication between the mobile terminal 10 and the base station when accessing a web site through the wireless Internet.

The audio processor 150 reproduces an audio signal output from the controller 160 or transmits an audio signal such as a voice input from a microphone MIC to the controller 160. That is, the audio processor 150 converts the voice and sound data into an audible sound through the speaker SPK under the control of the controller 160, and outputs the audio signal such as a voice received from the microphone MIC. Transfer to the controller 160.

The controller 160 controls the overall operation of the mobile terminal 10 and the signal flow between the internal blocks. In particular, while the controller 160 displays the directory list selectable by the user's touch on the touch screen 110, from the touch coordinate signal or the motion detection device 100 according to the user's touch from the touchscreen 110. It is determined whether a motion detection signal corresponding to the movement of the user's finger is input, and the processing according to the present invention is executed according to the input signal.

Here, the motion detection signal includes a push detection signal according to a press gesture of a user finger and a swipe detection signal according to a swipe gesture of the user finger. The push detection signal may be a signal generated by a hardware click of the motion detection apparatus 100 (ie, a Dome click signal) or a signal generated by a software click of the motion detection apparatus 100 (ie, a long click). term press signal).

More specifically, the controller 160 includes a directory list when a motion detection signal is input from the motion detection apparatus 100 while displaying a directory list selectable by a user touch on the touch screen 110. A list of files corresponding to the directory items of any one of them (eg, the first directory item) is displayed to the user as a pop-up menu or a pull-down menu.

Here, displaying as a 'pop-up menu' means that a list of files corresponding to a specific directory item is displayed in a new window over the previously displayed directory list, and displaying as a 'pull-down menu' corresponds to a specific directory item. This means that the list of files will expand to the bottom of that particular directory entry.

When the touch coordinate signal corresponding to the user's touch is input from the touch screen 110 while the directory list selectable by the user touch is displayed on the touch screen 110, the displayed directory list is displayed. The specific directory item corresponding to the touch coordinate signal received on the screen is detected. Then, the file list corresponding to the detected specific directory item is page transitioned and displayed to the user.

In this case, the "page changeover" means that the screen on which the directory list is displayed is replaced with the file list corresponding to the detected specific directory item.

In addition, the controller 160 displays the file list corresponding to any one of the directory items included in the directory list to the user as a pop-up menu or a pull-down menu. It determines whether the swipe detection signal is input, and processes the function according to the present invention according to the input signal to be executed.

In more detail, the controller 160 displays a file list corresponding to any one directory item included in the directory list to the user through a pop-up menu or a pull-down menu, and the push detection signal from the motion detection apparatus 100. Is input, the pop-up menu or pull-down menu is activated so that the user can sequentially select a specific file item through the motion sensor operation on the pop-up menu or the pull-down menu. Select a specific file item) and deactivate the previously displayed directory list. When the swipe detection signal is input from the motion detection apparatus 100 while the pop-up menu or the pull-down menu is activated, the controller 160 detects a swipe displacement of the user's finger based on the swipe detection signal. do. The controller 160 sequentially activates the file items belonging to the activated popup menu or the pulldown menu according to the detected swipe displacement on the activated popup menu or the pulldown menu.

Meanwhile, the controller 160 inputs a swipe detection signal from the motion detection apparatus 100 while displaying a file list corresponding to any one directory item included in the directory list to the user as a pop-up menu or a pull-down menu. When detected, the swipe displacement of the user's finger is detected based on the swipe detection signal. The controller 160 sequentially displays a file list corresponding to a directory item located after any one directory item on the directory list as a pop-up menu or a pull-down menu according to the detected swipe displacement.

The motion detection apparatus 100 detects a movement of a subject (finger) and transmits a motion detection signal corresponding thereto to the controller 160. The motion detection apparatus 100 may use a touch pad, a touch screen, a trackball, a scroll wheel, or an infrared (IR) laser, a laser, an electric field, a capacitor, or a thermistor. It may be implemented in various forms including a mobile pointing device for detecting the movement of the.

Here, the subject may be generally understood to be a user's body part such as a finger, but may be any other replaceable object that enables the motion detecting apparatus 100 to detect movement even if it is not the body.

Meanwhile, the motion detection apparatus 100 applied to the present invention generates and moves a cursor or pointer on the screen of the touch screen 110 through the movement of the subject, and points the same pointing points as in a personal computer (PC). Implement the technology. For example, if a user moves a finger after raising a finger (subject) on the motion detection apparatus 100, the cursor (or pointer) on the screen moves according to the moving direction. In this case, the motion detection apparatus 100 may detect physical contact of the subject or light reflected by the subject, and generate a motion detection signal accordingly.

According to the above configuration, in the existing touch-based user interface environment, the user minimizes unnecessary 'depth movement' in order to check or control subordinate or detailed data related to a large number of contents or files stored in the mobile terminal. It can work. Therefore, the user can easily and quickly check and control the data desired by the mobile terminal.

Hereinafter, a case in which the user interface control method according to the present invention is applied to a music player application will be described as an example.

7 to 9 are flowcharts illustrating a method for controlling a user interface of a mobile terminal using a motion detection apparatus according to the present invention, and FIGS. 10 to 21 are diagrams illustrating a method for controlling a user interface according to the present invention to a music player application. This is an exemplary view for explaining the implementation case as an example.

First, referring to FIGS. 7 to 21, the controller of the mobile terminal according to the present invention displays a list of album directories selectable by the user's touch on the touch screen (S100). The album directory list 213 displayed at step S100 may include a plurality of album directory items 211, and each album directory item 211 may have album art, album name, and artist name as identification information. At this time, the control unit includes an album directory list 213, an indicator 203 indicating an operation state of the portable terminal, a battery level, a current time, etc., a directory status window 205 indicating a current directory location, and a category. Library button 207 for checking the separated directory list name, Back button 209 for returning to the previous screen, and control bar for controlling the execution (play, stop, previous track, next track, etc.) of music files The control bar may be displayed together on the display unit 12.

Next, the controller determines whether a touch coordinate signal according to a user's touch or a motion detection signal corresponding to a user's finger movement are input from the touch screen (S110).

Here, the motion detection signal includes a push detection signal according to a press gesture of a user finger and a swipe detection signal according to a swipe gesture of the user finger. The push detection signal may be a signal generated by a hardware click of the motion detection apparatus 100 (ie, a Dome click signal) or a signal generated by a software click of the motion detection apparatus 100 (ie, a long click). term press signal).

As a result of the determination in step S110, when a motion detection signal is input from the motion detection apparatus (S120), as shown in FIG. 11, the music file list 217 corresponding to the first album directory item included in the album directory list is displayed in a pop-up menu ( Display to the user as a pop-up menu or a pull-down menu.

Here, the music file list 217 displayed as a pop-up menu or a pull-down menu includes individual check boxes that can be individually selected by the user by pressing the motion sensor and music included in the music file list 217. You can include an entire selection to select all of the file entries.

In addition, the display of the pop-up menu described above means that the music file list 217 corresponding to a specific album directory item is displayed on a previously displayed album directory list through a new window, and displayed as a 'pull-down menu'. This means that the music file list 217 corresponding to the specific album directory item is displayed to be expanded below the specific album directory item.

Next, the controller determines whether the push detection signal or the swipe detection signal is input from the motion detection device while displaying the music file list corresponding to the first album directory item to the user as a pop-up menu or a pull-down menu (S140). ).

As a result of the determination in step S140, when a swipe detection signal is input from the motion detection apparatus (S150), the controller detects a swipe displacement of the user's finger based on the received swipe detection signal (S160). In addition, the control unit according to the swipe displacement detected in step S160, on the album directory list, the album directory item located before or after the first album directory item (eg, the last album directory item) (eg, the second album directory item). The music file list 217 corresponding to the pop-up menu or the pull-down menu is sequentially displayed (see FIGS. 12 and 13).

For example, assuming that the album directory list is a list configured from top to bottom as shown in FIG. 10, and the list of music files corresponding to the second album directory item is displayed as a pop-up menu, the swipe displacement detected in step S160 is performed. Is +1 in the Y-axis direction, displays a list of music files corresponding to the first album directory item as a pop-up menu, and if the swipe displacement detected in step S160 is -1 in the Y-axis direction, the third album directory is displayed. A list of music files corresponding to the item is displayed in a popup menu. As another example, assuming that the album directory list is a list consisting of left to right, and the list of music files corresponding to the second album directory item is displayed as a pop-up menu, the swipe displacement detected in step S160 is in the X-axis direction. In the case of +1, the music file list corresponding to the third album directory item is displayed as a pop-up menu. If the swipe displacement detected in step S160 is -1 in the X-axis direction, the music corresponding to the first album directory item is displayed. Display the file list in a popup menu.

As described above, in the existing touch-based user interface environment, the user may minimize unnecessary repetition of 'depth movement' in order to check or control subordinate or detailed data related to a large number of contents or files stored in the mobile terminal. It can be effective.

On the other hand, when the push detection signal is input from the motion detection device as a result of the determination in step S140 (S141), the controller sequentially selects a specific music file item through a motion detection device operation on a pop-up menu or a pull-down menu. The pop-up menu or pull-down menu corresponding to the first album directory item is activated, and the album directory list is deactivated (S143) (see FIG. 14). In this case, the control item 217b for controlling the execution of each music file item together with the music file list 217a may be displayed as an activated pop-up menu or a pull-down menu. The control item 217b includes a Play item that can directly play a music file item selected by a user, an Enqueue item that can add a selected music file item to a playlist, and a close that can close a pop-up menu or a pull-down menu window. It can contain an item.

However, the Play item and the Enqueue item are initially in an inactive state (ie, a state in which user selection is impossible) and are activated when one or more music file items are selected by the user (see FIGS. 15 and 16). In the present invention, by displaying a control item with a music file list as a pop-up menu, a user can more effectively control whether or not the user wants to execute a music file item.

Next, in step S143, the controller determines whether a swipe detection signal is input from the motion detection apparatus while the pop-up menu or the pull-down menu is activated.

As a result of the determination in step S145, when the swipe detection signal is input from the motion detection device, the controller detects the swipe displacement of the user's finger based on the received swipe detection signal (S147). Then, the controller sequentially activates the music file item and the control item belonging to the activated pop-up menu or the pull-down menu according to the detected swipe displacement on the activated pop-up menu or the pull-down menu (S149) (see FIG. 15). .

For example, assuming that the music file list is a list configured from top to bottom as shown in FIG. 15, and the second music file item ('Everything back But you') is activated, the swipe displacement detected in step S147. Is +1 in the Y-axis direction, activate the first full selection item ('Select All', where 'Select All' is an item to select all music file items included in the music file list), and in step S147 If the detected swipe displacement is -1 in the Y-axis direction, the third music file item ['Girlfriend (radio Edit)'] is activated. When the swipe displacement detected in step S147 is +1 in the X-axis direction, the Play item is activated as shown in FIG. 17.

As shown in FIG. 15, when the push detection signal is input through the motion detection device in the state in which the second music file item is activated 219, the controller processes the corresponding music file item to be selected (check box is activated).

On the other hand, when the touch coordinate signal is input from the touch screen as a result of the determination in step S110 (S113), the controller detects a specific album directory item corresponding to the touch coordinate signal on the album directory list (S115). In operation S117, the music file list corresponding to the specific directory item detected in step S115 is page transitioned and displayed to the user (S117).

Here, 'page switching' and displaying means replacing and displaying the screen on which the album directory list is displayed with a file list corresponding to the detected specific directory item.

18 to 21 illustrate a case where a user interface control method according to the present invention is implemented in an artist directory list arranged based on an artist. This is implemented in the same manner as the user interface control method in the above-described album directory list, and those skilled in the art can easily infer without additional knowledge through the description of FIGS. 10 to 17. Therefore, further description will be omitted.

However, when a swipe detection signal is input from the motion detection device, the controller sequentially displays album art corresponding to each directory item included in the artist directory list as a pop-up menu or a pull-down menu based on the received swipe detection signal. do.

In the above description, a case in which the user interface control method according to the present invention is applied to a music player application is implemented as an example. However, the method for controlling a user interface according to the present invention is not limited thereto and may be applied.

As described above, the best embodiment has been disclosed in the drawings and the specification. Although specific terms have been employed herein, they are used for purposes of illustration only and are not intended to limit the scope of the invention as defined in the claims or the claims. Therefore, those skilled in the art will understand that various modifications and equivalent other embodiments are possible from this. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

10: portable terminal 100: motion detection device
110: touch screen 130: memory
140: communication unit 150: audio processing unit
160:

Claims (28)

The present invention relates to a method for controlling a user interface of a mobile terminal having a touch screen for detecting a user's touch and a motion detection device for detecting a user's finger movement.
Displaying a directory list including a plurality of directory items selectable by a user touch on the touch screen;
Determining whether a touch coordinate signal according to a user's touch or a motion detection signal corresponding to a user's finger movement is input from the motion detection device from the touch screen; And
When a motion detection signal is input from the motion sensor, a file list (including a plurality of file items) corresponding to any one directory item included in the directory list is displayed in a pop-up menu or a pull-down menu ( Pull-down menu) to display to the user, the user interface control method of a mobile terminal. The method according to claim 1,
When the touch coordinate signal according to the user's touch is input from the touch screen,
Detecting a specific directory item corresponding to the touch coordinate signal on the directory list; And
And page transitioning the file list corresponding to the detected specific directory item to display to the user. The method according to claim 1,
The motion detection signal may include a push detection signal according to a press gesture of a user finger and a swipe detection signal according to a swipe gesture of a user finger.
In a state in which a file list corresponding to any one directory item included in the directory list is displayed to the user through a pop-up menu or a pull-down menu,
And determining whether the push detection signal or the swipe detection signal is input from the motion detection device. The method according to claim 3,
When the push detection signal is input from the motion detection device,
Activating the pop-up menu or pull-down menu so that the user can sequentially select a specific file item through the motion sensor operation on the pop-up menu or pull-down menu, and deactivating the directory list. A user interface control method of a portable terminal. The method of claim 4,
Determining whether a swipe detection signal is input from the motion detection device while the pop-up menu or the pull-down menu is activated;
Detecting a swipe displacement of a user's finger based on the swipe detection signal when the swipe detection signal is input; And
And sequentially activating file items belonging to the activated pop-up menu or the pull-down menu according to the detected swipe displacement on the activated pop-up menu or the pull-down menu. How to control the user interface. The method according to claim 3,
When a swipe detection signal is input from the motion detection device,
Detecting a swipe displacement of a user's finger based on the swipe detection signal; And
Sequentially displaying a file list (including a plurality of file items) corresponding to a directory item located after the one directory item on the directory list in a pop-up menu or a pull-down menu according to the detected swipe displacement. The user interface control method of a mobile terminal, characterized in that it further comprises. The method according to claim 1,
In a state in which a file list corresponding to any one directory item included in the directory list is displayed to the user through a pop-up menu or a pull-down menu,
Determining whether a touch coordinate signal corresponding to a display area on a touch screen on which the pop-up menu or the pull-down menu is displayed is input from the touch screen; And
When a touch coordinate signal corresponding to the display area is input from the touch screen, the pop-up menu or pull-down so that a user may sequentially select a specific file item through the motion sensor operation on the pop-up menu or pull-down menu. Activating a menu and deactivating the directory list. The method according to claim 3 or 4,
The push detection signal is,
A dome click signal (Dome click) signal, characterized in that the user interface control method of a mobile terminal. The method according to claim 1,
The motion detection device,
A touch pad, a touch screen, a trackball, a scroll wheel, and a mobile pointing device. The method according to claim 1,
The one directory entry is
And a directory item located first among a plurality of directory items included in the directory list. The method according to claim 1,
The directory list includes a plurality of directory items including album art and album names for the album of a specific singer and identification information of at least one of the name of the specific singer,
When the motion detection signal is input from the motion detection device, displaying the file list corresponding to any one directory item included in the directory list to the user as a pop-up menu or a pull-down menu.
A pop-up menu or a control item for controlling the execution of music file items included in the music file list together with a music file list (including a plurality of music file items) corresponding to the directory item including the one or more identification information. The user interface control method of a mobile terminal, characterized in that for displaying to the user in the pull-down menu. The method of claim 11,
The control item,
Individual selection items for individually selecting music file items included in the music file list, all selection items for selecting all music file items included in the music file list, and Play for directly playing the selected music file items. Item, and an Enqueue item for adding a selected music file item to a playlist. The method of claim 11,
When the touch coordinate signal according to the user's touch is input from the touch screen,
Detecting a specific directory item corresponding to the touch coordinate signal on the directory list;
And switching a page of a music file list corresponding to the detected specific directory item and displaying the same to a user. The method of claim 11,
The motion detection signal may include a push detection signal according to a press gesture of a user finger and a swipe detection signal according to a swipe gesture of a user finger.
In a state in which a music file list corresponding to the directory item including the at least one identification information is displayed to the user as a pop-up menu or a pull-down menu,
And determining whether the push detection signal or the swipe detection signal is input from the motion detection device. The method according to claim 14,
When the push detection signal is input from the motion detection device,
Activating the pop-up menu or pull-down menu on the pop-up menu or pull-down menu so that a user can sequentially select a particular music file item through the motion sensor operation, and deactivating the directory list. Characterized in that the user interface control method of the mobile terminal. The method according to claim 15,
Determining whether a swipe detection signal is input from the motion detection device while the pop-up menu or the pull-down menu is activated;
Detecting a swipe displacement of a user's finger based on the swipe detection signal when the swipe detection signal is input; And
And sequentially activating music file items belonging to the activated pop-up menu or the pull-down menu according to the detected swipe displacement on the activated pop-up menu or the pull-down menu. User interface control method. The method according to claim 14,
When a swipe detection signal is input from the motion detection device,
Detecting a swipe displacement of a user's finger based on the swipe detection signal; And
According to the detected swipe displacement, a music file list (including a plurality of music file items) corresponding to a directory item located after the one directory item is sequentially displayed on the directory list through a pop-up menu or a pull-down menu. The method of controlling a user interface of a mobile terminal, characterized in that it further comprises the step of displaying. The present invention relates to a user interface control device of a mobile terminal having a touch screen for detecting a user's touch and a motion detection device for detecting a user's finger movement.
A touch screen displaying a directory list including a plurality of directory items selectable by a user touch; And
It is determined whether a touch coordinate signal according to a user's touch or a motion detection signal corresponding to a user's finger movement is input from the motion detection device from the touch screen, and if a motion detection signal is input from the motion detection device, the motion detection signal is included in the directory list. And a control unit for controlling to display a file list (including a plurality of file items) corresponding to any one directory item to a user as a pop-up menu or a pull-down menu. Device for controlling the user interface of the terminal. 19. The method of claim 18,
The control unit,
When a touch coordinate signal according to a user's touch is input from the touch screen, a specific directory item corresponding to the touch coordinate signal is detected on the directory list, and a page list of a file list corresponding to the detected specific directory item is changed. Device for controlling a user interface of a mobile terminal, characterized in that for displaying to the user. 19. The method of claim 18,
The motion detection signal may include a push detection signal according to a press gesture of a user finger and a swipe detection signal according to a swipe gesture of a user finger.
The control unit,
In a state in which a file list corresponding to any one directory item included in the directory list is displayed to the user through a pop-up menu or a pull-down menu,
And determining whether the push detection signal or the swipe detection signal is input from the motion detection device. The method of claim 20,
The control unit,
When the push detection signal is input from the motion detection device,
The pop-up menu or the pull-down menu on the pop-up menu or pull-down menu to enable the user to sequentially select a specific file item through the operation (operation) operation, characterized in that the portable device, characterized in that for deactivating the directory list, Device for controlling the user interface of the terminal. 23. The method of claim 21,
The control unit,
In the state where the pop-up menu or the pull-down menu is activated, it is determined whether a swipe detection signal is input from the motion detection device. When the swipe detection signal is input, the swipe detection signal is input based on the swipe detection signal. And detecting a wipe displacement and sequentially activating file items belonging to the activated popup menu or pulldown menu according to the detected swipe displacement on the activated popup menu or pulldown menu. User interface control device. The method of claim 20,
The control unit,
When a swipe detection signal is input from the motion detection device, a swipe displacement of a user's finger is detected based on the swipe detection signal, and according to the detected swipe displacement, one of the ones on the directory list. And a file list corresponding to a directory item located next to the directory item is sequentially displayed as a pop-up menu or a pull-down menu. The method according to claim 20 or 21,
The push detection signal is,
A user interface control device for a portable terminal, characterized in that a dome click signal. 19. The method of claim 18,
The motion detection device,
And a touch pad, a touch screen, a trackball, a scroll wheel, and a mobile pointing device. 19. The method of claim 18,
The directory list includes a plurality of directory items including album art and album names for the album of a specific singer and identification information of at least one of the name of the specific singer,
The control unit,
When a motion detection signal is input from the motion detection device, a music file item included in the music file list together with a music file list (including a plurality of music file items) corresponding to a directory item including the one or more identification information. And a control item capable of controlling the execution of these items to a user in a pop-up menu or a pull-down menu. 19. The method of claim 18,
The control item,
Individual selection items for individually selecting music file items included in the music file list, all selection items for selecting all music file items included in the music file list, and Play for directly playing the selected music file items. Item, and an Enqueue item for adding a selected music file item to a playlist. 19. The method of claim 18,
The control unit,
In a state in which a file list corresponding to any one directory item included in the directory list is displayed to the user through a pop-up menu or a pull-down menu,
It is determined whether a touch coordinate signal corresponding to the display area on the touch screen on which the pop-up menu or the pull-down menu is displayed is input from the touch screen, and when the touch coordinate signal corresponding to the display area is input from the touch screen, the pop-up menu Or to activate the pop-up menu or pull-down menu so that a user can sequentially select a specific file item through the motion sensor operation on a pull-down menu, and deactivate the directory list. Interface control method.

Images