KR101251964B1 - Method for providing user interface according to rotation gesture and electronic device using the same - Google Patents

Abstract

A UI providing method based on a rotation gesture and an electronic device applying the same are provided. The present UI providing method calculates a rotation angle by a user's rotation gesture and performs GUI interaction according to the calculated rotation angle. As a result, the GUI interaction can be performed according to the rotation angle of the user's rotation gesture, and the user command can be conveniently and quickly inputted, and the side effects that can cause the user's fun and interest can also be caused. have.

Description

A method for providing a user interface based on a rotation gesture and an electronic device using the same {Method for providing user interface according to rotation gesture and electronic device using the same}

The present invention relates to a method for providing a user interface and an electronic device using the same, and more particularly, to a method for providing a user interface used to input a user command and an electronic device using the same.

The UI has been developed to grasp the user's motion and to receive the user's command based on the identified motion, so that the user's command can be input as an action, thereby increasing the user's entertainment.

In order to change the currently activated window to another window in the UI as described above, the window change button displayed on the screen should be operated. As described above, changing the window by the button operation is inconvenient and large time when the number of windows is large. There is a problem that this takes.

In addition, the user has a problem that such an operation is difficult to induce fun and interest for the user who is eating on the button.

The present invention has been made to solve the above problems, and an object of the present invention is to provide a UI providing method for performing GUI interaction, and an electronic device applying the same according to the rotation angle of the user's rotation gesture.

According to the present invention for achieving the above object, a method for providing a user interface (UI), the step of calculating the rotation angle by the user's rotation gesture; And performing a graphical user interface (GUI) interaction according to the rotation angle.

The rotation angle calculation step may include: recognizing a straight line formed by two points designated by the user; And calculating a rotation angle of the recognized straight line.

The performing of the GUI interaction may include: identifying a number of GUI interactions that can be performed; Dividing a rotatable range by the number of GUI interactions and allocating the GUI interactions to the divided sections; Identifying which of the divided sections the rotation angle corresponds to; And performing a GUI interaction assigned to the identified section.

The rotatable range may be 360 ° or 180 °.

The performing of the GUI interaction may include calculating a rotation angle change amount by subtracting an initial rotation angle from the rotation angle; Identifying a rotation progress step from the rotation angle change amount; And performing a sequence of GUI interactions that are increased or decreased by the rotation progress step.

In the performing of the GUI interaction, the sequence of GUI interactions increased or decreased by the rotation progression step may be the sequence of GUI interactions sequentially increased or decreased as much as the rotation progression step from the sequence of GUI interactions performed at the initial rotation angle. .

In addition, the GUI interaction, it is preferable to select any one of a plurality of GUI elements.

On the other hand, according to the present invention, the electronic device, a photographing unit for photographing the user to generate an image; And a controller configured to calculate a rotation angle by the rotation gesture of the user based on the image generated by the photographing unit and perform GUI interaction according to the calculated rotation angle.

As described above, according to the present invention, it is possible to perform a GUI interaction according to the rotation angle of the user's rotation gesture, and to input user commands conveniently and quickly, as well as inducing user's fun and interest. There are also side effects that can be made.

1 to 3 are views provided to explain the concept of grasping a user's rotation gesture and selecting a window;
4 and 5 are provided for explaining a method of selectively activating a window according to a rotation angle of a user's gesture, based on an absolute angle method;
6 is a flowchart provided to explain a window activation method based on an absolute angle method according to an embodiment of the present invention;
7 is a flowchart provided to explain a window activation method based on a relative angle method according to another embodiment of the present invention;
8 is a block diagram of an electronic device to which the present invention is applicable.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

1. By rotating gesture window  Selection

1 to 3 are diagrams provided to explain a concept of identifying a user's rotation gesture and selecting a window. Specifically, in FIGS. 1 to 3, the rotation angle formed by the rotation gesture of the user is calculated and one of the windows 1 to 6 executed on the screen is activated based on the calculated rotation angle.

Here, the user's rotation gesture, as shown in Figs. 1 to 3, designate two points with the left hand L and the right hand R, respectively, and a circumference having a diameter of a straight line connecting the two specified points It is an operation to rotate the left hand L and the right hand R symmetrically in the image.

If the state shown in FIG. 1 is an initial state, FIG. 2 is a state in which rotation is made slightly compared to the initial state, and FIG. 3 is a state in which rotation is made in comparison with the initial state.

Accordingly, if the window selected in the state shown in FIG. 1 is 'Window-1', 'Window-2' is selected in FIG. 2, which has been rotated slightly, and 'Window-5' is shown in FIG. You can see that it is selected.

That is, according to the rotation angle of the user's rotation gesture, it can be seen that one of the windows 1-6 executed on the screen is activated. Here, the rotation angle is obtained by recognizing a straight line (circle diameter) connecting two points designated by the user's left hand (L) and right hand (R), and calculating how much the recognized straight line is rotated about the center. Can be.

Hereinafter, a process of selectively activating a window using the calculated rotation angle will be described in detail with two examples.

2. Absolute Angular  Based window  Activation

4 is a view provided to explain a method of selectively activating a window according to a rotation angle of a user's gesture based on an absolute angle method.

The absolute angle method divides the rotatable range by the user by the number of windows currently executed. In FIG. 4, since the number of currently executed windows is six, a result of dividing 360 °, which is a rotatable range by a user, into six sections 1 to 6 is shown.

The numbers marked on the divided sections are the numbers of the windows to be activated, and the windows of the numbers indicated on the sections including the rotation angle based on the left hand L are activated. In FIG. 4, since the rotation angle is included in the section 1 of the rotatable range, the window-1 is activated.

Unlike FIG. 4, where the rotatable range is assumed to be 360 °, FIG. 5 illustrates the result of dividing the rotatable range to 180 ° to the left and dividing it into sections as many as the number of windows currently executed.

When reducing the rotatable range as shown in Figure 5, there is a disadvantage in that the section width is reduced, but considering the operating range of the user arm there is an advantage that the user is convenient to perform the rotation gesture.

Hereinafter, a window activation process based on the absolute angle method will be described in detail with reference to FIG. 6. 6 is a flowchart provided to explain a window activation method based on an absolute angle method according to an embodiment of the present invention.

As shown in FIG. 6, first, the number of currently executed windows is determined (S110), and the rotatable range according to the user's rotation gesture is divided into sections as many as the number of windows (S120). Allocates windows to each other (S130).

Thereafter, the rotation angle by the rotation gesture of the user is calculated (S140), and the window assigned to the section including the calculated rotation angle is activated (S150). For example, if the calculated rotation angle is included in 'section-3', activate 'Window-3'. If the calculated rotation angle is included in 'section-5', activate 'Window-5'. Let's do it.

3. Relative Angular  Based window  Activation

The window activation based on the relative angle method is a method of calculating how much the rotation angle by the user gesture has changed from the initial rotation angle, and activating the windows one by one based on the change amount.

Hereinafter, a window activation process based on the relative angle method will be described in detail with reference to FIG. 7. 7 is a flowchart provided to explain a window activation method based on a relative angle method according to another embodiment of the present invention.

As shown in FIG. 7, first, a sequence number is assigned to currently executed windows (S210).

The order is: 1) reverse assignment in order of execution (i.e., fast ordering from the first executed window), 2) assignment according to execution order (i.e., assigning fast order from the first executed window) or 3) windows Based on the screen arrangement of the (e.g., from the window located in the center left) can be assigned the order in the clockwise direction.

The sequence numbering method mentioned above is merely an example for convenience of explanation, and may be assigned in a different manner if necessary.

Subsequently, when the rotation gesture is started by the user (S220-Y), the currently active window is designated as the initial window (S230), and the initial rotation angle (that is, the initial rotation angle by the user's rotation gesture) is initially rotated. Store at an angle (S240).

Whether the rotation gesture is started by the user in operation S220 may be determined based on whether two points are respectively designated by the left hand L and the right hand R of the user.

That is, when one point is selected by the user's left hand L or the right hand R, or when no point is selected, it is determined that the rotation gesture is not started, but the user's left hand L and the right hand R When the two points are selected by), it can be determined that the rotation gesture has started.

Then, when the user's rotation gesture is completed (S250-Y), the rotation angle change amount is calculated by subtracting the initial rotation angle from the current rotation angle (S260). Since the initial rotation angle has been stored in step S240, it may be used.

In addition, the method of determining whether the user's rotation gesture is completed may be reversed by the method of determining whether the user's rotation gesture is started. That is, when the selection of two points is maintained by the user's left hand L and the right hand R, it is determined that the rotation gesture is not completed (that is, the rotation gesture is in progress). When one point is selected by the left hand L or the right hand R, or when no point is selected, it is determined that the rotation gesture is finished.

Next, the rotation progress step is calculated from the rotation angle change amount calculated in step S260 (S270). Then, the window of 'the sequence number increased or decreased by the rotation progress stage calculated in step S270' is activated in 'the sequence number of the initial window designated in step S230' (S280).

The rotation progression step can be taken as the quotient when the rotation angle change amount is divided by the 'reference rotation angle'. For example, when the rotation angle change amount is 65 ° and the reference rotation angle is 20 °, the rotation progress step is +3. If the sequence number of the initial window is '2', in step S280, 'window-5' having the sequence number '5' (= 2 + 3) is activated.

As another example, when the rotation angle change amount is -25 ° and the reference rotation angle is 20 °, the rotation progress step is -1. If the sequence number of the initial window is '2', in step S280, 'window-1' having the sequence number '1' (= 2-1) is activated.

4. by rotating gesture UI Electronic device that can provide

Hereinafter, an electronic device capable of providing a user with a UI such as window activation by the above-described rotation gesture will be described in detail with reference to FIG. 8. 8 is a block diagram of an electronic device to which the present invention is applicable.

As shown in FIG. 8, the electronic device 300 according to the present embodiment includes a photographing unit 310, an image processing unit 320, a control unit 330, a display 340, and a storage unit 350. .

The photographing unit 310 photographs a user to generate an image, and the image processor 320 performs image processing necessary for the image generated by the photographing unit 310.

The controller 330 detects a user's rotation gesture from an image applied from the image processor 320. Specifically, the controller 330 detects the user's left hand L and right hand R in the image, and rotates the left hand L and the right hand R on a circumference having a straight line connecting the detected points. Detect.

The controller 330 activates one of the windows executed based on the rotation angle of the user's rotation gesture. The determination of the window to be activated may be based on the above-described relative angle method or absolute angle method.

The display 340 displays all or part of the executed windows, with the activated window at the top.

The storage unit 350 is a storage space for storing a program and data necessary for the control unit 330 to perform the algorithm illustrated in FIGS. 6 and 7.

5. Variant

In the above embodiment, a rotation gesture is detected by photographing a user, which is merely an example for convenience of description. The technical idea of the present invention may be applied to the case where the user's rotation gesture is detected through the touch screen.

In addition, in the above embodiment, it is assumed that one of a plurality of executed windows is selected and activated, but the window corresponds to an example of a GUI element displayed on the screen. The technical idea of the present invention may also be applied to selecting other GUI elements other than Windows. Here, the GUI element is a element constituting the GUI displayed on the display, and is a concept including not only the aforementioned window but also an icon, a menu item, a widget, a graphic controller, and the like.

It is also possible to implement other types of GUI interactions in addition to selecting GUI elements according to the rotation angle by the rotation gesture. That is, when there are several GUI interactions that can be performed, it is also possible to select and execute one of the GUI interactions according to the rotation angle of the user's rotation gesture.

In addition, in the above embodiment, the rotatable range is assumed to be 360 ° or 180 °, but may be replaced by an angle in a different range.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

300: electronic device 310: photographing unit
320: image processing unit 330: control unit
340: display 350: storage

Claims (8)

Calculating a rotation angle by a rotation gesture of the user; And
And performing a graphical user interface (GUI) interaction according to the rotation angle.
The rotation angle calculation step,
Recognizing a straight line formed by two points designated by the user; And
Calculating a rotation angle of the recognized straight line;
The GUI interaction is,
Method of providing a user interface (UI), characterized in that to select any one of a plurality of GUI elements.
delete The method of claim 1,
The GUI interaction performing step,
Determining the number of GUI interactions that can be performed;
Dividing a rotatable range by the number of GUI interactions and allocating the GUI interactions to the divided sections;
Identifying which of the divided sections the rotation angle corresponds to; And
And performing a GUI interaction assigned to the identified section.
The method of claim 3, wherein
The rotatable range,
UI providing method characterized in that the 360 ° or 180 °.
The method of claim 1,
The GUI interaction performing step,
Calculating a rotation angle change amount by subtracting an initial rotation angle from the rotation angle;
Identifying a rotation progress step from the rotation angle change amount; And
And performing a sequence of GUI interactions in increments of the rotation progress step.
6. The method of claim 5,
The GUI interaction performing step,
The sequence of GUI interactions increased or decreased by the rotation progress step is
And a sequence of GUI interactions in which the sequence sequentially increases or decreases as much as the rotation progressing step from the sequence of GUI interactions performed at the initial rotation angle.
delete A photographing unit which photographs a user and generates an image;
And a controller configured to calculate a rotation angle by the user's rotation gesture based on the image generated by the photographing unit, and perform a graphical user interface (GUI) interaction according to the calculated rotation angle.
The control unit,
Recognizing a straight line formed by the two points specified by the user in the image, the electronic device, characterized in that for calculating the rotation angle of the recognized straight line by the rotation angle of the user's rotation gesture.

Images