KR101529886B1 - 3D gesture-based method provides a graphical user interface - Google Patents

Abstract

The present invention relates to a method of providing a gesture-based 3D graphical user interface, comprising a touch-sensitive screen display (D) for detecting a gesture delivered via the display (D), identifying the gesture, In a mobile electronic device capable of controlling a software application by an identified gesture, when a software application is executed, a plurality of upper objects (A) are displayed as respective independent phrases, and the upper object (A) A first step of displaying the name on a display (D) in 3D graphics;
When one of the upper objects A in the first stage is single tabped, the selected upper object A1 is enlarged while moving to the center of the display D, and the remaining upper objects A are enlarged and displayed (D) in 3D graphics;
When the selected upper level object A1 in the second stage is single-tabbed, the lower level subordinate object B is subordinate to the upper level object A1, A third step in which other upper objects (A) which are graphically displayed and which have been reduced in the second step disappear from the display (D);
When one of the subordinate objects B in the third step is single tabbed, the selected subordinate object B1 is enlarged while moving to the center of the display D, and the remaining unselected objects are rotated to select the selected subordinate object (B);
When the selected sub-object B1 in the fourth step is single-tabbed, the detailed information window W1 belonging to the sub-object B1 is popped up and displayed in the center of the display D, step;
When the detailed information window W1 of the fifth step is clicked, the keyboard key K is popped up from the lower end of the display D to the upper end of the display D so that the information necessary for the detailed information window W1 can be typed and inputted. The application can be easily and conveniently used without any additional training through a simple gesture and screen switching using intuitive 3D graphics when driving various applications using the mobile electronic device .

Description

[0001] The present invention relates to a gesture-based 3D graphical user interface,

The present invention relates to a gesture-based 3D graphical user interface providing method, and more particularly, to a gesture-based 3D graphical user interface providing method using an easy gesture and screen switching using intuitive 3D graphics.

With the development of IT technology, the use of various mobile electronic devices such as smart phones and tablet PCs as well as computers has been expanded, and various software applications for utilizing these devices have been developed and announced every day.

Thus, as users experience numerous software applications, software applications with new user interface configurations are often encountered. In the case of software applications with such a new user interface configuration, it is difficult for the user to control in a manner known to the user Because most software applications follow a universal user interface, the most common user interface is a pull-down menu.

The 'pull-down menu' method means that a menu is displayed when a key is clicked or clicked. When the icon of the software application displayed on the display of the electronic device used by the user is selected, the corresponding software is started, A menu bar, which is a command group required for the display, is usually arranged horizontally on the upper or lower side of the screen, or vertically on the left or right side of the screen.

Accordingly, when a user selects a desired user menu on the menu bar, the submenus belonging to the menu may be additionally listed or the menu window may be additionally displayed at any position of the display. Such a menu window is referred to as a 'popup'.

Thus, it is the user's most common user interface to control the application software by choosing the commands displayed in the menu bar or pop-up, which is based on Windows, the widely used operating system on desktop computers, Of the user interface.

However, in recent years, various mobile electronic devices such as a smart phone and a tablet PC, which are rapidly increasing in number of users, are limited in the size of the display due to the characteristics of use of the products carried by the user. .

Thus, when running and controlling a software application on a mobile electronic device having a touch-sensitive screen display of about 5 inches or less, the number of menus displayed on the menu bar at one time is too small to indicate the use of the self- It is difficult to accurately select the menu button with the fingertip when the menu button is made too small because of the characteristic of the user interface that the user must select the menu by touching the display with the fingertip.

In addition, when the main menu bar is clicked and subobjects are additionally listed under the main menu bar, most of the small display display space of the mobile electronic device is consumed, so that the execution state of the corresponding software application is not displayed on the display, The number of menus that can be displayed on the menu bar is inevitably limited. Therefore, there are many inconveniences in using a software application having various menus in a mobile electronic device having a small display.

In order to solve such a problem, development of a mobile electronic device is progressing in a direction to improve the resolution of the display by hardware to clearly identify the small character, but since there is a technical limitation in improving the resolution of the display, In addition to improving the display resolution of electronic devices, a user interface has been actively developed to more easily and easily control software applications mainly used in mobile electronic devices. In order to control mobile electronic devices more easily and conveniently, One of the user interfaces is 'gestures'.

That is, in the past, a user interface used in a mobile electronic device such as a smart phone or a tablet PC has a specific icon representing a command menu or command of the software application displayed on the display of the corresponding device as an auxiliary input tool such as a finger or a touch pen Inputting and executing a command to a software application by recognizing only a simple operation of touching (tapping) one or two times in succession, but recently, in controlling a software application, a specific control command is displayed on a menu button Instead of locating and directly touching an icon, a user may use a supplementary input tool such as a finger or a touch pen to perform a specific action, such as drawing a left-to-right line of the display, in place of the "gesture" You can run commands Thereby reducing the consumption of the display display space by displaying various menus for control of the software application on the display by allowing the user to control the software application without displaying a specific control command on the display, Thereby eliminating the inconvenience and allowing for faster and easier control of software applications.

As a result, there has been developed a user interface that enables control of a mobile electronic device by using a 'gesture'. Currently, a single tab that is pressed once with a single finger at a specific position or an arbitrary position of the display, A double-tab for pressing a specific position or a certain position of the display twice in succession with one finger, a specific position of the display, or a hold (for example, Hold "), a specific location on the display, or a drag to drag an arbitrary location with one finger while dragging it to another location on the display, as well as various" gestures " The user interface is widely used for mobile electronic devices such as smartphones and tablet PCs. .

However, since the conventional user interface using the gesture has a limitation to control the software application with only the gesture, the gesture is not effectively used because it is used together with the existing pull-down menu type user interface, and the gesture However, there is a problem in that it is not intuitive to use gestures other than skilled users who are fully intimated with gestures. To utilize the gestures separately, it is necessary to separately learn the functions and usage methods of the gestures by using manuals, There is a problem that a lot of effort is required for

Therefore, it is necessary to develop a user interface that can easily, quickly, and easily control a software application used in various electronic devices including a mobile device such as a smart phone or a tablet PC, A more intuitive and innovative gesture-based user interface that can replace the existing pull-down menu method is in desperate need.

1. Published Patent Application No. 10-2009-0029670 2. Published Unexamined Patent Application No. 10-2013-0027016

It is an object of the present invention to provide an intuitive gesture-based 3D graphical user interface that can be easily and easily used without a separate learning process.

A mobile electronic device having a touch-sensitive screen display (D) for detecting a gesture communicated via the display (D), identifying the gesture and enabling control of the software application by the identified gesture , When a software application is executed, a plurality of upper objects (A) are displayed as independent phrases, and a name defining the corresponding upper object (A) is displayed on the surface of each phrase, Stage 1;

When one of the upper objects A in the first stage is single tabped, the selected upper object A1 is enlarged while moving to the center of the display D, and the remaining upper objects A are enlarged and displayed (D) in 3D graphics;

When the selected upper level object A1 in the second stage is single-tabbed, the lower level subordinate object B is subordinate to the upper level object A1, A third step in which other upper objects (A) which are graphically displayed and which have been reduced in the second step disappear from the display (D);

When one of the subordinate objects B in the third step is single tabbed, the selected subordinate object B1 is enlarged while moving to the center of the display D, and the remaining unselected objects are rotated to select the selected subordinate object (B);

When the selected sub-object B1 in the fourth step is single-tabbed, the detailed information window W1 belonging to the sub-object B1 is popped up and displayed in the center of the display D, step;

When the detailed information window W1 of the fifth step is clicked, the keyboard key K is popped up from the lower end of the display D to the upper end of the display D so that the information necessary for the detailed information window W1 can be typed and inputted. And a sixth step shown in FIG.

On the other hand, when a software application is executed, a plurality of upper objects A are displayed as independent phrases, and the names defining the upper object A are displayed on the surface of each phrase in a 3D graphic on the display D In a first step, when a margin portion of the display D is double-tabged, a seventh step in which the screen is enlarged while the tab portion moves to the center;

In the seventh step, if the margin of the display D is double-tabged, the screen may be reduced as the tab is moved to the center.

When the selected upper level object A1 in the second stage is single tabbed, the lower level subordinate B is subordinate to the upper level object A1, The other upper objects A that have been reduced in the second step are displayed in 3D graphics on the display D and disappear when the selected upper object A1 is continuously pressed and held in the third step disappearing from the display D ) Are displayed on the upper part of the display (D);

In a ninth step, one of the child objects (B) dependent on the held upper object (A1) is dragged-and-dropped into one of the upper objects (A) displayed on the upper part of the display Drag & Drop), the designated upper object A is displayed in a different color, and the held lower object B1 is moved to the designated upper object A and is subordinate to the lower object B of the upper object A And may include a tenth step.

In a ninth step, one of the child objects (B) dependent on the held upper object (A1) is dragged and dropped to one of the other child objects (B) , The held child object B1 may include the eleventh step of moving to the specified child object B and being dependent on the child object B1.

In a ninth step, one of the child objects (B) dependent on the held upper object (A1) is dragged and dropped in a blank space of the display (D) The held child object B1 having the drag-and-dropped can be divided into separate independent objects and displayed as 3D graphics on the display D as separate spheres.

When one of the upper objects A in the first stage is single tabbed, the selected upper object A1 is enlarged while moving to the center of the display D, and the remaining upper objects A are enlarged The upper object A1 is displayed in a transparent manner when the center object A1 is displayed on the display D in a 3D graphic in the second step, The information window W2 for modifying the information of the corresponding upper level object A1 is popped up and displayed at a predetermined size in the center portion of the display D and at the same time And a thirteenth step in which the keyboard keyboard K pops up from the bottom of the display D to the bottom of the display D, as shown in FIG.

In addition, when the software application is executed, a plurality of upper objects A are displayed as respective independent phrases, and the names defining the upper object A are displayed on the surface of each phrase in a 3D graphic on the display D In the first step, the object addition button E is displayed as "+" at one end of the upper part of the display D, and when the object addition button E is single- Is displayed in a predetermined size in the center of the display D and at the same time a keyboard key K is popped up from the lower end of the display D to be displayed at the lower end of the display D .

In addition, when the software application is executed, a plurality of upper objects A are displayed as respective independent phrases, and the names defining the upper object A are displayed on the surface of each phrase in a 3D graphic on the display D In the first step, the designated upper object A1 is selected by long tabping one of the upper objects A, and an object addition button (" + " E is changed to the object delete button F and when the designated upper object A1 is dragged and dropped to the object delete button F indicated by "X" in a state of being displayed as "X" And the corresponding upper object (A) is deleted.

In addition, when the software application is executed, a plurality of upper objects A are displayed as respective independent phrases, and the names defining the upper object A are displayed on the surface of each phrase in a 3D graphic on the display D In the first step, when the margin portion of the display D is moved in a desired direction with one finger being pressed, the display D is moved to the rear of the upper objects A displayed in the 3D graphics along the moving direction of the finger And a step 16 in which the positioned upper object A is rotated forward and the upper object A positioned at the front is rotated backward and displayed in 3D graphics.

In addition, when the software application is executed, a plurality of upper objects A are displayed as respective independent phrases, and the names defining the upper object A are displayed on the surface of each phrase in a 3D graphic on the display D In the first step, when the margin portion of the display D is simultaneously pressed with two fingers and the interval between the two fingers is enlarged, the screen displayed in the 3D graphic is enlarged on the display D. When the interval between the two fingers is narrowed, And displayed in a 3D graphic.

In addition, when the software application is executed, a plurality of upper objects A are displayed as respective independent phrases, and the names defining the upper object A are displayed on the surface of each phrase in a 3D graphic on the display D In the first step, when the margin portion of the display D is simultaneously pressed with two fingers and the two fingers are simultaneously moved in the desired direction in the up, down, left, and right directions, a screen displayed in 3D graphic on the display (D) And displaying the 3D graphic in a scrolling manner.

The present invention can easily and conveniently use an application without any additional training through a simple gesture and screen switching using an intuitive 3D graphic when driving various applications using a mobile electronic device.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 and FIG. 2 illustrate exemplary interface changes according to a preferred single tap gesture of the present invention. FIG.
3 is an exemplary diagram illustrating a change in interface according to a preferred double tap gesture of the present invention.
4 is an exemplary diagram illustrating a change in interface according to a preferred multi-tap-hold gesture of the present invention.
5 is an exemplary diagram illustrating a change in interface according to a preferred long tap gesture of the present invention.
Figure 6 is an exemplary diagram illustrating changes in the interface according to the preferred long tap-drag and drop gesture of the present invention.
Figure 7 is an exemplary diagram illustrating a change in interface according to a preferred drag gesture of the present invention.
8 is a diagram showing an example of a change in the interface according to the preferred pinch zoom gesture of the present invention
9 is a diagram illustrating a change in interface according to the preferred multi-swipe of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings.

It is to be noted that like elements in the accompanying drawings use the same reference numerals in any of the drawings, and detailed descriptions of well-known functions or known configurations that may unnecessarily obscure the gist of the present invention are omitted. Come on.

According to a preferred embodiment of the present invention, the present invention basically consists of the first to sixth steps.

1 shows the first through third steps. As shown in the figure, the first step has a touch-sensitive screen display D, and is transmitted through a display D When a software application is executed in a mobile electronic device capable of detecting a gesture, identifying the gesture, and controlling the software application by the identified gesture, a plurality of upper objects (A) are displayed as respective independent phrases, And a 3D graphic is displayed on the display D so that the name defining the corresponding upper object A is displayed on the surface.

That is, the upper objects A displayed in a spherical shape are displayed in a 3D graphic on the display D so that the three-dimensional sensation and the sense of distance are expressed, so that even if a plurality of the upper objects A are displayed on the small display D of the mobile electronic device, Can be easily and quickly recognized.

On the other hand, a mobile electronic device having a touch-sensitive screen display D, which detects a gesture transmitted via the display D, identifies the gesture, The device is represented by a smartphone or a tablet PC which is widely used at present. Since the gesture detection or identification technology of the mobile electronic device is a publicly known technology, the description of the gesture detection or hardware and the hardware description according to the identification are omitted .

In addition, the touch-sensitive screen display D can be replaced with terms such as 'touch screen', 'touch pad', 'touch surface'.

As shown in FIG. 1, in the second step, when one of the upper objects A in the first step is subjected to a single tab operation, the selected upper object A1 is moved to the center of the display D And the remaining upper objects A are reduced and displayed in 3D graphics on the display D while being retreated behind the selected upper object A1.

That is, among the upper objects A displayed in the first step, the upper objects A except for the upper object A1 selected in the second step are zoomed out and zoomed out on the screen of the display D It is possible to concentrate the user's line of sight on the selected upper object A1. In order to improve the concentration of the line of sight, the color or transparency of the selected upper object A1 and the remaining upper objects A may be displayed differently.

1, when the selected upper level object A1 in the second level is single-tabbed, the lower level object B, which is subordinate to the upper level object A1, Since a large number of subordinate objects B that are subordinate to the corresponding upper level object A1 are intuitively displayed by being displayed in a 3D graphic on the display D in a spherical shape radially connected to the upper level object A1, The type and configuration of the child object (B) subordinate to the child object (A1) can be recognized easily and quickly.

FIG. 2 illustrates the fourth through sixth steps. As shown in the drawing, in the fourth step, if one of the child objects B in the third step is single-tabbed, The object B1 is enlarged while moving to the center of the display D and the remaining unselected objects are rotated and moved to the back of the selected lower object B1 to focus the user's gaze on the selected lower object B1 In order to improve the concentration of the line of sight, the color and transparency of the selected lower object B1 and the remaining objects may be displayed differently.

In the fifth step, if the selected sub-object B1 in the fourth step is single-tabbed, the detailed information window W1 belonging to the sub-object B1 is popped up so that a predetermined The detailed information window W1 displayed at this time may be modified into various forms according to the type of application.

That is, when the application used by the present application is the same as the document editing application, if the child object B indicates a menu dependent on the parent object A, it can be used as a window for inputting an execution value for executing the menu In the case of a spreadsheet application, it can be used as a window for inputting specific data values. In the case of a telephone application, it is used as a window for inputting contact information of a specific person belonging to a parent object (A) .

Accordingly, in the sixth step, when the detailed information window W1 of the fifth step is clicked, the keyboard key K is popped up from the bottom of the display D to the top of the display D so that information necessary for the detailed information window W1 can be typed, The user can input, modify, delete, and store desired text information in the detailed information window W1 by displaying it on the lower portion of the screen D of FIG.

FIG. 3 illustrates the seventh through eighth steps. Referring to FIG. 7, in the seventh step, when a software application is executed, a plurality of upper objects A are displayed as independent phrases, In a first step of displaying a name defining a corresponding upper object A on a surface of a sphere in a 3D graphic on a display D, if a margin of the display D is double-tabped, (D) screen of the mobile electronic device in which the software application to which the present invention is applied is small due to enlargement of the screen while moving to the center, or a plurality of upper objects (A) can not be easily distinguished, the necessary portion can be enlarged, so that the identification is facilitated.

If the margin of the display D enlarged in the seventh step is double-tabged as in the eighth step, the tab is shifted to the center and the screen is reduced to enlarge and reduce the screen of the display D It is possible to easily distinguish objects displayed in the 3D graphic on the display D because the gesture is quickly and easily performed.

FIG. 4 is a flowchart illustrating steps 9 to 12. In a ninth step, when the selected upper layer object A1 in the second layer is single-tabbed, a lower layer subordinate to the upper layer object A1 In a third step in which the object B is displayed as a 3D graphic on the display D in a spherical shape radially connected to the upper object A1 and the other upper objects A that have been reduced in the second step disappear from the display D, When the selected upper object A1 is continuously pressed and held, the upper objects A that have disappeared are displayed on the upper part of the display D. At this time, the displayed upper object A is transparent It can be displayed or displayed in a different color.

In the tenth step, in the ninth step, one of the subordinate objects B belonging to the upper level object A1 being held by one finger is held by another finger or an auxiliary input tool such as a touch pen Dragged and dropped onto one of the upper objects A displayed on the upper part of the display D as the upper object A, that is, the upper object A on which the drag-and-drop is performed, The lower object B1 having undergone the drag-and-drop operation is moved to the designated upper object A and the lower object of the upper object A is displayed (B), it is possible to easily and easily move the child object (B), which is dependent on the upper object (A), to another upper object (A) by using the gesture.

In the eleventh step, in the ninth step, one of the child objects (B) dependent on the held upper object (A1) is held and dragged and dropped to one of the other child objects (B) Drag & Drop), the held lower object B1 is moved to the designated lower object B and is subordinate to the lower object B so that only the gesture is used to move the lower object B between the upper object A The movement of the child object B between the child objects B can be easily and easily performed.

In step 12, in step 9, one of the child objects (B) dependent on the held upper object (A) is dragged and dragged into a blank space of the display (D) The dragged and dropped dragged subobject B1 is displayed as a 3D graphic on the display D as an independent spherical object while being separated into individual independent objects so that the dragged object It is possible to easily and easily convert the subordinate object (B) into the independent object, and the converted independent object has the same status as the upperordinate object (A).

FIG. 5 illustrates steps 13-14. In step 13, when one of the upper objects A in the first step is single-tabbed, the selected upper object A is displayed on the display D, and the remaining upper objects A are reduced and displayed in a 3D graphic on the display D, the centered upper object A1 is moved to the center of the long tab The upper layer object A1 is displayed transparently and the information window W2 for modifying the information of the upper layer object A1 is displayed in a pop- And at the same time the keyboard key K is popped up from the lower end of the display D to be displayed at the lower end of the display D, It is possible to modify the information of the desired upper object (A) easily Easily enter, modify, delete, and be able to save.

In the 14th step, when a software application is executed, a plurality of upper objects A are displayed as independent phrases, and a name defining the corresponding upper object A is displayed on the surface of each phrase, In the first step of displaying in graphic form, the object addition button E is displayed as "+" at one end of the upper part of the display D, and when the object addition button E is single- The detailed information window W1 is popped up and displayed at a predetermined size in the center of the display D and at the same time the keyboard K is popped up from the lower end of the display D to be displayed at the lower end of the display D, It is possible to easily and easily input, modify, and store the information on the new object A and the information on the newly created upper object A.

FIG. 6 illustrates a fifteenth step. In the fifteenth step, when a software application is executed, a plurality of upper objects A are displayed as independent phrases, and a corresponding upper object A is displayed on the surface of each phrase. A designated upper object A1 is displayed in a transparent manner by long tabping one of the upper objects A in a first step displayed on the display D in a 3D graphic so that a name defining the name of the upper object A1 is displayed, The object addition button E marked on the upper side of the upper part of the display D is changed to the object deletion button F and the designated upper object A1 is deleted from the object indicated by "X" Drag & Drop to the button F causes the corresponding upper object A1 to be deleted, thereby enabling quick and easy deletion of the upper object A only by the gesture.

FIG. 7 illustrates a sixteenth step. In operation 16, when a software application is executed, a plurality of upper objects A are displayed as independent phrases, and the upper object A is displayed on the surface of each phrase. In a first step in which a name defining a name of the display D is displayed on the display D in a 3D graphic form. When the margin portion of the display D is pressed in one direction and moved in a desired direction in a vertical direction, The upper object A located at the back of the upper objects A displayed in the 3D graphic is rotated forward and the upper object A located at the front is rotated backward and displayed in 3D graphics, The user can easily and quickly construct the upper object A by using only the gesture while displaying a large number of the upper objects A in the display space of the display D having a small size Thereby it can avoid.

FIG. 8 illustrates a seventeenth step. In operation 17, when a software application is executed, a plurality of upper objects A are displayed as independent phrases, and the upper object A is displayed on the surface of each phrase. In the first step displayed on the display D in a 3D graphic so that the name defining the name of the display D is displayed on the display D. When the space between the two fingers is widened while holding the margin portion of the display D with two fingers at the same time, When the graphically displayed screen is enlarged and the interval between two fingers is narrowed, the screen is reduced and displayed as a 3D graphic, thereby displaying a large number of the upper objects (A) in the display space (D) The user can recognize the configuration of the upper object A easily and quickly using only the gesture.

9 is a flowchart illustrating an operation 18 of the software application. In operation 18, when a software application is executed, a plurality of ancillary objects A are displayed as independent phrases, In a first step in which a name defining a name of the display D is displayed in a 3D graphic on the display D, when two fingers are simultaneously moved in a desired direction up and down and left and right with the margin portion of the display D pressed simultaneously with two fingers, The screen displayed in the 3D graphics on the display screen D is scrolled in the direction in which the two fingers are moved and displayed in 3D graphics so that a large number of the upper objects A are displayed in the display space D having a small size of the mobile electronic device, It is possible to recognize the configuration of the upper object A easily and quickly using only the gesture.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention.

That is, although the preferred embodiment has been described based on a mobile electronic device such as a smart phone or a tablet PC, the present invention is not limited thereto, and if a similar hardware configuration is used, various software applications can be executed similarly to a smart phone or a tablet PC And it is applicable to an electronic apparatus.

In addition, although the preferred embodiment has been described with reference to fingers as the most common control means in using mobile electronic devices, the present invention is not limited thereto and may be applied to touch pens for mobile electronic devices or various auxiliary devices Gesture input using an input tool is also possible.

In addition, the present invention can be applied to a document editing application, a presentation application, a spreadsheet application, an SNS application, an email application, a phone application, a drawing application, a graphic editing application, a video editing application, a music reproduction application, Applications, and so on.

Further, in the description of the present invention, each step is divided into numerals. However, it should be noted in advance that the step numbers are for distinguishing steps easily, and that the steps are not performed only in the order of the numbers displayed.

A, A1: parent object B, B1: child object
D: Display E: Add Object button
F: Delete object button K: Keyboard keyboard
W1: Detail window W2: Information window

Claims (13)

A mobile electronic device having a touch-sensitive screen display (D) for detecting a gesture communicated via the display (D), identifying the gesture and enabling control of the software application by the identified gesture , When a software application is executed, a plurality of upper objects (A) are displayed as independent phrases, and a name defining the corresponding upper object (A) is displayed on the surface of each phrase, Stage 1;
When one of the upper objects A in the first stage is single tabped, the selected upper object A1 is enlarged while moving to the center of the display D, and the remaining upper objects A are enlarged and displayed (D) in 3D graphics;
When the selected upper level object A1 in the second stage is single-tabbed, the lower level subordinate object B is subordinate to the upper level object A1, A third step in which other upper objects (A) which are graphically displayed and which have been reduced in the second step disappear from the display (D);
When one of the subordinate objects B in the third step is single tabbed, the selected subordinate object B1 is enlarged while moving to the center of the display D, and the remaining unselected objects are rotated to select the selected subordinate object (B);
When the selected sub-object B1 in the fourth step is single-tabbed, the detailed information window W1 belonging to the sub-object B1 is popped up and displayed in the center of the display D, step;
When the detailed information window W1 of the fifth step is clicked, the keyboard key K is popped up from the lower end of the display D to the upper end of the display D so that the information necessary for the detailed information window W1 can be typed and inputted. And a sixth step of displaying the gesture-based 3D graphical user interface.
The method according to claim 1, wherein when the software application is executed, a plurality of upper objects (A) are displayed as respective independent phrases, and a name defining the upper object (A) And a seventh step in which, in a first step of displaying a gesture-based 3D graphical user interface, a margin is enlarged by moving a tab part to a center by double-tabping a blank part of the display D;
The gesture-based 3D graphic user (1) according to claim 2, wherein the gesture-based 3D graphic user (2) includes a step of reducing the screen by moving the tab portion to the center when the margin portion of the display (D) Interface providing method.

The method according to claim 1, wherein when the selected upper object (A1) of the second step is single-tabbed, the lower object (B) subordinate to the upper object (A1) The other upper objects A displayed in 3D graphic on the display D and reduced in the second stage disappear when the selected upper object A1 is continuously depressed and held in the third stage disappearing from the display D A method for providing a gesture-based 3D graphical user interface, the method comprising the ninth step in which the upper objects (A) are displayed above the display (D).
The method according to claim 4, wherein in the ninth step, one of the upper objects (A) displayed on the upper part of the display (D) in a state of holding one of the lower objects (B) When dragging and dropping, the designated upper object (A) is displayed in a different color, and the held lower object (B1) is moved to the designated upper object (A) (B). ≪ RTI ID = 0.0 > [10] < / RTI >
The method of claim 4, wherein, in the ninth step, one of the child objects (B) dependent on the parent object (A1) being held is dragged and dragged to one of the other child objects ≪ / RTI >& Drop), the held child object (B1) is moved to the specified child object (B) and is subordinate to the child object (B).
The method as claimed in claim 4, wherein, in the ninth step, one of the subordinate objects (B) dependent on the held upper level object (A1) is held and dragged and dropped in a blank space of the display (D) Drag & drop), the held subobject B1 with drag-and-drop is displayed as a 3D graphic on the display D as a separate sphere separated into individual independent objects, A method for providing a user interface.
The method according to claim 1, wherein, when one of the upper objects (A) of the first stage is single tabbed, the selected upper object (A1) is enlarged while moving to the center of the display (D) A) are reduced and displayed in a 3D graphic on the display D, when the centered upper object A1 is long-tabbed, the corresponding upper object A1 is displayed transparently, The information window W2 for modifying the information of the corresponding upper level object A1 is popped up and displayed in the center of the display D in a predetermined size And at the same time, a keyboard key K is popped up from the lower end of the display D to be displayed at the lower end of the display D.
The method according to claim 1, wherein when the software application is executed, a plurality of upper objects (A) are displayed as respective independent phrases, and a name defining the upper object (A) The object addition button E is displayed as "+" at one side of the upper end of the display D, and when the object addition button E is single tabed, The information window W1 is popped up and displayed at a predetermined size in the center of the display D and at the same time the keyboard keyboard K is popped up from the lower end of the display D to be displayed at the lower end of the display D Based gesture-based 3D graphical user interface.
The method according to claim 1, wherein when the software application is executed, a plurality of upper objects (A) are displayed as respective independent phrases, and a name defining the upper object (A) A designated upper object A1 is displayed transparently by selecting one of the upper objects A and displayed on the upper side of the display D as an object indicated by "+" The addition button E is changed to the object deletion button F and the designated upper object A1 is dragged and dropped to the object deletion button F indicated by "X" And then the corresponding upper object (A) is deleted.
The method according to claim 1, wherein when the software application is executed, a plurality of upper objects (A) are displayed as respective independent phrases, and a name defining the upper object (A) When the blank part of the display D is moved in a desired direction in a state where the blank part of the display D is pressed with one finger, the upper objects A displayed in the 3D graphic on the display D along the moving direction of the finger Wherein the upper object (A) positioned at the rear of the upper object (A) rotates forward and the upper object (A) positioned at the front is rotated backward to be displayed as a 3D graphic.
The method according to claim 1, wherein when the software application is executed, a plurality of upper objects (A) are displayed as respective independent phrases, and a name defining the upper object (A) In the first step displayed on the display D, when the space between the two fingers is widened while the margin portion of the display D is simultaneously pressed with two fingers, the screen displayed in the 3D graphic is enlarged on the display D, And a seventeenth step in which the screen is reduced and displayed as a 3D graphic by narrowing the display of the gesture-based 3D graphic user interface.
The method according to claim 1, wherein when the software application is executed, a plurality of upper objects (A) are displayed as respective independent phrases, and a name defining the upper object (A) In the first step displayed on the display D, when the margin portion of the display D is simultaneously pressed with two fingers and the two fingers are simultaneously moved in the desired direction in the up, down, left, and right directions, Wherein the gesture-based 3D graphical user interface comprises the steps of:

Images