JP4656385B2 - Window display device, window display method, and window display program - Google Patents

Description

  The present invention relates to a window display device and a graphical user interface, and is suitable for application to a personal computer, for example.

  2. Description of the Related Art Conventionally, in a personal computer having a display unit such as a liquid crystal display, when a large amount of various files such as moving images, still images, music, and text data belong to a plurality of categories, for example, a Windows (registered trademark) folder If it is a structure, multiple categories are treated as folders, and files belonging to multiple categories are copied and included in each folder, or shortcuts of files belonging to multiple categories are generated for each folder. This makes it easy to search for a desired file.

On the other hand, in a two-dimensional display structure such as Windows (registered trademark), there is a limit to browsing the contents of a plurality of folders simultaneously. On the other hand, as a display method for displaying a plurality of windows, a plurality of windows are displayed in a three-dimensional manner on the screen, so that the plurality of windows can be displayed on a single screen in a state that can be visually confirmed. There is what was made to obtain (for example, refer to patent documents 1).
JP 2002-55751 A

  By the way, since the personal computer having such a configuration employs a folder structure, in order for the user to search for a desired file, the user descends in order from the categorized upper folder to the lower folder, and finds the corresponding file for the user. However, there is a problem that it is forced to perform complicated operations several times.

  Further, when a plurality of windows are displayed three-dimensionally, a large number of windows are displayed in one screen, and thus there is a problem that it is not easy to search for a window desired by the user.

The present invention has been made in view of the above points, and proposes a window display device , a window display method, and a window display program capable of easily searching a user-desired window from a plurality of windows associated with a category. It is something to try.

Oite the window display device of the present onset bright order to solve such a problem, a plurality of windows respectively corresponding exists in multiple files, each window the plurality of windows that can belong to many categories simultaneously a window display means for displaying on the display means, to generate a virtual space for arranging the plurality of windows in three dimensions, generate a plurality of operation sphere as a virtual object associated with the respective plurality categories And a virtual space generating means for stereoscopically displaying the plurality of operation balls together with the category name in the virtual space on the display means, a plurality of windows and a plurality of operation balls arranged three-dimensionally with respect to the virtual space. in a state of being displayed on the display means, when selected any operation sphere, the temporary depending on the position on the virtual space of the operations sphere Change the viewpoint with respect to space, and displays a plurality of windows at an angle corresponding to the viewpoint after the change, it was converted by the plurality of windows belonging to the category associated with the operation ball from the virtual space into two-dimensional plane and window enhancement means for highlighting upon, when the operation ball is dragged in a state of being selected to display while moving the operation ball itself, the highlighted the window to which the operation sphere is intended for the user Window recognition means for recognizing that the window has been selected when a drop operation is performed is provided .

Thereby, when an arbitrary operation sphere is selected, the viewpoint for the virtual space is changed according to the position of the operation sphere in the virtual space, and a plurality of windows are displayed at angles corresponding to the changed viewpoint. Therefore, it is possible to present a plurality of windows in a state that is easy to see for the user, and at that time, only a plurality of windows belonging to the category associated with the operation ball are converted from the virtual space to a two-dimensional plane. In addition, since it can be highlighted, only a plurality of windows belonging to the category can be distinguished from among a plurality of windows arranged in a three-dimensionally scattered state in the virtual space. In addition, it can be presented in a state where it can be easily recognized, and in addition, a drop operation can be performed on the window using the operation ball itself indicating the category. By, it is possible to easily and reliably selecting the desired windows for users.

Oite this onset bright window display method, and window display program also more of the plurality of windows respectively corresponding exists in the file, each window the plurality of windows that can belong to many categories simultaneously displayed on the display means, to generate a virtual space for arranging the plurality of windows in three dimensions to produce a plurality of operation sphere as a virtual object associated with the respective plurality categories, the plurality operation sphere stereoscopic display on the display means in a state of being placed in the virtual space together with the category name and a state in which multiple windows and a plurality of operation spheres arranged three-dimensionally relative to the virtual space is displayed on the display means, when any action ball is selected to change the viewpoint with respect to the virtual space according to the position on the virtual space of the operations sphere, the variable With an angle for displaying a plurality of windows corresponding to the viewpoint of the later emphasizes only multiple windows belonging to the category associated with the operation ball in terms of converted from the virtual space into two-dimensional plane, the operation ball when the drag operation in the selected state display while moving the operation sphere itself, that the window is selected when the operation ball is dropped operated on the highlighted the window of interest of the user To recognize.

Thereby, when an arbitrary operation sphere is selected, the viewpoint for the virtual space is changed according to the position of the operation sphere in the virtual space, and a plurality of windows are displayed at angles corresponding to the changed viewpoint. Therefore, it is possible to present a plurality of windows in a state that is easy to see for the user, and at that time, only a plurality of windows belonging to the category associated with the operation ball are converted from the virtual space to a two-dimensional plane. In addition, since it can be highlighted, only a plurality of windows belonging to the category can be distinguished from among a plurality of windows arranged in a three-dimensionally scattered state in the virtual space. In addition, it can be presented in a state where it can be easily recognized, and in addition, a drop operation can be performed on the window using the operation ball itself indicating the category. By, it is possible to easily and reliably select a desired window to the user.

According to the present invention, when an arbitrary operation sphere is selected, the viewpoint with respect to the virtual space is changed according to the position of the operation sphere on the virtual space, and a plurality of windows are formed at an angle according to the changed viewpoint. Can be displayed so that a plurality of windows can be presented to the user in an easy-to-view state. At that time, only a plurality of windows belonging to the category associated with the operation sphere are two-dimensionally displayed from the virtual space. Since it can be highlighted after being converted into a plane, only a plurality of windows belonging to the category can be distinguished from among a plurality of windows arranged in a three-dimensional manner in the virtual space. Therefore, it can be presented to the user in an easily recognizable state, and in addition, it can be dropped on the window using the operation ball itself indicating the category. By work, it is possible to easily and reliably select a desired window to the user, thus the desired window window display device capable of easily find without complicated operations of the window display method and window display programs It can be achieved free.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

(1) Configuration of Window Display Device In FIG. 1, reference numeral 1 denotes a window display device mounted on a personal computer as a whole. For example, an input from a user is accepted via an input unit 2 made of a mouse, and the input result is 3 Display on the display unit 5 based on the input result from the virtual space control unit 3 that performs processing related to the three-dimensional virtual space such as conversion to a coordinate system in the three-dimensional virtual space, processing for constructing the three-dimensional virtual space, and the like A display content determination unit 4 that determines the content to be processed, a category management unit 6 that manages the category of the window associated with the file, the category to which the window belongs, the display attribute and display content of the window itself, the window size, etc. The window attribute storage unit 7 stores the information.

  In particular, the virtual space control unit 3 generates a three-dimensional virtual space for three-dimensionally displaying a plurality of windows on the screen screen (two-dimensional plane) of the display unit 5 formed of a liquid crystal display or the like. In addition, the virtual space control unit 3 generates a plurality of windows semi-transparently in order to display a plurality of windows in the three-dimensional virtual space so as to be visible, and uses the plurality of windows in the depth direction of the three-dimensional virtual space. And has been made to arrange.

  In addition, the virtual space control unit 3 generates an operation sphere for easily selecting a user-desired window from a number of windows classified into a plurality of types of categories as a virtual object for placing in the three-dimensional virtual space. The operation sphere is arranged in a three-dimensional virtual space together with a plurality of windows and displayed on the display unit 5.

  In the window display device 1, the processing by the virtual space control unit 3 and the display content determination unit 4 is executed by a control unit 9 having a CPU (Central Processing Unit) configuration, and the processing by the category management unit 6 and the window attribute storage unit 7 is performed. The storage management unit 10 having a hard disk drive configuration is executed so that a graphical user interface using a three-dimensional virtual space and a plurality of windows can be realized according to a window display program stored in the window attribute storage unit 7. Has been made.

  Specifically, the window display device 1 three-dimensionally displays a plurality of windows W1 to W7 using the depth direction of the three-dimensional virtual space VS generated by the control unit 9 as shown in FIG. The operation balls SQ1 to SQ5 classified into categories for selecting a user-desired window from the plurality of windows W1 to W7 are stereoscopically displayed in the three-dimensional virtual space VS.

  In this case, since the control unit 9 also stereoscopically displays the operation balls SQ1 to SQ5 using the depth direction of the three-dimensional virtual space VS, the large operation ball SQ1 is located on the most front side in the three-dimensional virtual space. It is visually shown that the small-sized operation balls SQ3 and SQ4 are positioned on the innermost side in the three-dimensional virtual space.

  By the way, the operation ball SQ1 is a category “artist”, the operation ball SQ2 is a category “movie”, the operation ball SQ3 is a category “work”, the operation ball SQ4 is a category “live”, and the operation ball SQ5 is a category “2004”. Is shown. Therefore, when searching for a desired file belonging to a certain category from the plurality of windows W1 to W7, the user first selects one of the operation balls SQ1 to SQ5.

  In the plurality of windows W1 to W7 displayed in the three-dimensional virtual space VS, the window titles are described in the windows and still images for pasting the contents are pasted. The user can intuitively and instantaneously recognize what the file contents of the windows W1 to W7 are.

  Specifically, the window title of “Billy Shoel Live 2004” and the still image during piano performance are displayed as the window W1, the window title of “Udata Hikaru” and the still image during singing are displayed as the window W2, and the window W3 The window title of “SkiNow2004” and the still image of the skier are displayed, the window title of “Conference 2004” and the still image during the conference are displayed as window W4, and the window title of “Jiro Kitajima 2004” and the person's A still image is displayed, a window title of “Family Travel 2004” and a still image of a family photo are displayed as a window W6, and a window title of “Beatles Movie” and a still image being played are displayed as a window W7. .

  The control unit 9 is configured to generate and display the plurality of windows W1 to W7 in a colored and translucent manner, and is translucent even when the plurality of windows W1 to W7 are displayed so as to overlap each other. Therefore, the rear window W can be visually confirmed by the user without being hidden by the front window W.

  The windows W1 to W7 in this case are such that, for example, a red window indicates a moving image file, a blue window indicates a still image file, and a white window indicates a text file, and is associated with the windows W1 to W7. The file type can be recognized by the user as a color image.

  In this manner, the control unit 9 displays a plurality of windows W1 to W7 in the three-dimensional virtual space VS in a three-dimensional manner on the screen screen of the display unit 5 and displays the windows W1 to W7 in a colored translucent manner. Compared to the case where the windows W1 to W7 are two-dimensionally displayed on the screen screen, more windows W1 to W7 can be visually confirmed at a time.

  Here, the control unit 9 recognizes the position of the cursor KS operated via the input unit 2 on the screen screen, and determines the three-dimensional virtual at an angle based on the viewpoint when viewing the three-dimensional virtual space VS from the position. The space VS is displayed on the display unit 5. Thereby, the user can visually confirm the three-dimensional virtual space VS and the plurality of windows W1 to W7 from the angle he / she wants to see.

  As shown in FIG. 3, for example, when the control unit 9 recognizes that the operation ball SQ1 in the three-dimensional virtual space VS is selected via the cursor KS, the control unit 9 displays the operation ball SQ1 via the display content determination unit 4. The angle is changed to the angle when the 3D virtual space VS is viewed from the direction to display the 3D virtual space VS, and the windows W1, W2, W5, and W7 belonging to the category “artist” of the operation ball SQ1 are displayed in 3 respectively. The two-dimensional highlighting is performed in a state of being lifted from the three-dimensional virtual space VS and facing the screen screen of the display unit 5 and moved to the front side.

  In particular, the control unit 9 displays only the windows W1, W2, W5, and W7 belonging to the category “artist” of the operation ball SQ1 from the plurality of windows W1 to W7 displayed in the three-dimensional virtual space VS. By displaying in two dimensions on the screen, the windows W1, W2, W5 and W7 associated with the category “artist” of the operation ball SQ1 are clearly shown to the user from the other windows W3, W4 and W6. It is made to be able to do.

  When the control unit 9 recognizes that the operation ball SQ1 is selected through the cursor KS, the control unit 9 highlights the outline of the operation ball SQ1 so that the category “artist” of the operation ball SQ1 is currently displayed. The user can visually confirm that the item is selected.

  As described above, the window display device 1 allows the user to select the operation ball SQ1 in the three-dimensional virtual space VS via the cursor KS, and thereby the window W1 for the category “artist” of the operation ball SQ1. , W2, W5, and W7 belong, and the file contents of the windows W1, W2, W5, and W7 can be intuitively and surely recognized, and a user-desired window W can be easily selected from among them. Has been made.

  Similarly, as shown in FIG. 4, when the control unit 9 recognizes that the operation ball SQ5 in the three-dimensional virtual space VS is selected via the cursor KS, for example, the control unit 9 starts from the direction of the operation ball SQ5. The three-dimensional virtual space VS is displayed by changing the angle to the angle at the time of viewing, and the windows W1, W3, W4, W5, and W6 belonging to the category “2004” of the operation ball SQ5 are respectively displayed in the three-dimensional virtual space VS. The two-dimensionally highlighted display is made in such a manner that it stands up from the screen and faces the screen screen of the display unit 5 and is moved to the nearest side.

  Accordingly, the control unit 9 displays only the windows W1, W3, W4, W5, and W6 belonging to the category “2004” of the operation ball SQ5 from the plurality of windows W1 to W7 displayed in the three-dimensional virtual space VS. A state in which the windows W1, W3, W4, W5 and W6 associated with the category “2004” of the operation ball SQ5 are clearly distinguished from other windows W by two-dimensional display on the screen screen of the unit 5 Can be presented to the user.

  Also in this case, when the control unit 9 recognizes that the operation sphere SQ5 is designated, the outline of the operation sphere SQ5 is thickly highlighted, whereby the category “2004 of the operation sphere SQ5 is displayed. The user can visually confirm that “is selected”.

  Further, the control unit 9 displays the window titles and still images of the windows W1, W3, W4, W5, and W6 so that the user can recognize the file contents intuitively and reliably.

  As shown in FIG. 5, in this state, when the operation ball SQ5 selected via the cursor KS is dragged as indicated by the thick arrow, the control unit 9 performs a three-dimensional virtual space VS for the operation ball SQ5. The two-dimensional sprite SP1 in which the operation sphere SQ5 is projected and the outline is displayed in broken lines is generated while being left inside, and only the two-dimensional sprite SP1 is moved and displayed in accordance with the user's drag operation.

  At this time, when the two-dimensional sprite SP1 is overlaid on the window W6, the control unit 9 highlights the window W6 with the highlight frame KW so that the user can recognize that the window W6 has been selected. Yes.

  When the two-dimensional sprite SP1 is dropped on the window W6 in this state, the control unit 9 recognizes that the window W6 is finally selected, and opens the file associated with the window W6. Thus, a moving image, a still image or text is displayed on the screen screen of the display unit 5.

(2) Window Display Processing Procedure Next, the window display processing procedure for the window display device 1 to realize a graphical user interface using the three-dimensional virtual space VS according to the window display program will be described with reference to the flowchart of FIG. Explained.

  Actually, the control unit 9 of the window display device 1 enters from the start step of the routine RT1, moves to the subroutine SRT1, and executes initialization processing in the subroutine SRT1.

  As shown in FIG. 7, in step SP11 of the subroutine SRT1, the control unit 9 builds a three-dimensional virtual space VS to be displayed on the display unit 5 by the virtual space control unit 3, and proceeds to the next step SP12. In this case, the finite three-dimensional virtual space VS as shown in FIG. 2 is constructed, but an infinite three-dimensional virtual space can also be constructed.

  In step SP12, the control unit 9 generates windows W1 to W7 to be arranged in the three-dimensional virtual space VS by the virtual space control unit 3, and proceeds to the next step SP13. These windows W1 to W7 are intended for moving images, still images, text files, and the like. For example, the windows W1 to W7 display a description of the content in a one-to-one correspondence with some content, or a collection of photographs and thumbnail images. A plurality of contents may be collected.

  In step SP13, the control unit 9 categorizes the windows W1 to W7 according to the meanings of the categories classified in advance into several categories, and proceeds to the next step SP14. Here, the criteria for categorization may be that the control unit 9 may automatically categorize using the keywords included in the window titles of the windows W1 to W7, and the windows W1 to W7 may be categorized by user operation. It may be divided. Furthermore, the category itself may be arbitrarily set or changed by the user.

  In step SP14, the control unit 9 ends the initialization process by assigning the operation balls SQ1 to SQ5 to the above-described categories, and returns to step SP2 (FIG. 6). In this case, the control unit 9 matches the number of operation balls SQ1 to SQ5 with the number of categories, but does not necessarily need to match.

  The control unit 9 can also change the shape and appearance of the operation balls SQ1 to SQ5 in accordance with the category. In this case, the control unit 9 performs this initialization process. Actually, the controller 9 texture-maps the operation balls SQ1 to SQ5 as the appearance of the operation balls SQ1 to SQ5 and displays the category names as characters. It is also possible to distinguish each category by changing each.

  When the initialization process is executed in this way, for the operation ball SQ1 of the category “Artist”, the “William Live Live 2004” window W1 having the “Artist” name as a keyword, the “Udata Hikaru” window W2, The window W5 of “Jiro Kitajima” and the window W7 of “Beatles Movie” are registered in the window attribute storage unit 7 of the storage management unit 10 in a state of being associated with each other.

  Further, the operation ball SQ2 of the category “movie” is registered in the window attribute storage unit 7 of the storage management unit 10 in a state where the window W7 of “Beatles Movie” with the keyword “Movie” is associated. Similarly, the operation ball SQ3 of the category “work” is registered in the window attribute storage unit 7 of the storage management unit 10 in a state where the window W4 of “conference 2004” with the keyword “conference” is associated. .

  Further, for the operation ball SQ4 of the category “live”, the window attribute storage unit 7 of the storage management unit 10 is associated with the window W1 of “Billy Shoel Live 2004” to which the keyword “live” is attached. For the operation ball SQ5 of the category “2004”, the “William Live 2004” window W1, the “SkiNow 2004” window W3, the “Meeting 2004” window W4, with the keyword “2004” attached, The window W5 of “Jiro Kitajima 2004” and the window W6 of “family trip 2004” are associated with each other and registered in the window attribute storage unit 7 of the storage management unit 10.

  When the initialization process ends in this way, in step SP2 (FIG. 6), the control unit 9 determines whether or not to end the graphical user interface using the three-dimensional virtual space VS. Specifically, if the end of the window display program is specified by input from the user, or if it must be ended due to hardware restrictions such as insufficient memory, the end condition is satisfied. .

  If a positive result is obtained in step SP2, the control unit 9 determines that the end condition is satisfied, moves to next step SP5, and ends the window display processing procedure using the graphical user interface by the window display program, and step SP2 If a negative result is obtained, the control unit 9 proceeds to the drawing content determination processing procedure in the next subroutine SRT3.

  As shown in FIG. 8, in step SP21 of the subroutine SRT3, the control unit 9 determines whether or not there is any input to the three-dimensional virtual space VS displayed on the display unit 5 after the initialization process is performed in the subroutine SRT1. Determine. The information input here is, for example, input coordinate values of the screen coordinate system on the screen screen of the display unit 5, trigger information, or the like.

  If an affirmative result is obtained in this step SP21, this indicates that some input has been made to the screen screen via the input unit 2. At this time, the control unit 9 moves to the next step SP22, and the screen screen is displayed. The input coordinate value above is acquired and the process proceeds to the next step SP23.

  In step SP23, the control unit 9 performs coordinate conversion processing of the input coordinate value from the screen coordinate system to the three-dimensional virtual space system, and proceeds to the next step SP24. Specifically, the control unit 9 sets a vertical line drawn in the vertical direction from the screen screen as the virtual straight line L1 based on the input coordinate value in the screen coordinate system, and adds the point on the virtual straight line L1 to the input coordinate value 3 Convert to dimensional coordinate values.

  In step SP24, the control unit 9 determines whether or not the screen screen of the display unit 5 is currently set to the operation ball selection mode. Here, as shown in FIG. 3 or FIG. 4, the state in which the operation ball selection mode is set includes, for example, the windows W1, W2, W5, and W7 belonging to the category “artist” of the selected operation ball SQ1, respectively. It is in a state where it is raised from the three-dimensional virtual space VS and highlighted two-dimensionally in a form facing the screen screen of the display unit 5, and if the operation ball selection mode is not set, a negative result is given. Then, the control unit 9 proceeds to the next step SP25.

  In step SP25, the control unit 9 determines that the cursor KS is operated based on whether or not the virtual straight line L1 obtained in step SP23 and any of the operation balls SQ1 to SQ5 intersect in a state that is not the operation ball selection mode. It is determined whether or not the ball is on the spheres SQ1 to SQ5, and if a positive result is obtained, the process proceeds to the next step SP26.

  In step SP26, since the cursor KS is on the operation balls SQ1 to SQ5, the control unit 9 recognizes that any of the operation balls SQ1 to SQ5 is selected by the cursor KS, and shifts to the operation ball selection mode. When the operation sphere SQ5 is selected, the outline of the operation sphere SQ5 is highlighted and the window belonging to the category “2004” associated with the operation sphere SQ5 selected by the cursor KS Deciding to highlight two-dimensionally W1, W3, W4, W5 and W6 in a form facing the screen screen of the display unit 5 and generating a two-dimensional sprite SP1 projecting the operation ball SQ5 The display is decided and the process proceeds to the next subroutine SRT27.

  Incidentally, when the virtual straight line L1 and a plurality of operation balls SQ1 to SQ5 existing in the three-dimensional virtual space VS intersect, the control unit 9 targets the operation ball SQ closest to the screen screen of the display unit 5. Has been made.

  At this time, the control unit 9 not only highlights the windows W1, W3, W4, W5, and W6 belonging to the category “2004” associated with the operation ball SQ5 but also blinks the two-dimensional sprite SP1. In this way, the user can easily visually check the two-dimensional sprite SP1 to be moved.

  The control unit 9 also blinks the window W1, W3, W4, W5, and W6, changes the color, displays an animation such as enlargement / reduction, vibration, rotation, and the like to highlight the window W1. , W3, W4, W5 and W6 can be highlighted.

  As shown in FIG. 9, in step SP41 of the subroutine SRT27, the control unit 9 acquires a three-dimensional coordinate value in the three-dimensional virtual space VS of the operation ball SQ5 selected via the cursor KS, and proceeds to the next step SP42. .

Step control unit 9 in SP42, the virtual line L2 connecting the three-dimensional coordinate values of the operation ball SQ5 obtained in step SP 4 1 As shown in FIG. 9, the center of gravity coordinate value representing the center of gravity G of the 3-dimensional virtual space VS And the process proceeds to the next step SP43.

  In step SP43, the control unit 9 obtains a coordinate value on the screen screen corresponding to the viewpoint position YS1 of the user separated from the operation ball SQ5 by a predetermined distance m1 on the virtual straight line L2, and proceeds to the next step SP44.

  This predetermined distance m1 is not a fixed distance, and if this distance is too long, the windows W1, W3, W4, W5 and W6 displayed on the screen screen of the display unit 5 become small and difficult to see. If the distance is too short, the value is determined in order to avoid inconveniences such as that the windows W1, W3, W4, W5 and W6 cannot be displayed on the screen screen of the display unit 5. Accordingly, the predetermined distance m1 may be set according to the type of display device, or the user may arbitrarily set the predetermined distance m1.

  In step SP44, the control unit 9 translates or rotates, for example, the screen AB1 before changing the angle so that the coordinate value of the viewpoint position YS1 obtained in step SP43 is located at the center of the screen screen, thereby generating the three-dimensional virtual space VS. The screen AB2 after the angle change after the angle change is determined to be displayed, and the process proceeds to the next step SP4 (FIG. 6).

Control unit 9 in the step SP4, and displays a three-dimensional virtual space VS using steps SP 4 4 a three-dimensional virtual space VS of results of angle change angle change after screen AB2, associated with the operation ball SQ5 The windows W1, W3, W4, W5 and W6 are highlighted two-dimensionally, and the two-dimensional sprite SP1 based on the operation ball SQ5 is displayed, so that the windows W1, W3 are selected from the direction in which the operation ball SQ5 is selected. , W4, W5, and W6 are presented to the user in the most viewable state, and the process returns to step SP2.

  On the other hand, if a negative result is obtained in step SP25 (FIG. 8), this indicates that the cursor KS is not on the operation balls SQ1 to SQ5. At this time, the control unit 9 moves to the next subroutine SRT28, An angle change processing procedure based on the position of the cursor KS is started.

  As shown in FIG. 11, in step SP51 of the subroutine SRT28, the control unit 9 acquires the two-dimensional coordinate value of the cursor KS currently existing on the screen screen, and proceeds to the next step SP52.

Step SP52 the control unit 9 in obtains a 2-dimensional coordinate values of the cursor KS obtained in step SP 5 1, connecting the centroid coordinate value representing the center of gravity G of the 3-dimensional virtual space VS imaginary straight line L3 (not shown) Then, the process proceeds to next step SP53.

  In step SP53, the control unit 9 on the screen screen corresponding to the user's viewpoint position YS2 (not shown) separated from the center of gravity G of the three-dimensional virtual space VS by a predetermined distance m2 (not shown) on the virtual straight line L3. Is obtained, and the process proceeds to the next step SP54.

  As with the predetermined distance m1, the predetermined distance m2 is not a fixed distance. If the distance is too long, the windows W1 to W7 displayed on the screen screen of the display unit 5 become small and difficult to see. On the contrary, if this distance is too short, the value is determined in order to avoid the occurrence of inconveniences such as the inability to display all the windows W1 to W7 on the screen screen of the display unit 5.

  In step SP54, the control unit 9 translates or rotates the screen before the angle change so that the coordinate value of the viewpoint position YS2 obtained in step SP53 is located in the center of the screen screen, thereby changing the angle of the three-dimensional virtual space VS. Then, it is determined to display the screen after changing the angle, and the process proceeds to the next step SP4 (FIG. 6).

  In step SP4, the control unit 9 displays the screen after angle change as a result of changing the angle of the three-dimensional virtual space VS in step SP44 on the display unit 5, so that the three-dimensional virtual space VS is displayed from the direction in which the cursor KS is currently located. When viewed, the windows W1 to W7 are presented to the user in the most viewable state, and the process returns to step SP2.

  That is, the control unit 9 executes the angle change processing procedure based on the cursor position of the subroutine SRT29 while repeating step SP2, subroutine SRT3, and step SP4, so that 3 is performed in real time in accordance with the operation of moving the cursor KS by the user. The angle of the dimensional virtual space VS is changed, and the screen after the angle change can be displayed on the display unit 5.

  On the other hand, after step SP26, step SP27, and step SP4, the two-dimensional sprite SP1 projectingly displaying the operation ball SQ5 is displayed on the display unit 5, and then the process proceeds from step SP2 to the subroutine SRT3 again. If it is obtained, since the operation ball selection mode has already been set at this time, the control unit 9 proceeds to the next step SP29.

  In step SP29, the control unit 9 determines the drawing content so as to move the coordinate value of the two-dimensional sprite SP1 on which the operation ball SQ5 is projected and displayed in accordance with the drag operation by the user's cursor KS, and the next step SP4 (FIG. 6). Move on.

  In step SP4, the control unit 9 displays the two-dimensional sprite SP1 on the screen screen of the display unit 5 while moving the two-dimensional sprite SP1 in accordance with the drag operation by the cursor KS, and returns to the above-described step SP2.

  By the way, after displaying the two-dimensional sprite SP1 through the drawing content determination processing procedure of the subroutine SRT3, the process returns to the step SP2 (FIG. 6) again, and a negative result is obtained in the step SP2, and then the subroutine SRT3 (FIG. 8). If a negative result is obtained in step SP21, this indicates that the two-dimensional sprite SP1 has not been dragged and is not moving. At this time, the control unit 9 moves to the next step SP30.

  In step SP30, the control unit 9 determines whether or not the operation ball selection mode is set, and also displays a window on a virtual straight line L4 (not shown) from the two-dimensional sprite SP1 obtained in step SP23 in the previous loop. It is determined whether any of W1 to W7 exists.

  If a positive result is obtained here, this means that any of the windows W1 to W7 is present in the operation ball selection mode and on the virtual straight line L4 from the two-dimensional sprite SP1. The control unit 9 moves to the next step SP31. Here, when there are a plurality of windows W1 to W7 on the virtual straight line L4, the window W closest to the screen screen is selected.

  In step SP31, when the control unit 9 recognizes that, for example, the window W6 existing on the virtual straight line L4 has been selected, the control unit 9 highlights the window W6 by adding a highlight frame KW with a thicker periphery. Indicates to the user that W6 is currently selected.

  In step SP31, when the two-dimensional sprite SP1 is dropped on the window W6, the control unit 9 recognizes that the window W6 is finally selected, and proceeds to the next step SP32.

  On the other hand, if a negative result is obtained in step SP30, this means that the two-dimensional sprite SP1 exists outside the windows W1 to W7 when the two-dimensional sprite SP1 is dropped, and the windows W1 to W7 are present. In this case, the control unit 9 proceeds to the next step SP32.

Control unit 9 in step SP32, when recognizing that any window W1~W7 is selected, or both to recognize that not selected, and proceeds to the next step SP4 (Fig. 6).

  In step SP4, when the control unit 9 recognizes that any of the windows W1 to W7 has been selected, the control unit 9 opens the file associated with the selected window W and displays the video on the screen screen of the display unit 5, While returning to step SP2 again, when recognizing that none of the windows W1 to W7 has been selected, the state as it is is drawn and the process returns to step SP2 (FIG. 6) again.

  In step SP2, the control unit 9 determines whether or not to end the graphical user interface using the three-dimensional virtual space VS. If an affirmative result is obtained, the control unit 9 proceeds to step SP5 and ends the window display processing procedure.

(3) Window Display Change and Window Movement Processing Next, the window display device 1 changes the display of the window W on the three-dimensional virtual space VS according to the window display program, and moves the window W according to the drag operation. The processing in this case will be specifically described.

  As shown in FIG. 12, the control unit 9 of the window display device 1 in this case has operation areas 21 and 22 for changing the display form of the window W according to the operation of the user arranged on both sides of the screen. Windows W11 to W17 in which the menu bar 23 is arranged at the top of the screen are generated, and these are arranged in the three-dimensional virtual space VS. Here, FIG. 12 shows only the window W11 for convenience of explanation.

  When the control unit 9 recognizes that the operation area 21 or 22 of the window W11 is clicked through the cursor KS, the control unit 9 determines the state after changing the display form of the window W11 through the display content determination unit 4. Then, the window W11 is changed to the determined display form and displayed.

  Specifically, as shown in FIG. 13, when the control unit 9 recognizes that the operation region 21 of the window W11 has been clicked, the control unit 9 displays the window W11A in which the operation region 21 has changed to a shape inclined toward the back of the screen. 5, when it is recognized that the operation area 22 of the window W <b> 11 has been clicked, the window W <b> 11 </ b> B in which the operation area 22 has changed to a shape inclined toward the back of the screen is displayed on the display unit 5.

  When the control unit 9 recognizes that the operation area 22 has been clicked in the state of the window W11A, the control unit 9 returns the window W11A to the original window W11 and displays it, and that the operation area 21 has been clicked in the state of the window W11B. Is recognized, the window W11B is returned to the original window W11 and displayed.

  As shown in FIG. 14, the control unit 9 displays the windows W11A to W13A tilted to the back side on the display unit 5, and the cursor KS is dragged in the arrow J direction with the cursor KS overlaid on the window W11A. When operated, as shown in FIG. 15, the window W12A and the window W13A are overlapped and displayed in a state of being bundled by the window W11A in accordance with the movement of the window W11A.

  Thereby, even when the control unit 9 displays a plurality of windows W11 to W13 on the screen screen of the display unit 5, the control unit 9 can further overlap the plurality of windows W11A to W13A inclined to the back side. Many windows W can be displayed, and since the plurality of windows W11A to W13A are colored and translucent, the rear windows W12A and W13A can be visually confirmed by the user.

(4) Operation and Effect In the above configuration, the control unit 9 of the window display device 1 generates a three-dimensional virtual space VS for arranging a plurality of windows W1 to W7 in a three-dimensional manner, and includes a number of categories. Operation spheres SQ1 to SQ5 to be arranged in the associated three-dimensional virtual space VS are generated, and a plurality of windows W1 to W7 and a plurality of operation spheres SQ1 to SQ1 arranged three-dimensionally with respect to the three-dimensional virtual space VS. SQ5 is displayed on the display unit 5.

  At this time, the control unit 9 three-dimensionally displays the plurality of windows W1 to W7 using the depth direction of the three-dimensional virtual space VS, and displays the plurality of windows W1 to W7 in a colored translucent manner. As a result, the number of windows W can be displayed simultaneously without being restricted by the area of the screen screen of the display unit 5, and the contents can be recognized by the user.

  In this state, when the operation ball SQ5, for example, is selected from the operation balls SQ1 to SQ5, the control unit 9 displays only a plurality of windows W1, W3, W4, W5, and W6 belonging to the category of the operation ball SQ5 in the three-dimensional virtual space. It is raised from the VS and highlighted two-dimensionally in a form facing the screen screen of the display unit 5.

  As a result, the user can visually and surely recognize that a plurality of windows W1, W3, W4, W5, and W6 belong to the category of the operation ball SQ5 with a simple operation of selecting the operation ball SQ5. And intuitively and instantaneously determine what the file contents of the windows W1, W3, W4, W5 and W6 are based on the still images that make the window titles and contents of the windows W1, W3, W4, W5 and W6 image. Can be recognized.

  Thereafter, the user simply drags the cursor KS on the two-dimensional sprite SP1 and drags it over the windows W1, W3, W4, W5, and W6 belonging to the category of the operation ball SQ5, and performs a drop operation. The window W can be easily selected.

  The control unit 9 changes the angle of the three-dimensional virtual space VS in accordance with the movement of the cursor KS, or changes the angle of the three-dimensional virtual space KS based on the selected operation ball SQ5, and displays the screen AB2 after the angle change. As a result, the windows W1 to W7 can be presented in a direction that is easy for the user to see.

  According to the above configuration, the control unit 9 of the window display device 1 displays on the display unit 5 only the windows W belonging to the category of the selected operation ball SQ among the operation balls SQ1 to SQ5 associated with the category. Thus, it is possible to easily present the window W desired by the user from among the windows W that are selected by the user.

(5) Other Embodiments In the above-described embodiment, the case where the virtual space control unit 3 constructs a finite three-dimensional virtual space VS has been described. However, the present invention is not limited to this, A finite or infinite two-dimensional virtual surface may be used.

  In the above-described embodiment, the case where the windows W1 to W7 are intended for moving images, still images, text files, and the like has been described. However, the present invention is not limited to this, and video display such as music files is performed. You may make it target the content which does not do.

  Further, in the above-described embodiment, the case where the red window indicates a moving image, the blue window indicates a still image, and the white window indicates a text file has been described. However, the present invention is not limited to this. Various combinations may be set according to the file type, such as a yellow window indicating a music file or a green window indicating a game program. Various other display forms may be set, such as indicating.

  Furthermore, in the above-described embodiment, for example, when the operation sphere SQ5 is selected, only the two-dimensional sprite SP1 on which the operation sphere SQ5 is projected and displayed is displayed while being moved in accordance with the drag operation. The present invention is not limited to this, and the selected operation ball SQ5 itself may be displayed while being moved in accordance with the drag operation.

  Further, in the above-described embodiment, the case where the window display device of the present invention is mounted on a personal computer has been described. However, the present invention is not limited to this, and a PDA (Personal Digital Assistant) having a display, a mobile phone The window display device of the present invention may be mounted on other various electronic devices.

  Further, in the above-described embodiment, the case where the window display processing procedure in the window display device 1 is executed based on the window display program has been described, but the present invention is not limited to this, and the window display program stores the window display program. The window display processing procedure may be executed by installing in the window display device 1 via the storage medium.

  Further, in the above-described embodiment, the window display device of the present invention is configured by the virtual space control unit 3 as the virtual space generation unit, the display content determination unit 4 as the window enhancement unit, and the control unit 9 as the window recognition unit. However, the present invention is not limited to this, and the window display device may be configured using virtual space generating means, window emphasizing means, and window recognizing means having other various circuit configurations.

  The window display device and the graphical user interface according to the present invention can be applied to, for example, a purpose of searching a user-desired window from a plurality of windows in a short time.

It is a rough-line block diagram which shows the circuit structure of a window display apparatus. It is a basic diagram which shows a three-dimensional virtual space window screen. It is a basic diagram with which it uses for description of several window emphasis display (1) matched with the operation ball | bowl. It is a basic diagram with which it uses for description of several window emphasis display (2) matched with the operation ball | bowl. It is a basic diagram with which it uses for description of the selection method of a window by drag and drop. It is a flowchart which shows a window display processing procedure. It is a flowchart which shows the initialization process procedure. It is a flowchart which shows the drawing content determination processing procedure. It is a flowchart which shows an angle change process sequence. It is an approximate line figure used for explanation of angle change. It is a flowchart which shows the angle change process sequence based on a cursor position. It is a basic diagram which shows the structure of a window. It is a basic diagram with which it uses for description of three-dimensional deformation | transformation of a window. It is an approximate line figure used for explanation during dragging. It is an approximate line figure used for explanation after dragging.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Window display apparatus, 2 ... Input part, 3 ... Virtual space control part, 4 ... Display content determination part, 5 ... Display part, 6 ... Category management part, 7 ... Window attribute storage part, 9: Control unit, 10: Memory management unit.

Claims (6)

A plurality of windows respectively corresponding exists in multiple files, each window and window display means for displaying on the display means the plurality of windows that can belong to many categories simultaneously,
To generate a virtual space for arranging the plurality of windows in three dimensions to produce a plurality of operation sphere as a virtual object associated with each of said multiplicity categories, the category the plurality of operation spheres a virtual space generating means for three-dimensional display on the display means in a state of being arranged in the virtual space together with the name,
When an arbitrary operation sphere is selected in a state where the plurality of windows and the plurality of operation spheres arranged three-dimensionally with respect to the virtual space are displayed on the display unit, the virtual space of the operation sphere is selected. change the viewpoint with respect to the virtual space according to the position on the, at an angle corresponding to the viewpoint after the change and displays the plurality of windows, only the plurality of windows belonging to the category associated with the operation sphere Window highlighting means for highlighting after converting the virtual space from the virtual space to a two-dimensional plane ;
When the operation ball is dragged in a state of being selected to display while moving the operation ball itself, is that window when the operation ball is dropped operated on the highlighted the window of interest of the user And a window recognizing means for recognizing selection. The window recognizing means does not move the operation ball itself when the operation ball is dragged in a selected state, but the operation ball itself remains in the virtual space while the outline of the operation ball is left. A two-dimensional sprite displayed in a broken line is generated, displayed while moving only the two-dimensional sprite in accordance with the drag operation, and the two-dimensional sprite is dropped on the highlighted window intended by the user. When the window is selected
The window display device according to 請 Motomeko 1. It said window recognition means recognizes that the corresponding window is selected, and outputs open the file associated with the Window
Window display device according to 請 Motomeko 1. The window emphasizing means displays one of the left and right ends of the plurality of windows in the virtual space, tilted to the back side and spaced apart from each other, and dragged outward while the inner window is designated. When operated, the inner window changes the outer window into a bundled state.
The window display device according to 請 Motomeko 1. A plurality of windows each corresponding to a plurality of files, each window simultaneously belonging to many types of categories, a window display step of displaying the plurality of windows on the display means by the window display means ;
Virtual and generates the virtual space generation unit space, the number type of the virtual space generating means a plurality of operating sphere as a virtual object associated with each category for arranging the plurality of windows in three dimensions a virtual space generation step for stereoscopic display on the display means generate, in a state where the plurality of operation spheres were placed in the virtual space together with the category name by the virtual space generation means by,
When an arbitrary operation sphere is selected in a state where the plurality of windows and the plurality of operation spheres arranged three-dimensionally with respect to the virtual space are displayed on the display unit, the virtual space of the operation sphere is selected. change the viewpoint with respect to the virtual space according to the position on the, at an angle corresponding to the viewpoint after the change and displays the plurality of windows by the window enhancement means, belonging to the category associated with the operation sphere A window emphasizing step for emphasizing after converting only a plurality of windows from the virtual space to a two-dimensional plane ;
When the operation ball is dragged in a state of being selected to display while moving the operation ball itself, window recognition means when the operation ball is dropped operated on the highlighted the window of interest of the user window display method and a recognizing window recognition step that the window is selected by. On the computer,
A plurality of windows respectively corresponding exists in multiple files, each window and window display step of displaying on the display means the plurality of windows that can belong to many categories simultaneously,
To generate a virtual space for arranging the plurality of windows in three dimensions to produce a plurality of operation sphere as a virtual object associated with each of said multiplicity categories, the category the plurality of operation spheres a virtual space generation step for stereoscopic display on the display means in a state of being arranged in the virtual space together with the name,
When an arbitrary operation sphere is selected in a state where the plurality of windows and the plurality of operation spheres arranged three-dimensionally with respect to the virtual space are displayed on the display unit, the virtual space of the operation sphere is selected. change the viewpoint with respect to the virtual space according to the position on the, at an angle corresponding to the viewpoint after the change and displays the plurality of windows, only the plurality of windows belonging to the category associated with the operation sphere A window emphasizing step for emphasizing after converting the virtual space into a two-dimensional plane ;
When the operation ball is dragged in a state of being selected to display while moving the operation ball itself, is that window when the operation ball is dropped operated on the highlighted the window of interest of the user roux Indou display program to execute the recognizing window recognition step that has been selected.