JP2004102499A - Gui display unit, gui application development supporting device and method, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device and method for efficiently executing cursor movement processing based on a user input. <P>SOLUTION: This device is provided with a focus navigator for executing retrieval processing by a retrieval engine on the basis of cursor movement instruction input information and for deciding the cursor movement destination, and a focus manager for executing the movement processing of a cursor according to the movement destination instruction information of the cursor decided by the focus navigator. The focus navigator executes the cursor movement destination decision processing according to a cursor movement destination selection algorithm for selecting a single cursor movement destination on the basis of the cursor movement instruction input information. Thus, it is possible to efficiently decide the cursor movement destination based on the user input. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a GUI display device, a GUI application development support device and method, and a computer program. More specifically, a GUI display device and a GUI application development support device that enhance the visual effect by performing animation display on a cursor displayed on a graphical user interface (GUI) and enable easy display of a cursor position or cursor movement. , And methods, and computer programs.
[0002]
[Prior art]
2. Description of the Related Art In PCs, communication terminals, various information home appliances, etc., displays such as CRTs and LCDs are used as user interfaces for data display or data input / output. On such a display, for example, a screen image in which functions according to the usage form of the information home appliance are set is displayed as a graphical user interface (GUI). In the GUI, various functions are set, such as arrangement of input buttons, setting of a data input field, or processing when a button is pressed, and various image settings of a display screen are performed. As a programming language for developing an application program for setting the design and functions of such a user interface screen, Sun Microsystems, Inc. Are widely used.
[0003]
A program written in the Java language is converted into byte code (Byte Code) as a Java executable file format independent of a computer and a platform, read by a Java virtual machine (Java VM), and subjected to machine language conversion (interpreter). It is executed on a simple device.
[0004]
In Java, in order to easily produce application software in a short time, software components that do not need to be recompiled are prepared in advance, and a program is created by combining the components. In Java, a technology for reusing these components (Java Beans) has been constructed.
[0005]
Parts are set in units of various components such as windows, buttons, lists, combo boxes, and text input fields to be displayed on a display, and these parts (components) are used as attribute information such as button shapes and arrangement information. "Property", "method" as processing as a result of an action on a part, and further, when an action on a part, for example, data arrival, interrupt occurrence, property change, method call, etc. occurs, an event is sent to another part. An "event" as a function of contact is defined. These “properties”, “methods”, and “events” are component requirements of Java beans.
[0006]
The minimum execution unit of Java is called a "class", and a Java program is generated by one or more classes. The class has variables (Variable) as data and methods (Method) as operations. The program component set as this class can be transferred to and stored in a PC or information home appliance via a network such as the Internet or a LAN, and the device storing the class file does not depend on the platform. A Java virtual machine can execute a program stored in a class file.
[0007]
An important element of the GUI is a cursor or pointer. The cursor or pointer moves based on input information from, for example, a mouse as a user input device, a keyboard, or a cross key of a remote controller or the like, and indicates valid input position information. In the following description, a cursor is used as a generic term for a concept including a cursor and a pointer. For example, when the cursor is moved using a mouse, it is possible to move the cursor in an arbitrary direction according to the movement of the mouse trackball. However, the cursor is moved by key input such as a keyboard and a cross key. In this case, the movement direction is determined based on only four types of directions, up, down, left, and right, and the movement according to the user's intention is not always performed.
[0008]
Various information home appliances are assumed to be devices equipped with a GUI. However, these information home appliances are rarely configured to have input means such as a mouse. In many cases, a cross key is provided. When a cursor movement instruction is performed based on such a simple input device, it is preferable that the cursor be immediately set to a destination button or the like based on the user's movement instruction input.
[0009]
[Problems to be solved by the invention]
SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and a component to be moved immediately, such as a component to be moved, based on a cursor movement instruction input information from a user, for a movable cursor in a graphical user interface (GUI). Provided are a GUI display device, a GUI application development support device, a method, and a computer program which can determine a destination of a button, a list, a combo box, etc., and set a cursor on a component of the destination. Aim.
[0010]
[Means for Solving the Problems]
According to a first aspect of the present invention,
A GUI display device that executes a control process of a cursor displayed on a display,
A focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination;
A focus manager that executes cursor movement processing according to the cursor movement destination instruction information determined by the focus navigator;
The GUI display device is characterized in that the focus navigator is configured to execute a cursor movement destination determination process in accordance with a cursor movement destination selection algorithm for selecting a unique cursor movement destination based on the cursor movement instruction input information.
[0011]
Further, in one embodiment of the GUI display device of the present invention, the cursor movement instruction input information is movement direction instruction information in one of four directions, up, down, left and right, and the cursor movement destination selection algorithm executed by the focus navigator includes the following. It is an algorithm for executing a process of determining a unique component from a plurality of components existing in a direction corresponding to the movement direction instruction information as a cursor movement destination.
[0012]
Further, in one embodiment of the GUI display device of the present invention, the cursor destination selection algorithm executed by the focus navigator includes a coordinate information acquiring process for each component displayed on the display, and the cursor is moved based on the acquired coordinate information. It is an algorithm that executes a process of determining a destination.
[0013]
Further, in one embodiment of the GUI display device of the present invention, the cursor movement instruction input information is movement direction instruction information in one of four directions, up, down, left and right, and the cursor movement destination selection algorithm executed by the focus navigator includes the following. It is an algorithm for selecting a component located at the shortest distance from the current cursor setting component among a plurality of components existing in a direction corresponding to the movement direction instruction information.
[0014]
Further, in one embodiment of the GUI display device of the present invention, the cursor movement instruction input information is movement direction instruction information in any of four directions, up, down, left and right, and the cursor movement destination selection algorithm executed by the focus navigator includes: It is an algorithm for selecting the component at the end from among a plurality of components existing in the direction corresponding to the direction indication information.
[0015]
Further, a second aspect of the present invention provides
A GUI application development support device for supporting development of a GUI application having cursor movement instruction information on a graphical user interface (GUI),
A focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination, and a focus manager that executes a cursor movement process according to the cursor movement destination instruction information determined by the focus navigator. , An editing processing unit to be set as a cursor control program,
The editing processing unit,
A GUI application development support device is configured to execute a setting process of a cursor destination selection algorithm for selecting a single cursor destination based on cursor movement instruction input information for the focus navigator.
[0016]
Further, in one embodiment of the GUI application development support device of the present invention, the editing processing unit performs cursor movement of a single component from a plurality of components existing in a direction corresponding to one of four directions of up, down, left, and right. It is characterized in that an algorithm for executing the process to be determined is set for the focus navigator.
[0017]
Further, in one embodiment of the GUI application development support device of the present invention, the editing processing unit acquires coordinate information of each component displayed on the display, and determines a cursor moving destination based on the acquired coordinate information. Is set for the focus navigator.
[0018]
Further, in one embodiment of the GUI application development support device of the present invention, the editing processing unit is configured to select from a current cursor setting component among a plurality of components existing in a direction corresponding to any one of four directions, up, down, left, and right. An algorithm for selecting a component located at the shortest distance is set for the focus navigator.
[0019]
Further, in one embodiment of the GUI application development support device of the present invention, the editing processing unit is located at the end of a plurality of components existing in a direction corresponding to any one of four directions, up, down, left, and right. An algorithm for selecting a component is set for the focus navigator.
[0020]
Further, a third aspect of the present invention provides
A GUI display cursor movement processing method for executing control processing of a cursor displayed on a display,
Executing a search processing by a search engine based on the cursor movement instruction input information, and determining a cursor movement destination;
A cursor movement processing step of executing a cursor movement process in accordance with the cursor movement instruction information determined in the cursor movement destination determination step, wherein the cursor movement destination determination step is based on the cursor movement instruction input information. A GUI display cursor movement processing method characterized by executing a cursor movement destination determination process according to a cursor movement destination selection algorithm for selecting only one cursor movement destination.
[0021]
Further, in one embodiment of the GUI display cursor movement processing method of the present invention, the cursor movement instruction input information is movement direction instruction information in one of four directions, up, down, left and right, and the cursor movement executed in the cursor movement destination determination step. The pre-selection algorithm is an algorithm for executing a process of determining a unique component from a plurality of components existing in a direction corresponding to the movement direction instruction information as a cursor movement destination.
[0022]
Further, in one embodiment of the GUI display cursor movement processing method of the present invention, the cursor movement destination selection algorithm executed in the cursor movement destination determination step includes a coordinate information obtaining process of each component displayed on the display, It is an algorithm for executing a process of determining a cursor destination based on information.
[0023]
Further, in one embodiment of the GUI display cursor movement processing method of the present invention, the cursor movement instruction input information is movement direction instruction information in one of four directions, up, down, left and right, and the cursor movement executed in the cursor movement destination determination step. The preselection algorithm is an algorithm for selecting a component located at the shortest distance from the current cursor setting component among a plurality of components existing in a direction corresponding to the movement direction instruction information.
[0024]
Further, in one embodiment of the GUI display cursor movement processing method of the present invention, the cursor movement instruction input information is movement direction instruction information in one of four directions, up, down, left and right, and the cursor movement executed in the cursor movement destination determination step. The first selection algorithm is characterized in that it is an algorithm that selects the component at the end from among a plurality of components existing in the direction corresponding to the movement direction instruction information.
[0025]
Further, a fourth aspect of the present invention provides
A method for generating a GUI application program having cursor movement instruction information on a graphical user interface (GUI),
A focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination, and a focus manager that executes a cursor movement process according to the cursor movement destination instruction information determined by the focus navigator. , Having an editing processing step for setting as a cursor control program,
The editing processing step includes:
A method for generating a GUI application program includes a step of executing a setting process of a cursor movement destination selection algorithm for selecting a unique cursor movement destination based on cursor movement instruction input information for the focus navigator.
[0026]
Further, in one embodiment of the GUI application program generating method of the present invention, the editing processing step includes moving a single component from a plurality of components existing in a direction corresponding to one of four directions, up, down, left, and right, with a cursor. Setting an algorithm for executing the process to be determined as the focus navigator in the focus navigator.
[0027]
Further, in one embodiment of the method for generating a GUI application program of the present invention, the editing processing step obtains coordinate information of each component displayed on the display, and determines a cursor moving destination based on the obtained coordinate information. Is set for the focus navigator.
[0028]
Further, in one embodiment of the GUI application program generating method according to the present invention, the editing processing step includes, among a plurality of components existing in a direction corresponding to the movement direction instruction information in four directions, up, down, left, and right, from the current cursor setting component. Setting an algorithm for selecting a component located at the shortest distance to the focus navigator.
[0029]
Further, in one embodiment of the GUI application program generating method according to the present invention, the editing processing step is located at an extreme end of a plurality of components existing in a direction corresponding to any one of four directions, up, down, left, and right. Setting an algorithm for selecting a component in the focus navigator.
[0030]
Furthermore, a fifth aspect of the present invention provides
A computer program for executing a GUI display process for executing a control process of a cursor displayed on a display, comprising:
Executing a search processing by a search engine based on the cursor movement instruction input information, and determining a cursor movement destination;
A cursor movement processing step of executing a cursor movement process in accordance with the cursor movement instruction information determined in the cursor movement destination determination step, wherein the cursor movement destination determination step is based on the cursor movement instruction input information. A computer program characterized by including a step of executing a cursor destination determination process in accordance with a cursor destination selection algorithm for selecting a unique cursor destination.
[0031]
Further, a sixth aspect of the present invention provides
A computer program for executing a GUI application program generation process having cursor movement instruction information on a graphical user interface (GUI),
A focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination, and a focus manager that executes a cursor movement process according to the cursor movement destination instruction information determined by the focus navigator. , Having an editing processing step for setting as a cursor control program,
The editing processing step includes:
A computer program characterized by including a step of executing a cursor destination selection algorithm setting process for selecting a single cursor destination based on cursor movement instruction input information for the focus navigator.
[0032]
[Action]
A GUI display device according to the present invention executes a search process by a search engine based on cursor movement instruction input information, and determines a cursor navigator according to a focus navigator that determines a cursor destination, and a cursor navigator according to the cursor destination instruction information determined by the focus navigator. A focus manager that executes a moving process, and the focus navigator is configured to execute the cursor moving destination determining process according to a cursor moving destination selecting algorithm that selects only one cursor moving destination based on the cursor moving instruction input information. Even if the user input is only input of setting information with a coarse moving direction such as a cross key, it is possible to immediately determine the destination based on the user input, and the user can finely control the cursor movement. There is no need to do.
[0033]
Further, in the GUI application development support device of the present invention, the edit processing unit determines a focus navigator in which a cursor destination selection algorithm for selecting a unique cursor destination based on cursor movement instruction input information and a focus navigator are determined. A focus manager that executes cursor movement processing in accordance with cursor movement destination instruction information is configured to be set as a cursor control program. Therefore, by changing and setting the mode of the cursor movement destination selection algorithm, for example, the current cursor setting The cursor can be moved in various forms, such as an algorithm for selecting the component located at the shortest distance from the component, and an algorithm for selecting the component located at the end of a plurality of components existing in the direction corresponding to the movement direction instruction information. It becomes possible to easily generate a GUI application program.
[0034]
The computer program of the present invention is provided, for example, in a computer-readable format for a general-purpose computer system capable of executing various program codes, in a storage medium or communication medium such as a CD, FD, or MO. And a computer program that can be provided by a communication medium such as a network. By providing such a program in a computer-readable format, processing according to the program is realized on a computer system.
[0035]
Further objects, features, and advantages of the present invention will become apparent from a more detailed description based on embodiments of the present invention described below and the accompanying drawings. In this specification, the term “system” refers to a logical set of a plurality of devices, and is not limited to a device having each configuration in the same housing.
[0036]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, a GUI application development support device, a GUI display device, a method, and a computer program of the present invention will be described in detail with reference to the drawings.
[0037]
[1. Hardware configuration]
First, an example of a hardware configuration of a GUI application development support device of the present invention will be described with reference to FIG. Each component in the GUI application development support device 100 will be described with reference to FIG. A CPU (Central Processing Unit) 101 which is a main controller of the GUI application development support device 100 executes various GUI application development programs under the control of an operating system (OS). The CPU 101 performs, for example, execution of program creation processing based on the Java language, specifically, setting of functions of components set on the GUI screen such as buttons and combo boxes, and setting processing of display images. As shown, the CPU 101 is interconnected with other components by a bus 107.
[0038]
The memory 102 is a storage device used to store a program code executed by the CPU 101 and temporarily store work data being executed. The memory 102 shown in FIG. 1 includes both a nonvolatile memory such as a ROM and a volatile memory such as a DRAM.
[0039]
The graphics processing chip 150 is a chip in which a dedicated processing circuit for executing color arrangement processing for various GUI components is incorporated.
[0040]
The display controller 103 as a display control unit is a dedicated controller for actually processing a drawing command issued by the CPU 101. The drawing data processed by the display controller 103 is temporarily written to, for example, a frame buffer (not shown) and then output to the screen by the display 108. For example, an image reproduced from the HDD (111) and an image processed by the CPU 101 are displayed on the screen of the display 108, so that the user can see the presentation screen.
[0041]
The input device interface 104 is a device for connecting user input devices such as a keyboard 109 and a mouse 110 to the GUI application development support device 100. The user can input a command for processing or displaying an image via the keyboard 109 and the mouse 110.
[0042]
The network interface 105 can connect the GUI application development support device 100 to a local network such as a LAN (Local Area Network) or a wide area network such as the Internet according to a predetermined communication protocol such as Ethernet.
[0043]
On a network, a plurality of host terminals and servers (not shown) are connected in a transparent state, and a distributed computing environment is constructed. On the network, distribution services such as software programs and data contents can be provided. For example, image data can be downloaded to the HDD (111) via a network from another server storing moving images, still images, and the like.
[0044]
The external device interface 106 is a device for connecting an external device such as a digital camera or a hard disk drive (HDD) 111 or a media drive 112 to the GUI application development support device 100.
[0045]
The HDD 111 is an external storage device in which a magnetic disk as a storage medium is fixedly mounted, is excellent in storage capacity, data transfer speed, and the like, and is capable of random access. For example, a program can be installed on the HDD 111 in a state where the software program can be executed. In the HDD 111, a program code of an operating system to be executed by the CPU 101, an application program, a device driver, and the like are stored in a nonvolatile manner.
[0046]
The media drive 112 is a device for loading a portable medium 160 such as a CD (Compact Disc), an MO (Magneto-Optical Disc), and a DVD (Digital Versatile Disc) and accessing a data recording surface thereof.
[0047]
The portable medium 160 is mainly used for backing up software programs, data files, and the like as computer-readable data, and for transferring them between systems (that is, including sales, distribution, and distribution). . Application programs for performing various processes can be physically distributed and distributed among a plurality of devices by using these portable media.
[0048]
The apparatus as shown in FIG. 1 can be realized as a compatible machine or a successor of a personal computer "PC / AT (Personal Computer / Advanced Technology)" of IBM Corporation in the United States. Of course, a computer having another architecture can be applied.
[0049]
[2. Functional configuration]
Next, a functional configuration of a GUI application development support apparatus of the present invention for developing a GUI application by separately configuring a logical portion of each component set in a graphical user interface (GUI) and a graphics expression portion. Will be described with reference to FIG.
[0050]
As shown in FIG. 2, the GUI application development support device of the present invention is a component storage that stores various components such as buttons, combo boxes, lists, windows, and text boxes set on a screen as a user interface. It has a part 200. The component storage unit 200 includes a logical component storage unit 201, a graphics expression component storage unit (simple) 202, and a graphics expression component storage unit (rich) 203.
[0051]
The logical component storage unit 201 is a component that stores logical information on various components (components) such as buttons, combo boxes, lists, windows, and text boxes set on a screen as a user interface. For example, if it is a button, it is configured as a software program component that defines functions such as a process when the button is turned on and a process when the button is turned off.
[0052]
On the other hand, a graphics expression component storage unit (simple) 202 and a graphics expression component storage unit (rich) 203 store display image information of components, that is, are configured as software program components that store a graphics expression program. Is done. The graphics expression component storage unit (simple) 202 and the graphics expression component storage unit (rich) 203 are components that store programs for executing different graphics expressions.
[0053]
The image data storage unit 205 stores, for example, image data such as jpeg and gif. By associating the image data with the graphics expression component of each component, an animation display based on the image data according to various operations of the component becomes possible. These animation setting processes will be described later.
[0054]
The operator as the developer of the GUI application program executes various data inputs to the editing processing unit 210 via the data input / output unit 220, and sets the functions of the components such as buttons and combo boxes and the graphic image. To build a GUI component.
[0055]
The component creation processing execution program is, for example, one class (factory class) of a Java program. The edit processing unit 210 executes a factory class to create various components. The processing in the editing processing unit 210 is a processing executed under the control of the CPU 101 in the hardware configuration diagram of FIG.
[0056]
The component (component) includes, for example, a “property” as attribute information such as a button shape and arrangement information, a “method” as a process as a result of an action on the component, and an action on the component, for example, data arrival, interruption occurrence, property When a change, a method call, or the like occurs, the editing processing unit 210 edits the event as a GUI component that defines an "event" as a function of communicating an event to another component.
[0057]
The editing processing unit 210 includes a property editing unit 211 for editing properties set for a component, a method editing unit 212 for editing a method, and an event editing unit 213 for editing an event.
[0058]
When setting the appearance of the generated GUI component, that is, the graphics expression, the operator inputs Look & Feel package designation data to the editing processing unit 210 that executes the factory class. That is, either "rich" or "simple" is designated.
[0059]
A factory class is executed in the editing processing unit 210 in accordance with the specified data, and any one of the graphic expression component storage unit (simple) 202 and the graphic expression component storage unit (rich) 203 is selected in accordance with the specified data. The corresponding program component is read, and a component is created together with the read component of the logical component storage unit 201.
[0060]
For example, when a GUI component for a button is generated, a button component is read from the logical component storage unit 201 that stores a component that stores logical information about the component (component), and further, Look & Feel package designation data from the operator, that is, , "Rich" or "simple", according to the designated data, the graphics expression component storage unit (simple) 202 or the graphics expression component storage unit (rich) 203 stores a button graphics expression program. The component is read out, and one button component is generated by combining the logic component with either the "rich" or "simple" graphics expression component.
[0061]
Similar editing processing is executed for various parts (components) other than buttons, such as combo boxes, lists, windows, and text boxes. After the editing processing, the set GUI application program is stored in the program storage unit 221. Then, the GUI executed by the program execution unit 222 and generated is displayed on the display unit 223.
[0062]
In the above-described embodiment, an example has been described in which only two types of components, each storing a graphics expression program, "simple" and "rich" are set, but these types may be set as an arbitrary number of three or more. The operator can also input any specified data of the set graphics expression component, select the graphics expression component according to the specified data, and create various GUI components.
[0063]
[3. Processing sequence]
Next, a procedure of a process of generating a GUI component by applying the GUI application development support device of the present invention will be described with reference to FIGS.
[0064]
FIG. 3 is a diagram showing a processing sequence for generating a GUI component by selecting “simple” of a graphics expression component. FIG. 3 shows, from the left, processing of an operator, a GUI generation application, a component factory, a graphics expression part, and a logical part. Note that the processing of the graphics expression part and the logic part corresponds to the execution of a program stored in a read part of the graphics expression part storage unit (simple) 202 and the logical part storage unit 201 shown in FIG. The processing and the processing of the component factory are executed in the editing processing unit 210 of FIG.
[0065]
First, in step S101, the operator inputs a GUI component generation command (Create) to the GUI generation application. This GUI component generation command (Create) is input together with data specifying a component type, for example, a component type such as “button”, “list”, “combo box”, “radio button”, or “window”. .
[0066]
Further, in step S102, "Look &Feel" designation for designating a graphics expression is output from the operator to the component factory via the application. Here, it is assumed that “Simple” is designated as “Look & Feel” designation.
[0067]
Next, in step S103, a component generation command is output from the application to the component factory. This command includes identification data indicating the component type specified in step S101.
[0068]
In step S104, a component generation instruction (Create) is output from the component factory for the graphic expression part (simple) and the logical part, and the component generation is executed according to the storage program of the logical part and the graphic expression part.
[0069]
The processing after step S105 shows a processing sequence in the case where the application executes a component processing, for example, a command to open a “window” as a component. The component open processing instruction from the application is passed to the logic part, and a paint command is passed to the graphics representation part (simple) based on the execution of the program of the logic part. The graphics expression part (simple) executes the paint processing of the component according to the input instruction from the logical part.
[0070]
Here, since the graphics expression portion applied to the component generation is “simple”, the generation component displayed on the display, that is, the button or the like has a simple configuration in which only the color setting by Paint is performed.
[0071]
Next, a processing sequence for generating a GUI component by selecting “rich” of a graphics expression component will be described with reference to FIG. As in FIG. 3, from the left, the processing of the operator, the GUI generation application, the component factory, the graphics expression part, and the logical part are shown. As in FIG. 3, the processing of the graphics expression part and the logic part corresponds to the execution of the program stored in the read parts of the graphics expression part storage unit (simple) 202 and the logical part storage unit 201 shown in FIG. , These processes, and the process of the component factory are executed in the editing processing unit 210 of FIG.
[0072]
First, in step S201, the operator inputs a GUI component generation command (Create) to the GUI generation application. This GUI component generation command (Create) is input together with data specifying a component type, for example, a component type such as “button”, “list”, “combo box”, “radio button”, or “window”. .
[0073]
Further, in step S202, "Look &Feel" designation for designating a graphics expression is output from the operator to the component factory via the application. Here, it is assumed that “Rich” is specified as “Look & Feel”.
[0074]
Next, in step S203, the application outputs a component generation command to the component factory. This command includes identification data indicating the component type specified in step S201.
[0075]
In step S204, a component generation instruction (Create) is output from the component factory for the graphic expression part (simple) and the logical part, and the component is generated according to the storage program of the logical part and the graphic expression part (rich). You.
[0076]
The processing after step S205 shows a processing sequence in the case where the application executes a component processing, for example, a command to open a “window” as a component. The component open processing instruction from the application is passed to the graphics expression part, and the animation is executed based on the execution of the animation program stored in the graphics expression part (S206).
[0077]
Further, in step S207, the open processing instruction is passed to the logic part, and based on the execution of the program of the logic part, the paint (Paint) instruction is passed to the graphics expression part (simple), and the graphics expression part (rich) ) Executes the paint process of the component according to the input instruction from the logical part.
[0078]
In the sequence diagram shown in FIG. 4, since the graphics expression portion applied to the component generation is "rich", the generation component displayed on the display, that is, the button, etc., is only if the color setting by Paint is performed. Instead, the animation expression is executed.
[0079]
[4. File configuration example]
An example of a file configuration for executing component display as described above will be described.
[0080]
For example, as an example of a GUI component, the following files are required as a file in the case of configuring a button control [Buttoncon] component as a GUI component as an icon having a button function.
[0081]
CB Buttcon. java: a class that implements the logic part of the button control,
Buttcon. Java: a class that implements a Look & Feel part as a graphics expression part of a button-con,
buttcon_normal_off. gif: image when button control is “off”,
buttcon_normal_on. gif: Image when button control is “ON”,
buttcon_pushed. gif: image when button control is pressed,
CComponentFactory. java: a factory class used by the application to create a button
Application. Java: An application for displaying the created button control.
The class indicates a Java execution unit program.
[0082]
FIG. 5 shows the directory structure of each of the above files. Below a certain GUI application file [application] is a [customtoolkit] file as a toolkit, and in this file, CButtcon. Java: a class that implements the logic part of the button control, and CComponentFactory. Java: Contains a factory class used by an application to create a button controller, and further includes a Look & Feel file [laf] file as graphics expression information.
[0083]
The Look & Feel file [laf] contains Buttcon. Java: A class that implements a Look & Feel portion as a graphics expression part of a button controller, that is, a class corresponding to the above-described graphics expression component is included. Further, as an image data file [image], a buttoncont_normal_off. gif: image when the button controller is “off”, buttcon_normal_on. gif: image when the button controller is “ON”, buttcon_pushed. gif: each image when the button is pressed.
[0084]
The GUI application program executes processing applying the processing program and image data included in each of these files according to the input information of the user. Specifically, both various function execution processing according to the program of the logic component class and various graphics expression processing according to the program of the graphics expression component class are executed.
[0085]
[5. Display example]
Next, a display process example of a GUI component generated based on a configuration in which a logical portion of each component and a graphics expression portion are separated will be described with reference to FIGS.
[0086]
FIG. 6 shows an example in which each component is generated and displayed by applying a graphics expression part (simple). A description will be given by taking a button 311 and a combo box 312 as examples of GUI components.
[0087]
When the operation of the button 311 is performed, for example, on / off of the button, or focus setting, that is, cursor setting, processing based on the on / off operation of the button is executed by processing of the logical part of the button component. Further, in response to, for example, a paint command from the logical portion, the graphics expression portion (simple) is executed, and the paint process, that is, the process of changing the display color of the button is performed.
[0088]
When the operation of the combo box 312, for example, opening / closing of the combo box 312, is performed, processing based on the opening / closing operation of the combo box is executed by the processing of the logical part of the combo box component. Further, the graphics expression portion (simple) of the combo box component is executed by a paint command from the logical portion, for example, and paint processing, that is, processing such as changing the display color of the combo box is performed.
[0089]
It should be noted that what kind of graphics expression is to be executed by the processing from the operator can be set differently depending on each GUI component. That is, by changing the processing program of the graphics expression part (simple), the graphics expression processing corresponding to each component can be performed.
[0090]
FIG. 7 shows an example in which each component is generated and displayed by applying a graphics expression part (rich). The button 320 and the combo box 330 will be described as examples of GUI components.
[0091]
When the operation of the button 320, for example, the on / off operation of the button or the focus setting, that is, the cursor setting, is performed, in addition to the above-described paint processing, the processing of the animation 321 and 322 is performed as the processing of the graphic expression part (rich) of the button component Execution is performed. Although it is difficult to understand in the figure, an animation is executed in which the ripples spread around the buttons in (b) and (c). The processing based on the ON / OFF operation of the button is executed by the processing of the logical part.
[0092]
Further, when the operation of the combo box 330, for example, opening / closing of the combo box 330 is performed, the processing based on the opening / closing operation of the combo box is executed by the processing of the logical part of the combo box component, and The animations 331 and 332 are executed as the processing of the graphics expression part (rich). Although it is difficult to understand in the figure, in (b) and (c), an animation set so as to spread downward at the bottom of the combo box is executed.
[0093]
[6. Animation setting and execution processing]
Next, processing for setting animations for various GUI components such as windows, buttons, combo boxes, and lists and executing the same will be described.
[0094]
FIG. 8 is a diagram showing a processing screen for setting image data for causing a component to execute an animation. A component [button (Button)] is set in the component designation field 351, and an image data setting field 352 is formed in the lower part. The calling image (Jpeg) in each component state at the time of (Focus) setting or the like has a configuration that can be individually set. Note that when the focus is set, the cursor is set to the component and the component is in an operable state such as on or off.
[0095]
For example, when an ON process is performed, an animation index method is called and executed according to a program specified in the graphics expression component. By executing the animation index method, the Jpeg images 11 to 21 are read from the image file [Image], and the button images displayed on the GUI are animated based on the plurality of images. When the processing of OFF is executed, the Jpeg images 31 to 38 are read from the image file [Image], and the image of the button displayed on the GUI is animated based on the plurality of images.
[0096]
Note that the example shown in FIG. 8 shows an example in which the component state has four states: normal (Normal), on (On), off (Off), and focus (Focus). The present invention is not limited to this. For example, the following definitions may be used, and the image data may be set according to each state.
NORMAL: Normal state
NORMAL DEACTIVATED: Inactive normal state
FOCUSED: Focus state
FOCUSED DEACTIVATED: Inactive normal state
PUSHED: Push state
PUSHED DEACTIVATED: Inactive push state
DISABLED: Inoperable state
DISABLED DEACTIVATED: An inactive and inoperable state.
By setting different animation constituent image data in association with each of the above eight states, the user can grasp the state of the component according to the animation. Note that the inactive state indicates a state in which the state is displayed in a window that is not the operation target.
[0097]
As described above, it is possible to set individual image files corresponding to processes for each component, and it is possible to freely set an optimal animation expression according to various processes. Although the figure shows an example in which an animation is set for a button, animations corresponding to various processes can be similarly set for other components.
[0098]
For example, in the case of an animation when the combo box is opened and an animation when the combo box is closed, each animation is set by individually selecting and setting an image from an image file.
[0099]
The GUI application development support device for executing the animation display setting process by setting the image data corresponding to the state of each component described above is realized by the configuration described above with reference to FIGS. Further, a processing configuration limited to a function for executing a setting process of an image file according to each component state will be described with reference to a block diagram shown in FIG.
[0100]
As shown in FIG. 9, the GUI application development support device includes a component storage unit 400 storing various components such as buttons, combo boxes, lists, windows, and text boxes set on a screen as a user interface. The component storage unit 400 has a logical component storage unit 401 as a software program component that defines the processing function of the component, and a graphics expression component storage unit 402 as a software program component that defines the graphics expression of the component. Note that the graphics expression component can be configured as a plurality of different components that execute a plurality of types of graphics expression such as simple and rich as described above.
[0101]
The image data storage unit 403 stores image data read out according to an animation index method called by executing a graphics expression class as a program stored in the graphics expression component stored in the graphics expression component storage unit 402. ing. The image data is, for example, a data file such as jpeg or gif, and corresponds to each of the graphics expression components stored in the graphics expression component storage unit 402.
[0102]
An operator as a developer of the GUI application program executes various data inputs to the editing processing unit 410 via the data input / output unit 420 and sets functions of each component such as a button and a combo box, and a graphic image. To build a GUI component.
[0103]
The component creation processing execution program is, for example, one class (factory class) of a Java program. The edit processing unit 410 executes a factory class to create various components. Note that the processing in the editing processing unit 410 is processing executed under the control of the CPU 101 in the hardware configuration diagram of FIG.
[0104]
In the animation setting process, as described with reference to FIG. 8, the editing processing unit 410 executes a process of associating image data to be read according to the state of the component. This process is executed as a part of the editing process of the “property”, “method”, and “event” of the component.
[0105]
When setting the appearance of the generated GUI component, that is, the graphics expression, the operator inputs Look & Feel package designation data to the editing processing unit 410 that executes the factory class. That is, either "rich" or "simple" is designated, and, as described with reference to FIG. 8, image data to be read is set according to the state of the component.
[0106]
According to these setting information, a GUI application program having various components is generated, the generated GUI application program is stored in the program storage unit 421, executed by the program execution unit 422, and the generated GUI is displayed on the display unit 423. Is displayed.
[0107]
The processing at the time of executing the animation, that is, the processing in the GUI display device will be described with reference to FIG. Display processing of the animation 514 of a button as a GUI component displayed on the display 513 will be described.
[0108]
For example, if the component is a button component, the animation display process is executed by the graphics expression class 511 of the graphics expression component included in the button component. The animation index method is called in accordance with the program specified in the graphics expression class 511, and the Jpeg images 11 to 21 set in the setting processing described above with reference to FIG. 8 are read from the image file [Image] 512. In rare cases, an image of a button displayed as a GUI based on the plurality of images is displayed as an animation 514.
[0109]
Here, an example is shown in which an animation in which ripples spread around the button is displayed. Note that the image file [Image] 512 can be set as an image file storage unit by securing a partial area of the memory 102, the HDD 111, and other storage units of the hardware configuration in FIG. 1, and can be stored.
[0110]
The above-described processing is summarized as an animation display processing method sequence of a GUI component for displaying on a display.
(1) a class execution step of executing a graphics expression class of a graphics expression component associated with the component;
(2) an image reading step for reading preset image data from the image file according to the animation index method called in the class execution step;
(3) displaying the image data read in the image reading step on a display;
Are summarized as execution steps. These processing steps are recorded as an execution program of the GUI application, and are executed according to the GUI operation by the user, that is, an animation is displayed.
[0111]
Various animations of components such as buttons can be easily set by changing the call image data. For example, as an operation such as ON and OFF, various animation settings such as generation of distortion in the uneven shape of the tongue and change of color can be performed. It is also possible to have a configuration in which the animation is continuously executed when the cursor is in the set focus state, not only during the operation such as ON and OFF. This is realized by calling the animation index method and reading and executing the focus image file from the image data on condition that the cursor position overlaps the button component position.
[0112]
As described with reference to FIG. 2, the graphics expression component storage unit stores a plurality of graphics expression components storing different graphics expression processing execution programs even with the same component such as simple or rich, for example, a button. Is prepared. In the example of FIG. 2, only two types, that is, simple and rich, are shown, but a plurality of graphic expression components such as rich 1, rich 2,... Can be set.
[0113]
Each of these graphics expression parts can be associated with a different individual readout image file. Even if the buttons have the same function, the graphics expression parts to be applied by specifying the first Look & Feel package are not used. The animation determined and set in association with the part is displayed. Therefore, it is possible to perform various different animation displays according to the specification of the Look & Feel package.
[0114]
[7. Cursor animation expression]
As described above, the components such as buttons and combo boxes each have a logical part and a graphics expression part as individual software programs, and the graphics expression program is a simple, rich, etc. file from a plurality of types of files. It has a selectable configuration.
[0115]
Next, a description will be given of graphics representation processing of a cursor that can be moved in accordance with an input from an input unit such as a mouse, a keyboard, or a cross key composed of up, down, left, and right instruction keys. In this specification, a cursor is used as a generic term of identification display indicating a designated position on a window, and is described as a combination of, for example, concepts of a pointer, a cursor, and the like. When the cursor is located at various component positions such as a button, a list, and a combo box, the component is said to be in a focused state.
[0116]
As described above, regarding the graphic representation of the component, according to the state of the component, specifically, according to various states such as, for example, when the component is a button, the button component is in a push state or in a focus state. The image files set individually are read out, and animation display is executed according to the read image files.
[0117]
The cursor can be used not only when the cursor is positioned on a specific component, that is, when the component is focused, but also when moving between components, for example, when moving the cursor from one button component to another. Also perform an animation expression.
[0118]
The processing for setting these various animations according to the state of the component at the cursor or the cursor setting position can be executed by substantially the same processing as the above-described processing of setting an image file according to the state of the component. The GUI application development support device that executes this setting process is realized by the configuration described above with reference to FIGS. 1 and 2, but has a function for executing the image file setting process according to the cursor. The processing configuration limited to is described with reference to the block diagram shown in FIG.
[0119]
As shown in FIG. 11, the GUI application development support device includes a component storage unit 560 that stores various components such as buttons, combo boxes, lists, windows, and text boxes set on a screen as a user interface. The component storage unit 560 includes a logical component storage unit 561 and a graphics expression component storage unit 562. The graphics expression component storage unit 562 includes a cursor-related graphics expression program file that stores a program related to graphics expression in the cursor or the cursor setting component.
[0120]
The image data storage unit 563 is a storage unit that stores animation / image data that can be read in accordance with the execution of the graphics expression program. The image data storage unit 563 displays a cursor image, an image when a cursor is set on a component, that is, an image at the time of focus setting, and an arrow (arrow) indicating a movable direction of the cursor set on the component described later. Arrow (arrow) display image is included. The image data is, for example, an image data file such as jpeg or gif.
[0121]
An operator as a developer of the GUI application program inputs various data, commands, and parameters to the editing processing unit 570 via the data input / output unit 580, and executes the input according to the component state of the cursor or the cursor setting position. A process of associating the image data to be read is executed.
[0122]
The edit processing unit 570 executes, for example, a search process by a search engine based on the cursor movement instruction input information to determine a cursor movement destination, and a cursor movement processing in accordance with cursor movement destination instruction information determined by the focus navigator. A cursor manager for executing a process of setting a cursor control program as a cursor control program, and further, for a focus navigator, setting of a cursor movement destination selection algorithm for selecting only one cursor movement destination based on cursor movement instruction input information Execute the process. Details of the focus navigator and the focus manager will be described later.
[0123]
Further, the editing processing unit 570 performs a process of associating an image having direction information indicating a direction in which the cursor can be moved with the focus state component in the cursor setting state. Note that the processing in the editing processing unit 570 is processing executed under the control of the CPU 101 in the hardware configuration diagram of FIG.
[0124]
According to these setting information, a GUI application program having various components is generated, the generated GUI application program is stored in the program storage unit 581, executed by the program execution unit 582, and the generated GUI is displayed on the display unit 583. Is displayed.
[0125]
Next, according to the generated GUI application program, a configuration for executing an animation expression process of a cursor, that is, a functional configuration for executing a process in a GUI-equipped device or a GUI display device such as an information home appliance, will be described with reference to the block diagram of FIG. This will be described with reference to the drawings.
[0126]
The focus object 601 is a program file having a program describing an animation expression at a cursor or a cursor position. The focus manager 602 executes a process of moving the cursor in accordance with the cursor destination instruction information input from the focus navigator 603, and executes processes such as notifying an instruction to execute an animation to the focus object 601. It is a program. The focus navigator 603 has a search engine 604, executes a search process by the search engine 604 based on a user input from an input unit such as a mouse or a cross key, determines a destination of the cursor, and determines a destination of the determined cursor. The destination information and the like are output to the focus manager 602.
[0127]
The focus navigator 603 executes a cursor moving destination determination process according to a cursor moving destination selection algorithm that selects only one cursor moving destination based on cursor movement instruction input information. The cursor movement instruction input information is, for example, movement direction instruction information in any of four directions, up, down, left, and right. This is an algorithm that determines the only component from among the components described above as the cursor movement destination.
[0128]
As a user input device for designating the movement of the cursor, for example, a remote controller having an output unit such as infrared rays can be used. FIG. 13 shows a configuration example of the remote controller. The controller shown in FIG. 13 includes a power switch 701 for a control device having a GUI, an output unit 702 including infrared output means, a display 703, an input button 704 for executing various designations, and a function to instruct the cursor to move up, down, left, and right. And a cross key 705 having. Note that the controller illustrated in FIG. 13 is an example, and various configurations according to the functions of the GUI-equipped device are possible. Further, the input unit is not limited to the remote controller, and may be an input unit integrated with the GUI-equipped device itself.
[0129]
A cursor movement processing sequence accompanied by an animation expression will be described. When a user input from an input unit such as a cross key occurs, the focus navigator 603 receives the input information. The focus navigator 603 executes a destination search process to which the search engine 604 is applied based on the input information.
[0130]
The focus navigator 603 determines a destination component based on a search result of the search engine 604. Various modes can be applied to the destination determination processing mode, and specific examples thereof will be described later.
[0131]
When the destination is determined, the focus navigator 603 outputs a destination instruction to the focus manager 602, and the focus manager 602 executes a cursor moving process toward the destination. Further, the focus manager 602 outputs an animation execution command to the focus object 601, and the focus object 601 executes an animation processing program, that is, a reading process and a display process of an image file set corresponding to the cursor. Through this series of processing, the cursor movement processing that executes the animation expression is performed.
[0132]
FIG. 14 shows an example of animation expression when the cursor is moved. As described with reference to FIG. 12, the animation execution processing is executed based on the reading of the image data by the focus object. In the processing example of FIG. 14, the cursor moves from the button 721 displayed on the display to the button 722, the focus state of the button 721 is released, and the sequence ((a) to (d) until the button 722 becomes the focus state. 2) shows an example of a display.
[0133]
In the example of FIG. 14, an animation expression in which rectangular frames similar to the button shape are sequentially generated in the cursor moving direction and the rear rectangular frame disappears with the cursor movement is executed. These animation expressions are based on image data read by the focus object. The setting of the image data is an animation display based on the image data set by the same processing as the setting processing of the image data corresponding to the state of the component described above with reference to FIG.
[0134]
The focus navigator 603 receives an input from a remote controller as shown in FIG. 13 or a cross key as an input unit of the device itself, and determines a cursor moving destination by a search process using a search engine 604 based on the input information. I do. An example of processing for determining a cursor destination will be described with reference to FIG. FIG. 15 shows two different processing examples (a) and (b). In each case, a processing example when a user input designating a rightward movement occurs when the cursor is positioned on the button 751 and the button 751 is in the focus state is shown.
[0135]
FIG. 15A shows an example in which the uppermost button A among the buttons A to C located to the right of the button 751 is determined as the destination, and FIG. In this example, a middle button B among buttons A to C is determined as a destination.
[0136]
FIG. 15A shows a process of selecting the uppermost button from the buttons in the right direction of the button 751. This process is performed by the focus navigator 603. The coordinate position information (X, Y) of each button component is obtained. It is executed based on. For example, a process of selecting a button located to the right of the button 751 by comparing the X coordinate of the button 751 with the X coordinate of each button component is executed. Determined as the cursor destination.
[0137]
FIG. 15B illustrates a process of selecting a button that is closest to the button 751 from among the buttons located to the right of the button 751. This process is performed by the focus navigator 603 using coordinate position information ( (X, Y) based on a distance calculation process with the button 751, and a destination selection process based on a calculation result comparison process.
[0138]
How to determine the destination based on the user input information depends on the program executed by the focus navigator 603 and the search engine 604. The destination setting algorithm based on the user input information is determined by setting the program. Can be set variously. For example, as described above, an algorithm for selecting a component located at the shortest distance from the current cursor setting component among a plurality of components existing in a direction corresponding to the movement direction instruction information, or an algorithm for selecting a component existing in a direction corresponding to the movement direction instruction information An algorithm or the like for selecting the component located at the end of the plurality of components to be set can be set. These algorithm setting processes are executed in the editing processing unit 570 (see FIG. 11) in the GUI application development support device.
[0139]
It is also possible to set a destination according to the input information in advance in the logical component of the component such as a button. In this case, the destination search processing by the focus navigator 603 is not executed, and the component has The destination is determined according to the destination setting information.
[0140]
As described above, the focus navigator executes the destination determination process applying the search engine based on the input information, and further obtains information on the movable direction of each component, and for the component in the focus state, It is possible to display a graphic image such as an arrow (arrow) indicating the direction in which the cursor can move. This image display processing program can be set in a graphics expression component corresponding to the above-described component, or can be set as a focus object corresponding to a cursor.
[0141]
FIG. 16 shows an arrow display example. In the display example of (a), there are components in which the cursor can be moved in four directions, up, down, left, and right, from the button component 781 in which the cursor is set and in the focused state. For components in such a state, an arrow (arrow) indicating that there is a component movable in four directions, up, down, left, and right, is displayed. In (b), components that can be moved by the cursor from the button component 782 in the focused state exist in two directions, upward and right. For the component in such a state, an arrow indicating that there is a component that can be moved in the upper and right two directions is displayed.
[0142]
In (c), a component that can move the cursor exists only in the downward direction with respect to the button component 783 in the focused state. For components in such a state, an arrow is displayed only in the downward direction. In (d), a component to which the cursor can move exists only in the upward direction with respect to the button component 784 in the focused state. For components in such a state, an arrow is displayed only in the upward direction.
[0143]
The procedure for determining the destination and displaying the movable direction information in the cursor moving process will be described with reference to the flowchart shown in FIG. First, in step S301, it is determined whether there is an input from an input unit such as a cross key or the like, and if there is an input, the process proceeds to step S302, and whether or not the component at the current cursor position has movement information indicating a destination instruction, for example, It is determined whether or not the destination component information is included in the logical partial file of the component. If there is information, the process proceeds to step S310, the destination is determined according to the movement information, and in step S307, the cursor is moved to the determined destination.
[0144]
If it is determined in step S302 that the component in the focus state does not have the information indicating the destination instruction, the process proceeds to step S303, in which a search engine is executed based on the user input information, and the focus navigator is searched in step S304. Determines the destination based on the search results of the search engine. Further, in step S305, the focus navigator acquires the cursor movable direction information of the destination component based on the component arrangement information in four directions around the destination component.
[0145]
In step S306, the destination information determined by the focus navigator and the movable direction information of the destination component are passed to the focus manager, and in step S307, cursor movement processing for the destination is executed.
[0146]
In step S308, the focus manager determines whether or not cursor moveable direction information of the destination component has been received from the focus navigator. If the information has not been received, the process ends. On the other hand, an instruction for displaying identification information (for example, an arrow) based on the movable direction information is output, and the focus object executes an arrow display animation according to the input instruction.
[0147]
That is, the focus object selects image data according to the movable direction information input from the focus manager, and executes, for example, an animation display including an image in which an arrow is set in the movable direction described above with reference to FIG. I do.
[0148]
[8. Configuration example of GUI display device]
Next, an example of an apparatus configuration having a graphical user interface (GUI) for executing various display processes according to the above description, such as an information home appliance, will be described with reference to FIG.
[0149]
Various home appliances and communication devices are assumed as the GUI-equipped devices. The device configuration example shown in FIG. 18 shows one example, and shows a GUI display device configuration example in which a moving image can be received via a network or read from a storage medium and reproduced.
[0150]
The GUI display device 800 shown in FIG. 18 has a communication interface 801 for receiving Internet distribution data, broadcast data, or the like, and receives an HTML document, a moving image content, and the like from a data distribution site. A storage medium interface 802 is an interface for data transfer between various storage media 820 such as a DVD and a flash memory, and an interface for inputting and outputting various contents such as image data between the storage medium 820 and the data processing device 800. It is.
[0151]
If the content transmitted from the image distribution site or the content stored in the storage medium 820 has been encoded, the decoding / encoding processing unit 803 executes a decoding process, and then controls the display control unit 808 to control the content. Originally, it is displayed on the display device 810.
[0152]
On the other hand, various commands by the user or the above-described cursor movement instruction information are input from the controller 811, received by the receiving unit 807, and output to the control unit (CPU) 804. The control unit 804 executes various types of processing according to the above-described logical components, graphics expression components, and the like corresponding to each component. Further, a focus management process, that is, a process of determining a component to which a cursor is moved in accordance with the movement of the cursor is executed. Further, an animation display process using image data in which a movable direction is indicated by, for example, an arrow is executed according to the focus object.
[0153]
The storage unit in the GUI display device 800 is a storage unit used for storing received data, storing various processing programs, storing a preset display image program, or a storage area as a work area in the CPU 804, and includes a RAM, a ROM, and the like. Be composed. The timer 806 is used to measure the execution time of various programs in the GUI processing.
[0154]
The present invention has been described in detail with reference to the specific embodiments. However, it is obvious that those skilled in the art can modify or substitute the embodiment without departing from the spirit of the present invention. That is, the present invention has been disclosed by way of example, and should not be construed as limiting. In order to determine the gist of the present invention, the claims described at the beginning should be considered.
[0155]
The series of processes described in the specification can be executed by hardware, software, or a combined configuration of both. When executing the processing by software, the program recording the processing sequence is installed in a memory in a computer embedded in dedicated hardware and executed, or the program is stored in a general-purpose computer capable of executing various processing. It can be installed and run.
[0156]
For example, the program can be recorded in a hard disk or a ROM (Read Only Memory) as a recording medium in advance. Alternatively, the program is temporarily or permanently stored on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Only Memory), an MO (Magneto optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, or a semiconductor memory. It can be stored (recorded). Such a removable recording medium can be provided as so-called package software.
[0157]
The program is installed in the computer from the removable recording medium as described above, and is wirelessly transferred from the download site to the computer, or is transferred to the computer by wire via a network such as a LAN (Local Area Network) or the Internet. The computer can receive the program transferred in this way and install it on a recording medium such as a built-in hard disk.
[0158]
The various processes described in the specification may be executed not only in chronological order according to the description but also in parallel or individually according to the processing capability of the device that executes the processes or as necessary. Further, in this specification, a system is a logical set configuration of a plurality of devices, and is not limited to a device having each configuration in the same housing.
[0159]
【The invention's effect】
As described above, the GUI display device of the present invention executes the search processing by the search engine based on the cursor movement instruction input information, and determines the focus destination by which the cursor is to be moved, and the movement of the cursor by which the focus navigator is determined. A focus manager that executes a cursor movement process according to the destination instruction information, wherein the focus navigator performs a cursor destination determination process according to a cursor destination selection algorithm that selects only one cursor destination based on the cursor destination instruction input information. Therefore, even if the user input is only the setting information with a coarse moving direction such as a cross key, the destination can be immediately determined based on the user input. Does not need to perform fine control of cursor movement.
[0160]
Further, according to the GUI application development support device of the present invention, in the editing processing unit, a focus navigator in which a cursor destination selection algorithm for selecting a unique cursor destination based on cursor movement instruction input information is set, and a focus navigator. And the focus manager that executes the cursor movement process according to the cursor movement destination instruction information determined as the cursor control program, so that the mode of the cursor movement destination selection algorithm is changed and set, for example, The cursor may be selected in various forms, such as an algorithm for selecting a component located at the shortest distance from the current cursor setting component, and an algorithm for selecting a component located at the end of a plurality of components existing in a direction corresponding to the movement direction instruction information. The GUI application program for executing the dynamic can be easily produced.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a hardware configuration example of a GUI application development support device of the present invention.
FIG. 2 is a block diagram showing a functional configuration of a GUI application development support device of the present invention.
FIG. 3 is a sequence diagram illustrating a processing sequence of the GUI application development support device of the present invention.
FIG. 4 is a sequence diagram illustrating a processing sequence of the GUI application development support device of the present invention.
FIG. 5 is a diagram illustrating an example of a file configuration necessary for executing processing of the GUI application development support device of the present invention.
FIG. 6 is a diagram illustrating a display example of a GUI component generated by the GUI application development support device of the present invention.
FIG. 7 is a diagram illustrating a display example of a GUI component generated by the GUI application development support device of the present invention.
FIG. 8 is a diagram illustrating an example of an animation setting process corresponding to each state of a component executed in the GUI application development support device of the present invention.
FIG. 9 is a block diagram illustrating a functional configuration for setting animation processing of a component in the GUI application development support device of the present invention.
FIG. 10 is a diagram illustrating an example of an animation execution process corresponding to the state of a component generated in the GUI application development support device of the present invention.
FIG. 11 is a block diagram showing a configuration for executing an image data setting processing function corresponding to a cursor in the GUI application development support device of the present invention.
FIG. 12 is a block diagram showing a configuration for executing cursor movement and cursor-corresponding image data display processing in the GUI display device of the present invention.
FIG. 13 is a diagram illustrating a configuration example of a remote controller attached to a GUI-equipped device and capable of instructing cursor movement.
FIG. 14 is a diagram illustrating an example of an animation display accompanying a cursor movement on a GUI display.
FIG. 15 is a diagram illustrating an example of moving a cursor between components on a GUI display.
FIG. 16 is a diagram showing an example of displaying a cursor movable direction identification mark of a component on a GUI display.
FIG. 17 is a diagram illustrating a flowchart for explaining a destination determination and a movable direction information display procedure in the cursor movement process.
FIG. 18 is a block diagram illustrating a configuration example of a GUI display device.
[Explanation of symbols]
101 CPU
102 memory
103 Display controller
104 Input device interface
105 Network Interface
106 External device interface
107 bus
108 Display
109 keyboard
110 mouse
111 HDD
112 Media Drive
150 Graphics Processing Chip
160 Portable Media
200 Parts storage unit
201 Logical component storage unit
202 Graphics expression part storage unit (simple)
203 Graphics expression part storage unit (rich)
205 Image data storage
210 Edit processing unit
211 Property Editing Department
212 Method Editor
213 Event Editing Department
220 Data input / output unit
221 Program storage unit
222 Program Execution Unit
223 Display
311 button
312 Combo box
320 button
330 Combo Box
321,322 animation
331,332 animation
351 Component specification field
352 Image setting column
400 Parts storage unit
401 Logical component storage unit
402 Graphics expression part storage unit
403 Image data storage
410 Edit processing unit
420 data input / output unit
421 Program storage unit
422 Program execution unit
423 display
511 Graphics Expression Class
512 Image file
513 Display
514 animation
560 Parts storage unit
561 Logical component storage unit
562 Graphics expression part storage unit
563 Image data storage
570 Edit processing unit
580 Data input / output unit
581 Program storage
582 Program execution unit
583 Display
601 Focus object
602 Focus Manager
603 Focus Navigator
604 search engine
701 Power switch
702 output unit
703 display
704 input button
705 Cross key
721,722 button
723 animation
751 button
781-784 button
800 GUI display device
801 Communication I / F
802 Storage medium I / F
803 decoding / encoding processing unit
804 control unit (CPU)
805 storage unit
806 timer
807 receiver
808 Display control unit
810 display
811 Controller

Claims (22)

A GUI display device that executes a control process of a cursor displayed on a display,
A focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination;
A focus manager that executes cursor movement processing according to the cursor movement destination instruction information determined by the focus navigator;
A GUI display device, wherein the focus navigator is configured to execute a cursor movement destination determination process in accordance with a cursor movement destination selection algorithm for selecting a unique cursor movement destination based on the cursor movement instruction input information. The cursor movement instruction input information is movement direction instruction information in any of four directions, up, down, left, and right.
The cursor movement destination selection algorithm executed by the focus navigator is an algorithm for executing a process of determining a unique component as a cursor movement destination from a plurality of components existing in a direction corresponding to the movement direction instruction information. The GUI display device according to claim 1. The cursor movement destination selection algorithm executed by the focus navigator includes an operation of acquiring coordinate information of each component displayed on the display, and executing a process of determining a cursor movement destination based on the acquired coordinate information. 2. The GUI display device according to claim 1, wherein: The cursor movement instruction input information is movement direction instruction information in any of four directions, up, down, left, and right.
The cursor movement destination selection algorithm executed by the focus navigator is an algorithm for selecting a component located at the shortest distance from the current cursor setting component among a plurality of components existing in a direction corresponding to the movement direction instruction information. The GUI display device according to claim 1. The cursor movement instruction input information is movement direction instruction information in any of four directions, up, down, left, and right.
The method according to claim 1, wherein the cursor destination selection algorithm executed by the focus navigator is an algorithm for selecting a component located at the end of a plurality of components existing in a direction corresponding to the movement direction instruction information. The GUI display device according to the above. A GUI application development support device for supporting development of a GUI application having cursor movement instruction information on a graphical user interface (GUI),
A focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination, and a focus manager that executes a cursor movement process according to the cursor movement destination instruction information determined by the focus navigator. , An editing processing unit to be set as a cursor control program,
The editing processing unit,
A GUI application development support apparatus, wherein the focus navigator is configured to execute a setting process of a cursor movement destination selection algorithm for selecting a unique cursor movement destination based on cursor movement instruction input information. The editing processing unit,
An algorithm for executing a process of determining a single component as a cursor destination from a plurality of components existing in a direction corresponding to one of four directions of up, down, left, and right directions of movement is set for the focus navigator. 7. The GUI application development support device according to claim 6, wherein: The editing processing unit,
7. The method according to claim 6, wherein coordinate information of each component displayed on the display is acquired, and a processing algorithm for determining a cursor moving destination based on the acquired coordinate information is set for the focus navigator. A GUI application development support device as described in the above. The editing processing unit,
An algorithm for selecting a component located at the shortest distance from the current cursor setting component among a plurality of components existing in directions corresponding to the four directions of up, down, left, and right directions of movement is set in the focus navigator. 7. The GUI application development support device according to claim 6, wherein: The editing processing unit,
An algorithm for selecting a component located at the end from among a plurality of components existing in a direction corresponding to one of four directions of up, down, left, and right directions of movement direction is set in the focus navigator. The GUI application development support device according to claim 6. A GUI display cursor movement processing method for executing control processing of a cursor displayed on a display,
Executing a search processing by a search engine based on the cursor movement instruction input information, and determining a cursor movement destination;
A cursor movement processing step of executing a cursor movement process in accordance with the cursor movement instruction information determined in the cursor movement destination determination step, wherein the cursor movement destination determination step is based on the cursor movement instruction input information. A GUI display cursor movement processing method, comprising executing a cursor movement destination determination process in accordance with a cursor movement destination selection algorithm for selecting only one cursor movement destination. The cursor movement instruction input information is movement direction instruction information in any of four directions, up, down, left, and right.
The cursor destination selection algorithm executed in the cursor destination determining step is an algorithm for executing a process of determining only one component as a cursor destination from a plurality of components existing in a direction corresponding to the moving direction instruction information. The method for moving a GUI display cursor according to claim 11, wherein: The cursor destination selection algorithm executed in the cursor destination determining step is an algorithm that includes a process of acquiring coordinate information of each component displayed on the display and executes a process of determining a cursor destination based on the acquired coordinate information. 12. The method according to claim 11, wherein the cursor is moved. The cursor movement instruction input information is movement direction instruction information in any of four directions, up, down, left, and right.
The cursor movement destination selection algorithm executed in the cursor movement destination determination step is an algorithm for selecting a component located at the shortest distance from the current cursor setting component among a plurality of components existing in a direction corresponding to the movement direction instruction information. The method for moving a GUI display cursor according to claim 11, wherein: The cursor movement instruction input information is movement direction instruction information in any of four directions, up, down, left, and right.
The cursor movement destination selection algorithm executed in the cursor movement destination determination step is an algorithm for selecting a component located at an end portion among a plurality of components existing in a direction corresponding to the movement direction instruction information. Item 12. The GUI display cursor movement processing method according to item 11. A method for generating a GUI application program having cursor movement instruction information on a graphical user interface (GUI),
A focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination, and a focus manager that executes a cursor movement process according to the cursor movement destination instruction information determined by the focus navigator. , Having an editing processing step for setting as a cursor control program,
The editing processing step includes:
A method for generating a GUI application program, comprising: executing a setting process of a cursor destination selection algorithm for selecting only one cursor destination based on cursor movement instruction input information for the focus navigator. The editing processing step includes:
Setting an algorithm for executing, in the focus navigator, an algorithm for executing a process of determining a single component as a cursor destination from a plurality of components existing in directions corresponding to the four directions of up, down, left, and right directions. 17. The method according to claim 16, wherein: The editing processing step includes:
17. The method according to claim 16, further comprising: acquiring coordinate information of each component displayed on a display, and setting a processing algorithm for determining a cursor moving destination based on the acquired coordinate information for the focus navigator. A method for generating a GUI application program according to the above description. The editing processing step includes:
And setting, in the focus navigator, an algorithm for selecting a component located at the shortest distance from the current cursor setting component among a plurality of components existing in directions corresponding to the four directions of up, down, left, and right directions. The method according to claim 16, wherein: The editing processing step includes:
Setting, for the focus navigator, an algorithm for selecting a component located at an end portion among a plurality of components existing in a direction corresponding to one of four directions of up, down, left, and right directions. The method for generating a GUI application program according to claim 16. A computer program for executing a GUI display process for executing a control process of a cursor displayed on a display, comprising:
Executing a search processing by a search engine based on the cursor movement instruction input information, and determining a cursor movement destination;
A cursor movement processing step of executing a cursor movement process in accordance with the cursor movement instruction information determined in the cursor movement destination determination step, wherein the cursor movement destination determination step is based on the cursor movement instruction input information. A computer program comprising a step of executing a cursor destination determination process according to a cursor destination selection algorithm for selecting a unique cursor destination. A computer program for executing a GUI application program generation process having cursor movement instruction information on a graphical user interface (GUI),
A focus navigator that executes a search process by a search engine based on cursor movement instruction input information and determines a cursor movement destination, and a focus manager that executes a cursor movement process according to the cursor movement destination instruction information determined by the focus navigator. , Having an editing processing step for setting as a cursor control program,
The editing processing step includes:
A computer program comprising a step of executing, for the focus navigator, a setting process of a cursor movement destination selection algorithm for selecting a unique cursor movement destination based on cursor movement instruction input information.

Images