JPH11110205A - Gui generation support device, its method and storage medium recording gui generation support program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To design and generate a GUI interactive screen which excels both operability and maintainability by selecting a 2nd display parts to be converted into a 1st display parts when a 1st instruction is given to the 1st display parts and displaying the 2nd display parts on a display screen in place of the 1st display parts. SOLUTION: A parts management part 3 performs a variety of management for the parts data corresponding to the display parts, etc., shown at a display part 2, based on various input information, etc., which are inputted via an input part 1. A parts storage part 4 stores the character string data and the bit map data which are inputted via the part 1 as the parts data. A conversion part 5 converts the parts data sent from the part 3 based on the conversion rule stored in a rule storage part 6 and the conversion frequency information stored in a frequency storage part 7. Thus, it's possible to easily perform exchange of the GUI parts having the equal meanings and to produce an easier- to-handle GUI with high efficiency.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a GUI creation support device, a GUI creation support method, and a recording program for recording a GUI creation support program for supporting creation of a graphical user interface (hereinafter referred to as "GUI") such as a computer application program. Regarding the medium.

[0002]

2. Description of the Related Art A GUI creation support device (GUI builder) is often used for designing and creating a GUI.

In a general GUI creation support apparatus, a GUI is designed and created by selecting and arranging buttons and lists called GUI parts from a palette in a window frame whose size can be freely changed. This work is performed by the GUI designer, and the data exchanged between the user of the computer and the computer is expressed as a specific GUI display screen using the GUI display screen. In designing and creating a GUI using such a GUI creation support device, there are the following problems.

[0004] In other words, designing and creating a GUI using a GUI creation support device can be easily performed by a method such as drawing.
There is an advantage that the UI screen can be designed.
However, on the contrary, this advantage causes a problem that a GUI is designed and created without imagining a final completed state, and a rework process is generated later. In other words, parts are added and functions are changed in the design process. In particular, in the case of data that is selected and input from candidates, candidates may be added in the future. Some GUI parts are provided only for selection from fixed candidates, and others take into account the addition of candidates. Considering that the candidates are fixed, the parts for selection from fixed candidates are used. If it is, the GUI screen must be recreated when the candidate is added. Therefore, the designer has to design and create while imagining the final state of completion while taking into account which components are used and how.

For example, when creating a GUI for selecting one item from a plurality of items, an expression method (parts) such as a pull-down menu, an exclusive button, and a list box is prepared. In such a case, which method should be followed depends on the operation scene and the like, and further depends on the preference of the user or the designer. In such a case, in the conventional GUI creation support device,
There are few means to change from one expression method to another expression method, and once it is decided to express it with a certain part, in order to replace it with another part, the corresponding G
Work equivalent to reconstructing the UI screen was required.

[0006] Prior to creating an actual system, it is common practice to create a mockup for confirming the appearance and behavior of the system. However, creating the mockup itself was very cumbersome and inconvenient.

[0007]

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and is intended to design and create a GUI interactive screen excellent in operability and maintainability.
An object of the present invention is to provide a UI creation support device, a GUI creation support method, and a recording medium on which a GUI creation support program is recorded.

[0008] Further, the present invention relates to a GUI to be converted.
A GU that takes into account information about which part the component is currently
An object of the present invention is to provide an I creation support device, a GUI creation support method, and a recording medium on which a GUI creation support program is recorded.

Further, the present invention provides a GUI creation support device which takes into account the current arrangement of GUI components to be converted,
An object of the present invention is to provide a UI creation support method and a recording medium on which a GUI creation support program is recorded.

[0010]

According to a first aspect of the present invention, there is provided a GUI creation support apparatus for creating a display screen including a display component. When a first instruction is given to one display component, the second display component is to be converted to a second display component.
And a means for performing control for displaying the second display component on the display screen in place of the first display component. .

According to a second aspect of the present invention, there is provided the GUI creation support device according to the first aspect, wherein the displayed second image is displayed.
Second selecting means for selecting a third display component to be converted from the second display component in accordance with a second instruction given to the display component, and selecting the third display component from the second display component. Means for performing control for display on the display screen in place of the display component.

According to a third aspect of the present invention, in the GUI creation support apparatus according to the first aspect, the first selecting means determines that the first display component is to be converted based on a predetermined rule. Is selected.

According to a fourth aspect of the present invention, in the GUI creation support apparatus according to the second aspect, the second selecting means determines that the second display component is to be converted based on a predetermined rule. Is selected.

According to a fifth aspect of the present invention, in the GUI creation support apparatus according to the third aspect, the predetermined rule includes configuration information of a display component displayed on the display screen. .

According to a sixth aspect of the present invention, in the GUI creation support apparatus according to the fourth aspect, the predetermined rule includes configuration information of a display component displayed on the display screen. .

According to a seventh aspect of the present invention, in the GUI creation support apparatus according to the fourth aspect, there is further provided a means for determining the second display component as a display component, and the predetermined rule is: The number of times that the second display component is determined as a display component is included as frequency information.

[0017] According to an eighth aspect of the present invention, in the GUI creation support apparatus according to the seventh aspect, when the second display component is determined as a display component, the frequency information is determined based on a learning rule. It is characterized by further comprising a learning means for updating.

According to a ninth aspect of the present invention, in the GUI creation support apparatus according to the first aspect, means for storing type information of the first display component and a hierarchical relationship between a plurality of the type information are shown. Means for storing respective weights of a plurality of rules, wherein the first selecting means sets a second display component to which the first display component is to be converted based on the type information and the weight. It is characterized by selecting.

The present invention according to claim 10 is the first invention.
The GUI creation support device according to claim 1, further comprising a unit that calculates a display position of the first display component on the display screen, wherein the first selection unit is configured to calculate the display position of the first display component based on the calculated display position. A second display component to be converted from one display component is selected.

The present invention according to claim 11 provides the present invention as set forth in claim 1
In the GUI creation support device described above, means for calculating each display position of the plurality of first display components on the display screen, and a second display component on the display screen based on the calculated display position Means for determining each of the display positions.

The present invention according to claim 12 is based on claim 1.
The means for grouping a plurality of first display components, and each display of a second display component on the display screen in the grouped unit based on a predetermined rule. Means for determining a position.

The present invention according to claim 13 is based on claim 1.
3. The GUI creation support device according to item 2, further comprising: a unit that calculates the number of groups based on the type of the first display component, wherein the grouping unit includes a plurality of the first display components based on the calculated number of groups. The display components are grouped.

According to a fourteenth aspect of the present invention, in the GUI creation support method for creating a display screen including a display component, a first instruction is given to the first display component displayed on the display screen. And performing control for selecting a second display component to which the first display component is to be converted and displaying the second display component on the display screen in place of the first display component. It is characterized by.

According to a fifteenth aspect of the present invention, a first aspect is provided.
4. The GUI creation support method according to item 4, wherein a second instruction given to the displayed second display component is provided,
A third display component to be converted is selected from the second display component, and control is performed to display the third display component on the display screen in place of the second display component. And

The present invention according to claim 16 is a recording medium in which a program for creating a display screen including a display component is recorded, wherein the program is a first display component displayed on the display screen. A first selection means for selecting a second display component to be converted to the first display component when a first instruction is given to the first display component; Means for performing control for display on the display screen in place of

[0026] The present invention according to claim 17 is based on claim 1.
7. The recording medium according to 6, wherein the program is configured to execute a third display component to be converted from the second display component in accordance with a second instruction given to the displayed second display component. It further comprises means for selecting and means for performing control for displaying the third display component on the display screen in place of the second display component.

According to the present invention, for example, one GUI object (display component) is selected from the GUI under design,
When the conversion key is pressed, the current display component is converted to another display component. For example, if a "label" written as "OK" is selected and converted, it is converted into a "text field" written as "OK". Then, when you press the conversion key again, "O
It is converted to a "button" written with "K". Pressing the convert key further converts it to an option button labeled "OK". If only one object is selected, for example, "label", "text field",
The objects of “button” and “check box” are conversion candidates.

Similarly, conversion is performed when a plurality of GUI objects are selected and then converted. The conversion candidates are, for example, “set of labels”, “set of text fields”, “text field of multiple lines”, “set of command buttons”, “set of check boxes”, “set of option buttons”, “list of option buttons”. Box, combo box, drop-down list box, tab dialog, and tree view objects are conversion candidates. Note that these names are merely examples of conversion candidates. The present invention is not limited to this. The order of such selection candidates can be changed or learned based on the frequency of use of each component or the label name.

[0029]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 shows a GUI according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a configuration of a creation support device. In FIG. 1, an input unit 1 is for inputting character string data and bitmap data used in a GUI to be created, commands according to each operation status, and the like. The input unit 1 is realized by, for example, a pointing device such as a keyboard and a mouse. The display unit 2 is for presenting various internal data and the like handled by the computer to the user. In this example, particularly, the display unit 2 is for displaying display components such as a window (Form) and a label described later, a mouse cursor, and the like. It can display not only text but also graphical figures and the like. The display unit 2 is realized by a so-called display or the like. The input unit 1 and the display unit 2 constitute a user interface.

The component management unit 3 performs various managements on component data corresponding to display components and the like displayed on the display unit 2 based on various input information and the like input from the input unit 1. Details of the component management unit 3 will be described later. The component storage unit 4 stores the character string data and bitmap data input by the input units 1 as component data. The conversion unit 5 converts the component data sent from the component management unit 3 based on the conversion rule stored in the rule storage unit 6 and the conversion frequency information stored in the frequency storage unit 7. The learning unit 8 learns the frequency information using a predetermined learning algorithm, and updates the frequency information stored in the frequency information storage unit 7.

Next, the component management section 3 will be described in detail.

FIG. 2 is a diagram showing the configuration of the parts management unit 3. 2, an input information interpreting unit 21 interprets whether the input information sent from the input unit 1 is a command or other instruction, character string data or bitmap data, and interprets the result. In response to this, data or control information is transmitted to each unit described later. Such an interpretation is appropriately interpreted according to the operation situation and the input mode.

First, when the input information interpreting section 21 interprets that the input data is character string data or bitmap data, the input information interpreting section 21 sends the character string data and the like to the component data registering section 22. The component data registration unit 22 stores the transmitted character string data and bitmap data as component data as component data.
To send to.

When the input information interpreting section 21 interprets that the instruction is a component selection instruction, the input information at that time is transmitted to the component selecting section 23. The component selection unit 23 selects a corresponding component (group) based on the input information. That is,
The component selection unit 23 includes: position information constituting the input information;
A display component is selected from the screen information stored in the screen data storage unit 24. In this case, it is also possible to select a plurality according to the input information. When selecting a display component, the component selection unit 23 sends information on the display component to the component data reading unit 25. Also, the component selection unit 23
The screen data in the screen data storage unit 24 is updated in order to clearly indicate to the user that the display component has been selected. The component data reading unit 25 reads the corresponding component data from the component storage unit 4 in accordance with the transmitted information on the display component, and temporarily stores the content therein.

Further, if the input information interpreting unit 21 interprets that the input information is a component conversion instruction, the input information interpreting unit 21 sends the input information at that time to the conversion instruction unit 26. The conversion instructing unit 26 reads out the component data temporarily stored in the component data reading unit 25 from the component data reading unit 25 and sends it to the conversion unit 5. That is, the transmitted component data corresponds to the display component selected by the component selection unit 23. The conversion part 5 creates a candidate list based on the conversion rules stored in the rule storage part 6 and the frequency information stored in the frequency information storage part 7 in the conversion part 5, and the candidate selection part 27 Will be returned. The candidate selection unit 27 selects one from the list of candidates as a selection candidate, and rewrites the contents of the screen data storage unit 24 based on the selection candidate. As a result, the conversion result is displayed on the screen of the display unit 2.

The selection of the selection candidates is performed, for example, by sequentially selecting from the head of the candidate list, and after selecting all of the candidate lists, the head candidate is selected again. The selection of the next candidate is performed by the input information interpreting unit 1 interpreting the conversion instruction as the next candidate selection and transmitting the conversion instruction to the candidate selecting unit 27 when the conversion instruction is continuously input from the input unit 1. Done.

When the input information interpreting section 21 interprets that the selection of the component has been canceled, the input information at that time is sent to the component selecting section 23 and the candidate selecting section 27. Parts selector 2
No. 3 updates the screen data in the screen data storage unit 24 to screen data that clearly indicates the deselection, in order to clearly indicate to the user that the display component has been deselected. On the other hand, the candidate selection unit 27
Sends the finally selected display component to the learning unit 8.

Next, the operation of the GUI creation support device according to the present invention will be described using an example. When the GUI creation support device starts up, a window (Form) in which no parts or the like are arranged is displayed on the display unit 2 as an initial state. FIG. 3 is a diagram illustrating an example of the initial state of the window. In this example, a state in which no parts or the like are arranged is set as the initial state. However, for example, a default part may be defined in advance, and a state in which the default part is displayed may be set as the initial state.

Now, assume that five character strings are input using the input unit 1. Here, "File", "Save",
Create five strings: "Save New", "Open", and "End". For example, after pointing an arbitrary position on the window using a pointing device (not shown) such as a mouse or the like, a desired character string is input from the input unit 1, and when the character string is determined, the character string data and a preset frame are set. One component data combined with the data is generated by the component data registration unit 22. This component data is stored in the component storage unit 4.

FIGS. 4A and 4B are diagrams showing an example of component data stored in the component storage unit 4. FIG. As shown in FIG. 4A, the component data includes a GUI component number 401, an element number 402, an element number 403, a lower element number 404, a character string 405, a component name 406, a value 407, a state 408, a position 409, and a size. 410 and lower elements 411. For example, it is assumed that a character string input by the input unit 1 is initially stored in an expression format called, for example, a “label”. When a character string “file” is input, data as shown in FIG. 4B is generated and stored.

Here, each item will be described.

The number 401 is a unique number given to each part used to specify the part.

The number of elements 402 is the number of component elements included in the same group and located at the same level. Since only one label “file” is included here, the number of elements is one.

The element number 403 is a unique number given to each element included in the same group and located at the same level.

The number of lower elements 404 indicates the number of lower elements when a certain part and another part have a hierarchical relationship, such as a menu part.

The character string 405 is a character string displayed by the component element.

The part name 406 is the name of a part element.

The value 407 is the value of the component element. For example, in the case of a check box, it takes a value of 1 if it is checked and a value of 0 if it is not checked. Empty (null) for components that do not take a value. Values that can be taken by each component are different.

State 408 is the state of the component element. For example, in the case of a button, if the operation is disabled, "impossible"
If operation is possible, take the state of "OK". The possible states differ depending on the component.

The position 409 indicates the position of the component element in the window. For example, it is represented by the number of pixels.

The size 410 indicates the size of the component.

The lower element 411 is information of a lower component. Empty if there are no lower elements.

FIG. 5 shows a window in which all of the above five character strings have been input. The above-described component data is stored for each label shown in FIG.

Next, using the input unit 1, four labels of "save", "new save", "open" and "end" are selected and dragged and dropped on the label "file". FIG. 6 shows a window in this operation state. That is, the user operates the mouse cursor or the like to display the display unit 2.
When the mouse button is clicked and input information is given at the position corresponding to the label (display component) displayed on the window displayed in, the corresponding label is selected based on the mouse cursor position information Is displayed, and subsequent input operations such as drag and drop can be performed. Here, for example, SHIF
When the labels are sequentially clicked while pressing the T key, a plurality of labels can be selected. Then, by dragging the mouse cursor and dropping the label "File" and other selected labels in a position overlapping, the display part on the window is converted to a display part of another format Is done.

FIG. 7 is a flowchart showing the operation of the component management unit 3 and the conversion unit 5.

The component management unit 3 first receives the input information based on the click operation (step 701), and
3 selects the component data, the component data is read by the component data reading unit 25 (Step 702), and the input data based on the subsequent drag and drop operation (Step 703) causes the conversion instruction unit 26 to read the component data. The component data temporarily stored in the unit 25 is read out (step 704) and sent to the conversion unit 5 (step 705). The conversion unit 5 converts the component data into component data of a display component other than the current expression component, for example, a combo box (step 706).

FIG. 8 is a diagram showing an example of a state where the label group of FIG. 6 is converted into a combo box. When the user does not display the target display component as a result of the conversion by the conversion unit 5 and the display, the input unit 1
A next candidate conversion instruction is given (step 707). As a result, the next display component is displayed (step 7).
08).

FIG. 9 is a diagram showing an example of a state where the standard combo has been converted according to the next candidate conversion instruction. Then, when the user gives the next candidate conversion instruction again, a menu is displayed as the next candidate. FIG. 10 is a diagram illustrating an example of a state converted into a menu according to the next candidate conversion instruction. Thus, the user repeats the next candidate conversion instruction using the input unit 1 until a display component desired to be used appears. Then, the user performs the confirmation processing from the input unit 1 (step 709), and the series of processing ends.

If the arrangement of the display components is not the desired arrangement, it is possible to select an item in the menu and directly move the display component to the destination. That is, the user selects an item of the corresponding display component using the input unit 1, drags the item, and performs a drop operation at a desired position. FIG. 11 is a diagram illustrating an example of the state of the operation of changing the arrangement order of the display components.

For example, "file""new""open"
If five labels “Save” and “End” are created and all are selected at the same time and converted to a menu, the part data storage unit 4
12A to FIG. 12E.

Next, conversion processing in the GUI creation support device according to the present embodiment will be described with reference to FIG.

FIG. 13 is a diagram for explaining the flow of the conversion process in the GUI creation support device according to the present embodiment.

First, when the component data is acquired, the conversion unit 5
Creates a list of available parts (step 130
1). Creation of this list is performed according to a predetermined format. This format may be, for example, "if one component is selected," label ",
"Text", "Button", "Check button" can be selected "," If there are multiple selected parts, "set of labels", "set of text fields", ""Textfield","Set of command buttons", "Set of check boxes", "Set of option buttons", "List box", "Combo box", "Drop-down list box", "Tab dialog", "Tree view""Is selectable],
Something like that has been defined.

Next, the conversion unit 5 determines whether or not there is a rule that matches the current situation based on the rules stored in the rule storage unit 6 (step 1302).

Here, an example of the rules stored in the rule storage unit 6 will be described.

Rule 1: if Character string = “OK” then Part name. Button +1 This is a rule that, if the selected character string is “OK”, the priority of “button” is increased as a component candidate.

Rule 2: if Character string = “cancel” then Part name. Menu-1 This is a rule that if the selected character string is "cancel", the priority of "menu" is reduced as a component candidate.

Rule 3: if character string 1 = “file” and character string 2 = “end” then part name Menu + 2; part name *. Button +1 This means that if two or more parts are selected and the character string contains "File" and "End", "File" is easier to select the menu, and other candidates are This is a rule for raising the priority of a button so that it becomes a part of a menu.

Rule 4: if Element count> 20 then Part name. Option button-1 This means that if the number of selected elements is 20 or more,
The rule is to lower the priority of the option button.

The above rules are merely examples, and can be added, changed, deleted, etc. by customizing the user as appropriate.

If the conversion unit 5 determines that a matching rule exists, the conversion unit 5
The priority value of the available component list created in step 1301 is changed (step 1303). Step 13
After the process of 03, the process returns to step 1302 to determine whether or not there is another matching rule. When all the matching rules are gone, the conversion unit 5 reads the frequency information from the frequency information storage unit 7 and gives priority to the available component list created in step 1301 using the frequency information by adding the number of times. The value of the degree is changed (step 1304). Then, the conversion unit 5 determines in step 1301
The list of available components created in step is rearranged based on the priority (step 1305). The rearranged result is sent to the candidate selection unit 27 of the component management unit 3 (step 1306), and the selection candidates are displayed.

When the display component to be used is determined, the candidate selection unit 27 sends information on the determined component data to the learning unit 8. The learning unit 8 adds 1 to the current frequency information of the corresponding display component based on this information, and updates the frequency information in the frequency information storage unit 7 as new frequency information.

In the learning section 8, it is also possible to use case-based reasoning, function learning, a neural network, etc. in addition to the frequency information. The determined configuration of the display component is stored as a case, and if there is a similar configuration in the past using the case-based reasoning, the past case is corrected to create a candidate.

For example, by using the case-based reasoning, when there are cases of the menus of “File”, “New”, “Open”, “Save new”, “Save”, and “End” In the case where a label group “file, new, open, save, end” is created, the case in this menu is searched as a similar case. Since the searched case is a menu, "menu" is easily selected as a conversion candidate as a display component.

Next, a second embodiment will be described.

When converting a GUI component, there are a case where a completely new component is created and a case where a previously created GUI component is changed. In the latter case, since the GUI component to be converted may already have some meaning, an example in which conversion is performed using the current component type will be described.

FIG. 14 is a diagram showing a configuration of a GUI creation support device according to the present embodiment. In FIG. 14, the same reference numerals are given to the same function realizing means as in the first embodiment described above. The component specifying unit 141 determines the type of the component to be converted. FIG. 15 is a flowchart showing this operation.

For example, as shown in FIG.
Is selected with a mouse or the like and a conversion operation is performed using a conversion key, the conversion instruction unit 26 is displayed.
Sends the conversion instruction to the conversion unit 5 and notifies the component identification unit 141 of the GUI component to be converted (see FIGS. 4A and 4B). The component identification unit 141 Determine the type. In the case of this example, the following two GUI parts are extracted, and their types are determined.

Label ["age": "] () combo [] (" under 20 "," 20-30 "," 30-40
Age "," 40-50 years old "," 50-60 years old "," 60 years old or older ") Here, each part is a part type [name] (component, ...), ...
It should be described as follows.

The component type is the type of the current component (component name)
Enters. For example, label, button, option, combo, fra
me, menu,… etc. That is, the above-mentioned "label [" age ":"] () "means a label including a character string" age: ". The components are empty parentheses because the label has no components. When a plurality of character strings are included in one part, the character strings of the constituent elements are displayed separated by commas.

In the case of a GUI component having a hierarchical structure such as a menu, a component type and a label name are entered instead of a character string.
For example, as shown in FIG. 17, when the menu is expressed hierarchically, menu ["file"] ("open", "close", [menu] ("reload", "rewrite" )).

As described above, when information on the GUI component selected by the component specifying unit 141 is obtained, the component specifying unit 141 converts the obtained information of the GUI component into the conversion unit 5.
To send to. The conversion unit 5 replaces the current GUI component with another GUI based on the rules stored in the rule storage unit 6.
Convert to parts.

Here, a description example of a rule is shown below. That is, in the present invention, if-the in the first embodiment is used.
The following notation method can be used instead of the n rule.

Parts type (character string), parts type (character string, ...), ...
-> Part name (character string), part name (character string,…) That is, the left side (left side of arrow “->”) indicates the condition to be satisfied, and if the left side is satisfied, it is converted into the right part group.
For example, in the case of the rule label [""] ()-> button ["cancel"] (), if you convert the label "cancel" in English, convert it to a katakana button "cancel". means. Instead of a character string, a variable name can be used as follows.

Label [$ a + "button"] (), label [$ b] ()-> butt
on [$ a] (), button [$ b] () In this case, if the label “OK button” and the label “Cancel” are converted, “a”
"K" is assigned, "cancel" is assigned to $ b, and converted into two buttons "OK" and "Cancel".

Here, it is assumed that the rule storage unit 6 holds the following rules.

Rule 1 [30]: label [$ a] (), combo [$ b *]-> f
rame [$ a] (option [$ b *] ()) Rule 2 [10]: label [$ a] ()-> button [$ a *] () Rule 3 [20]: combo [] ($ a *)-> kusto [] ($ a *) Rule 4 [15]: label [$ a] (), combo [$ b *]-> menu [$ a] ($ b *) Parentheses after the rule name The numbers in parentheses indicate the strength (weight) of each rule. In addition, a variable name that includes “*” indicates one or more items.

As described above, assuming that information on the GUI component is obtained by the component specifying unit 141, the conformity of each rule is as follows. Note that the degree of conformity of the rule is the number of conditions to be satisfied.

Rule 1 = 2 Rule 2 = 1 Rule 3 = 1 Rule 4 = 2 Further, when the priority is obtained by multiplying the strength of each rule, Rule 1 = 60 Rule 2 = 10 Rule 3 = 20 Rule 4 = 30 from this result, the order of the conversion candidates is rule 1, rule 4, rule 3 and rule 2.

Next, a third embodiment of the present invention will be described.

The present embodiment is characterized in that an appropriate GUI component is more effectively selected as a candidate based on the position in the screen or window where the GUI component is to be arranged. FIG. 18 is a diagram illustrating a configuration of a GUI editing device according to the present embodiment.

In FIG. 18, the position calculation unit 181
This is for calculating the position in the screen where the UI component is currently arranged. The position in the screen is represented, for example, by two values of the center position of each GUI component from the upper end and the left end in the window.

FIG. 19 is a flowchart showing the operation of this apparatus.

When a GUI component is selected with a mouse or the like and a conversion operation is performed using a conversion key (step 190).
1) The conversion instruction unit 26 sends a conversion instruction to the conversion unit 5 (step 1902), and notifies the position detection unit 181 of the GUI component to be converted (step 1903).
. The position detector 181 calculates the position of the GUI component (Step 1904). For example, if the windows are as shown in FIG.
2.5%, 12.5%), Button 2 (37.5%, 87.5%) and Button 3
The value (65.5%, 87.5%) is output to the conversion unit 5 (step 1905). It is also possible to use absolute coordinates on the screen instead of relative values on the screen. The conversion unit 5 converts the GUI component into a predetermined GUI component based on the output (
Step 1906). For example, in the case of button 1, since button 1 is at the top of the screen, it is converted to a menu at the top. In the case of button 2, since button 2 is at the bottom of the screen, it is converted to a menu at the bottom.

The following is an example of a rule stored in the rule storage unit 6.

Rule 5 [20]: label [$ a] (> 50%, <50%) ()-> button [$ a] () The percentage number given as an argument of label is a GUI component. Condition to be compared to the current position of That is, if the vertical position of the conversion candidate label is larger than 50% (located in the lower half of the window) and the horizontal position is smaller than 50% (located in the left half of the window), this rule is used. Will be satisfied.

According to the present invention, for example, a GUI part to be arranged at the top of a window is presented to the user as an optimal GUI part candidate by, for example, converting it into a menu, thereby making the GUI part easier to use. Can be built.

In FIG. 18, the position detector 18
1, the component specifying unit 141 is provided. However, in particular, only the position detecting unit 181 may be provided. In this case, the rules 1 to 4 become unnecessary.

Next, a fourth embodiment of the present invention will be described.

In a window as shown in FIG. 21A, when various “buttons” are scattered, it is difficult for the user to understand which GUI parts should be used as titles and how to arrange them. ,troublesome. Therefore, in the present embodiment, a method for specifying the order from the arrangement position of the GUI parts on the window will be described.

In a window as shown in FIG. 21A,
"Age:", "Under 20", "20-30", "3
It is assumed that seven GUI parts (buttons) of “0-40 years old”, “40-50 years old”, “50-60 years old” and “60 years old or older” are scattered.

FIG. 22 is a diagram showing the configuration of a GUI creation support device according to the fourth embodiment.

The order calculating section 221 shown in FIG.
When the seven GUI parts shown in A are selected and the conversion operation is executed, the order relation between the target GUI parts is obtained. For example, as shown in FIG. 21B, the order determining unit 221 orders the GUI components in order from the upper side in the display direction for the region of the rectangle 211 that inscribes all the selected GUI components in the case of the vertical orientation in the display direction. In this case, if the height difference between a certain GUI component and another GUI component is within N (N is a constant), the GUI component arranged on the left side in the display direction is replaced with the GUI component arranged on the right side. The ordering is performed so that the parts take precedence.

Rectangle 2 inscribing selected GUI part
If 11 is horizontally long in the display direction, the GUI components are ordered in order from the left side in the display direction. In this case, the horizontal difference is M
If it is within, the GUI arranged at the top of the display direction
The parts are ordered in preference to the GUI parts arranged below. Note that M and N may be reciprocals of the size of the component to be aligned.

In the example shown in FIG. 21B, the inscribed rectangle 21
1 is determined to be vertically long, so the upper
Order the parts.

FIG. 23 is a diagram for explaining the operation of the order determining unit 221.

In the figure, all the selected GUIs
It is determined whether the rectangular area inscribed in the component is vertically long or square (STEP 2301). If it is determined that the image is vertically long, a vertical direction priority flag is set to perform the ordering in the display direction upper side priority (STEP
2302). On the other hand, if it is determined to be landscape,
The horizontal direction priority flag is set (S P2303). The GUI component is selected from the direction indicated by this flag. Next, the order determination unit 221 performs initialization for loop processing (STEP 2304), and repeats the following processing until the variable j exceeds the number of selected GUI components (STEP 2305).

First, the order determination unit 221 selects the i-th and j-th GUI parts according to the direction priority flag (S
(Step 2306), it is determined whether or not the difference between the positions of the two GUI parts is within a constant N (STEP 230).
7). Here, the position difference is 2 in the case of priority in the vertical direction.
The difference between the horizontal center axes of the GUI parts (that is, the height), and in the case of giving priority to the horizontal direction, the difference between the vertical center axes. S
In the TEP 2307, when it is determined that the number is within N, it is determined whether or not the i-th GUI component is located to the left (above in the case of horizontal priority) with respect to the j-th GUI component ( (STEP 2308). If it is determined that the component is located on the left (upper) side, the order of the i-th GUI component is set to p, and the order of the j-th GUI component is lowered by one (STEP 2309). In addition, STEP2307
, If it is determined that it is larger than N,
The processing of TEP2309 is performed.

On the other hand, if it is determined in STEP 2308 that the GUI component is not located on the left (upper) side, the priority of the i-th and j-th GUI parts is switched. After that, the order determining unit 221 increments the variable by one to shift the GUI component of interest by one (STE
P2311), the above processing is repeated until the conditions are satisfied.

By the above processing, each GUI is set as follows.
The order of the parts is determined.

1 "age:" 2 "under 20 years old" 3 "20-30 years old" 4 "30-40 years old" 5 "40-50 years old" 6 "50-60 years old" 7 "60 years old or older" Here , Button [$ a] (), button [$ b *] ()-> label [$ a] (), combo [$ b *]
When the rule () is stored, the screen is converted to the screen shown in FIG. 16 described above by matching this rule.

Note that the ordering is not limited to the method described above, and it is sufficient that the ordering can be performed uniquely. For example, the order in which the components are selected, left priority, upper priority, determination of upper priority, left priority over L GUI components from the beginning, and the like are available.

Next, a fifth embodiment of the present invention will be described.

In the present embodiment, a plurality of GUI parts are grouped, and a conversion operation is performed on the grouped GUI parts, so that more optimal arrangement of the GUI parts can be performed. .

For example, when GUI components are arranged in a window as shown in FIG. 24A, normal conversion is performed as shown in FIG. 24B. On the other hand, in the present embodiment, the conversion as shown in FIG. 24C can be performed.

FIG. 25 is a diagram showing the configuration of a GUI component creation support device according to this embodiment. In the figure, a component grouping unit 251 groups a specific GUI component group based on a predetermined rule in accordance with a grouping instruction from the input unit 1, and a component grouping release unit 2
52, according to an instruction to cancel grouping from the input unit 1,
GUs grouped by the component grouping unit 251
The grouping of the I parts group is released.

FIG. 26 is a diagram showing a grouping procedure in the component grouping section.

First, for each of the arranged GUI components, a relationship is established for each of the two GUI components (S
(STEP 2601), and the linear distance between the GUI parts is obtained (STEP 2602). The GUI component distance is, for example, a linear distance between centers of the GUI components.

FIG. 27A is a conceptual diagram for calculating the distance between GUI components. That is, FIG. 27A shows a state in which the centers of the GUI components in the window shown in FIG. 24A are connected by a straight line.

Next, one of the longest line segments is selected from the associated line segments (STEP 2603), and the relation between the GUI parts is released (STEP 2604).
After the release, the line segments are traced in a predetermined order for each GUI part (element) (STEP 2605). Thereby, it is checked whether all the GUI parts are connected by the line segment, that is, whether or not the GUI parts are divided (STEP 26).
06). More specifically, starting from the GUI part “1” (in this case, the GUI part “Nationality” is set to “1”), it is possible to trace in the direction of the GUI part “2”. "1" is marked on an internal table (for example, an array variable). This is all the GUI
By examining the parts, it is possible to examine whether or not each GUI part is divided (see FIG. 27).
B).

If it is determined in STEP 2606 that the image is not divided, the flow returns to STEP 2603, and
The above process is repeated.

It is assumed that the cancellation of the relationship progresses and, for example, the state shown in FIG. In this case, the groups are divided into groups of "nationality", "Japan" and "other than Japan" and groups of "sex", "male" and "female".

The method of calculating the distance between the GUI components is not limited to the above method, and may be, for example, the distance between the ends of the GUI components. Also, the grouping method is not limited to the method described above. For example, after selecting a GUI component to be grouped with a mouse or the like, a command for grouping instruction may be input.

Next, a sixth embodiment of the present invention will be described.

In the fifth embodiment described above, when two or more groups exist at the same distance, the number of divisions may not be determined. Therefore, in this embodiment,
The number of groups is detected by the group number calculation unit.

FIG. 28 is a diagram showing the configuration of a GUI editing device according to the present embodiment.

When a group division instruction is input from the input unit 1, the component specifying unit 141 specifies the type of the selected GUI component and sends it to the group number calculating unit 281. The group number calculation unit 281 counts the number for each group, sets the group number candidates in ascending order, and sends the candidates to the grouping unit 251. The grouping unit 281 performs division until the specified number of groups is reached. When there is a request for grouping again, division is performed until the next group number candidate is obtained.

[0129]

As described above, according to the GUI creation support apparatus of the present invention, replacement of GUI parts having the same meaning is facilitated, and a more convenient GUI can be efficiently created.

Further, according to the present invention, since the type of the GUI component, the arrangement position on the screen, the arrangement order, and the like are taken into consideration, a GUI creation support device with excellent operability and conversion efficiency can be provided. Becomes

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration of a GUI creation support device according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration of a component management unit illustrated in FIG. 1;

FIG. 3 is a diagram illustrating an example of an initial state of a window.

FIG. 4 is a diagram illustrating an example of component data stored in a component storage unit illustrated in FIG. 1;

FIG. 5 is a diagram illustrating an example of a window in a state where a character string has been input.

FIG. 6 is a diagram illustrating an example of a window in a state of a drag and drop operation.

FIG. 7 is a flowchart illustrating an operation of the GUI creation support device according to the first exemplary embodiment.

FIG. 8 is a diagram illustrating an example of a window in a state where the label group of FIG. 6 is converted into a combo box.

FIG. 9 is a diagram illustrating an example of a window that has been converted to a standard combo according to a next candidate conversion instruction.

FIG. 10 is a diagram illustrating an example of a window that has been converted into a menu according to a next candidate conversion instruction.

FIG. 11 is a diagram illustrating an example of a window in a state of an operation of rearranging the order of display components.

FIG. 12 is a diagram illustrating an example of component data stored in a component storage unit illustrated in FIG. 1;

FIG. 13 is a flowchart illustrating a flow of a conversion process in the GUI creation support device according to the first embodiment.

FIG. 14 is a diagram illustrating a configuration of a GUI creation support device according to a second embodiment.

FIG. 15 is a flowchart illustrating an operation of the GUI creation support device according to the second embodiment.

FIG. 16 is a diagram illustrating an example of a display screen according to the second embodiment.

FIG. 17 is a diagram illustrating an example of a display screen according to the second embodiment.

FIG. 18 is a diagram illustrating a configuration of a GUI creation support device according to a third embodiment.

FIG. 19 is a flowchart illustrating an operation of the GUI creation support device according to the third embodiment.

FIG. 20 is a diagram showing an example of a display screen for explaining the third embodiment.

FIG. 21 is a diagram showing an example of a display screen for explaining a fourth embodiment.

FIG. 22 is a diagram illustrating a configuration of a GUI creation support device according to a fourth embodiment.

FIG. 23 is a diagram for explaining the operation of the order determining unit shown in FIG. 22;

FIG. 24 is a diagram showing an example of a display screen for explaining a fifth embodiment.

FIG. 25 is a diagram illustrating a configuration of a GUI creation support device according to a fifth embodiment.

FIG. 26 is a diagram illustrating a grouping procedure in the component grouping unit illustrated in FIG. 25;

FIG. 27 is a diagram illustrating an example of grouping in the component grouping unit illustrated in FIG. 25;

FIG. 28 is a diagram illustrating a configuration of a GUI creation support device according to a sixth embodiment.

[Description of Signs] 1 input unit 2 display unit 3 parts management unit 4 parts storage unit 5 conversion unit 6 rule storage unit 7 frequency storage unit 8 learning unit 21 input information interpretation unit 22 part data registration unit 23 parts selection unit 24 screen data Storage unit 25 Component data read unit 26 Conversion instruction unit 27 Candidate selection unit

Claims (17)

[Claims] 1. A G for creating a display screen including a display component
In the UI creation support device, when a first instruction is given to a first display component displayed on the display screen, a first display component that selects a second display component to be converted to the first display component is selected. And a means for controlling display of the second display component on the display screen in place of the first display component. 2. The GUI creation support device according to claim 1, wherein the second display component is provided for the displayed second display component.
Second selecting means for selecting a third display component to be converted from the second display component in accordance with the instruction of the third display component;
Means for performing control for displaying the display component on the display screen in place of the second display component. 3. The GUI creation support device according to claim 1, wherein the first selection unit is configured to execute the first selection based on a predetermined rule.
A GUI creation support device, wherein a second display component to be converted is selected. 4. The GUI creation support device according to claim 2, wherein the second selection unit is configured to execute the second selection based on a predetermined rule.
A GUI creation support device, wherein a third display component to be converted is selected. 5. The GUI creation support device according to claim 3, wherein the predetermined rule includes configuration information of a display component displayed on the display screen. 6. The GUI creation support device according to claim 4, wherein the predetermined rule includes configuration information of a display component displayed on the display screen. 7. The GUI creation support device according to claim 4, further comprising: means for determining the second display component as a display component, wherein the predetermined rule displays the second display component. A GUI creation support device, wherein the number of times determined as a part is included as frequency information. 8. The GUI creation support device according to claim 7, further comprising: a learning unit that updates the frequency information based on a learning rule when the second display component is determined as a display component. A GUI creation support device, characterized in that: 9. The GUI creation support device according to claim 1, wherein: means for storing type information of the first display component; and weights of a plurality of rules indicating a hierarchical relationship between the plurality of type information. Means for selecting a second display component to which the first display component is to be converted, based on the type information and the weight. Creation support device. 10. The GUI creation support device according to claim 1, further comprising: means for calculating a display position of the first display component on the display screen, wherein the first selecting means calculates the display position of the first display component. A second display component to which the first display component is to be converted, based on the displayed display position. 11. The GUI creation support device according to claim 1, wherein: means for calculating display positions of the plurality of first display components on the display screen; and the display based on the calculated display positions. Means for determining each display position of the second display component on the screen. 12. The GUI creation support device according to claim 1, wherein: a means for grouping the plurality of first display components; and
Means for determining each display position of the second display component on the display screen.
Creation support device. 13. The GUI creation support device according to claim 12, further comprising: means for calculating the number of groups based on the type of the first display component; A GUI creation support device, wherein a plurality of the first display components are grouped based on the group. 14. A GUI creation support method for creating a display screen including a display component, wherein, when a first instruction is given to the first display component displayed on the display screen, the first display component is provided. Selecting a second display component to be converted, and performing control to display the second display component on the display screen in place of the first display component. . 15. The GUI creation support method according to claim 14, wherein the second display component provided to the displayed second display component is provided.
According to the instruction of the third display component to be converted from the second display component, the control for displaying the third display component on the display screen in place of the second display component A GUI creation support method characterized by performing: 16. A recording medium in which a program for creating a display screen including a display component is recorded, wherein the program is provided with a first instruction to a first display component displayed on the display screen. A first selecting means for selecting a second display component to which the first display component is to be converted; and displaying the second display component on the display screen in place of the first display component. And a means for performing control for performing the recording. 17. The recording medium according to claim 16, wherein
A second program provided to the displayed second display component.
Means for selecting a third display component to be converted from the second display component according to the instruction of the second display component; and displaying the third display component on the display screen in place of the second display component. A recording medium, further comprising means for performing control.