JP2007048309A - User interface device and program therefor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a user interface for changing over a display component in response to state transition to an event to be easily displayed by previously executing addition/deletion of the state and edition of a display component in each state and an event process. <P>SOLUTION: This user interface device is provided with: an input means for inputting information from an input apparatus; a display means for displaying a user interface of a design object device; a basic display component storage means for storing basic display components previously designed as components for displaying the user interface; a composite display component storage means for hierarchically storing composite display components for defining the arrangement of basic display components displayed in each state and other composite display components; and a simulation means for simulating the sizes, positions, appearances and behaviors of the composite display components based on the information input by the input means. The composite display component has an event handler for executing transition between states and a defined process based on the information input by the input means in a plurality of states and each state. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a user interface device and a program for a user interface device that are applied to the design of a user interface such as a mobile phone or a portable information terminal that switches display components in accordance with a state transition with respect to an event.

  FIG. 3 is a block diagram showing a conventional user interface design apparatus disclosed in Patent Document 1, for example. The apparatus disclosed in this document includes a layout design unit 111 that interactively designs layout data, an attribute setting unit 112 that sets attribute data, and a generation trigger setting unit 113 that sets a generation trigger for each GUI component. GUI screen design apparatus 101, layout data storage section 121, attribute data storage section 122, and generation data storage section 123, a design data storage apparatus 102, and a source program based on the design data The source program generating device 103 by the GUI screen source program generating unit 131 for generating the image and the output device 104 for outputting to a hard disk or the like (see, for example, Patent Document 1).

  In the user interface design device having such a configuration, when a first generation opportunity is set, a source program for generating a GUI component and an access function source program are generated in the GUI screen, and a second generation opportunity is generated. Is set, a source program of a dynamically generated access function is generated, and a GUI component is generated when necessary.

JP 2000-137599 A

  In the conventional user interface design apparatus having such a configuration, design of user interface parts accompanied by state transition and simulation of a user interface combining them cannot be performed.

  The present invention has been made in order to solve the above-described problems. A user interface for switching display components in accordance with a state transition with respect to an event is added to a display component and event processing in each state. It is an object of the present invention to obtain a user interface device and a user interface device program that can be easily designed by editing.

  This invention is designed in advance as input means for inputting information from an input device, display means for displaying the user interface of the design target apparatus on the display apparatus, and parts for displaying on the user interface of the design target apparatus. Basic display component storage means for storing the basic display component, and composite display component storage means for storing the composite display component, wherein the composite display component includes the basic display component to be displayed in each state and other composite displays. Based on the information input by the composite display component storage means and the input means for defining the arrangement of the parts, the size, position, appearance, and behavior of the composite display component stored in the composite display component storage means are simulated. Simulation means for displaying the user interface on the display means, and the composite display component is A plurality of states and an event handler for performing a transition between the states and a defined process based on the information input by the input unit in each of the states; The composite display component in which a basic display component to be displayed in each state of the component and other composite display components are combined in a hierarchical manner is stored, and the simulation means receives an operation input input via the input device. Based on this, if there is the basic display part to be displayed on the stored composite display part, the basic display part is displayed, and if there is another composite display part to be displayed, the composite display part is processed. Simulating the size, position, appearance and behavior of the composite display component stored in the composite display component storage means A user interface device according to symptoms.

  This invention is designed in advance as input means for inputting information from an input device, display means for displaying the user interface of the design target apparatus on the display apparatus, and parts for displaying on the user interface of the design target apparatus. Basic display component storage means for storing the basic display component, and composite display component storage means for storing the composite display component, wherein the composite display component includes the basic display component to be displayed in each state and other composite displays. Based on the information input by the composite display component storage means and the input means for defining the arrangement of the parts, the size, position, appearance, and behavior of the composite display component stored in the composite display component storage means are simulated. Simulation means for displaying the user interface on the display means, and the composite display component is A plurality of states and an event handler for performing a transition between the states and a defined process based on the information input by the input unit in each of the states; The composite display component in which a basic display component to be displayed in each state of the component and other composite display components are combined in a hierarchical manner is stored, and the simulation means receives an operation input input via the input device. Based on this, if there is the basic display part to be displayed on the stored composite display part, the basic display part is displayed, and if there is another composite display part to be displayed, the composite display part is processed. Simulating the size, position, appearance and behavior of the composite display component stored in the composite display component storage means Therefore, it is possible to easily design a user interface that switches display components in accordance with state transitions for events by adding / deleting states and editing display components and event processing in each state. It becomes possible.

Embodiment 1 FIG.
FIG. 1 is a block diagram of a user interface design apparatus according to Embodiment 1 of the present invention. This apparatus includes a state set editing unit 10, an event process editing unit 20, a basic display component storage unit 30, a state display editing unit 40, a composite display component storage unit 50, an attribute editing unit 60, a composite display component attribute setting unit 70, and a simulation unit. 80, virtual display component storage means 90.

  The composite display component to be designed in the user interface design apparatus has a state space composed of a plurality of states, and enables design description of behavior such as display and state transition in each state.

  The state set editing means 10 is used for defining the state space of the composite display component. Specifically, it is possible to add a new state to the state space of the composite display component or delete a state that already exists in the state space. Each state may be given a name for identifying each state. Further, when there are a plurality of states in the state space, any state may be set as an initial state in order to specify which state is to be initially obtained when the composite display component is displayed. Further, a function for editing a state group consisting of several states may be provided. Then, it is possible to activate each corresponding event processing editing unit 20 or status display editing unit 40 by designating each state or state group.

  The event processing editing means 20 is used to design and describe the behavior of each state or state group of the composite display component. Specifically, an event handler that defines what kind of event is to be processed in each state or state group is set.

  Examples of event types include a key event such as a key being pressed, a mouse event such as a mouse button being clicked, a timer event that occurs when a specified time elapses after entering a certain state, a key or a mouse, etc. A release event that occurs after a specified time after the input from ceases, an entry event that occurs when entering a certain state or state group, an exit event that occurs when exiting from a certain state or state group, or an audio input An audio input event, an image input event that occurs due to input from a camera, a motion event that occurs due to the movement of a device, and the like are considered. Furthermore, internal events used for communication / synchronization between composite display components, etc., difficult or complicated to realize with real user interface devices, events related to functions under development, or simulation means A virtual event that makes it possible to set an event that is difficult to simulate in 80 and design a corresponding event handler is also conceivable. Further, for example, various events may be provided with attributes for identifying the event in detail, such as which key is pressed in the case of a key event and how long a specified time is in the case of a timer event.

  In the event handler, the type and attribute of the event and an action that defines the processing when the corresponding event occurs are set. Processes described by actions include the internal state of the user interface device and the attributes of display components to be described later, the transmission of internal events to other composite display components, the execution of some program code, and the transition of composite display components And so on. In addition, it may be possible to set a so-called guard in the event handler so as to determine whether or not an event should be processed based on an internal state of the user interface device, and to prevent event processing. For the description of actions and guards, for example, it is conceivable to use an interpreter-executable programming language.

  The basic display component storage unit 30 stores basic display components designed in advance. As basic display parts, buttons, labels, text input forms, check boxes, menus, and the like can be considered. In addition, a panel or a frame for arranging other basic display components may be considered. Although it is possible to prepare as many basic display parts of the same type as the layout, size, color, display character string, etc., as necessary, it is possible to change them as attributes and edit attributes at the time of design. If editing is possible at 60, the number of basic display parts to be prepared is reduced, and the versatility of individual basic display parts is improved.

  The status display editing means 40 can add a new display component to be displayed in each status or status group of the composite display component, or delete a display component that has already been registered or added to each status or status group. To.

  As the display component, for example, the basic display component stored in the basic display component storage unit 30, the composite display component in the composite display component storage unit 50 for storing the already designed composite display component, or the virtual display component storage unit 90 is used. There is a virtual display component stored in.

In addition, the layout of the display parts to be displayed in each state or state group of the composite display parts is displayed graphically together with their appearance, and they are directly operated with a mouse etc., and the layout such as the size and size or the context between parts is displayed. It may be possible to graphically edit the attribute / information related to or to directly start the attribute editing means 60 corresponding to each display component.
The composite display component storage means 50 stores composite display components that have already been designed.

  The attribute editing means 60 sets attribute values of display parts such as basic display parts and composite display parts. In addition to general attributes such as placement and size, for example, in the case of buttons, depending on the type of display component such as the display character string and its color, background color, events that occur when pressed, etc. Things can be considered. Moreover, you may give the name for identifying a display component mutually as an attribute. The attribute editing means 60 may provide an editing method according to these attribute types. It is also conceivable that an attribute of a certain display component can be set so as to refer to an attribute value of another display component.

The composite display component attribute setting means 70 adds and deletes attributes of the composite display component. When adding an attribute, the attribute type, name, initial value, reference relationship, etc. are set. As a result, the appearance and behavior of the composite display component can be easily changed by setting the attributes.
The simulation unit 80 simulates the operation of the composite display component.

  To simulate a composite display part, first set the state of the composite display part to the initial state, generate a display part corresponding to the initial state and the state group to which the initial state belongs, initialize the attributes, and specify While displaying in the specified layout, enable event handlers corresponding to them. The activated event handler waits for the occurrence of a corresponding event while starting a timer or the like as will be described later. The display of each display component is determined according to the attribute, for example. If the component to be displayed includes another composite display component, the above processing is repeated for the generated composite display component.

  Although the occurrence of an event may be simulated as it is, for example, an event corresponding to pressing a button representing a key of a user interface device is simulated by a mouse click or the like, and a key event specified by a button attribute or the like is used. It can be considered that the event handler of an appropriate display component (for example, a so-called focused display component) generates the event handler. In the case of a timer event, it is conceivable that a timer is started when a corresponding event handler becomes valid, an event is generated after a predetermined time, and is processed by the event handler. In the case of a release event, the timer may be reset every time a key event or the like occurs. When an event handler corresponding to a virtual event becomes valid, for example, a special button for generating the event is displayed on the display. Then, it is conceivable that a virtual event is generated by the user selecting it with a mouse or the like and processed by the event handler. On the other hand, if there is an event handler for an entry event of a certain state or state group, the event handler is processed when the state or state group is entered.

  In processing of an event handler corresponding to an event, first, if there is a guard, it is evaluated, and it is determined whether or not action processing is performed. If there is no guard, or if it is determined that the action should be processed as a result of evaluating the guard, the action is processed. As described above, guards and actions may be described in some programming language, for example, and interpreted. In addition, for the purpose of improving the response speed to a specific event, processing priorities may be given according to the type of event. On the other hand, depending on the type of event, a procedure for searching for a display component having an event handler that can process the event may be prepared. For example, in the case of a key event, if a display component with a so-called focus cannot process the key event, the event handler of the panel or composite display component on which the display component is placed, corresponding to the key event It is conceivable to search for and execute the processing. Furthermore, in the processing of guards and actions, a display component refers to the attribute value of another display component, or the named display component is managed using a so-called associative array, and these display components are referred to by name. You may realize that.

  When a composite display component transitions to another state as a result of the action processing in the event handler, if there is an exit handler corresponding to the current state or a current state group that is not common to the next state, it is executed. Then, the current state group that is not in common with the next state and the display component corresponding to the current state are not displayed and are deleted. In addition, event handlers corresponding to them are invalidated. If the part to be erased is a composite display part, the display part displayed in the part is erased and the event handler is invalidated recursively. On the other hand, when invalidating an event handler, processing such as invalidating a corresponding timer or deleting a button for generating a corresponding virtual event is performed as necessary. Then, the generation and display of the display component corresponding to the new state and the new state group not common to the current state among the state groups to which the state belongs, display, and validation of the event handler are performed as described above.

  The virtual display component storage means 90 is a function that is difficult or complicated to implement in an actual user interface device, or is a function under development, but the simulation means 80 has a function that is easy to implement virtually. Stores virtual display components.

  Next, how a display component is switched in accordance with a state transition in a composite display component designed using the above-described user interface design apparatus will be described with reference to FIG. For simplicity of explanation, each composite display component has state 1 as an initial state, and an event handler for transition from each state to another state is set for each state, while a state group is set. Shall not. In addition, it is assumed that an instance of each display component is generated before being displayed.

  In FIG. 2, the composite display component X has L states from state 1 to state L. For example, the basic display component A and the composite display component Y are used in the state 1, the basic display component B and the basic display component C are used in the state 2, and the basic display component D and the composite display component Z are used in the state L.

  On the other hand, the composite display component Y has M states from state 1 to state M. For example, in the state 1, the basic display component E is used, in the state 2, the basic display component F is used, and in the state M, the composite display component Z and the basic display component G are used.

  Further, the composite display component Z has N states from state 1 to state N. For example, the basic display component H is used in the state 1, the basic display component I is used in the state 2, and the basic display component J and the basic display component K are used in the state N.

  When the composite display component X is displayed when each display component is designed as described above, the composite display component X is first in state 1 and the composite display component Y is displayed together with the basic display component A. The composite display component Y is also in the state 1 first, where the basic display component E is displayed.

  Subsequently, if the composite display component Y is in the state M as a result of state transition by some event processing, the basic display component E disappears and the composite display component Z is displayed together with the basic display component G. The composite display component Z is first in state 1 where the basic display component H is displayed. On the other hand, the basic display component A displayed by the composite display component X remains displayed.

  Here, if a state transition occurs in the composite display component Z and the state N is reached, then the basic display component H disappears and the basic display component J and the basic display component K are displayed.

  Here, when the composite display component X transitions to the state 2, all but the composite display component X disappear, and the basic display component B and the basic display component C are displayed. Furthermore, when the composite display component 1 transitions to the state L, the basic display component B and the basic display component C disappear this time, the basic display component D and the composite display component Z are displayed, and the composite display component Z is First, the state 1 is reached, and the basic display component H is displayed there.

  Although switching of display components has been described here, the same processing is performed for enabling / disabling an event handler corresponding to each state.

  As described above, according to the first embodiment, the user interface design device adds the state set editing means 10 for adding / deleting the state of the composite display component composed of a plurality of states, and the transition between the states in each state of the composite display component. Event processing editing means 20 describing event processing such as, basic display part storage means 30 for storing basic display parts designed in advance, and basic display parts to be displayed in each state of the composite display parts are added / deleted. Since the state display editing means 40 is provided, a user interface that switches display components in accordance with the state transition for an event can be added, state addition / deletion, event processing editing in each state, and basic display component addition / deletion. It becomes possible to design easily.

  Furthermore, since the composite display component storing means 50 for storing the designed composite display component is provided, and the status display editing means 40 can add / delete other designed composite display components, a state where the composite display component is present. It becomes possible to arrange / delete another composite display part in FIG. For this reason, for example, even in the case of FIG. 2, as the design of the composite display component Z needs only one time, a complicated user interface including partially independent state transitions can be changed to the same user interface design. By combining a plurality of composite display parts designed by the apparatus in a hierarchical manner, it becomes possible to design with a good view while preventing a combined explosion of the number of states that occur when trying to handle them in one state space.

  The state set editing unit 10 can group several states of the composite display component, and the state display editing unit 40 can display display components that are displayed in a grouped state in common. By making it possible to edit together, it is possible to simplify the editing of display components that are displayed in common in several states.

  In addition, the state set editing unit 10 can group several states of the composite display component, and the event processing editing unit 20 can collectively edit common event processes. Thus, it is possible to simplify editing of event processing that is common in several states.

  In addition, the basic display component stored in the basic display component storage means 30 has attributes corresponding to the size, position, appearance, and behavior, and the basic display added to each state or group of states of the composite display component. By providing the attribute editing means 60 for editing the attributes of the parts, the layout desired by the designer can be obtained by changing the attributes of the basic display parts without preparing a large number of display parts of the same type having different layouts, appearances, and behaviors. , Appearance and behavior can be set flexibly and efficiently. Therefore, it is possible to efficiently realize the user interface in each state of the composite display component.

  Further, it further comprises composite display component attribute setting means 70 for adding / deleting attributes corresponding to the size and position of the composite display component and its appearance and behavior, and the attribute editing means 60 is provided for each state or By making it possible to edit the attributes of composite display parts added to a state group, it is possible to change the appearance and behavior of composite display parts by setting attributes, and the same type of appearance and behavior can be changed. Even if a large number of composite display parts are not prepared, the user interface in each state of the composite display part can be efficiently realized by changing the attribute.

  In addition, the attribute editing means 60 makes it possible to refer to and describe the attribute value of another basic display component or composite display component as the attribute value of the basic display component or composite display component. Designing a user interface that changes the appearance and behavior according to the attributes of an object becomes easy.

  In addition, the status display editing means 40 graphically displays the layout and appearance of the basic display component or the composite display component in each state or group of states of the composite display component, and directly manipulates them with a mouse etc. Arrangement of display parts in each state of the composite display part by enabling graphical editing of layout-related attributes and information such as size and context between parts, and enabling the corresponding attribute editing means 60 to be directly started It is possible to efficiently modify the arrangement and edit the attributes while intuitively grasping the above.

  Further, a simulation unit 80 for simulating the behavior of the composite display component stored in the composite display component storage unit 50 based on a touch input of a display and an operation input input via an input device such as a mouse or a keyboard is further provided. By providing, it becomes possible to proceed with the design while confirming the behavior of the composite display component being designed.

  In addition, as a component to be displayed in each state or group of states of the composite display component, it is difficult or complicated to realize with an actual user interface device, or is a function under development. By further including virtual display component storage means 90 for storing virtual display components having functions that can be easily performed, it is easy to proceed with the design while reviewing a new user interface function at an early stage of the design. Become.

  Further, the event processing editing means 20 virtually sets an event that is difficult or complicated to implement in an actual user interface device, or that is related to a function under development, or that is difficult to simulate in the simulation means 80. Then, it is possible to edit the event processing for such an event, the simulation means 80 issues a virtual event via the input / output device, and the processing for the issued virtual event is processed as a target composite. By making it possible to simulate with display components, it is difficult or complicated to realize with an actual user interface device, or it is difficult to simulate with events related to functions under development, or simulation means User interface behavior for events Easy to design and can be confirmed.

  According to the present invention, the following effects can be obtained.

  1. As described above, the user interface design apparatus according to the present invention includes a state set editing unit for adding / deleting a state of a composite display component having a plurality of states, and an event such as a transition between states in each state of the composite display component. Event processing editing means for describing processing, basic display part storage means for storing predesigned basic display parts, and status display editing means for adding / deleting basic display parts to be displayed in each state of the composite display parts Therefore, it is possible and easy to design a user interface with state transition for an event.

  2. The user interface design apparatus according to 1 further includes a composite display component storage unit that stores the designed composite display component, and the status display editing unit also adds the other designed composite display component.・ Equipped with a function to delete, it is possible to design a complex user interface containing partially independent state transitions as a combination of decoding display parts with a good view while preventing a combined explosion of the number of states. Become.

  3. With respect to any one of the user interface design apparatuses according to 1 or 2, the state set editing unit groups several states of the composite display component, and the state display editing unit includes the grouped display units. By providing a function for collectively editing the display components that are displayed in common in the states, it is possible to simplify the editing of the display components that are displayed in common in several states.

  4). With respect to any one of the user interface design apparatuses described in 1 to 3, the state set editing unit groups several states of the composite display component, and the event processing editing unit By providing a function for collectively editing event processes that are common to states, editing of event processes that are common to several states can be simplified.

  5. With respect to any one of the user interface design apparatuses according to 1 to 4, the basic display component stored in the basic display component storage means has attributes corresponding to size, position, appearance, and behavior, and the composite By providing attribute editing means for editing the above attributes of basic display parts added to each state or group of display parts, it is possible to change the attributes without preparing parts according to arrangement, appearance, behavior, etc. It is possible to efficiently design a user interface with state transition while using the desired arrangement and appearance of basic display components.

  6). Compound display part attribute setting means for adding / deleting attributes corresponding to the size, position, appearance, behavior, etc. of any of the user interface design devices described in 5 above, the attribute editing means, By providing a function to edit the attributes of composite display parts added to each state or group of states of the above composite display parts, it is possible to prepare the same kind of decoding display parts of different types, such as arrangement, appearance, and behavior. By changing the attributes, it is possible to efficiently design a user interface with state transition while setting and using the desired arrangement, appearance, and behavior of the decoding display component.

  7). For the user interface design device described in any one of 5 and 6, the attribute editing unit may use another basic display component or the composite display component as an attribute value of the basic display component or the composite display component. By providing a function for referring to and describing the value of the attribute, it is easy to design a user interface that changes the appearance and behavior according to the attributes of other display components.

  8). For any one of the user interface design devices described in 1 to 7, the status display editing means graphically displays the arrangement of the basic display component or the composite display component in each state or group of states of the composite display component. In addition, it is possible to directly edit the attributes and information related to the layout such as the size, size, and the context between parts, and to directly activate the corresponding attribute editing means. Accordingly, it is possible to efficiently correct the arrangement and edit the attributes while intuitively grasping the arrangement of the display components in each state of the composite display component.

  9. Simulation means for simulating the behavior of the composite display component stored in the composite display component storage means based on an operation input input to the user interface design device described in 1 to 8 above through an input device In addition to simulating the user interface, it is possible to proceed with the design while confirming the behavior of the composite display component being designed, so it is possible to proceed with the design of the user interface with state transitions. It becomes possible.

  10. A virtual display component storing unit that stores a virtual display component having a function that can be easily implemented virtually in the simulation unit is provided for the user interface design device described in 9 above, thereby providing a virtual display. It becomes possible to design and simulate a user interface using parts, and it is easy to proceed with the design while reviewing a new user interface function from an early stage of the design.

  11. In the user interface design device described in any one of 9 and 10, the event processing editing unit virtually sets an actually difficult event, edits the event processing for the event, and the simulation unit In an actual user interface device, the above virtual event is issued via an input / output device, and the process for the issued virtual event is simulated by the target composite display component. It is easy to design and confirm a user interface for an event that is difficult or complicated to implement, an event related to a function under development, or an event that is difficult to simulate by a simulation means.

It is a block diagram which shows the user interface design apparatus of this invention. It is a hierarchy figure for demonstrating a composite display component. It is a block diagram which shows the conventional user interface design apparatus.

Explanation of symbols

  10 state set editing means, 20 event processing editing means, 30 basic display part storage means, 40 state display editing means, 50 composite display part storage means, 60 attribute editing means, 70 composite display part attribute setting means, 80 simulation means, 90 Virtual display component storage means.

Claims (4)

An input means for inputting information from the input device;
Display means for displaying the user interface of the device to be designed on the display device;
Basic display component storage means for storing basic display components designed in advance as components for display on the user interface of the device to be designed;
Composite display component storage means for storing a composite display component, wherein the composite display component defines a layout of the basic display component and other composite display components to be displayed in each state,
Simulation that displays the user interface on the display unit by simulating the size, position, appearance, and behavior of the composite display component stored in the composite display component storage unit based on the information input by the input unit Means and
The composite display component has a plurality of states and an event handler that performs transition between the states and a defined process based on information input by the input unit in each state.
The composite display component storage means stores the composite display component in which the basic display component to be displayed in each state of the composite display component and other composite display components are combined hierarchically,
The simulation means displays the basic display component if there is the basic display component to be displayed on the stored composite display component based on the operation input input via the input device, and displays other basic display components. If the composite display part is present, the size, position, appearance, and behavior of the composite display part stored in the composite display part storage means are simulated while repeating the process for the composite display part. User interface device. The basic display component stored in the basic display component storage means and the composite display component stored in the composite display component storage means have attributes corresponding to size, position, appearance and behavior,
The composite display component stored in the composite display component storage means is a basic display component added to each state of the composite display component and a composite display component having the attributes of the composite display component, and the composite display component. The user interface device according to claim 1, further comprising: a composite display component having an attribute corresponding to the behavior. The attribute values of the basic display component and the composite display component can be described so as to refer to the attribute values of the other basic display component and the composite display component,
The simulation means refers to the attribute value when the attribute value of the basic display component and the composite display component refers to the attribute value of another basic display component and the composite display component. Item 3. The user interface device according to Item 2. Computer
An input means for inputting information from the input device;
Display means for displaying the user interface of the device to be designed on the display device;
Basic display component storage means for storing basic display components designed in advance as components for display on the user interface of the device to be designed;
Composite display component storage means for storing a composite display component, wherein the composite display component defines a layout of the basic display component and other composite display components to be displayed in each state,
Simulation that displays the user interface on the display unit by simulating the size, position, appearance, and behavior of the composite display component stored in the composite display component storage unit based on the information input by the input unit A program for a user interface device for functioning as a means,
The composite display component has a plurality of states and an event handler that performs transition between the states and a defined process based on information input by the input unit in each state.
The composite display component storage means stores the composite display component in which the basic display component to be displayed in each state of the composite display component and other composite display components are combined hierarchically,
The simulation means displays the basic display component if there is the basic display component to be displayed on the stored composite display component based on the operation input input via the input device, and displays other basic display components. If the composite display part is present, the size, position, appearance, and behavior of the composite display part stored in the composite display part storage means are simulated while repeating the process for the composite display part. A program for a user interface device.

Images