JPH09292963A - Graphical user interface - Google Patents

Abstract

PROBLEM TO BE SOLVED: To complement the insufficient reality and to obtain a satisfactory operating feeling by operation through a touch screen. SOLUTION: Displaying and operating parts can be scaled on a electing picture. In addition, the displaying and operating parts are vibrated and made to flow according to operation. In addition at the time of scrolling, a footprint in the direction is animation-displayed. At the time of indicating one of the picture of the displaying and operating parts, when it is specified to be the picture 38b of a displaying and operating part 100 based on its detected coordinate, pictures 39a, 39b... constituting a picture F next to it are displayed on a display unit based on an operation procedure data 12a. As operation procedure data is managed by a procedure managing parts separated and independently from the displaying and operating part, an operation procedure can be corrected easily without changing the displaying and operating part. It is also possible to add operation procedure data with a weight value to vary according to the history of operation to magneifying display or to eliminate the procedure.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a graphical user interface for operating devices of various devices in an air conditioner, a lighting device, a power receiving / distributing device, a home electric appliance and the like.

[0002]

2. Description of the Related Art In recent years, a direct touch system using a touch screen is becoming the mainstream as a graphical user interface of an operating device in an air conditioner, a lighting device, a power receiving and distributing device, a home electric appliance and the like. In the input method using the touch screen, the operation can be performed by directly touching the images of the operation buttons, operation keys, etc. that appear on the operation / display screen of the operation device, so that comfortable operation based on intuition can be performed. If there is a display that does not fit within the display / operation screen of the operating device, the scroll function is generally used, and the display / operation screen can be displayed by operating the images such as the arrow keys that appear on the display / operation screen. The display range is moved by scrolling part or all of the display vertically and horizontally. Further, as an auxiliary function of user operation, a display / operation component having various data such as image display data of an image of a function symbol such as an operation button or an operation key displayed on the display / operation screen is displayed / operated, for example. There is corresponding help information that explains the functions of the parts, and these help information are usually fixed, and display / display
When the image of the function symbol of a certain display / operation component displayed on the operation screen is operated, help information about the operated display / operation component is displayed on the display / operation screen.

In the software development in the graphical user interface of such an operating device, various data such as image display data of an image of a function symbol such as an operation button or an operation key and an image of the function symbol are operated and functions when the image is received. A display / operation screen corresponding to the operation device is created by arranging the image of the function symbol of the display / operation part having a program (software) for realizing the operation of the symbol on the screen. A program (software) that realizes the operation of the functional symbols of each display / operation component directly links each display / operation component to the next display / operation screen, and the operation procedure is created by this flow.
Then, when the display / operation screen is actually operated, a program (software) that realizes the operation of the function of the display / operation component is executed according to the operation procedure.

Further, as in the invention disclosed in, for example, Japanese Unexamined Patent Publication No. 6-202863, a procedure setting object for performing continuous procedure setting of the operation content of the user and the processing operation corresponding to the operation is provided as a function. In some cases, it is provided separately from the display / operation component having a program (software) that realizes the operation of. Again,
The operating procedure is in a fixed state during operation of the operating device, and the operating procedure is performed according to the fixed operating procedure.

[0005]

The conventional graphical user interface as described above visually recognizes an image of an operation button or an operation key displayed on a flat display unit such as an LCD (liquid crystal display), Since this image is operated by touching it through a flat touch screen, the tactile feeling of the operation is significantly insufficient compared to the case of operating a physical operation button or operation key in the real world, and the operation feeling is It was hard to get. Further, in the scroll function as well, there is a problem in that the direction of scrolling is difficult to understand from an image on the display / operation screen or an image such as an arrow key that indicates scrolling that appears on the display / operation screen. Furthermore, since the help information provided corresponding to each display / operation component is fixed as an auxiliary function of the user's operation, for example, the explanation of the function is passed and help information that is not practical can be obtained. Often provided, it is difficult for the user to obtain the information necessary to do what he / she intends, or on the contrary, excessive information is given to the user, which hinders the operation. There were things. In addition, in a memory in which more help information is stored than necessary, it may be uselessly consumed.

Further, each display / operation part is directly linked to the next display / operation screen by a program that realizes the operation of functions, etc., and the operation procedure is created by this flow, so the operation procedure is changed. In that case, it is necessary to repair each display / operation component level, and there is a problem that a huge amount of work is required to change the operation procedure and the cost becomes high.

Furthermore, since the display / operation component incorporates a plurality of programs that realize the operation of functions regardless of whether they are executed or not,
In some devices, unnecessary extra programs are installed, which causes problems such as unnecessarily consuming memory.

The present invention has been made to solve the above-mentioned problems, and improves operability and development efficiency.
The purpose of the present invention is to provide a graphical user interface capable of improving memory consumption.

[0009]

A graphical user interface according to the present invention is a display / operation part having various data including image display data and means for realizing various calculations, and image display data of the display / operation part. A display unit displaying an image of a functional symbol based on
A touch screen arranged on the surface of the display unit for detecting the coordinates of the position of the image display data of the image of the instructed and operated function symbol, and the image display data of the image instructed and operated based on the output signal of the touch screen. And a display / operation component specifying unit for specifying a display / operation component having each, and each display / operation component stores image display data of an image of a function symbol displayed on the display unit as various data and image display data. Display coordinate position data for displaying, and further as a means, display based on the display / operation component specifying information by the display / operation component specifying unit and the operation information on the image of the instruction and the operated function symbol. -Operation processing determination means for determining the operation mode to be processed for the one specified by the operation component specifying unit, and image display Coordinate position calculating means for calculating the coordinate position of the data, image size calculating means for calculating the image size of the image display data in the horizontal and vertical directions, and coordinate position information and image size by the coordinate position calculating means. A display for displaying the image of the functional symbol on the display unit based on the image size information by the calculation means.
When it is determined by the operation component image generation means and the operation processing determination means that the operation mode to be processed is reduction or enlargement image size batch conversion, the coordinate position calculation means and the image size calculation means are driven to display this display. An image size batch conversion processing unit that reduces or enlarges the image of the operation component.

Further, the graphical user interface according to the present invention has each display / operation component, a display unit, a touch screen, and a display / operation component identification section, and reduces or reduces an image as the display / operation component. A reduction / enlargement display / operation component for instructing enlargement is provided, and the reduction / enlargement display / operation component has image display data of an image of a function symbol as various data and display coordinate position data. As the operation processing determination means, the coordinate position calculation means, the image size calculation means, the display / operation component image generation means, and the operation mode to be processed by the operation processing determination means is a reduction or enlargement image size batch conversion. When it is determined, the coordinate position calculation means and the image size calculation means are driven to display the display designated in advance as the target of the image size batch conversion. Those having an image size batch conversion processing means for reducing or enlarging an image displayed in the area which is previously designated image or display unit of work parts.

The graphical user interface according to the present invention has each display / operation component, a display unit, and a display / operation component specifying unit, and each display / operation component has various types of data such as an image of a function symbol and a function. Image data having image display data of a vibration animation image expressing the vibration of the image of the symbol and display coordinate position data, operation processing determining means as means, and image data for continuously reading image display data of the vibration animation image. Continuous read instruction means, display / operation component image generating means for displaying an image of the vibration animation on the display unit based on the image display data of the image of the vibration animation read by the image data continuous read instruction means, and operation processing determination The operation mode to be processed by the means is the process of adding vibration animation. When it is determined, by driving the image data continuously read instruction unit, and has a vibration animation processing means for adding an image of the vibration animation for the image according to the display and operating parts.

The graphical user interface according to the present invention has each display / operation component, a display unit, a touch screen, and a display / operation component identification section, and each display / operation component is a functional symbol as various data. Image display data of the image, and display coordinate position data, operation processing determination means as means, image display portion setting means for indicating and setting the portion of the image display data displayed on the display unit, The flow of the image is the display / operation component image generating means for displaying the image of the portion where the functional symbol is designated on the display unit based on the setting information by the display portion setting means, and the operation mode to be processed by the operation processing determining means. When it is determined that the image display portion setting means is driven, the image of the designated portion related to this display / operation component is continuously displayed. Those having a flow animation processing means for flowing an image is displayed.

Further, the graphical user interface according to the present invention has each display / operation component, a display unit, and a display / operation component identification section, and is used for instructing the flow of an image as the display / operation component. It has a fluid display / operation component, and this fluid display / operation component has image display data of an image of a function symbol as various data and display coordinate position data, and an operation processing determination means and an image display portion as means. Setting means, display / operation component image generating means,
When it is determined by the operation processing determination means that the operation mode to be processed is the image flow, the image display portion setting means is driven to specify the display / operation part that is previously specified as the object of the image flow. And a fluid animation processing means for continuously displaying partial images and fluidizing the images.

Further, the graphical user interface according to the present invention has image display data of a band-shaped image of numbers as various data of each display / operation part.

The graphical user interface according to the present invention has each display / operation component, a display unit, a touch screen, and a display / operation component identification section, and is displayed on the display unit as the display / operation component. Display / operation screen composed of images of display / operation parts or display in a predesignated area / scroll display for instructing vertical / horizontal scrolling of the operation screen The operation component has, as various data, image display data of an image of a function symbol and an image of a direction instruction animation that expresses a scroll direction, and display coordinate position data. As a means, an operation process determination means and a direction instruction animation Image data continuous read-out instruction means for continuously reading out image display data of images, and image display data. Coordinate position calculation means for calculating the coordinate position of the image, image display portion setting means for indicating and setting the portion of the image display data to be displayed on the display unit, and functional symbols based on the setting information by the image display portion setting means. The image of the designated portion is displayed on the display unit, and the direction indication animation is performed based on the image display data of the image of the direction indication animation read by the image data continuous read instruction means and the coordinate position information by the coordinate position calculation means. And operation component image generating means for displaying the image of the image on the display unit, a flow animation processing means for driving the image display portion setting means to continuously display the image of the designated portion and flowing the image, and the flow animation. Display by driving the processing means
Display of the operation screen or area / Scroll processing means for scrolling the operation screen in a specified direction and continuous operation of image data when the operation processing determination means determines that the operation mode to be processed is scroll processing with direction instruction animation A scroll with a direction instruction animation that drives the read instruction means, the coordinate position calculation means, and the scroll processing means to display an image of the direction instruction animation on the display unit and scrolls the display / operation screen or the display / operation screen in the area. And processing means.

Further, the graphical user interface according to the present invention has image display data of a footstep image as image display data of an image of a direction indicating animation of scroll display / operation components.

The graphical user interface according to the present invention stores operation procedure data of each display / operation part and a procedure management part having means for realizing various calculations, and specific information and operation information of each display / operation part. The operation management history information storage unit is provided, and the procedure management component, as a means, displays the image of the function symbol of each display / operation component on the display unit based on the operation procedure data and the history information from the operation procedure history information storage unit. It has operation procedure management means for displaying and displaying each of the display / operation screens by the displayed image of the function symbol.

Further, in the graphical user interface according to the present invention, the procedure management component operates as a means to change the weight value for the operation procedure data of each display / operation component based on the history information from the operation procedure history information storage section. The procedure change processing means and the operation procedure data of each display / operation component are prioritized based on the weight value changed by the operation procedure change processing means, and the display / operation component having the operation procedure data with high priority is assigned. While changing the image display data and display coordinate position data of the image of the function symbol, or the operation procedure data of this display / operation part, the change data, the operation procedure data of each display / operation part, and the operation procedure history information storage unit Display the image of the function symbol of each display / operation part after the change on the display unit based on the history information. Those having an operation procedure management means for configuring each display and operation screen as an image of a function symbol is displayed.

The graphical user interface according to the present invention has various data including help data having help information of each display / operation component and a help component having means for realizing various calculations. The help component is various data. Display data of the image of the function symbol displayed on the display unit, help information explaining the function of each display / operation part, help information explaining the operation procedure of each display / operation part, and operation procedure history information storage Help data having help information summarizing the operation contents based on history information from the control section, based on the operation procedure data from the operation procedure management means of the procedure management part and the history information from the operation procedure history information storage section as means. Display / operation screen composed of images of the display / operation parts displayed on the display unit. And it has a help component generating means for displaying help information for the help data corresponding to the display unit.

Further, in the graphical user interface according to the present invention, the help parts are, as means, help data change processing means for changing the help data based on history information from the operation procedure history information storage section, and operation of the procedure management parts. Occurrence of a help component that causes the display unit to display help information including changed help information for the help data corresponding to each display / operation screen based on the operation procedure data from the procedure management means and the history information from the operation procedure history information storage section. And means.

In the graphical user interface according to the present invention, it is set whether each display / operation component is operable or impossible with respect to the image related to this display / operation component displayed on the display unit 1 as a means. It has an operable / incapable setting means for operating.

[0022]

BEST MODE FOR CARRYING OUT THE INVENTION

Embodiment 1 FIG. 1 and 2 are block diagrams showing the configurations of the first to ninth embodiments of the present invention. 1st of this invention
The display / operation component according to the ninth embodiment includes various data including image display data and display coordinate position data, a program (software) that implements various operations, and an operation for executing each program (software). And a control unit. It should be noted that the processing units 4, 11, 14, 14a, 15, 15a, 1 shown in FIGS.
6, 17, 17a, 18, 19, 20, 21, 23, 2
3a, 24, 25, 25a, 26, 26a, 27, 27
a, 28 and 29 are programs (software)
And an arithmetic and control unit that executes it.

In the first embodiment, at the time of operation on the display / operation screen, an image of a function symbol of a display / operation component 200 in the display / operation screen is instructed and operated, and the instructed and operated display / display is performed. When the operation processing determination unit 21 of the operation component 200 determines that the operation mode to be processed is the reduced or enlarged image size batch conversion, the display / operation component 100 that is designated in advance as the target of the image size batch conversion or With respect to the display / operation component 100 having the image of the function symbol displayed in the area designated in advance, the display / operation component 100 of the display / operation component 200 is operated by the image size calculation unit 15a and the coordinate position calculation unit 14a. Calculation processing for converting the image size of 100 image display data and calculation processing for changing the coordinate position of the display coordinate position data It was carried out, displaying an image of the functional symbols based on the image display data and the display coordinate position data after the image size conversion and coordinate position change-operation parts 20
It is displayed on the display unit 1 through the display / operation component image generation unit 4 of 0.

On the display / operation screen A of the operation device of a certain device as shown in FIG. 3A, the image 31 of the function symbol based on the image display data of the display / operation parts displayed on the display unit 1, Of 32, the image 31 of the function symbol of the display / operation component designated in advance as the target or the image of the function symbol of the display / operation component having the image of the function symbol displayed in the region B designated in advance When reducing or enlarging 31 (the image of the function symbol of the display / operation component displayed inside the display unit 1), first, the image 32 of the function symbol of the display / operation component displayed on the display unit 1 ( For example, having a function of changing the image size, which is one of the function symbol images of the display / operation parts displayed on the outside of the display unit 1. An image 32 of "reduction / enlargement" of the display and operation part of the image size reduction / enlargement button user instructs and operation, and the image size batch conversion mode.

At this time, the coordinates of the image 32 of the display / operation component of the image size reduction / enlargement button designated and operated by the touch screen 2 having the coordinate position detection unit are detected and detected by the display / operation component identification unit 20. Coordinate information and operation information such as one-time pressing or two-time pressing are output. Then, the display / operation component specifying unit 20 reduces the image size of the image display data of the image 32 which is instructed and operated based on the detected coordinate information from the touch screen 2.
It is specified that the data is image display data of the enlargement button display / operation component, and as shown in FIG. 2, the image size reduction / enlargement button display / operation component 200 operation processing determination unit 21.
Is displayed in the display / operation component 100 designated in advance as the target in the image size batch conversion processing unit 23a or in the region B designated in advance based on the identification information and the operation information by the display / operation component identification unit 20. An instruction to collectively convert the image size is output to the image 31 of the function symbol of the displayed / operation component 100 that is being displayed.

Next, the image size batch conversion processing section 23a
Is an image size calculator 15a and a coordinate position calculator 14
Display / operation component 10 that is designated as a target in a.
0 or an instruction for performing calculation processing of image size change and coordinate position change on the image 31 of the function symbol of the display / operation component 100 displayed in the predetermined area B is output, and the image size calculation is performed. The unit 15a and the coordinate position calculation unit 14a convert the image size of the display / operation component 100 designated as a target in advance or the image display data of the display / operation component 100 displayed in the region B designated in advance. And an arithmetic process for changing the coordinate position of the display coordinate position data. The calculated image size information and coordinate position information are supplied to the display / operation component image generation unit 4, and the display / operation component image generation unit 4 determines the image 31a or the image 31b based on the calculated image size information and coordinate position information. To generate
Write to the image memory 3.

Then, in the display unit 1, FIG.
Alternatively, as shown in FIG. 3C, reduction of the display / operation component 100 designated as a target in advance or the display / operation component 100 having an image of the function symbol displayed in the region B designated in advance is reduced. Or enlarged image 3
1a and 31b are displayed. The image display data storage unit 7 and the display coordinate position data storage unit 6 of each reduced or enlarged display / operation component 100 display the image size reduction / enlargement button / image size calculation unit 15a of the operation component 200. The image size information and the coordinate position information calculated by the coordinate position calculation unit 14a are stored.

Here, when the reduction is instructed by the image size reduction / enlargement button, the calculation processing of the image size reduction and the coordinate position change is performed, and as shown in FIG. The display / operation component 100 or the image 31 of the display / operation component 100 designated in advance as the object or the image 31 of the display / operation component 100 in the region B designated in advance is reduced using the designated / specified portion as a fulcrum. Is displayed. Then, at the coordinate position, the button layout shown in FIG. 3A becomes similar to the button layout, and the arithmetic processing is performed so that the original image is stored. Further, when enlargement is instructed by the image size reduction / enlargement button, arithmetic processing of image size enlargement and coordinate position change is performed, and as shown in FIG. An image 3 of the display / operation component 100 designated in advance as a target or the display / operation component 100 in the region B designated in advance with the component 100 or a previously designated location as a fulcrum.
1 is enlarged and displayed. Then, at the coordinate position, similar to the case of the reduction, the button arrangement shown in FIG.

As described above, one of the function symbol images 31 and 32 based on the image display data of the display / operation components 100 and 200 displayed on the display unit 1,
When the user designates and operates the image 32 of the image size reduction / enlargement button display / operation component 200, it is determined that the operation mode to be processed is reduction or enlargement image size batch conversion. The display / operation component 100 or the region B specified in advance by the image size calculation unit 15a and the coordinate position calculation unit 14a of the display / operation component 200 as a target.
The image size of the image display data of the display / operation component 100 and the coordinate position of the display coordinate position data are calculated, and the image 31 reduced or enlarged through the display / operation component image generation unit 4 based on the calculation result. Is displayed on the display unit 1, the image 31 of the function symbol of the display / operation component 100 designated in advance on the display / operation screen A or the display / operation component 100 in the region B designated in advance is displayed.
Can be collectively reduced or expanded, and the reduced display / operation screen A (FIG. 3B) or the enlarged display / operation screen A (FIG. 3C) can be easily displayed. be able to. As a result, the entire image of the arranged display / operation component 100 can be seen on the reduced display / operation screen A, and a part of the arranged display / operation component 100 can be seen on the enlarged display / operation screen A. Since the enlarged view can be easily seen, the operability of the display / operation screen A of the operation device can be improved.

In the above-described embodiment, one of the display / operation parts is a display / display button which is an image size reduction / enlargement button.
Although the case where the operation component 200 is provided has been described as an example, the operation component 200 may have a function of either reducing the image size or increasing the image size, and the display / operation component 100 designated in advance or the designation designated in advance. Area B
The display / operation component 100 may have a function of reducing and enlarging the image size, or one of the functions. In this case, as shown in FIG. 1, calculation of each display / operation component 100 itself is executed by the image size batch change processing unit 23, the image size calculation unit 15, and the coordinate position calculation unit 14 included in each display / operation component 100. It

Further, 1 is used as operation information for reduction or enlargement.
Although the case where the button is pressed twice or twice is shown, for example, each time the button is pressed, a rule for assigning a function of contracting or expanding, such as contracting, expanding, normal, contracting, expanding, normal, ... The calculation processing may be performed in accordance therewith, and the reduction / enlargement magnification may be set to several steps or one step.

Embodiment 2 FIG. FIG. 4 is an operation explanatory view of a display / operation screen displayed on the display unit according to the second embodiment of the present invention. In the second embodiment, when an operation is performed on the display / operation screen, the image of the function symbol of the display / operation component operable in the display / operation screen is instructed and operated, and the display / operation component instructed and operated is displayed. When the operation processing determination unit 21 determines that the operation mode to be processed is vibration animation processing, for example, a button is displayed for the image of the function symbol of the display / operation component instructed and operated by the image data continuous read instruction unit 16. Of the display / operation parts that are instructed and operated for the vibration animation image based on the read image display data. The function symbol images are displayed one after another on the display unit 1 via the display / operation component image generation unit 4. That.

In the display / operation screen C on the operation device of a certain device as shown in FIG. 4A, the operation / operation part among the display / operation parts having the image 33, 34 of the function symbol displayed on the display unit 1 is operated. When the user instructs and operates, for example, the image 33 of the “decision button”, which is one of the images 33 of the functional symbols of the display / operation components that can be displayed, the display / operation component identification unit 20 displays the touch screen 2 as in the first embodiment. The image display data of the image 33 that is instructed and operated based on the detected coordinate information from the
The operation processing determination unit 21 of the specified display / operation component 100 identifies the image 33 of the operation component, and as shown in FIG. The instruction to perform is output.

Next, the vibration animation processing unit 24 outputs an instruction to the image data continuous read instructing unit 16 to continuously read out a plurality of image display data which are vibration animation images for the image of the function symbol, and the image data continuous read operation is performed. The read instruction unit 16 sequentially reads the image display data of the vibration animation image from the image display data storage unit 7. The image display data of the read vibration animation image is written in the image memory 3 via the display / operation component image generation unit 4 one after another. Then, in the display unit 1, as shown in FIG. 4B, the vibration animation image 35 is displayed around the image 33 of the enter button.

In this way, the image 3 of the functional symbol of the operable display / operation part displayed on the display unit 1
When the user designates and operates one of the three items, it is determined that the operation mode to be processed is the vibration animation process, and the image data continuous read instruction unit 16 or the like reads the image display data of the vibration animation image one after another and displays it. The vibration animation image 35 can be displayed on the outer periphery of the image 33 via the operation component image generation unit 4 to display an animation that appears to vibrate. This makes it possible to compensate for the lack of realization of the operation on the touch screen which is flat and has no tactile response when the operation / operation screen C is operated, and the operation is performed by displaying the vibration animation image 35. It is possible to easily confirm the above, and to improve the operability such as the intelligibility of the operation.

Embodiment 3 FIG. FIG. 5 is an operation explanatory diagram for setting the display portion of the image of the function symbol of the display / operation component according to the third embodiment of the present invention. The third embodiment is a display /
During operation on the operation screen, a display / operation component 100 having an image of a band-shaped functional symbol such as a numerical value
A part of the image is displayed in a predetermined area, the image is instructed and operated, and the operation mode to be processed by the operation processing determination unit 21 of the instructed and operated display / operation component 100 is the flow animation process. When it is determined that the display position of the image of the function symbol of the display / operation component 100 designated and operated by the image display portion setting unit 17 is continuously moved,
Display / operation component 10 based on the display position according to the processing result
Image of 0 function symbol is displayed / operation part image generation unit 4
Are sequentially displayed on the display unit 1 via.

On the display / operation screen of the operation device of a certain device, as shown in FIG. 5A, a partial image 36 of the function symbol is displayed in a predetermined area D of the display / operation screen.
When the user instructs and operates the image 36a in the area D of the display / operation component 100 having the band-shaped function symbol image 36 in which a is displayed, the display / operation component identification unit 20 touches as in the first embodiment. The image display data of the image 36a that is instructed and operated based on the detected coordinate information from the screen 2 is the image 3 of the numerical display / operation component 100.
6, the operation processing determination unit 21 of the specified display / operation component 100 executes the flow animation to the flow animation processing unit 25 based on the specific information and the operation information, as shown in FIG. Output the instruction to perform.

Next, the flow animation processing unit 25 displays the display / instruction which is instructed and operated by the image display portion setting unit 17.
The image display portion setting unit 17 outputs an instruction for continuously moving the display position of the image 36a displayed in the region D of the image 36 of the function symbol of the operation component 100, and the image display portion setting unit 17 displays The images 36a displayed in the area D of the image 36 of the function symbol are set one after another. The set image display data of the image 36a is sequentially written into the image memory 3 via the display / operation component image generation unit 4, and in the display unit 1, as shown in FIGS.
Numerical image 3 of the display / operation component 100 in the area D
Flowing animation image 3 of 6 moving continuously
6a is displayed.

In this way, when the user gives an instruction and operates the image 36a displayed in the area D of the display / operation component 100 having the band-shaped image 36 displayed on the display unit 1, the operation mode to be processed. Is determined to be a flow animation process, the images 36a displayed in the area D are sequentially set by the image display portion setting unit 17 and the like, and the display instructed and operated via the display / operation component image generation unit 4 is performed. The image 36a displayed in the area D of the operation component 100 can be continuously moved to display the animation in which the numerical values are sequentially changed. Thus, for example, when operating the display / operation screen for setting a numerical value, it is possible to easily understand the direction of increase / decrease of the numerical value and improve operability.

In the above-described embodiment, the image 36a is displayed in the area D, and the image 36a is displayed and set in the area D by the image display part setting unit 17 of the display / operation component 100 instructed and operated. Although the case where the displayed image 36a is continuously moved is shown, as shown in FIG. 3A, the display / operation component having the arrow key image 32 (see FIG.
Of the display / operation component 201) and the image display portion setting unit 17a of the display / operation component 201) of FIG. On the other hand, a flow animation process may be performed. In this case, the flow animation processing unit 25 and the image display portion setting unit 17 of the display / operation component 100 having the image 36a displayed in the area D are not executed.

Embodiment 4. FIG. 6 is an operation explanatory view of the display / operation screen displayed on the display unit according to the fourth embodiment of the present invention. In the fourth embodiment, when an operation is performed on the display / operation screen, a certain display / operation screen is displayed.
When the image of the function symbol of the operation component is instructed and operated, and the operation mode determination unit 21 of the instructed / operated display / operation component determines that the operation mode to be processed is the scroll process with footprints, it is designated in advance. For the display / operation component 100 having the image of the function symbol displayed or displayed in the displayed area, the scroll processing unit 27a and the flow animation processing unit 25a are provided.
An image of the functional symbol of the display / operation component 100 displayed or displayed in the area based on the display position as a result of the processing by causing the processing to continuously move the display position displayed in the area Are sequentially displayed on the display unit 1 via the display / operation component image generation section 4, and at the same time, the image data continuous reading instruction section 16 displays an image of a direction instruction animation image such as a footprint showing the scroll direction in the area. The display coordinate position data after the calculation is caused to perform a process of continuously reading a plurality of data and the calculation process of calculating the coordinate position to be displayed of the image display data read by the coordinate position calculation unit 14a. For sequentially displaying the direction instruction animation image based on the display / operation component image generation unit 4 in the area of the display unit 1 A.

On the display / operation screen A of the operation device of a certain device as shown in FIG. 6A, the image 3 of the function symbol of the display / operation component displayed on the display unit 1 is displayed.
When the image 31 of the function symbol displayed or displayed in the area B designated in advance among 1, 32 is scrolled in the vertical direction, the function symbol of the display / operation component displayed on the display unit 1 is displayed. Having a scroll function which is one of the images 32 of
When the user indicates and operates the image 32 of the “arrow key” of the operation component, the display / operation component identification unit 20 instructs and operates the image 32 based on the detected coordinate information from the touch screen 2 as in the first embodiment. Image display data is the image 32 of the scroll display / operation component, and as shown in FIG. 2, the operation processing determination unit 21 of the scroll display / operation component 201 determines based on the specific information and the operation information. An instruction to perform the scroll with footprints is output to the scroll processing unit with footprints 26a.

Then, the scroll processing unit 26a with footprints
Indicates a scroll instruction and a footprint for the image 31 of the functional symbol of the display / operation component 100 displayed or displayed in the area B designated in advance by the scroll processing unit 27a and the image data continuous reading instruction unit 16. The scroll processing unit 27a outputs an instruction to display the direction instruction animation image, and the scroll processing unit 27a displays the display position of the function symbol of the display / operation component 100 displayed or displayed in the predetermined area B with respect to the image 31. The image display portion setting unit 17a sets the images displayed in the area B of the image 31 of the function symbol of each display / operation component 100 one after another, and the setting is performed. Image display data of the images are sequentially written into the image memory 3 via the display / operation component image generation unit 4. Then, in the display unit 1, FIG.
As shown in (c), the image 31 of the function symbol scrolled in the vertical direction of the display / operation component 100 displayed in the area B is displayed.

Further, the image data continuous read instructing section 16 reads the image display data of the direction instruction animation image from the image display data storage section 7 one after another, and displays the image display data of the read direction instruction animation image one after another. It is written in the image memory 3 via the operation component image generation unit 4. At the same time, the coordinate position calculation unit 14a successively calculates the coordinate positions to be displayed in the image display data of the read direction indication animation image, and the calculated coordinate position information is displayed on the image via the display / operation component image generation unit 4. It is sequentially written in the memory 3. Then, in the area B of the display unit 1, as shown in FIG. 6B, a direction instruction animation image 37 such as a footprint is displayed on the image 31 of the display / operation component 100.
It is displayed together with the scroll display of.

As described above, when the user gives an instruction and operates the image 32 of the scroll display / operation component 201, which is one of the images 31 and 32 of the function symbols of the display / operation components displayed on the display unit 1, It is determined that the operation mode to be processed is the scrolling process with footprints, and the scrolling / displaying operation is displayed in or displayed in the area B previously designated by the footprint scrolling processing unit 26a of the operation component 201. Display / operation parts 100
Image 31 is scroll-displayed, and at the same time, a direction instruction animation image 37 such as a footprint is displayed, so that the scroll direction can be easily understood, and
It is easier to scroll in the intended direction, and operability can be improved.

Embodiment 5. FIG. 7 is a schematic diagram of a display / operation screen according to the fifth embodiment of the present invention, an operation explanatory diagram thereof, and operation procedure data stored in an operation procedure data storage unit. As shown in FIG. 1, the fifth embodiment displays a procedure management component 300 that manages the display and operation procedure of each display / operation component 100, 200 ...
00 and the like, the procedure management component 300 includes the operation procedure data and the operation procedure history information storage unit of the display / operation components 100, 200 ... Based on the history information from 22, the display / operation component image generation unit 4 of each display / operation component 100, 200 ...
An operation procedure management unit 11 for displaying an image of the functional symbols 200 ... On the display unit 1 via the image memory 3 to form a display / operation screen, and an operation procedure data storage unit 12.
An operation procedure default value storage unit 13 for storing initial data of operation procedure data, and an operation procedure change processing unit 19 described later.
It is composed of

On the display / operation screen A on the operation device of a certain device as shown in FIG. 7, an image 38b which is one of the function symbol images of the display / operation parts displayed on the display unit 1 is designated and operated. Then, as in the first embodiment, the display / operation component specifying unit 20 displays the touch screen 2
It is specified that the image display data of the image 38b which is instructed and operated based on the detected coordinate information from is, for example, the image 38b of the display / operation component 100 of "2F illumination",
The operation processing determination unit 21 of the “2F illumination” display / operation component 100 outputs an instruction to the next processing unit to perform an operation mode to be processed based on the specific information and the operation information, and as shown in FIG. , And outputs the specific information and the operation information to the operation procedure history information storage unit 22.

Next, the history information of the operation procedure history information storage unit 22 based on the specific information and the operation information is sent to the operation procedure data storage unit 12 via the operation procedure change processing unit 19, and the operation procedure management unit 11 records the history. Information and operation procedure data 12 stored in the operation procedure data storage unit 12
Based on a, as shown in FIG. 7, the images 39a, 39b ... Of the functional symbols of the display / operation parts constituting the next display / operation screen, for example, the display / operation screen F are displayed as the image 39.
a display unit 1 having a, 39b, ...
To display. Then, when one of the images 39a, 39b, ... Comprising the display / operation screen F is instructed and operated, the display of the image instructed and operated as described above is performed.
The operation component is specified, and the operation / procedure management unit 11 of the procedure management component 300 configures the next display / operation screen I based on the history information based on the specific information and the operation information and the operation procedure data 12a. Images 40a, 40b ... Of function symbols are displayed on the display unit 1. The first display / operation screen A is also displayed by the procedure management component 300.

As described above, the operation / procedure data 12a for the next step for the display / operation parts 100, 200, ...
Since it is managed by the procedure management component 300 independent of 0, 200, ...
The operation procedure data storage unit 1 without changing the programs (software) of the display / operation components 100, 200, ...
It is possible to easily revise the operation procedure by changing only the operation procedure data 12a stored in No. 2, it is possible to avoid an enormous amount of work in development, and to improve development efficiency. .

Embodiment 6. FIG. 8 is a schematic diagram of operation procedure data stored in the operation procedure data storage unit according to the sixth embodiment of the present invention, and an operation explanatory view of a display / operation screen. In the sixth embodiment, as shown in FIG. 1, the history information of the operation procedure history information storage unit 22 based on the specific information and the operation information sequentially sent from the operation processing determination unit 21 of each display / operation component 100, 200 ... Based on the above, the operation procedure change processing unit 19 provided in the procedure management component 300 of the fifth embodiment stores each display stored in the operation procedure data storage unit 12.
A weight value (priority) for the operation procedure data 12a of the operation components 100, 200 ... Is changed, and the operation procedure management unit 1 of the procedure management component 300 is based on this weight value.
1 prioritizes the operation procedure data of each display / operation component 100, 200 ... And, for the display / operation components 100, 200 ... Having the operation procedure data of high priority,
Change the image display data and display coordinate position data of the image of the display / operation part to enlarge the size of the image, move the display position, or color the display / operation part with the operation procedure data of the display / operation part. Change processing is performed such that the display / operation component is changed to a preselected state or a part of the operation procedure data is omitted, and various data after the change, each display / operation component 10
0, 200 ... Operation procedure data 12a and display / operation component image generation section 4 for each display / operation component 100, 200 ... Based on history information from operation procedure history information storage unit 22.
To display the image of the function symbol of each display / operation component 100, 200 ... On the display unit 1 via the image memory 3 to form a display / operation screen.

In the display / operation screen A of the operation device of a certain device as shown in FIG. 8B, one of the images of the function symbols of the display / operation components 100, 200 ... Displayed on the display unit 1 is displayed. When a certain image 38b is instructed and operated, the display / operation component specifying unit 2 is operated as in the first embodiment.
0 is the image 38a of the display / operation component 100 in which the image display data of the image 38a designated and operated based on the detected coordinate information from the touch screen 2 is, for example, "1F illumination".
"1F Illumination" display / operation part 1
The operation processing determination unit 21 of 00 outputs an instruction to cause the next processing unit to perform the operation mode to be processed based on the specific information and the operation information, and as shown in FIG. Output specific information and operation information.

The history information of the operation procedure history information storage section 22 based on the specific information and the operation information is the operation procedure change processing section 1
9 and the operation procedure change processing unit 19 displays the operation procedure data 12a stored in the operation procedure data storage unit 12 on the display / operation screen A based on the history information, as shown in FIG. The weight value of the operation procedure data corresponding to the image 38a of the display / operation component 100 is changed. Then, the operation procedure management unit 11 displays the next display / operation screen, for example, the display / operation screen F (FIG. 8C), based on the history information and the operation procedure data 12a stored in the operation procedure data storage unit 12. Images 39a, 39b ... Of the function symbols of the display / operation parts constituting the image
The display unit 1 is displayed through the display / operation component image generation unit 4 and the image memory 3 having the ... The image 39 that constitutes the display / operation screen F
When one of a, 39b ... Is instructed and operated, the display / operation part of the image instructed and operated is specified as described above, and the history information of the operation procedure history information storage unit 22 based on the specific information and the operation information is added. Based on the operation procedure change processing unit 19, the weight value of the operation procedure data corresponding to the instruction of the operation procedure data 12a and the image of the operated display / operation component is changed, and the history information and the operation procedure data 12 are changed.
Based on a, the operation procedure management unit 11 causes the display unit 1 to display the image of the functional symbol of the display / operation component forming the next display / operation screen.

At this time, the operation procedure management unit 11 prioritizes the operation procedure data of each display / operation component based on the weight value changed by the operation procedure change processing unit 19, and the operation procedure data of high priority is set. For a display / operation component having, for example, a display / operation component having the image 39a, the image display data and the display coordinate position data of the image 39a are changed to enlarge the size of the image 39a and color the same. A change process is performed to change the procedure data to display the image 39a in a preselected state, and the changed image display data, display coordinate position data, and operation procedure data are stored in the display / operation part having the image 39a. It is sent to the display / operation component image generation unit 4. Then, on the display unit 1, as shown in FIG. 8C, the image 39a in the enlarged and colored and selected state is displayed.

As described above, the display / operation components 100 and 200 stored in the operation procedure data storage unit 12 by the operation procedure change processing unit 19 provided in the procedure management component 300.
Of the operation procedure data 12a is changed,
Based on this weight value, the operation procedure management unit 11 prioritizes each operation procedure data, and with respect to the display / operation components 100, 200 ... Having the operation procedure data with high priority,
The display / operation parts 100, 200 ... Are changed in image display data or the like by enlarging the size of the image, or the operation procedure data is changed to change the operation procedure. An operation screen can be obtained, and a highly user-friendly graphical user interface can be obtained.

In the above-described embodiment, for the display / operation component having the operation procedure data with a high priority assigned based on the weight value, the image of the display / operation component is enlarged, the coloring and the image are selected. Although the case of displaying the displayed state is shown, any one of them may be displayed, and the display position of the image is changed to a position where it is easy to operate, and is displayed.
The operation procedure data may be changed so that an operation procedure with a high priority is automatically executed without leaving room for selecting an image.

Embodiment 7. FIG. 9 is an operation explanatory diagram of a display / operation screen displayed on the display unit according to the seventh embodiment of the present invention. In the seventh embodiment, as shown in FIG. 1, various help data including help information of each level of each display / operation component 100, 200 ... Is managed, and an image of a function symbol displayed on the display unit 1 is used. A help component 400 for displaying help information corresponding to the configured display / operation screen on the display unit 1 is displayed / operation component 10.
0, 200, and the procedure management component 300 are provided separately, and the help component 400 is stored in the operation procedure data and the operation procedure history information storage unit 22 from the operation procedure management means 11 of the procedure management component 300. A help component generation unit for displaying help information of each level of the help data stored in the help data storage unit 9 corresponding to each display / operation screen on the display unit 1 through the image memory 3 based on the history information of 29, a help data storage unit 9, a help data default value storage unit 10 for storing initial data of help data, and a help data change processing unit 18 described later.

The help information of each level of the help data corresponds to the image of each display / operation component 100, 200 ... And the first-level help information for explaining the meaning and function of the display / operation component 100, 200. Based on history information from the operation procedure history information storage unit 22 and second level help information corresponding to the images of the display / operation screens or the images of the display / operation components 100 constituting the screens and explaining the operation procedures thereof. It is help information of the third level, which is general information for confirming the contents operated by the user.

An image 4 which is one of the images of the function symbols displayed on the display unit 1 in the display / operation screen A on the operating device of a certain device as shown in FIG. 9A.
When the instruction and operation of 1a is performed, the display / operation component identification unit 20 causes the image display data of the image 41a instructed and operated based on the detected coordinate information from the touch screen 2 to be, for example, “help (?)” As in the first embodiment. It is specified that the image is the image 41a of the help component 400, and the specific information and the operation information are output to the help component image generation unit 29 and the operation procedure history information storage unit 22 of the help component 400.

Next, the history information of the operation procedure history information storage unit 22 based on the specific information and the operation information is sent to the procedure management component 300 as shown in FIG. The help component image generation unit 29 sends the history information including the history information of other display / operation components to the storage unit 9, and the help data storage unit 9
Based on the help data, the operation procedure data of the procedure management component 300, and the identification information and the operation information from the display / operation component identification unit 20 stored in FIG. For example, the image 38a of "1F illumination"
The first-level help information corresponding to the display / operation component having is written in the image memory 3. Then, the display unit 1 displays the first-level help information for explaining the meaning and function of the display / operation component of the image 1a of "1F illumination".

Next, the "1F illumination" image 38a is designated and operated, and as shown in FIG.
When the operation screen E is displayed on the display unit 1, if an image 41b, which is one of the image of the function symbol, is designated and operated, a display having the image designated as described above, for example, the image 39a of "schedule setting" is displayed. The help information corresponding to the operation component is written in the image memory 3 by the help component image generation unit 29, and the display unit 1 displays the second level help information for explaining the operation procedure of “schedule setting”. Then, the schedule is set based on the help information, and when the image of the help component 400 is instructed and operated on the next display / operation screen, the history information from the operation procedure history information storage unit 22 is sent to the help component image generation unit 29. Then, the help information of the third level, which is the general information for confirming the contents operated by the user based on the history information, is written in the image memory 3 by the help component image generating unit 29, and the display unit 1 is displayed in FIG. (C)
As shown in, the third level help information 42, which is the general information for confirming the contents operated by the user, is displayed.

As described above, the help data is used as the help information of each level, and the help information corresponding to each display / operation component on each display / operation screen is easily operated by operating the images 41a and 41b of the help component 400. Since it can be displayed on the screen, only the help information necessary for the user to perform the intended operation can be obtained.
It is possible to make the operation of the image of the operation component more understandable and simple, and it is also possible to easily confirm the content of the operation, thereby improving the operability. Also, the help data is displayed / operated by the components 100, 20.
It is stored in a help component 400 that is provided separately from 0 ...
0, 200 ... Can be easily performed without changing the program (software), and storage of more than necessary help data in each display / operation component 100, 200. There is no fear of wasteful consumption of.

Embodiment 8 FIG. FIG. 10 is an operation explanatory diagram of a display / operation screen displayed on the display unit according to the eighth embodiment of the present invention. In the eighth embodiment, as shown in FIG. 1, history information of an operation procedure history information storage unit 22 based on specific information and operation information sequentially sent from the operation processing determination unit 21 of each display / operation component 100, 200 ... On the basis of,
The help data change processing unit 18 provided in the help component 400 of the seventh embodiment changes the help data stored in the help data storage unit 11, and the help component image generation unit 29 manages the operation procedure of the procedure management component 300. Based on the operation procedure data from the means 11 and the history information from the operation procedure history information storage unit 22, the help information at each level of the changed help data and the help data stored in the help data storage unit 9 is displayed / operated. It is displayed on the display unit 1 corresponding to the screen.

In the display / operation screen A of the operation device of a certain device as shown in FIG. 10B, the display unit 1
When the image 38a, which is one of the image of the function symbols of the display / operation components 100, 200 ... Displayed in, is designated and operated, the display / operation component identification unit 20 displays the touch screen 2 from the touch screen 2 as in the first embodiment. It is specified that the image display data of the image 38a designated and operated based on the detected coordinate information is, for example, the image 38a of the display / operation component of "1F illumination", and the operation processing of the display / operation component of "1F illumination". The determination unit 21 outputs an instruction to the next processing unit to perform the operation mode to be processed based on the specific information and the operation information, and outputs the specific information and the operation information to the operation procedure history information storage unit 22.

The history information of the operation procedure history information storage unit 22 based on the specific information and the operation information is sent to the operation procedure data storage unit 12 via the operation procedure change processing unit 19 of the procedure management component 300, and the operation procedure management unit 11 Based on the history information and the operation procedure data, displays the image of the function symbol of the next display / operation component that forms the next display / operation screen, displays the image having the image, displays the operation component / the operation component image generation unit 4
And display on the display unit 1 via the image memory 3.

Here, in the history information from the operation procedure history information storage unit 22, an operation error by the user is made, for example, although the screen is moved to the next display / operation screen, the original display / operation screen is returned and the operation is performed again. When a plurality of pieces of history information indicating an operation error such as is sent to the help data change processing unit 18, the help data change processing unit 18 outputs additional help data such as an operation guide corresponding to the location where the error occurs, to the help data storage unit. Send to 9 for storage and change help data. Then, the help component image generation unit 29 writes the changed help data, for example, the help information of the operation guide, which is the second level help information, in the image memory 3 based on the history information and the operation procedure data. Then, in the display unit 1, as shown in FIG. 10A, the help information 4 of the operation guide is displayed on the display / operation screen A in which an error is likely to occur.
3 is displayed.

At this time, of the images displayed on the display unit 1, the image of the display / operation component to be next instructed and operated, for example, the image 38a is displayed / operated on the display / operation component 100.
Image 3 is displayed by the operable / impossible setting unit 28 provided in
8a in an operable state, and another image is made inoperable by the operable / incapable setting unit 28 of the display / operation part, so that the operation is forcibly performed according to the operation procedure. .

Further, in the display / operation screen A in which the help information 43 of the operation guide is displayed, when the history information indicating an operation error is hardly sent to the help data change processing unit 18, the help data change processing unit 18 Performs a help data change process that omits help data such as an operation guide corresponding to a location causing an error, and the help component image generation unit 29, based on the history information and the operation procedure data, changes the help data, that is, the help for the operation guide. The help information in which the information 43 is omitted is written in the image memory 3. Then, as shown in FIG. 10B, the display unit 1 displays a normal one without the help information 43 of the operation guide.

From the fluctuation of the probability of operation error, etc.,
For example, the help information 43 of the operation guide may be colored so as to be conspicuous, or the content of the operation guide may be changed. Display the operation guide,
You may change to a forced operation guide.

In this way, the operation procedure history information storage unit 22
Help data change processing unit 1 based on history information from
Since the help data can be easily changed by simplifying or refining the help information by 8,
Operations can be performed more smoothly on each display / operation screen, and operability can be improved.

Embodiment 9. The ninth embodiment is implemented by a program (software) that implements various processes of the display / operation components 100, 200, ... Each processing unit 4, 11, 14, 14a, 1 in FIG. 1 and FIG.
5, 15a, 16 ... Are mutually independent and alternatively configured, and can be appropriately combined with each display / operation component.

In the display / operation component 100 or the like which is usually installed in an object-oriented manner, data portions such as image display data and display coordinate position data, and processing such as an image size calculation portion and a coordinate position calculation portion for processing the data portion. The integrated processing unit is not attached to or detached from the display / operation parts or the like. However, among these processing units, for example, a processing unit for displaying data for debugging, a processing unit for outputting the coordinate position on the screen of the display / operation component 100,
Alternatively, there is a processing unit that is necessary when developing the display / operation components and the display / operation screen, but is unnecessary on the actual machine, or a processing unit that is unnecessary depending on the type of equipment that mounts the display / operation components.

Therefore, if the respective processing units are made independent of each other and can be selectively combined and can be appropriately combined with the respective display / operation parts, the processing units that are unnecessary on the actual machine can be removed when mounted. You can

For example, in the display / operation component 100 mounted on the operating device of a certain device, the image size batch conversion process and the vibration animation process are necessary, but the flow animation process and the scroll process with footprints are not necessary. The operation processing determination unit 21, the image size batch conversion processing unit 23, the coordinate position calculation unit 14, the image size calculation unit 15, the vibration animation processing unit 24, the image data continuous read instruction unit 16 and the display / operation component image shown in FIG. The generation unit 4 is incorporated in the display / operation component 100, and the flow animation processing unit 25, the image display portion setting unit 17, the scroll processing unit with footprints 26, and the scroll processing unit 27 are not incorporated in the display / operation component 100.

As described above, by making it possible to appropriately combine the respective processing units, which are independent of each other and are selectively configured, with the respective display / operation components 100 and the like, wasteful consumption of the memory by the unnecessary processing units. Can be prevented and the amount of memory consumption can be improved. Further, since the processing units can be easily incorporated, the processing units required only during development can be enriched without worrying about memory consumption and the like, and development efficiency can be improved.

[0075]

As described above, the graphical user interface according to the present invention has various display / display units including means for realizing various data including image display data and various calculations.
Position of the operation parts, the display unit where the image of the function symbol based on the image display data of the display / operation parts is displayed, and the position of the image display data of the image of the function symbol that is arranged and instructed and operated on the surface of the display unit. A touch screen that detects the coordinates of the touch screen, and a display / operation component specifying unit that specifies the display / operation component that has image display data of the image that is instructed and operated based on the output signal of the touch screen. The operation component has image display data of an image of a functional symbol displayed on the display unit as various data, and display coordinate position data for displaying the image display data, and further, as a means, a display / operation component identification unit. Display / operation based on the specific information of the display / operation parts and the operation information on the image of the instruction and the operated function symbol. Operation processing determination means for determining an operation mode to be processed for the product specified by the product specification unit, coordinate position calculation means for calculating the coordinate position of the image display data, and the image size of the image display data in the horizontal direction. Image size calculation means for calculating each in the vertical direction, and display / operation part image generation for displaying an image of the functional symbol on the display unit based on the coordinate position information by the coordinate position calculation means and the image size information by the image size calculation means Means and the operation processing determination means determines that the operation mode to be processed is the image size batch conversion of reduction or enlargement, the coordinate position calculation means and the image size calculation means are driven, and this display / operation component is displayed. Image size batch conversion processing means for reducing or enlarging the image concerned, or operation processing determination When it is determined that the operation mode to be processed by the step is the reduction or enlargement image size batch conversion, the coordinate position calculation unit and the image size calculation unit are driven and designated in advance as the target of the image size batch conversion. Since it has an image size batch conversion processing means for reducing or enlarging the image of the display / operation part or the image displayed in the predetermined area of the display unit, the image of the function symbol can be easily operated. Can be reduced or enlarged for display, or reduced or enlarged for display. This allows you to see the entire image of the display / operation parts that are arranged on the display / operation screen that is composed of the reduced image, and the display that is arranged on the operation / operation screen that is composed of the enlarged image. Since a part of the operation parts can be enlarged, the operability of the display / operation screen for the user of the operation device of the device can be improved.

The graphical user interface according to the present invention has each display / operation component, a display unit, and a display / operation component identification unit, and each display / operation component has various types of data such as an image of a function symbol and a function. Image data having image display data of a vibration animation image expressing the vibration of the image of the symbol and display coordinate position data, operation processing determining means as means, and image data for continuously reading image display data of the vibration animation image. Continuous read instruction means, display / operation component image generating means for displaying an image of the vibration animation on the display unit based on the image display data of the image of the vibration animation read by the image data continuous read instruction means, and operation processing determination The operation mode to be processed by the means is the process of adding vibration animation. When it is determined, it has a vibration animation processing means for driving the image data continuous read instructing means and adding the image of the vibration animation to the image related to this display / operation component. A vibration animation image can be displayed on the outer periphery of the image of the display / operation component to display an animation that looks like vibration. This allows
It is possible to make up for the lack of realization of operation on the touch screen that is flat and has no tactile response, and it is possible to easily confirm that the operation was performed by displaying the vibration animation image, making the operation easy to understand. It is possible to improve the operability such as the size.

The graphical user interface according to the present invention has each display / operation component, a display unit, and a display / operation component identification unit, and as a display / operation component, a flow display for instructing the flow of an image.・ Has operation parts,
The fluidized display / operation component has image display data of the image of the function symbol as various data and display coordinate position data, and has operation processing determination means, image display portion setting means, and display / operation component image as means. When it is determined by the generating means and the operation processing determining means that the operation mode to be processed is the flow of the image, the image display portion setting means is driven to display the image of the designated portion related to this display / operation component. When it is determined by the operation processing determination means that the operation mode to be processed is the flow of the image, the image display portion setting means is driven, Flow animation processing hand that continuously displays the images of the specified parts of the display / operation parts that have been specified as the target of image flow in advance and flows the images. Since those having bets can be a display moving images of instructions and operated display and operation part continuously. As a result, it is possible to easily confirm that the images of the displayed and operated parts that have been instructed and operated are sequentially moving, and it is possible to make up for the lack of actual feeling of operation and to improve operability such as intelligibility of operation. be able to.

Further, since the graphical user interface according to the present invention has image display data of a band-shaped image of numbers as various data of each display / operation component, it is possible to obtain a numerical value when performing the flow processing of the image. The direction of increase / decrease can be easily understood, and operability can be improved.

The graphical user interface according to the present invention has each display / operation component, a display unit, a touch screen, and a display / operation component identification section, and is displayed on the display unit as the display / operation component. Display / operation screen composed of images of display / operation parts or display in a predesignated area / scroll display for instructing vertical / horizontal scrolling of the operation screen The operation component has, as various data, image display data of an image of a function symbol and an image of a direction instruction animation that expresses a scroll direction, and display coordinate position data. Image data continuous read-out instruction means for continuously reading out image display data of images, and image display data. Coordinate position calculation means for calculating the coordinate position of the image, image display portion setting means for indicating and setting the portion of the image display data to be displayed on the display unit, and functional symbols based on the setting information by the image display portion setting means. The image of the designated portion is displayed on the display unit, and the direction indication animation is performed based on the image display data of the image of the direction indication animation read by the image data continuous read instruction means and the coordinate position information by the coordinate position calculation means. And operation component image generating means for displaying the image of the image on the display unit, a flow animation processing means for driving the image display portion setting means to continuously display the image of the designated portion and flowing the image, and the flow animation. Display by driving the processing means
Display of the operation screen or area / Scroll processing means for scrolling the operation screen in a specified direction and continuous operation of image data when the operation processing determination means determines that the operation mode to be processed is scroll processing with direction instruction animation A scroll with a direction instruction animation that drives the read instruction means, the coordinate position calculation means, and the scroll processing means to display an image of the direction instruction animation on the display unit and scrolls the display / operation screen or the display / operation screen in the area. Since it has a processing means, it is possible to easily understand the scrolling direction, facilitate scrolling in the intended direction, and improve operability.

Since the graphical user interface according to the present invention has the image display data of the footstep image as the image display data of the image of the direction indicating animation of the scroll display / operation component, it is possible to change the scroll direction. This makes it easier to understand and makes up for the lack of operational experience.

The graphical user interface according to the present invention stores operation procedure data of each display / operation part and a procedure management part having means for realizing various calculations, and specific information and operation information of each display / operation part. The operation management history information storage unit is provided, and the procedure management component, as a means, displays the image of the function symbol of each display / operation component on the display unit based on the operation procedure data and the history information from the operation procedure history information storage unit. Since it has operation procedure management means for displaying and displaying each of the display / operation screens based on the displayed image of the function symbol, the operation procedure data of each display / operation part is compared with that of the memory. It is possible to prevent wasteful consumption and change the means of each display / operation part when the operation procedure is revised. Instead, it is possible to easily revise the operating procedure by changing only the operating procedure data managed by the procedure management component, avoiding an enormous amount of work in development and improving development efficiency. be able to.

Further, in the graphical user interface according to the present invention, the procedure management component operates as means to change the weight value for the operation procedure data of each display / operation component based on the history information from the operation procedure history information storage section. The procedure change processing means and the operation procedure data of each display / operation component are prioritized based on the weight value changed by the operation procedure change processing means, and the display / operation component having the operation procedure data with high priority is assigned. While changing the image display data and display coordinate position data of the image of the function symbol, or the operation procedure data of this display / operation part, the change data, the operation procedure data of each display / operation part, and the operation procedure history information storage unit Display the image of the function symbol of each display / operation part after the change on the display unit based on the history information. Since it has an operation procedure management unit that configures each display / operation screen by the image of the displayed function symbol, it is possible to obtain a display / operation screen that is easy to operate close to the user's intention and has high operability. A graphical user interface can be obtained.

The graphical user interface according to the present invention has various data including help data having help information of each display / operation component and a help component having means for realizing various calculations. The help component is various data. Display data of the image of the function symbol displayed in the display unit, help information explaining the function of each display / operation component, help information explaining the operation procedure of each display / operation component, and operation procedure history information storage Help data having help information summarizing the operation contents based on history information from the control section, based on the operation procedure data from the operation procedure management means of the procedure management part and the history information from the operation procedure history information storage section as means. To display the help information of the help data corresponding to each display / operation screen on the display unit. Since it has a component generation means, it can obtain only the help information necessary for the user to perform the intended operation, and the operation of the image of the display / operation component can be made easier and more understandable. The contents of the operation can be easily confirmed, and the operability can be improved. When the help information is revised, the help information can be revised easily by changing only the help data managed by the help component without changing the means of each display / operation component. It is possible to avoid the enormous amount of work in, and improve the development efficiency.

Further, in the graphical user interface according to the present invention, the help parts are, as means, help data change processing means for changing help data based on history information from the operation procedure history information storage section, and operation of procedure management parts. A help component for displaying on the display unit the help information including the help information after the change of the help data corresponding to each display / operation screen based on the operation procedure data from the procedure management means and the history information from the operation procedure history information storage section. Since it has a generation means, it is possible to easily change the help data such as simplifying or detailing the help information, improving the development efficiency, and improving the display / operation screen. The operation can be performed more smoothly and the operability can be improved.

In the graphical user interface according to the present invention, it is set whether each display / operation component can be operated or cannot be operated with respect to the image related to this display / operation component displayed on the display unit 1 as means. Since it has a setting means for enabling / disabling operation, it is possible to eliminate the inconvenience of erroneously instructing and operating an unnecessary image of the display / operation part, thereby improving the operability. be able to.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of first to ninth embodiments of the present invention.

FIG. 2 is a block diagram showing a configuration of first to ninth embodiments of the present invention.

FIG. 3 is an operation explanatory diagram of a display / operation screen displayed on the display unit according to the first embodiment of the present invention.

FIG. 4 is an operation explanatory diagram of a display / operation screen displayed on the display unit according to the second embodiment of the present invention.

FIG. 5 is an operation explanatory diagram of setting a display portion of an image of a function symbol of a display / operation component according to a third embodiment of the present invention.

FIG. 6 is an operation explanatory diagram of a display / operation screen displayed on a display unit according to a fourth embodiment of the present invention.

FIG. 7 is a display / operation screen displayed on a display unit according to a fifth embodiment of the present invention and an explanatory view of its operation;
It is a schematic diagram of the operation procedure data stored in the operation procedure data storage unit.

FIG. 8 is a schematic diagram of operation procedure data stored in an operation procedure data storage unit according to a sixth embodiment of the present invention, and an operation explanatory view of a display / operation screen displayed on a display unit.

FIG. 9 is an operation explanatory diagram of a display / operation screen displayed on the display unit according to the seventh embodiment of the present invention.

FIG. 10 is an operation explanatory diagram of a display / operation screen displayed on the display unit according to the eighth embodiment of the present invention.

[Explanation of symbols]

1 display unit, 2 touch screen, 4 display
Operation component image generation unit, 11 Operation procedure management unit, 14, 1
4a Coordinate position calculation unit, 15, 15a Image size calculation unit, 16 Image data continuous read instruction unit, 17, 17a
Image instruction part setting part, 18 help data change processing part,
19 operation procedure change processing unit, 20 display / operation component specifying unit, 21 operation process determination unit, 22 operation procedure history storage unit, 23, 23a image size batch change processing unit, 24
Vibration animation processing unit, 25, 25a Flow animation processing unit, 26, 26a Scroll processing unit with footprints, 27, 27a Scroll processing unit, 28 operable / incapable setting unit, 29 help component image generation unit, 3
1, 32, 33, 34, 36, 36a, 38a, 38
b, 39a, 39b, 40a, 40b, 41a, 41b
Function symbol image, 35 vibration animation image, 37 direction instruction animation image, 42,43 help information, 100,200,201 display / operation parts,
300 procedure management parts, 400 help parts.

Claims (13)

[Claims] 1. Each display / operation part having various data including image display data and means for realizing various calculations, and a display for displaying an image of a functional symbol based on the image display data of the display / operation part. A unit, a touch screen arranged on the surface of the display unit for detecting the coordinates of the position of the image display data of the image of the instructed and operated function symbol, and instructed and operated based on the output signal of the touch screen. An image of a functional symbol displayed on the display unit as the various data, the display / operation component specifying unit for specifying the display / operation component having image display data of the image. Display data and display coordinate position data for displaying the image display data, and the display / operation unit as the means. The operation mode to be processed for the one identified by the display / operation component identification unit is determined based on the identification information of the display / operation component by the identification unit and the operation information for the instruction and the image of the operated function symbol. Operation processing determination means, coordinate position calculation means for calculating the coordinate position of the image display data, image size calculation means for calculating the image size of the image display data in each of the horizontal and vertical directions, and the coordinate position calculation A display / operation component image generation means for displaying an image of the functional symbol on the display unit based on the coordinate position information by the means and the image size information by the image size calculation means; and an operation mode to be processed by the operation processing determination means. When it is determined that the image size is collectively converted by reducing or enlarging, the coordinate position calculation means and And a image size batch conversion processing unit for driving the image size calculation unit to reduce or enlarge the image related to the display / operation component. 2. Display / operation parts having various data including image display data and means for realizing various calculations, and a display for displaying an image of a functional symbol based on the image display data of the display / operation parts. A unit, a touch screen arranged on the surface of the display unit for detecting the coordinates of the position of the image display data of the image of the instructed and operated function symbol, and instructed and operated based on the output signal of the touch screen. A display / operation component specifying unit for specifying a display / operation component having image display data of an image, and a reduction / enlargement display / operation component for instructing reduction or enlargement of an image as the display / operation component. The reduction / enlargement display / operation part has image display data of the image of the function symbol displayed on the display unit as the various data. A display coordinate position data for displaying the image display data, and further, the display / operation component specifying information and the instruction and the image of the function symbol operated by the display / operation component specifying unit as the means. Operation processing determining means for determining an operation mode to be processed for the one identified by the display / operation component identifying section, and coordinate position computing means for computing the coordinate position of the image display data, based on the operation information; An image size calculation means for calculating the image size of the image display data in each of the horizontal direction and the vertical direction, and a function symbol based on the coordinate position information by the coordinate position calculation means and the image size information by the image size calculation means. Display / operation part image generating means for displaying an image on the display unit,
When the operation mode determination unit determines that the operation mode to be processed is the image size batch conversion of reduction or enlargement, the coordinate position calculation unit and the image size calculation unit are driven to previously perform the image size batch conversion. A graphical user having an image size batch conversion processing unit for reducing or enlarging an image of the display / operation component designated as or the image displayed in the previously designated region of the display unit. interface. 3. A display / operation part having various data including image display data and a means for realizing various calculations, and a display for displaying an image of a functional symbol based on the image display data of the display / operation part. A unit, a touch screen arranged on the surface of the display unit for detecting the coordinates of the position of the image display data of the image of the instructed and operated function symbol, and instructed and operated based on the output signal of the touch screen. A display / operation component specifying unit for specifying a display / operation component having image display data of an image, wherein each of the display / operation components includes an image of a functional symbol displayed on the display unit as the various data, and Image display data of an image of a vibration animation that expresses the vibration of the image of the function symbol, and for displaying the image display data And display data based on the display / operation component identification information by the display / operation component identification unit and the operation information on the image of the instruction and the operated function symbol. An operation processing determination unit that determines an operation mode to be processed for the operation component specified by the operation component specifying unit, an image data continuous reading instruction unit that continuously reads image display data of the image of the vibration animation, and the image data. A display / operation component image generating means for displaying an image of the vibration animation on the display unit based on the image display data of the image of the vibration animation read by the continuous reading instruction means, and an operation to be processed by the operation processing determining means. When it is determined that the mode is the process of adding the vibration animation, the image data A graphical user interface including: a vibration animation processing unit that drives a continuous read instruction unit to add a vibration animation image to the image of the display / operation component. 4. Each display / operation part having various data including image display data and means for realizing various calculations, and a display on which an image of a functional symbol based on the image display data of the display / operation part is displayed. A unit, a touch screen arranged on the surface of the display unit for detecting the coordinates of the position of the image display data of the image of the instructed and operated function symbol, and instructed and operated based on the output signal of the touch screen. An image of a functional symbol displayed on the display unit as the various data, which has a display / operation component specifying unit for specifying a display / operation component having image display data of an image. Display data and display coordinate position data for displaying the image display data, and the display / operation unit as the means. The operation mode to be processed for the one identified by the display / operation component identification unit is determined based on the identification information of the display / operation component by the identification unit and the operation information for the image of the instruction and the operated function symbol. An operation processing determination means, an image display portion setting means for indicating and setting a portion displayed on the display unit in the image display data, and a function symbol is designated based on setting information by the image display portion setting means. The display / operation component image generating means for displaying the partial image on the display unit, and the image display portion setting means when the operation mode to be processed by the operation processing judging means is judged to be the flow of the image. Then, the flow animation process for continuously displaying the image of the designated portion related to the display / operation component and flowing the image. A graphical user interface having a logical means. 5. Each display / operation part having various data including image display data and means for realizing various calculations, and a display on which an image of a functional symbol is displayed based on the image display data of the display / operation part. A unit, a touch screen arranged on the surface of the display unit for detecting the coordinates of the position of the image display data of the image of the instructed and operated function symbol, and instructed and operated based on the output signal of the touch screen. And a display / operation component specifying unit for specifying a display / operation component having image display data of an image, and as the display / operation component, a flow display / operation component for instructing a flow of an image, The fluidized display / operation component stores the image display data of the image of the function symbol displayed on the display unit as the various data and the image display data. And a display coordinate position data for Shimesuru,
Further, the means specified by the display / operation component specifying unit as the means based on the display / operation component specifying information by the display / operation component specifying unit and the operation information on the image of the instruction and the operated function symbol. And an operation processing determining means for determining an operation mode to be processed,
Image display portion setting means for indicating and setting a portion displayed on the display unit in the image display data,
A display / operation part image generation means for displaying an image of a portion in which a functional symbol is designated on the display unit based on the setting information by the image display portion setting means, and an operation mode to be processed by the operation processing determination means are images. When it is determined that the image display portion setting means is driven, the image display portion setting means is driven to continuously display the images of the designated portions of the display / operation parts previously designated as the object of the image movement. A graphical user interface having a fluid animation processing means for fluidizing. 6. The graphical user interface according to claim 4, further comprising image display data of a band-shaped image of numbers as various display data of each display / operation component. 7. A display in which various data including image display data and each display / operation part having means for realizing various calculations and an image of a functional symbol based on the image display data of the display / operation part are displayed. A unit, a touch screen arranged on the surface of the display unit for detecting the coordinates of the position of the image display data of the image of the instructed and operated function symbol, and instructed and operated based on the output signal of the touch screen. A display / operation component specifying unit for specifying a display / operation component having image display data of an image, and the display / operation component includes an image of the display / operation component displayed on the display unit. display·
The operation screen or a display within a predesignated area has a scroll display / operation component for instructing scrolling of the operation screen in the vertical and horizontal directions, and the scroll display / operation component is stored in the display unit as the various data. Image display data of the image of the function symbol displayed and the image of the direction instruction animation that expresses the scroll direction,
Display coordinate position data for displaying the image display data, and further, as the means, display / operation component identification information and instructions by the display / operation component identification unit, and operation on the image of the operated function symbol. An operation processing determination unit that determines an operation mode to be processed for the one identified by the display / operation component identification unit based on the information, and an image that continuously reads out image display data of the image of the direction instruction animation. Data continuous read instructing means, coordinate position calculating means for calculating the coordinate position of the image display data, image display portion setting means for instructing and setting the portion of the image display data displayed on the display unit, The image of the portion where the function symbol is designated is displayed on the display unit based on the setting information by the image display portion setting means. And displaying the image of the direction instruction animation on the display unit based on the image display data of the image of the direction instruction animation read by the image data continuous read instruction means and the coordinate position information by the coordinate position calculation means. The operation component image generating means, the flow animation processing means for driving the image display portion setting means to continuously display the image of the designated portion and flowing the image, and the flow animation processing means for driving the flow animation processing means. When it is determined that the scroll processing means for scrolling the display / operation screen or the display / operation screen in the area in the designated direction, and the operation mode to be processed by the operation processing determination means is the scroll processing with direction instruction animation, Image data continuous reading instruction means, coordinate position calculator And the scroll processing means is driven, together to display an image of the direction indication animation on the display unit, the display and
A graphical user interface having a scroll processing means with a direction instruction animation for scrolling the display / operation screen in the operation screen or area. 8. The graphical user interface according to claim 7, wherein the image display data of the footstep image is provided as the image display data of the image of the direction indicating animation of the scroll display / operation component. 9. A procedure management component having operation procedure data of each of the display / operation components and means for realizing various calculations, and operation procedure history information in which specific information and operation information of the display / operation components are stored. A storage unit, and the procedure management component, as the means, displays the image of the functional symbol of each of the display / operation components on the display unit based on the operation procedure data and the history information from the operation procedure history information storage unit. 4. An operation procedure management unit for displaying each of the display / operation screens by displaying the image of the function symbol displayed on the display.
A graphical user interface according to 4, 5, 6, 7 or 8. 10. The procedure management component, as the means, is an operation procedure change processing means for changing a weight value for operation procedure data of each of the display / operation components based on history information from the operation procedure history information storage section. , Prioritizing the operation procedure data of each of the display / operation parts based on the weight value changed by the operation procedure change processing means, and displaying the function symbols of the display / operation parts having the operation procedure data of high priority. The image display data and the display coordinate position data of the image or the operation procedure data of the display / operation component is changed, and the change data, the operation procedure data of each display / operation component, and the operation procedure history information storage unit are changed. An image of the function symbol of each display / operation part after the change is displayed on the display unit based on the history information, and the displayed function symbol is displayed. 10. The graphical user interface according to claim 9, further comprising an operation procedure management unit configured to configure each display / operation screen with the image of the file. 11. A help component having various data including help data having help information of each of the display / operation components and a means for realizing various calculations, wherein the help component is the display unit as the various data. Image display data of the image of the function symbol displayed on the screen, help information explaining the function of each display / operation component, help information explaining the operation procedure of each display / operation component, and the operation procedure history information storage unit. Help data having help information summarizing operation contents based on history information from the operation procedure data from the operation procedure management means of the procedure management part and history from the operation procedure history information storage unit. Based on the information, each display / operation image composed of the images of the display / operation parts displayed on the display unit. The help component generating means for displaying the help information of the help data corresponding to the above on the display unit is included in claim 1, 2, 3, 4, 5, 6, 7, 8, 9, or 10. Graphical user interface. 12. The help component includes, as the means, a help data change processing unit that changes the help data based on history information from the operation procedure history information storage unit, and an operation procedure management unit of the procedure management component. Help component for displaying on the display unit the help information including the changed help information of the help data corresponding to each of the display / operation screens, based on the operation procedure data and the history information from the operation procedure history information storage unit. 10. The graphical user interface according to claim 9, further comprising a generating unit. 13. The display / operation component is operable to set whether or not the image related to the display / operation component displayed on the display unit 1 is operable as the means. Claims 1, 2, 3, 4, 5, 6, 7, 8, characterized by having impossible setting means.
A graphical user interface according to 9, 10, 11 or 12.