JPH05143217A - Operating procedure simulating device - Google Patents

Abstract

PURPOSE:To improve the designing efficiency by investigating the human interface of an electronic equipment, etc., at its designing stage. CONSTITUTION:The pictures and the animations serving as the changing units for display of an electronic equipment, etc., are set at a page information setting part 12 as the page information in accordance with the input of an input device 11. Meanwhile the connection of page information is set at a page information setting part 13 as the page connection information and written in a memory part 19. Then these page information and page connection information are read out of the memory 19 in response to the input of the device 11. The change of display of the electronic equipment, etc., is traced by a simulation executing part 16 based on those read-out information and simulated at a display part 18.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an operation procedure simulation device for simulating an operation procedure of, for example, an electronic device.

[0002]

2. Description of the Related Art For example, an electronic device such as an AV device is desired to have good sounds and images, and also to have high operability for obtaining those sounds and images. .. For example, in the case of recording an answering machine using a video tape recorder (VTR) in AV equipment, the user sets the channel of the program to be recorded, month / day, day of the week, start time, end time, tape running speed, etc. The VTR
It will be performed using the main body or a remote control device.
As a matter of course, it is desired that these series of operations be simple and that it be possible to confirm that there is no error each time. Therefore, for example, when performing a series of operations as described above on the VTR, a display unit is provided for confirming whether or not the operation is correct with visual information. It can be said that the so-called human interface. An example is an interface such as an interactive on-screen display (OSD).

[0003]

By the way, in order to study the design of the human interface such as the above-mentioned on-screen display (OSD) and the change and movement of the display information, it is necessary to wait until the prototype is made. From this point, it was difficult to examine sufficient operability, changes in displayed information, and movements. In addition, a complicated program is required to perform a simulation on a computer.

Note that this simulation is a technique for converting the state, nature, or behavior of a target system into an easy-to-understand system and reproducing it.
The technique of reproducing in a visually easy-to-understand form using computer graphics techniques, that is, the simulation using images has begun to be effectively utilized.

The present invention has been made in view of the above-mentioned circumstances, and provides an operation procedure simulation apparatus capable of examining the operability of, for example, an electronic device using a general-purpose computer before a prototype can be formed. With the goal.

[0006]

An operation procedure simulation apparatus according to the present invention is an input device for performing an input operation and an input of the input section in a simulation apparatus for simulating a display form of a human interface part of an electronic device. A display unit that displays the display content of the interface unit corresponding to the operation, a memory unit in which information corresponding to the input operation of the input unit is written, and a change of the display of the electronic device according to the input operation of the input unit. Connection between the page information setting section that sets a unit picture or video as each page information and writes it in the memory section, and each page information set in the page information setting section according to the input operation of the input section And the page connection information setting section for writing to the memory section and the above-mentioned memory according to the input operation from the input section. The page execution information and the page connection information written in the memory section, and a simulation execution processing section that traces the change in the display of the electronic device based on the page information and the page connection information and displays the change on the display section. The above-mentioned problems are solved by the features.

Further, the operation procedure simulation apparatus according to the present invention corresponds to an input section on which an input operation is performed and an input operation of the input section in a simulation apparatus for simulating a display form of a human interface part of an electronic device. A display unit that displays the display content of the interface unit, a memory unit in which information corresponding to the input operation of the input unit is written, and a moving image that becomes the display movement of the electronic device according to the input operation of the input unit is set. Provide a script to be a setting sheet screen, set a plurality of pictures along the time axis on this script, and store in the memory section to have a simulation execution processing section that simulates a moving image. The above-mentioned problem is solved by the feature.

[0008]

With the operation procedure simulation apparatus according to the present invention, a simulation can be performed by setting a picture or moving image in page information, which is a unit of display change, and setting connection information in the page to trace the connection between pages. it can. Also, a moving image can be simulated by setting a plurality of pictures along the time axis on the script that is the setting sheet screen.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of an operating procedure simulation apparatus according to the present invention will be described with reference to the drawings. FIG. 1 is a functional block diagram of this embodiment. In FIG. 1, the present embodiment is an input device 11 including, for example, a keyboard and a mouse.
And a page information setting unit 12 that sets, as page information, a picture or a moving image that is a unit of change in display of the electronic device according to an input operation from the input device 11, and an input operation from the input device 11 according to the input operation. The above page information setting section 1
2. The page connection information setting unit 13 for setting the connection of each page set in 2, the page information memory 14 in the memory unit 19 in which the page information from the page information setting unit 12 is written, and the page connection information setting unit. The page connection information memory 15 in the memory section 19 in which the page connection information from 13 is written, the page information written in the page information memory 14 and the page connection information written in the page connection information memory 15 are read. However, a simulation execution processing unit 16 that follows changes in the display of the electronic device according to an input operation from the input device 11, and a display that performs control for displaying the simulation executed by the simulation execution processing unit 16. Simulation executed by the control circuit 17 and the simulation execution processing unit 16 And a display unit 18 for displaying the control of the display control circuit 17.

Next, the operation of the present invention shown in FIG. 1 will be described. The operation procedure simulation apparatus according to the present invention is provided with the concept of page information in order to simulate the operation procedure and display contents of AV equipment and information equipment on a computer. This page information can set a picture, a color, and a moving image, and is set by the page information setting unit 12 according to an input operation from the input device 11. The page information set by the page information setting unit 12 is displayed by the display control unit 1.
Is displayed on the display unit 18 via the memory unit 19
Is written in the page information memory 14 inside. The above page information is independent of each other and is not connected as it is. Therefore, the page connection information setting unit 13 sets the connection between the pages set by the page information setting unit 12. The page connection information set by the page connection information setting unit 13 is displayed on the display unit 18 via the display control unit 17 and is written in the page connection information memory 15 in the memory unit 19. The page information and the page connection information stored in the page information memory 14 and the page connection information memory 15 in the memory unit 19 are read by the simulation execution processing unit 16 according to the input operation of the input device 11, The display control unit 17 is executed by the simulation execution processing unit 16.
Is displayed on the display unit 18 via.

The specific functions of the page information setting unit 12 and the page connection information setting unit 13 of the operation procedure simulation apparatus according to the present invention will be described with reference to the drawing showing the display section of the operation procedure simulation apparatus. .. Figure 2
FIG. 9 is a diagram showing a display example of a display unit 18 of an operation procedure simulation device when setting an arbitrary page in a human interface unit of a small portable input device called a so-called electronic notebook or the like.

In FIG. 2, an external appearance 20 on the display surface 21 side of a small portable input device such as a so-called electronic notebook is displayed on the display unit 18 of the operation procedure simulation device.
Then, the page setting screen 30 is displayed. On the external appearance 20 on the display surface 21 side of the portable small-sized input device, an operation button portion 22 for arbitrarily setting a page corresponding to the display content of the display surface 21 is also displayed. The display content of the display surface 21 of the external appearance 20 of this portable small input device is selected as page information by the operation button 22 and simulated.

Further, the page setting screen 30 switches the display contents every time the contents of the display surface 21 of the appearance 20 of the portable small input device switches. The page setting screen 30 functions as a so-called memo for setting the above-mentioned page and displaying the contents of the set page. The page setting screen 30 includes a page number display section 31 for displaying a page number, a type selection section 32 for selecting a picture, a color, or a moving picture type, and a name display section 3 for displaying a page name.
3. A name setting section 34a for setting or changing a name to be displayed on the name display section 33, and a connection setting section 34 for setting a connection (link) type, a link position, etc.
It is configured by a setting button section 34 and a finish switch 35.

The page setting screen 30 having such a configuration
The display content changes each time the page information is switched as described above, and the page number and name displayed on the page number display unit 31 and the name display unit 33 are displayed on the display surface 21 of the external appearance 20 of the portable small input device. Changes for each page corresponding to the display content of.

Next, in order to set each page using each of the setting sections of the page setting screen 30 and the like, an input operation is performed with the input device 11 such as a keyboard and a mouse. This page setting operation will be described below with reference to a flow chart of the overall operation flow and the main part (page setting) operation.

First, FIG. 3 is a flowchart of the overall operation of the embodiment of the operation procedure simulation apparatus according to the present invention. In the first step S1 of FIG. 3, it is determined whether or not the operation procedure simulation is new, and YES.
If it is (new), step S2 follows and page setting is performed. In this step S2, one of color, picture, and moving image which is a unit of change in display of the electronic device is selected and set as page information, and connection information between each page information set in such a manner is also set. .. When the page setting is completed in step S2, the process proceeds to step S4 and the simulation is executed. Next, from the executed simulation, a step S5 decides whether or not the setting change is necessary. When NO is determined in step S5 (setting change is unnecessary), the process proceeds to step S6, and it is determined whether or not the procedure needs to be changed. When NO is determined in step S6 (procedure change unnecessary), the process proceeds to step S7. In this step S7, the software for the above-mentioned operation procedure simulation is stored. YES in step S5 above
When it is determined that the setting needs to be changed, the process returns to step S2 and page setting is performed. When the page setting in step S2 is completed, the process proceeds to step S4 and the simulation is executed. When it is determined to be YES (procedure change is required) in step S6, the process proceeds to step S8,
The page is edited. When the page editing in step S8 is completed, the process returns to step S4 and the simulation is executed. When NO (not new) is determined in step S1, the operation procedure simulation software stored in step S3 is opened and executed in step S4. The fact that it is not new means that it is unnecessary to open and execute the software in step S3 because the software for the operating procedure simulation has already been completed. It is considered that the software is executed and a third party determines whether or not the setting change in step S5 is necessary.

Details of page setting, which is the main part of step S2, will be described with reference to FIG. FIG. 4 is a detailed flowchart of the page setting operation. In FIG. 4, when page setting is started, step S11 first determines whether or not page setting is performed, and if NO (no setting is performed), the process ends, and step S4 of the flowchart shown in FIG. 3 is executed. Proceed to. YES in step S11 above
When it is determined that the setting is performed, the process proceeds to step S12.
In this step S12, a color, a picture, and a moving image which are units of change in display of the electronic device are classified as a type, and one of them is selected as a page to be set. Step S1
When 2 selects one to be set as a page, the process proceeds to step S13, and a so-called connection information link is selected to be automatic (manual) or manual (manual). If auto is selected in this step S13, it is possible to automatically move to the designated page after executing an arbitrary page, and proceed to page selection in step S14. When manual is selected in step S13, the process proceeds to step S15 to set the position of the link. Step S1
When the setting of the link position is completed in step 5, the process proceeds to step S16, and the destination page to be moved when the set link position is selected is set. When new is selected in this step S16, the process proceeds to the page increase in step 17, and the process returns to the start. On the other hand, if the existing one is selected in step S16, the process proceeds to page selection in step S18.
The procedure returns from 18 to the setting of the link position in step S15.

The page setting operation has been described above with reference to the flow chart, but an example of the operation will be described here. Figure 4
If, for example, a picture is selected as the setting type in step S12, the type selection unit 32 selects and inputs the picture key 32a with the input device 11 such as a keyboard or a mouse, and the connection setting unit 34b of the setting button 34 automatically or Select a manual. If the manual is selected, the connection setting section 34b similarly sets the link position and specifies the destination. On the other hand, if you select Auto, specify the page to be moved automatically.

Next, with respect to the page connection information (link) connecting the page information when setting the page, a case of simulating an operation procedure of a small portable input device called, for example, a so-called electronic notebook is exemplified. As described below.
FIG. 5 is a diagram for explaining a link of a small portable input device called a so-called electronic notebook, for example.

In FIG. 5, the figure shown in A is the page on the display surface 21a of the appearance 20a of the small portable input device is called "cover", and the figure shown in B is the appearance 2
The page on the display surface 21b of 0b is named "memo", the figure shown in C is the page on the display surface 21c of the appearance 20c named "action", and the figure shown in D is The page on the display surface 21d of the appearance 20d is named "connection". Each appearance 20a,
In 20b, 20c, 20d, the operation button section 22 is provided at the position of the right shoulder of each display surface 21a, 21b, 21c, 21d, and by displaying the key corresponding to the name of each page, For example, by inputting an input device such as a mouse, one of the pages having the above name is displayed on a predetermined display surface.
For example, the key 22b of the operation unit 22 on the exterior 20a of FIG.
If you enter, on the display surface 21b on the appearance 20b of FIG.
A page named "memo" corresponding to the key 22b is displayed. Similarly, when the key 22c of the operation unit 22 on the appearance 20a of FIG. A is input, a page named "action" corresponding to the key 22c is displayed on the display surface 21c of the appearance 20c of FIG. When the key 22d of the operation unit 22 on the appearance 20a in the figure is input, a page named "connection" corresponding to the key 22d is displayed on the display surface 21d on the appearance 20d in the figure D. The above makes it possible to arbitrarily select the page to be displayed on the display surface by inputting the key of the operation unit 22. In other words, by inputting the key of the operation unit 22, the page connection position is determined. This means setting the link manually.

On the other hand, for example, if a page named "Cover" displayed on the display surface 21a of the appearance 20a of FIG. A is set as automatic (auto), it is displayed on the display surface 21b of the appearance 20b of FIG. Displayed on the display surface 21d of the appearance 20d of FIG. D even after the page named "memo" is finished, even after the page of the name "action" displayed on the display surface 21c of the appearance 20c of FIG. Even after the page named "connection" is completed, the screen returns to the page named "cover" displayed on the display surface 21a of the appearance 20a in FIG.

Therefore, in the embodiment of the operation procedure simulation apparatus according to the present invention, a human interface such as an interactive OSD (on-screen display) can be sufficiently studied at the design stage by using a general-purpose computer.

Next, a simulation of displaying a moving image will be described. The change or movement of the display unit of AV equipment, information equipment, etc. determines the operability and image of the product. We used the concept of script to simulate the changes and movements of the display on a computer. A script is like a script or screenplay, and can be called a setting sheet screen. You can simulate a movie by interactively setting pictures and colors on this script and executing them. The order of setting is when (time is set), who (selection of picture and color), where (display position in case of picture), and what (display type of picture).

FIG. 6 is an operation flowchart for setting a moving image using the above script. Function selection is performed in the first step S21 of FIG. 6, and this function selection determines whether or not a moving image is actually simulated. If the moving image is actually simulated, the process proceeds to step S22, and the time when the moving image is output is selected. Further, the editing of step S24 and the custom function are duplicated as a copy for editing, segment repeat, automatic arrangement, automatic scrolling, etc. of a moving image simulation whose setting has already been completed. When the time selection is completed in step S22, the process proceeds to step S23, and it is determined whether to set a picture or a color. When the setting of the picture is determined, the process proceeds to step S25, what kind of picture is to be moved is selected, and then the process proceeds to step S26. In step S26,
The display position of the picture is determined using the x and y coordinates on the screen. When step S26 is set, the process proceeds to step S27. In this step S27, the picture display method is determined. Specifically, it is a vertical wipe, a horizontal wipe, a center split, a blind wipe, a scroll and the like. In addition, the above step S2
When the color setting is determined in step 3, the process proceeds to step S28, and what color is used is selected. This choice of color also distinguishes the same shades of light and dark. When step S28 ends, the process proceeds to step S29, and the color display method is determined.
Specifically, the change from one color to another, or the change in brightness of the same color is sudden or gradual. Above step S27
When the selection of the picture display method and the selection of the color display method in step S29 are completed, the process proceeds to step S30. If YES is determined in this step S30, the setting is completed,
Proceed to execution of step S31. If the result executed in step S31 is determined and the setting may be completed, YES is determined in step S32 and the result is saved. Step S above
If NO is determined in 30, the process returns to step S21. If NO is determined in the above step S32, the process returns to the start of this flowchart.

An example of the script setting screen shown in the flow chart of FIG. 6 is shown in FIG. In this FIG.
The script setting screen 41 includes a time display (time axis) displayed in the horizontal direction from 1 to 15 per screen, and a display unit 42 having a region in which 26 (A to Z) can be simultaneously set in the vertical direction. , A button item selection section 43 for selecting items such as “setting 1”, “setting 2”, “edit”, and “custom”, and a setting button section 44 for displaying method, position setting, name setting, etc. It has a setting content section that is displayed on the display section 42 as a window only while the setting button section 44 is pressed.

The above-mentioned time display (time axis) is divided into 1 to 15 per screen, but if the screen is scrolled, the maximum is 5
Up to 12 can be displayed. In addition, the button item selection unit 43 can be set to a maximum of 2 by functioning.
Four settings are possible.

A specific method of setting a moving image on the script setting screen is to set a picture in the area A from the position of the time axis 3, and then set a slightly changed picture in the area A of the time axis 4. If a picture that gradually changes while changing the time axis is set in the same area A, a moving image can be simulated when step S31 of the flowchart of FIG. 4 is executed. The same applies to the color setting. Since the script setting screen has a maximum of 512 time axes and a maximum of 26 areas, it is possible to set various moving images at the same time.

Therefore, by simulating a moving image with the embodiment of the operation procedure simulating apparatus according to the present invention, the change or movement of the display section of the AV equipment or the information equipment, including the display contents thereof, can be performed before the prototype is produced. Can be examined and evaluated.

The operation procedure simulation apparatus according to the present invention is not limited to the above embodiment,
A wide variety of electronic devices can be used as long as they have an interface.

The inventor has also considered a flowchart having a new hierarchical structure in the process of inventing the operation procedure simulation apparatus according to the present invention. The flowchart of this new hierarchical structure will be described below with reference to the drawings. FIG. 9 is a diagram showing a conventional flowchart.
In the conventional flowchart, tasks 91 to 92,
94, task 92 to tasks 93 and 96, task 9
It is easy to understand if it is a structure that only flows from top to bottom like 4 to task 96, but it is a structure that returns from bottom to top such as task 93 to task 91, task 96, 95 to task 91. Or, if there are many tasks, the expression becomes complicated and difficult to understand. Also,
The area of the flow chart also becomes large.

Therefore, the present inventor has considered a flowchart of a new hierarchical structure called a step flowchart as shown in FIG. This step flow chart is shown in FIG.
As shown in, tasks 81, 82, 83, 84, 85, and 86 are arranged diagonally, and the connections of the tasks are forward from the task 81 side to the bottom, and backward from the task 86 side. Flowing toward. In addition, each task is organized so that it is easy to see by judging and highlighting the important points based on the number of branches. In FIG. 8, the shapes of the tasks 81 and 82 are emphasized, unlike the other tasks. Also, the intersections of the arrows and those not intersecting are also distinguished.

Therefore, in the above-mentioned step flowchart, since the complicated hierarchical structure can be effectively utilized and the limited area can be viewed, the relationship between the respective tasks can be understood well. In particular, when simulating a human interface part of an electronic device or the like with the operation procedure simulation device according to the present invention, it is useful for organizing the operation procedure of, for example, a complicated AV device.

[0033]

The operation procedure simulation apparatus according to the present invention simulates a human interface part of an electronic device on a computer screen, and sets a picture or a moving image in page information which is a unit of display change. The connection information between pages can be set to trace the connections between pages, and multiple pictures can be set along the time axis in the script that sets the video, so that the video can be simulated. The interface can be examined at the design stage, the human interface can be improved, and the design efficiency can be improved.

[Brief description of drawings]

FIG. 1 is a functional block diagram of an embodiment of an operation procedure simulation device according to the present invention.

FIG. 2 is a diagram showing a display example of a display unit of an embodiment of an operation procedure simulation device according to the present invention as a human interface portion of a small portable input device.

FIG. 3 is a flowchart for explaining an overall operation of the operation procedure simulation device according to the present invention.

FIG. 4 is a flowchart illustrating an operation of a page setting unit, which is a main part of the flowchart for explaining the overall operation of the operation procedure simulation apparatus shown in FIG.

FIG. 5 is a diagram for explaining a link of a small portable input device such as a so-called electronic notebook.

FIG. 6 is a flowchart for explaining a moving image setting operation when simulating a moving image with the operation procedure simulation apparatus according to the present invention.

FIG. 7 is a diagram showing a typical screen of a script used for setting a moving image.

FIG. 8 is a diagram showing a step flowchart having a new hierarchical structure.

FIG. 9 is a diagram showing a conventional flowchart.

[Explanation of symbols]

 11 ... Input device 12 ... Page information setting unit 13 ... Page connection information setting unit 14 ... Page information memory 15 ... Page connection information memory 16 ... Simulation Execution processing unit 17 ... Display control unit 18 ... Display unit 19 ... Memory unit

Claims (2)

[Claims] 1. A simulation device for simulating a display form of a human interface part of an electronic device, wherein an input part for performing an input operation and a display part for displaying display contents of the interface part corresponding to the input operation of the input part. And a memory section in which information corresponding to the input operation of the input section is written, and a picture or a moving image that is a unit of change in the display of the electronic device according to the input operation of the input section is set as each page information. And a page connection information setting unit that writes a connection to each page information set in the page information setting unit according to an input operation of the input unit and writes the page information setting unit in the memory unit. Read the page information and page connection information written in the memory section according to the input operation from the input section. An operation procedure simulation apparatus having a simulation execution processing unit that traces changes in the display of the electronic device based on the page information and page connection information and displays the changes on the display unit. 2. A simulation device for simulating a display form of a human interface part of an electronic device, wherein an input part for performing an input operation and a display part for displaying the display content of the interface part corresponding to the input operation of the input part. And a memory unit in which information corresponding to the input operation of the input unit is written, and a script that serves as a setting sheet screen for setting a moving image that is a display movement of the electronic device according to the input operation of the input unit, An operation procedure simulation apparatus comprising: a simulation execution processing unit for simulating a moving image by setting a plurality of pictures on the script along a time axis and storing them in the memory unit.