JPH10301761A - Preparation method for user interface and management device therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce development man-hour by generating operation execution type data capable of operating an electronic equipment corresponding to a command input operation from a user based on application object operation data. SOLUTION: An existing operation data input means 12 prepares and inputs existing operation data describing an operation procedure, a function, the correspondence relation and state transition relation obtained by checking the operation procedure of an existing equipment 11. An existing operation data storage means 13 holds the inputted existing operation data. A data selection means 15 selects the ones appropriate for the prescribed function of a new equipment from the existing operation data and outputs the application object operation data as the result at the time of preparing the user interface of the new equipment. A data conversion means 16 performs conversion from the application object operation data to a form executable by an interpreter 17, that is the operation execution type data. The interpreter 17 realizes the user interface at the time of execution by interpreting and executing the operation execution type data obtained by that.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a user interface management device and a method for constructing a user interface management device.

[0002]

2. Description of the Related Art Conventionally, a user interface management device has been described by Albert Nymeyer: "A Grammatical Specification o.
f Human-Computer Dialogue ", Computer Language, Vo
l. 21, pp. 1-16, 1995 (referred to as thesis 1) are known. FIG. 41 shows the structure of a conventional user interface management device, which includes operation description data 3401 that describes the operation of a user interface,
Data conversion means 3402 for converting the operation description data 3401 into operation execution type data in a format executable by the interpreter, and an interpreter 3 for executing the operation execution type data
403, operation dialogue means 340 for input / output with the user
4 and is used in combination with an application 3405 that realizes functions other than the user interface.

Next, the operation of the user interface management device will be described. First, the developer describes the operation of the user interface management device as operation description data 3401.
Described as In particular, it describes the association of what kind of token should be received and what action should be taken at the time of execution. Next, the data conversion unit 3402 converts the operation description data 3401 into a format executable by the interpreter 3403. Next, when the application is executed, the interpreter 3403 interprets and executes the operation description data which has been converted into an executable form in advance. As the operation at the time of execution, the operation interactive means 3404
The application 3405 interprets the token (for example, the numeral “1” or the character “a”) input from the application and requests the application 3405 to execute the operation corresponding to the token. The interpreter realizes a user interface as a whole by repeatedly executing the operation description data converted into an executable form and continuing to process the input from the user.

To summarize the overall process including the development and execution of the user interface, the user interface unit, the dialogue control unit, and the application unit have been considered as one unit. In particular, the user interface section is separated, and the behavior of an application in response to a previously input token from a user is described in a context-free grammar as behavioral description data, and the behavioral description data is compiled. It is possible to realize an interaction of displaying an output from an application in response to an input from a user.

[0005] According to these series of flows, what used to take a long time to directly develop the user interface portion of an application has been described. Then, the interaction between the user and the application can be realized by automatically generating the interaction control unit actually used at runtime by the data conversion means.

[0006]

However, in this user interface management device, first, a developer individually designs a user interface and creates operation description data, so that the operation procedure is not necessarily close to the operation procedure familiar to the user. In some cases, it was difficult to use.

[0007] Further, the developer also has the same problem of increasing the number of development steps as before, in the sense that every time a device is developed, a user interface management device for each device must be designed and developed. Was.

At the same time, there is another problem that the user interface becomes inconsistent because the operation description data is created individually.

Furthermore, there is no flexibility in converting the described behavioral description data, it is not possible to guarantee what the resulting interactive control unit will be, and the conversion method cannot be controlled. There was a problem that.

[0010] The present invention solves these problems and provides a user interface management device that provides a user with a user interface that the user is accustomed to and that can reduce the number of user interface development steps. Aim.

[0011]

SUMMARY OF THE INVENTION In order to solve this problem, the present invention firstly provides an operation procedure, a function, an operation procedure and a function obtained by investigating an operation procedure of an existing device. An existing data input means for constructing and inputting existing operation data describing the correspondence of the existing operation data storage means for storing the input existing operation data, a data selection means,
It is provided with a data conversion unit, an interpreter, and an operation dialogue unit.

[0012] This provides a user interface management device that provides the user with a user interface that the user is accustomed to and that can reduce the number of steps for developing the user interface.

Secondly, in addition to the first configuration, a selection method holding unit and an applicable function holding unit are provided. Accordingly, in addition to the first effect, a user interface management device that enables a developer to construct a user interface only by specifying a function of a device newly developed is obtained.

Third, in addition to the second configuration, an initial selection method input means is provided. Thereby, in addition to the second effect, a user interface management device that allows the user to select a desired user interface is obtained.

Fourth, in addition to the second or third configuration, a data verification means is provided. This allows
In addition to the second or third effects, a user interface management device that enables a developer to obtain a user interface that satisfies the constraints only by specifying constraints on the user interface is obtained.

Fifth, in addition to the second, third, or fourth configuration, an operation dialogue monitoring means is provided. Thereby, in addition to the second, third, and fourth effects, a user interface management device that enables the user to approach a user interface suitable for the user during use of the device is obtained.

Sixth, in addition to the fifth configuration, a function monitoring means is provided. Thereby, in addition to the fifth effect, it is possible to obtain a user interface management device that enables the user interface to quickly and accurately approach the user's preference.

Seventh, the operation dialog monitoring means in the fifth or sixth configuration is provided with an operation dialog monitoring means for inputting either of two values. As a result, a user interface management device that enables the user interface to approach the user's preference faster and more accurately than the fifth or sixth effect is obtained.

Eighth, the operation dialog monitoring means in the fifth or sixth configuration is provided with operation dialog monitoring means for inputting evaluation values of three or more stages.
As a result, a user interface management device that enables the user interface to approach the user's preference faster and more accurately than the fifth or sixth effect is obtained.

Ninth, the operation dialog monitoring means in the fifth or sixth configuration is provided with an operation dialog monitoring means for inputting an evaluation value of a continuous amount. As a result, a user interface management device that enables the user interface to approach the user's preference faster and more accurately than the fifth or sixth effect is obtained.

Tenthly, the operation dialogue monitoring means in the fifth or sixth configuration is provided with operation dialogue monitoring means for measuring the reaction time of the user and converting the time into a numerical value to be an evaluation value. is there. As a result, a user interface management device that enables the user interface to be closer to the user's preference without requiring the user to perform input operations, compared to the fifth or sixth effect, is obtained.

[0022]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The invention according to claim 1 of the present invention is based on an existing operation procedure employed in various electronic devices,
A plurality of existing operation data describing the correspondence between functions and their operation procedures and functions is stored in a database, and when a user interface of a new device is created, the existing From the existing operation data stored in the operation data database, a set of existing operation data to be used is selected, and the set is set as applicable operation data, and further, based on the applicable operation data, the electronic device A user interface is created by generating operation-executable data that enables operation in accordance with a command input operation from a user, and operation-executable data for a new function can be easily created. For the user interface with familiar operations. To.

According to a second aspect of the present invention, in the method for creating a user interface according to the first aspect, an existing operation stored in the database of the existing operation data for a predetermined function of a new device. From the data,
The operation of selecting the set of existing operation data to be used is performed by the judgment and operation of the development designer, and has an effect that the user interface developer can easily perform the operation of creating the applicable operation data.

According to a third aspect of the present invention, in the user interface creating method according to the first aspect, an existing operation stored in the existing operation data database for a predetermined function of a new device. From the data,
The operation of selecting a set of existing operation data to be used is performed by the processing operation of the data selection means.

According to a fourth aspect of the present invention, in the method for creating a user interface according to the second aspect, the generation of operation-executable data is performed by the judgment and operation of a development designer.

According to a fifth aspect of the present invention, in the user interface creating method according to the third aspect, the generation of the operation execution type data is performed by the processing operation of the data conversion means.

According to a sixth aspect of the present invention, there is provided an existing operation data input means for constructing and inputting existing operation data describing an operation procedure, a function, and a correspondence between the operation procedure and the function, Existing operation data storage means for storing input existing operation data, selection input means for a developer to input an instruction to select existing operation data, and existing operation data storage means based on an input from the selection input means Is a data selection unit that selects a set of existing operation data to be used from among the existing operation data accumulated by the server and uses the set as the applicable operation data, and a format that allows the interpreter to execute the applicable operation data Input / output between data conversion means for converting to operation-executable data and an application for executing the operation-executable data and realizing functions other than the user interface An interpreter for performing input and output with the operation dialogue means, and an operation and dialogue means for presenting information to the user and accepting input from the user by inputting and outputting instructions from the interpreter and transmitting the input information as a signal to the interpreter. It has an effect that the operation execution type data for the new function can be easily created.

According to a seventh aspect of the present invention, in the user interface management device according to the sixth aspect, the operation procedure is an operation procedure obtained by investigating an operation procedure of an existing device. Things.

[0029] The invention according to claim 8 of the present invention constructs existing operation data describing the correspondence between operation procedures, functions, the operation procedures and functions, and selection reference information of the operation procedures. Existing data input means for input, existing operation data storage means for storing the input existing operation data, selection method holding means for providing a reference for selecting a set of existing operation data by the data selection means, and a user interface other than the user interface Based on the application function holding means indicating the function of the application realizing the function, the selection method holding means, and the application function holding means, use the existing operation data stored in the existing operation data storage means. Data selection means for selecting a set of existing operation data and using that set as the operation data to be applied, and the interpreter can execute the operation data to be applied Data conversion means for converting the operation execution type data is a format, perform the operation execution type data,
An interpreter that performs input and output with the application and input and output with the operation dialogue means; and an input and output command from the interpreter presents information to the user and accepts input from the user. And an operation dialogue means for sending a signal to the user.

According to a ninth aspect of the present invention, in the user interface management device according to the eighth aspect, the operation procedure is an operation procedure obtained from the operation procedure of an existing device. .

According to a tenth aspect of the present invention, in the user interface managing apparatus according to the eighth aspect, an initial selection method input means for inputting a selection method by a selection method inputter is provided.

[0032] The invention according to claim 11 of the present invention is to construct existing operation data which describes an operation procedure, a function, a correspondence relation between the operation procedure and the function, and selection criterion information of the operation procedure, Existing data input means for input, existing operation data storage means for storing the input existing operation data,
Existing operation data storage means for storing existing operation data and selection reference information of each function, selection method holding means for providing a reference for selecting a set of existing operation data by the data selection means, and functions other than the user interface are realized. Based on the application target function holding unit indicating the function of the application, the selection method holding unit, and the application target function holding unit, the existing operation data to be used is selected from the existing operation data stored in the existing operation data storage unit. A data selecting unit for selecting a set and using the set as the applicable operation data; a data verifying unit for determining whether the applicable operation data and the operation execution type data satisfy the constraint; and an applicable operation data Conversion means for converting data into operation-executable data in a format executable by the interpreter; and operation-executable data An interpreter that executes and performs input and output with the application and input and output with the operation dialogue means, and presents information to the user and accepts input from the user according to input and output commands from the interpreter; The information has an operation dialogue means for sending the information as a signal to the interpreter.

According to a twelfth aspect of the present invention, in the user interface management device according to the eleventh aspect,
The data conversion means converts the applicable operation data into operation-executable data that is in a format executable by the interpreter, and the data verification means determines whether the applicable operation data and the operation-executable data match the constraints. Judgment is made, and if they match, the obtained operation execution data is passed to the interpreter. If they do not match, the constraint conditions are met and the data selection method matches the selection method in the holding means. The data processing means selects the applicable operation data having the highest degree, converts the applicable operation data into operation-executable data, and passes the data to an interpreter.

According to a thirteenth aspect of the present invention, in the user interface management device according to the eleventh or twelfth aspect, the operation procedure is an operation procedure obtained by investigating an operation procedure of an existing device. It was made.

According to a fourteenth aspect of the present invention, in the user interface management device according to any one of the eighth to thirteenth aspects, a state of a dialogue between the user and the operation dialogue unit is monitored, and the dialogue is performed. Operation dialogue monitoring means for outputting information on the state of the user, and reconstructing the user interface based on the output from the operation dialogue monitoring means.

According to a fifteenth aspect of the present invention, in the user interface management device according to the fourteenth aspect,
The output from the operation dialog monitoring means is input to the selection method holding means, and as a result, the user interface is reconstructed.

According to a sixteenth aspect of the present invention, in the user interface management device according to the fourteenth aspect,
The output from the operation dialog monitoring means is input to the data selection means. As a result, the user interface is reconstructed.

According to a seventeenth aspect of the present invention, in the user interface management device according to the fourteenth aspect,
The output from the operation dialog monitoring means is input to the data verification means, and as a result, the user interface is reconstructed.

[0039] The invention according to claim 18 of the present invention is the user interface management device according to claim 14, wherein
The output from the operation dialog monitoring means is input to the interpreter, and as a result, the user interface is reconstructed.

According to a nineteenth aspect of the present invention, in the user interface management device according to the fourteenth aspect,
A function monitoring means for monitoring a function instructed to be executed by an interpreter and inputting the function to a selection method holding means is provided.

According to a twentieth aspect of the present invention, in the user interface management device according to any one of the fourteenth to nineteenth aspects, the user interface operation is judged as superior or inferior in that the user interface is poor. One button is provided as operation dialogue monitoring means.

According to a twenty-first aspect of the present invention, in the user interface management apparatus according to any one of the fourteenth to nineteenth aspects, one of the binary values is used as the determination regarding the superiority or inferiority of the operation of the user interface. It is provided with an operation dialogue monitoring means for communicating.

According to a twenty-second aspect of the present invention, in the user interface management device according to any one of the fourteenth to nineteenth aspects, an evaluation value of three or more levels is determined as a judgment regarding superiority or inferiority of a user interface operation. It is provided with an operation dialogue monitoring means for communicating.

According to a twenty-third aspect of the present invention, in the user interface management device according to any one of the fourteenth to nineteenth aspects, an operation of transmitting an evaluation value of a continuous amount as a judgment regarding superiority or inferiority to operation of the user interface. This is provided with a dialogue monitoring means.

According to a twenty-fourth aspect of the present invention, in the user interface management device according to any one of the fourteenth to nineteenth aspects, the user interface between the user and the operation dialogue means is provided.
From the information presentation to the user, measure the time it takes to receive input from the user, and use the measured value as the state of dialogue,
An operation dialogue monitoring means for detecting a state of the dialogue is provided.

Hereinafter, embodiments of the present invention will be described in detail with reference to specific examples shown in the accompanying drawings.

(Embodiment 1) Hereinafter, a first embodiment of the present invention will be described. FIG. 1 is a principle diagram schematically illustrating an execution state of creation and management of a user interface according to the present invention. In this figure, reference numeral 1 denotes an existing operation procedure, function,
This is existing operation data describing the correspondence between the operation procedure and the function, and a plurality of the existing data 1 are stored in the storage means and made into a database. Reference numeral 2 denotes a function description of a new device, that is, a new device in which function data of a device whose user interface is to be created is written. In creating the user interface of the new device, a set of existing operation data to be used is selected from the existing operation data 1 stored in the database for a predetermined function of the new device, and the set is selected. It is assumed that the applicable operation data 3 is used. Further, based on the application target operation data 3, operation execution type data 4 that enables the electronic device to operate in accordance with a command input operation from a user is generated. A user interface is created by the above operation, and this user interface is managed. And
When a command input is given as a user input 5 from the user of the device, the command input is transmitted to the application 7 via the dialog control unit 6, and an operation corresponding to the command input is performed.

The operation of selecting the existing operation data 1 may be performed manually by the judgment and operation of the development designer, or may be performed mechanically by the processing operation of the data selection means. Further, the generation of the operation execution type data 4 may be performed by the judgment and operation of the development designer,
Alternatively, it may be performed mechanically by the processing operation of the data conversion means.

FIG. 2 is a block diagram showing an example of a configuration of a user interface management device for mechanically or automatically creating and managing a user interface according to the first embodiment. In FIG. 2, reference numeral 11 denotes various kinds of existing electronic devices (hereinafter, referred to as existing devices: TVs, video tape recorders, and the like) to be examined for what operation procedures, functions, and the like are adopted. Yes, those that adopt general operating procedures and functions are selected. An existing operation data input unit 12 acquires an operation procedure, a function, and the like from the existing device 11, constructs existing operation data 1 describing a correspondence relationship between the operation procedure and the function, and inputs the data. Existing operation data storage means as storage means for storing the existing operation data 1 and creating a database; 14 is a selection input means by which a user interface developer inputs an instruction to select the existing operation data 1; 15 is the selection input means A set of existing operation data to be used is selected from the existing operation data 1 stored by the existing operation data storage unit 13 based on the input from the server 14, and the set is selected as the applicable operation data 3. Means 16 is a data conversion for converting the applicable operation data 3 into operation executable data 4 which is an executable data format in response to an instruction input from a user. Stage, 17 perform the operation execution type data 4, and input and output from the application 18 to implement the functions other than the user interface,
Operation interactive means 19 to which instruction data from a user is input
An interpreter 19 for inputting and outputting data to and from the interpreter 17 presents information to the user according to an input / output command from the interpreter 17, accepts input from the user input unit 20, and sends the input information to the interpreter 17 as a signal. The operation dialogue means 20 is a user input unit such as a keyboard on which a user performs an input operation of instruction data.

The existing operation data input means 12 converts the existing operation data 1 describing the operation procedures, functions, their correspondences, and state transition relations obtained by investigating the operation procedures of the existing equipment 11, which is an existing equipment. Create and enter. The existing operation data storage unit 13 holds the input existing operation data 1. The data selecting means 15 is used to create the user interface of the new device by using the existing operation data 1
Of the new equipment, select the appropriate one
This is means for completing what is equivalent to the specification description of the development target device, and as a result, outputs applicable operation data (corresponding to the specification description) 3. In this configuration, at the time of this selection, the developer instructs which data is to be selected by the selection input means 14. Data conversion means 1
Reference numeral 6 converts the applicable operation data 3 into a format executable by the interpreter 17, that is, operation execution data 4. The interpreter 17 realizes a user interface at the time of execution by interpreting and executing the operation execution type data 4 obtained above.

Here, a description method of the existing operation data 1 will be added. The existing operation data 1 is stored in the existing device 11
It extracts the information of the user interface of
Describe using formal language. Here, it is described in an SGML-like format. FIG. 3 is a diagram showing an outline of a description example of the language specification of the existing operation data 1. As shown in this figure, the description method of the existing operation data 1 (in other words, the description rule) is as follows. <Tag name option 1 option 2 ...> ... </ tag> indicates one group.・ Tag list Function-related: Function. Operation related: Operation. Related to definition: Operation procedure definition, operation procedure, layout.・ Breakdown of options (attributes) Function-related functions Function name: Name that indicates the content of the function. Type: The type of target user used. Ranking: Usability evaluation results. Hierarchy: The distinction between basic and secondary. Keywords: Raw score: An index that shows how often the function is used. Operation-related screen: An attribute that represents a screen set later. Number of combination buttons: The number of buttons as a set. Button Set: Basic button set. Operation content, operation column: Operation content. Definition items Operation procedure definition tag Operation set name Operation procedure tag Initial state: Procedure: Transition destination: Layout tag This is described in the language specification. That is, in the above language specification, tags include "function", "operation", operation procedure definition "," operation procedure ", and" layout ", and options include" function name "," type ", and" order ". , "Hierarchy", "keyword", "raw", "screen", "number of combined buttons", "button set", and so on.

FIGS. 4 to 6 show examples of description of the existing operation data 1 described in accordance with the language specification. FIG. 4 is a diagram illustrating a first description example of the existing operation data 1. In this description example, the existing operation data 1 is referred to as “<function function name = video operation keyword =“ consumer electronics video operation ”>><function function name = tape reproduction keyword =“ tape reproduction Tape: sequential continuous information recording Playback: Continuous display of the information "><Operation screen = Screen A Number of combination buttons = 5 Button set name = Home appliance video A> Press the play button [>]. </ Operation></function><function function name = stop keyword = "stop tape playback stop recording stop continuous display stop recording"><operation screen = screen A number of combination buttons = 5 button set name = Home appliance video A> Press the stop button [□]. </ Operation></Function><Function Function name = Record Keyword = “Record”><Operation screen = Screen A ′ Number of combined buttons = 6 Button set name = Home appliance video B> Record button [○] and play button [> ] At the same time. </ Operation></function> ... <function function name = search key word = "search search"><operation screen = screen A number of combination buttons = 5> ... </ operation></function> ... </ function>< Definition Target = Operation procedure Button set name = Consumer electronics video A> Button set = {[<<] [□] [>] [>>>] [△]｝> Layout image = (file name) <Procedure>[>] Push. </ Procedure>… </ definition> ”.

Here, in the first and second rows, Indicates that the data is data for associating what “operation” is performed with respect to each “function”, that is, what operation is performed when what is desired. Then, various attributes are assigned to the function side and the operation side, respectively, and are associated with each other. Looking specifically at the above description, the keyword describes that the content (content) of “video operation” as the function name means “home appliance video operation”. In the following, correspondence between specific functions of the home appliance video operation and operations is performed.

In the following third to seventh lines, <function function name = tape playback Keyword = “tape playback Tape: recording of sequential continuous information playback: continuous display of the information”> ”Means that“ tape playback ”is taken up as an individual function. And
In the keyword portion, what is referred to as tape reproduction is described separately for "tape" and "reproduction".

<Operation Screen = Screen A Number of Combination Buttons = 5 Button Set Name = Consumer Electronics Video A> Pressing the play button [>] in the following lines 8 to 10 It describes how to perform such an operation. Here, “screen A” is used for the screen, the number of combination buttons used for the operation is “5”, the button set name for performing the operation is “household appliance video A”, and in the actual operation, "Press the play button [>]."

The </ operation> in the next 11th line indicates the end of the description group for the above “operation”. That is, here, the end position of the description of what operation is performed for the function “tape playback” is shown.

The </ function> in the next twelfth line indicates the end of the description group for the above-mentioned "function" (function name = tape reproduction). That is, here, the end position of the description of the function “tape reproduction” is shown. As a result, a part of the existing operation data that “tape playback” in the function “video operation” is finally completed by “pressing the playback button [>]” is created.

Next, a description will be given of a description of another function of the function “video operation”. In lines 13-18 Indicates that "stop" is taken up as another function in "video operation", and is a description of another function at the same level as the previous function "tape playback".
Then, the keyword part explains what the stop means.

<Operation Screen = Screen A Number of Combination Buttons = 5 Button Set Name = Home Appliance Video A> in the following lines 19 to 21> Press the stop button [□]. Describes what operation to perform for the function of “stop”. Here, "Screen A" is displayed on the screen.
The number of combination buttons used for the operation is "5", the button set name for the operation is "Home appliance video A", and the actual operation is "Press the stop button [□]" And

The </ operation> in the next line 22 indicates the end of the description group for the above “operation”. That is, here, it indicates the end position of the description of what operation to perform for the function of “stop”.

The </ function> in the next 23rd line indicates the end of the description group for the above-mentioned "function" (function name = tape reproduction). That is, here, the end position of the description of the function “tape reproduction” is shown. As a result, "stop" in the function "operate home appliance video" is finally "press the stop button [□]"
Thus, a part of the existing operation data to be completed is created.

Hereinafter, in the same manner, other functions of the “video operation” function include “recording”, “cue search”,
Is described. Then, when the association between the various functions and the operation regarding the function “video operation” is completed,
The function description at the “<function function name = video operation” (description on the first line) level is finished, and then “<definition target = operation procedure button set name = consumer electronics video A> button set = ｛[<< ] [□] [>] [>>>] [△]｝> Layout image = (file name) <Procedure> Press [>] </ Procedure… </ Definition> The association is made.

FIG. 5 is a diagram showing a second description example of the existing operation data 1 described in accordance with the language specification shown in FIG. In this description example, the existing operation data 1 is written as “<function function name = video operation>… </ function><function function name = video operation keyword =“ consumer electronics video ”><function function name = tape playback keyword =“ tape ” Playback Tape: Recording of sequential continuous information Recordable for each frame and can be retrieved in units Playback: "Logical time = real time" display of that information "><Operation screen = Screen B Combination button = 1 Button set name = Jog shuttle A> Turn the jog shuttle to the right XX degrees </ Operation></Function><Function Function name = Stop playback Keyword = "Stop tape playback, stop tape Stop continuous display . Selection of a specific frame. "><Operation screen = Screen B 'Combination button = 1> Press the stop button. </ Operation></Function> ... Described as </ Function>.

This description has been made according to the same specifications as the description of FIG. 4 above, so a detailed description will be omitted. However, in “home appliance video operation” in “function name = video operation” cited in the second description example, “home appliance video operation” in “function name = video operation” cited in the first description case above It is evident that a somewhat different operation has been performed.

FIG. 6 is a diagram showing a third description example of the existing operation data 1 described in accordance with the language specification shown in FIG. In this description example, the existing operation data 1 is described as “<function function name = video operation keyword =“ home appliance video operation ”>><function function name = recording reservation keyword =“ program reservation Program: continuous image information to be broadcast Reservation: Program time, channel setting "><Operation screen = Screen C Combination button = 4 Button set name = Remote control basic E> Press the [Program] button in the basic set the required number of times. Use the [+] and [-] buttons to specify the channel. Press the [Send] button. Specify the day using the [+] and [-] buttons. Press the [Send] button. Use the [+] and [-] buttons to specify the start time. Press the [Send] button. Use the [+] and [-] buttons to specify the start minute. Press the [Send] button. Specify the end time with the [+] and [-] buttons. Press the [Send] button. Use the [+] and [-] buttons to specify the end minute. Press the [Send] button. </ Operation></function><function function name = recording reservation keyword = "program reservation program: continuous image information to be broadcast reservation: program time and channel setting coding shortening"><operation screen = screen D Combination button = 15 Button set name = Remote control basic G> Press the [G code reservation] button. Press the [0] to [9] buttons as necessary and enter the G code. Press the [Convert] button. Press the [Send] button. </ Operation></function>…</function><definition> ｛[program] [+] [-] [feed]｝ </ definition><definition> Button set name = remote control basic G ｛[G code reservation] [0] [1] [2] [3] [4] [5] [6] [7] [8] [9] [conversion] [+] [-] [transmission]｝ </ definition> Describe.

This description is also made in accordance with the same specifications as the description of FIG. 4 described above, so a detailed description will be omitted. However, in the “home appliance video operation” in the “function name = video operation” mentioned in the third description example, the first first
It is clear that the operation is slightly different from the “home appliance video operation” in “function name = video operation” mentioned in the second description example.

Next, a method of describing the applicable operation data 3 will be described. The applicable operation data 3 is a description corresponding to the specification of the user interface of the new development target system (new equipment). In order to associate the function with the operation method, the function of the new development target system and the existing operation data 1 are used. This is a combination of the operation taken out. Therefore, when the new development target system has a new function, the operation and processing for associating the operation corresponding to the function are performed, and the applicable operation data 3 is created. The application target operation data 3 has the same data content as the above-mentioned existing operation data 1 in that it has one aspect of being data in which "functions" are associated with "operations", and has the same data format. The applicable operation data 3 is also
The description is made in accordance with the format of the existing operation data 1. In this description, in addition to the language specifications shown in FIG.
Use options as well. FIG. 7 shows applicable operation data 3
It is a figure which shows the outline | summary of the tag option added in order to describe. As shown in this figure, the tag options include: • Tag to be added Operation tag • Breakdown of option (attribute) to be added Operation tag: Operation content: Operation content. Application operation call entry: Entry name. There is. Note that “app” in FIG. 7 represents an application.

A description will now be given of a description example of the applicable operation data 3 described in accordance with the language specifications shown in FIG. 3 and the tag options shown in FIG. FIG. 8 is a diagram illustrating a description example of the application target operation data 3. In this description example, the applicable operation data 3 is referred to as “<function function name = WWW batch reproduction function keyword =“ line WWW still image reproduction ””><function function name = page selection> (omitted) <operation> “ Operation equivalent to “TV operation: home appliance 2: channel selection” </ operation></function><function function name = load><operation set name = Video operation: home appliance 1 screen = screen A combination button = 5 button set name = Home appliance video A> Press the [△] button. </ Operation><operation> (omitted) </ operation></function><function function name = parallel playback><operation set name = video operation: home appliance 1 screen = screen A combination button = 5 button set name = home appliance video A> Press the [>] button. </ Operation><operation> ★ entry of start of parallel playback ★ </ operation></function><function function name = stop><operation set name = video operation: home appliance 1 screen = screen A combination button = 5 button set name = Home Appliance Video A> Press the [□] button. </ Operation><Operation> ★ Entry for stopping playback in parallel ★ </ Operation></Function></Function> ”.

Here, the description of <function function name = WWW batch reproduction function keyword = “WWW still image reproduction in a line” ”in the first to fourth lines indicates that the system to be newly developed has“ W
WW batch playback function "(a function for batch playback of data received from the Internet), and its content (contents) is" WWW still image playback. Is described by a keyword. In the following, correspondence between individual functions and operations included in the WWW batch reproduction function is performed.

<Function> Function name = page selection> (Omitted) <Operation> “TV operation: home appliance 2: channel selection” in the following fifth to ninth lines is an individual function in the function “WWW batch reproduction function”. An operation corresponding to “page selection” is taken as a function, and an operation corresponding to the function is defined. And
<Operation> describes what operation is to be performed on the function of “page selection”. Here, in the actual operation, “television operation: home appliance 2: channel selection” is performed.

Here, the "WWW batch reproduction function", which is the above function display, is provided as a new function in the new development target system, and the description of this function display is created by the developer of the user interface. The “page selection” function as an individual function in the “WWW batch reproduction function” is also provided by a user interface developer and is created by this developer. However, “TV operation: home appliance 2: channel selection” regarding the operation is determined by the user interface developer from the database of the existing operation data storage unit 13 as the most appropriate operation corresponding to the “page selection” function. It is extracted and assigned (associated). That is, in the database of the existing operation data storage means 13, data of “television operation: home appliance 2: channel selection” exists as existing operation data 1. This data is an operation related to the television operation, the genre falls into the category of the home appliance 2, and the specific operation is “channel selection”. "WWW batch playback function"
It is intended to be applied to the operation of the "page selection" function in the "<".

The </ operation> in the next 10th line indicates the end of the description group of the above “operation”, and the </ function> in the next 11th line is the “function” (function name = page). Indicating the end of the description group for (selection) is as described above. By the above-described description processing, "page selection" in the function "WWW batch reproduction function" is finally applied by "television operation: home appliance 2: channel selection". Is created.

In the same manner, the individual functions of the “WWW batch reproduction function” are “load (download)”, “parallel reproduction”, “cancel”
Is described. And for each of the above individual functions,
Function operation “Load” Set name = Video operation: Home appliance 1 Screen = Screen A Combination button = 5 Button set name = Home appliance video A Press the [△] button. "Parallel playback" Set name = Video operation: Home appliance 1 screen = Screen A Combination button = 5 Button set name = Home appliance video A Press the [>] button. “Cancel” Set name = Video operation: Home appliance 1 screen = Screen A Combination button = 5 Button set name = Home appliance video A Press the [□] button. As described above, each operation is associated with an individual function in the function “WWW batch reproduction function”,
The application data 3 to be applied is completed. These associated operations are data that the user interface developer deemed most appropriate from the plurality of existing operation data 1 was manually (keyboard operation or the like) extracted from the database first. This is as described in the description of the description of “page selection”. In addition, in the application target operation data 3, data indicating “operation” is also incorporated in addition to the association between the function and the operation. The “operation” data is data for explaining what operation is performed when the associated function and operation are designated.

Next, a method of describing the operation execution type data 4 will be described. The operation execution type data 4 is for realizing a runtime user interface by being executed by the interpreter 17 at the time of execution, and includes display elements for each screen,
The next operation / state for the operation of the state and the GUI component is described. The operation execution data 4 is stored in the user input unit 2
Since the processing is executed by the interpreter 17 based on the operation command from 0, the existing operation data 1 and the applicable operation data 3 correspond to “operation” for “function”. Is different, "operation"
Is associated with “function (or operation)” (a data format in which such a function (operation) is executed when such an operation is performed). FIG. 9 is a diagram showing an outline of language specifications used to describe the operation execution type data 4. As shown in this figure, the operation execution type data 4 is composed of “component: screen state, which should be displayed in each state: GUI element, information display unit main body, and attribute of additional information. Each placement position attribute. Operation A description of the operation to be accepted in each state, the corresponding operation, and the state transition relation. ] Is described in the language specification. That is, in the above language specification, the state of the “GUI element”, the state of the “information display unit main body”, and the “additional information” should be described as the screen state, and the operation is “accepted in each state”. An operation "and" an operation and a state transition relation corresponding to the operation "should be described.

Here, a description will be given of a description example of the operation execution type data 4 described in accordance with the language specification.
FIG. 10 is a diagram showing a description example of the operation execution type data 4. In this description example, the operation execution type data 4 is described as “initial operation = state a screen state: state 1 display element: GUI element: button set name: home appliance video A part: $ [<<] [□] [>] [ >>> [△]｝ Layout information: (file name) Information display: Video display: Title list display Additional information: Time display, menu bar. Operation: Press the [>] button. Action: After the basic response action of the button, jump to the entry to start playing back. Result: The next state is state 2. Operation: Press the [□] button. Behavior: Basic response behavior of the button. Result: Return to the beginning of state 1. ... Screen state: State 2 Display element: GUI element: Part: {[<<] [□] [>] [>>>] [△] Layout information: (file name) Information display section: Video display section: Playback Middle Additional information: Time display, menu bar. Operation: Press the [□] button. Action: Jump to the entry for stopping playback. Result: The next state is state 1. Describe as follows. Here, the description of the initial operation = state a in the first line clearly indicates that the initial operation when this new development target system operates is “state a”.

The description of the screen state: state 1 in the next second line clearly indicates that the screen state at that time is state 1.

Display elements in the following third to tenth lines: GUI element: Button set name: Home appliance video A Parts: {[<<] [□] [>] [>>>] [△]} Layout information: (file Name) Information display section: {Video display section: Title list display} Additional information: Time display, menu bar. In the initial state, the button set name is the home appliance video A as the GUI element of the display element, and "[<
<] [□] [>] [>>>] [△] ”is used. In addition, "Title list on video display section" is displayed as the information display section. Also, as additional information, in the state 1, the new development target system has “time display and menu bar display”.
Is to be performed.

Operation in the following lines 11 to 15: Press the [>] button. Action: After the basic response action of the button, jump to the entry to start playing back. Result: The next state is state 2. Describes the correspondence between the operation by the user, the operation to be performed accordingly, and the result,
When the operation of “pressing the [>] button” is performed, it is described that “after performing the basic response operation of the button, jump to the entry for starting the parallel reproduction”. As a result, it is described that the “next state changes to state 2”. Here, the display element “GUI
The data relating to the “element”, “information display section”, “additional information”, and the data relating to “operation” are extracted from the database of the existing operation data storage unit 13 by the user interface developer and corresponded. That is, in the database of the existing operation data storage means 13, there are a lot of data related to each item as the existing operation data 1, and the user interface developer stores data suitable for associating from the database by keyboard operation or the like. It was pulled out.

In the next lines 16 to 20, Describes that, when the operation of pressing the [□] button, which is another operation different from the above operation, is performed, the “basic button response operation” should be performed. As a result, "return to the top of state 1" is described. In the same manner, the association between the “operation” by the user and the “operation” and “result” to be performed accordingly is described.

The description of the screen state: state 2 in the next line 21 clearly indicates that the screen state is state 2. Display elements in the following lines 22 to 29: GUI elements: Parts: {[<<] [□] [>] [>>>] [△] Layout information: (file name) Information display section: Video display section : During playback｝ Additional information: Time display, menu bar. Indicates that in the initial state, {[<<] [□] [>] [>>>] [{]} is used as the GUI element of the display element. In addition, “display on the video display unit that is being reproduced” is performed as a display related to the information display unit. In addition, in the state 2, the newly developed system performs “time display and menu bar display” as additional information.

Operation in the next 30th to 32nd lines: Press the [□] button. Action: Jump to the entry for stopping playback. Result: The next state is state 1. Describes that when the user performs an operation of “pressing the [□] button”, the user should “jump to the entry for starting the parallel playback”. As a result, it is described that “the next state changes to state 1”. In this way, the operation execution type data 4 is completed by associating the “screen state”, the “display element”, the various “operations”, the “operation”, and the “result”.

The operation of the user interface management device configured as described above will be described below. FIG.
FIG. 1 is a flowchart illustrating the operation of the user interface management device according to the present embodiment. First, an outline of the flow of the entire operation will be described. First, in step 701, the existing operation data 1 is set based on the know-how of the existing device 11.
Is described and input by the existing operation data input means 12, stored in the existing operation data storage means 13, and made into a database. When the user interface developer describes the specifications of the new development target system, that is, the development target device,
First, in step 702, the existing operation data storage unit 13
The developer refers to the existing operation data 1 held by the developer and extracts an appropriate part from the existing operation data 1 by giving an instruction using the selection input means 14, and extracts the appropriate part from the specification description of the development target device. The reflected data is referred to as application target operation data 3. FIG. 8 shows an example of the application data 3 to be applied, the contents of which are as described above. next,
In step 703, the data conversion means 16 converts the applicable operation data 3 into a form that can be executed by the interpreter 17, that is, the operation execution data 4. An example of the operation execution form data 4 which is an executable form is shown in FIG. 10, and the contents thereof are as described above. Finally, step 7
At 04, the interpreter 17 interprets and executes the operation execution data 4 to form a user interface of the target device.

The operation relating to the use of the data selection means 15 and the data conversion means 16 will be further described using a specific example. First, the data selection unit 15 will be described with reference to FIG. When the user interface developer describes the specifications related to the user interface of the development target device, it is necessary to associate the function 2 of the development target device with the operation method. As a method of performing this, a user interface specification is described by selecting an appropriate operation description from the existing operation data 1 and associating it with the function 2 of the development target device. Here, it is assumed that the association is performed by the developer, and a selection instruction from the description of the existing operation data 1 is input to each function 2 to be developed by using the selection input unit 14.
Describe the applicable operation data 3. When giving a selection instruction, the developer searches the existing operation data stored in the existing operation data storage unit 13 as shown in FIGS. The information of the suitable existing operation data is embedded in the target functional specification.

For a more specific description, for example, WW
Consider a case where a user interface of a device for overviewing certain information, such as a W browser, is created. inside that,
In a case where an operation corresponding to a function for continuously viewing several pages is associated, a keyword search by “continuously” and “show” from the existing operation data storage unit 13 results in “here” Video playback "and then apply the video playback operation to the feature that is being applied.
Input the selection instruction.

For example, a description about video operation of a home appliance in a few lines from the first <function / function name = video operation> in FIG. doing. <Function. . . In the group from> to </ function>, some individual functions are recursively described.
The first is related to a video playback function, in which “tape playback” is registered as a function name, “tape playback”, “tape: sequential continuous information recording” is registered as a keyword, and the like. Then, the operation procedure corresponding to the function is described in <Operation. . . > To </ operation> group.

Further, in order to use the concept of the basic button set of the existing operation procedure, <Definition>. . . The basic set is defined by the group of </ definition>. For example, the operation feeling of “household appliance video A” is ｛[<
The definition of the basic button set includes that it can be characterized for the first time by a series of operations using a group of buttons <>, [□], [>], [>>>], [△] △.

Returning to the description of the operation procedure, here, a set named “household appliance video A” is used as a basic button set, the number of combination buttons is five, and specific operations are as follows. The user instructs to press the [>] button of the set defined in “Home appliance video A”. (The same applies hereafter, so omitted.)

In the example shown in FIG. 4, there are several playback methods, one of which is taken out and embedded in the specification description of the device to be developed. Hereinafter, these procedures are sequentially repeated to create applicable operation data. FIG. 8 shows an example of application target operation data 3 as a result of associating a function with an operation.

The operation data 3 to be applied shows a form in which an operation procedure is selected from the existing operation data 1 and associated with each function of the system to be developed. In the first part, an operation procedure equivalent to channel selection of a home television is assigned as an operation to the function name “page selection” which is a lower function (individual function) of the function name “WWW batch reproduction function”. (The description of the operation procedure for selecting the channel of the home television is omitted here.)

Next, the operation of the data conversion means 16 will be described with reference to FIG.
This will be described with reference to FIG. Here, a description will be given on the assumption that a state and an operation sequence for each display screen are described as operation execution type data which is an execution form executed by the interpreter 17. The format outline of the operation execution data is as shown in FIG. In the present embodiment, the application target operation data 3 created by the data selection unit 15 is a description representing a function structure. Further, the application target operation data 3 holds information on whether the screen is the same screen, information on the number of combination buttons, and the like. This is replaced with the description for each display screen according to the flow of FIG. First, in step 801, grouping is performed on a screen-by-screen basis according to the screen information of the operation data 3 to be applied. Here, it is assumed that the same character has the same screen, and the one with the sign has the flexibility of being the same screen or another screen. However, here, for example, different screens are configured. Next, in step 802, display elements are arranged for each screen, and a diagram of state transition is created. Step 80
If there is any unprocessed one in step 3, the process returns to step 801; otherwise, the process ends. As described above, the data is converted into operation execution type data as shown in FIG.

The operation execution data 4 is the existing operation data 1
Generated by selecting from and converting from it. The operation execution data 4 roughly describes a screen state and an operation corresponding to the operation at that time. Here, as the screen state, display of a video operation panel (five buttons of [<<] [□] [>] [>>>] [△]) as a GUI element, a display unit of WWW batch reproduction itself, It consists of three additional information sections (display of clocks and the like). Also, as the operation corresponding to the operation, when the [>] button is pressed,
It describes jumping to "entry for start of parallel playback" of the WWW playback system. In addition, it indicates that the state after the start of the reproduction is “state 2”.
This is executed by the interpreter 17 to constitute a user interface as a whole. With these configurations, an operation system is assigned from the existing operation data 1 to each function to be developed as preprocessing,
At the time of execution, a user interface can be configured such that pressing [>] (play button) continuously displays the image at intervals of several seconds, while pressing [□] stops the display.

Here, it is assumed that the description is made for each display screen as the format of the operation execution data 4. A configuration example in which the interpreter 17 interprets and executes it is also conceivable.

As described above, according to the present embodiment, a user interface management device that configures an interface that allows a user to use a new device or a new system with the same operation as an interface that the user already knows well. Easy to do.

(Embodiment 2) A second embodiment of the present invention will be described. FIG. 13 is a block diagram illustrating a configuration of a user interface management device according to the second embodiment of the present invention. In FIG. 13, reference numeral 991 denotes various existing devices to be investigated for what kind of operation procedures, functions, and the like are adopted, and those that adopt general operation procedures, functions, and the like are selected. It is. 951 is existing equipment 9
An existing operation data input unit 901 for acquiring and inputting an operation procedure, a function, and the like from 91, constructing and inputting existing operation data 1 describing the correspondence between the operation procedure and the function, and 901 is a predetermined input existing operation data Existing operation data storage means 902 as storage means for storing 1 and creating a database
Is a data selection unit that selects a set of existing operation data to be used from the existing operation data 1 stored in the existing operation data storage unit 901 and sets the set as the applicable operation data 3; A data conversion means 904 for converting the data 3 into operation executable data 4 which is an executable data format in response to an instruction input from a user, executes the operation executable data 4, and realizes functions other than the user interface. An interpreter 905 for performing input and output with the application 992 and input and output with the operation dialogue means 905 to which instruction data from the user is input;
Presents information to the user in response to an input / output command from the interpreter 904,
An operation interactive unit 99 that accepts an input from the user and sends input information to the interpreter 904 as a signal. Reference numeral 993 denotes a user input unit such as a keyboard by which a user performs an input operation of instruction data. Further, reference numeral 906 denotes a selection method holding unit, and 907 denotes an application target function holding unit.

The user interface management apparatus according to this embodiment is different from the first embodiment in that a selection method holding unit 906 and an applicable function holding unit 907 are provided instead of the selection input unit 14. It is characterized by. The data selection means 902 is the selection method holding means 90
6, a set of existing operation data to be used is selected from the existing operation data 1 stored by the existing operation data storage unit 901 based on the input from the application target function holding unit 907, and application is performed from the set. The target operation data 3 is created.

In FIG. 13, the existing operation data input means 951 includes an operation procedure obtained by examining the operation procedure of the existing equipment 991 as shown in FIGS. 14 and 15, for example.
Existing operation data 1 describing functions and their corresponding relationships
Create and enter Existing operation data storage means 901
Holds existing input operation data. The application target function holding unit 907 holds the application target operation data 3 in which the user interface developer describes a new development target system, that is, the specifications of the development target device. FIG. 16 illustrates an example of the application data 3 to be applied. Selection method holding means 90
6 holds data relating to a selection method when the data selection unit 902 selects appropriate existing operation data from the existing operation data 1. FIG. 17 shows an example of data relating to this selection method. That is, as an example of the selection method: (a) Select the one having a high total score of the raw points included in the existing operation data Or (b) ・ As a result of the following scoring, select the one with the highest total score.・ Scoring for matching is as follows: (1) 10 points for keyword matching. (2) Hierarchy: basic = 10 points, secondary 1 = 5 points, secondary 2 =
2 points. (3) The operation is direct = 5 points, other = 1 point. (4) The ranking within the same category (described on the existing operation data) includes the following methods.

The data selection means 902 uses the selection method holding means 906 to describe the operation method for executing the function for each function of the applicable function holding means 907. This is a means for selecting and embedding an appropriate part (description of the operation method) in the existing operation data 1 held by the storage unit 901 to obtain the applicable operation data 3. The data conversion unit 903 converts the applicable operation data 3 into a format executable by the interpreter 94, that is, the operation execution data 4. The interpreter 904 interprets and executes the operation execution type data 4 obtained above.

The operation of the user interface management device configured as described above will be described below. FIG. 18 shows an overall flowchart. First, as in the first embodiment, in step 1501, the existing operation data 1 is described in advance based on the know-how of the existing device 991 and input by the existing operation data input unit 951, and the existing operation data storage unit 90 is described.
And store it in a database. When a user interface developer describes the specifications of a new development target system, that is, a development target device, first, at step 150
2, the data selection unit 902 uses the application target function list describing the specifications of the development target device by the developer and the existing operation data held by the existing operation data storage unit 901, and applies the data in accordance with the selection method holding unit 906. The target operation data 3 is created. The existing operation data here is shown in FIG.
As shown in FIG. 4, in addition to the case of the first embodiment, it includes information such as ranking, scoring, operation hierarchy, basicity, and the like, and is used by the data selection means. Step 1503 and subsequent steps are the same as in the first embodiment. That is, step 15
03, the data conversion means 903 sets the application data 3
Is converted into data executable by the interpreter 904, that is, operation-executable data 4. Finally, in step 1504, the interpreter 904 interprets and executes the operation execution data 4 to configure a user interface of the target device.

The use of the data selection means will be further described using a specific example. FIG. 19 shows a flowchart of the data selection means. The point different from the first embodiment is that in the first embodiment, the developer issues a selection instruction to make a selection and associates an operation method for each function.
This embodiment is characterized in that selection is automatically performed using the selection method holding unit 906 and the like.

Here, in order to link the function of the device to be developed with the existing operation method, matching by keywords and ranking by score totaling are used. It is assumed that the selection method holding unit 906 uses the method shown in FIG. As preparation for that, existing operation data 1
In addition to the first embodiment, options such as a hierarchy, a rank, and a raw score are added (see FIG. 3). In the example of FIG. 14, a description indicating a home appliance video operation is taken. The format is the same as that of the example in the first embodiment. In addition, a description indicating the distinction of the type of function, such as whether it is for household appliances or professional, etc., and spread to general among similar functions A description that ranks the two, and a description of raw points that indicate how each lower-level function is used in one function are added.

FIG. 16 shows an example in which a new development target system function is described as application target operation data (referred to as application target operation data 3a). The description about the function uses a format according to the existing operation data 1. Here, the function is named “WWW batch reproduction function”, and as a keyword representing this function, “WWW still images (images)” indicate that a plurality of still images (images) are displayed one after another.
W still images "," playback ", and" arrange in a line ". "WWW batch playback function"
It indicates that it consists of the functions of "page selection", "load", "playback", and "stop". In particular, as an entry of the function that the developer has built to realize "playback" Is associated with the “entry for start of reproduction” using an operation tag. In addition, the operation target operation data 3a at the stage shown in FIG.
In the example, the operation is not described from the beginning and is in the form of an applicable function list. Then, a description regarding the operation is generated by associating the data in the data selection unit 902.

As a result of using these pieces of information, for example, if the ranking in the selection method holding means 906 is as shown in FIG. 20, "video operation: home appliance 1" is selected here. At that time, the description of "video operation: home appliance 1" (FIG. 1
According to 4), “W
By embedding and embedding them as an operation method corresponding to the "WW batch reproduction function", application target operation data 3a as shown in FIG. 21 is obtained as a result. By comparing the application target operation data 3a in FIG. 21 with the application target operation data 3a in FIG. 16, it can be seen that information on the operation method corresponding to each function has been added. In addition, in particular, the feature here is not limited to association with individual operation methods, and a basic set of buttons, in the example of FIG.
As ｛[<<], [□], [>], [>>>],
[△] A set consisting of five buttons is extracted from existing operation data as a basic method of operating video of home appliances.
Correspond to the function to be developed. (The concept of the basic set has been described in the first embodiment.)

With the above operation, in the present embodiment, it is possible to configure a user interface that allows the user to operate the "playback" function of the WWW browser as if operating a video. As described above, according to the present embodiment, in addition to Embodiment 1, a user interface management device capable of efficiently developing and providing a user interface with which a user is familiar can be provided.

(Embodiment 3) FIG. 22 shows a third embodiment of the present invention.
It is a lineblock diagram of a user interface management device in an embodiment. In FIG. 22, reference numeral 1501 denotes a user interface management device, and 1502 denotes various existing devices to be examined for what operation procedures, functions, and the like are adopted. The one adopted is selected. An existing operation data input unit 1551 acquires an operation procedure, a function, and the like from the existing device 1502, and constructs and inputs existing operation data 1 that describes a correspondence relationship between the operation procedure and the function. The existing operation data storage means 1504 is a storage means for storing the existing operation data 1 and creating a database. The existing operation data 1 stored in the existing operation data storage means 1503 is used to store the existing operation data 1 to be used. A data selecting unit that selects a set and sets the set as the operation data 3 to be applied; 1505, a function holding unit to be applied; 1506
Is a selection method holding unit, and 1507 is application data 3 to be applied.
Is converted into operation executable data 4 which is an executable data format.
And an input / output between an application 1510 for realizing a function other than the user interface and an input / output between an operation interactive unit 1509 to which instruction data from a user is input. In response to the input / output command, the user provides information to the user, accepts input from the user 1511, and sends input information as a signal to the interpreter 1508. The user who performs. The data selection means 1504 is the selection method holding means 1506
And a set of existing operation data to be used is selected from the existing operation data 1 stored by the existing operation data storage unit 1503 based on the input from the application target function holding unit 1505, and the application target is selected from the set. The operation data 3 is created. Reference numeral 1512 denotes a user 1511 for which the user interface management device 1501 and the application 1
An initial selection method input unit 1513 for inputting an initial selection method before starting to use the device 510, and a selection method input unit 1513 for inputting a selection method to the initial selection method input unit 1512.

The operation of the user interface management device configured as described above will be described below. FIG.
FIG. 3 is a flowchart showing the operation of the user interface management device in the present embodiment. In FIG.
First, the existing operation data input unit 1551 ranks the operation procedure of the existing apparatus 1502, which is generally considered to be used by the user, the functions realized by the operation procedure and the selection criterion information, the scoring, and the operation. Hierarchy, basicity,
Investigation is performed on information such as (step 1601). Next, the existing operation data input unit 1551, based on the result of the investigation, determines the operation procedure of the existing device 1502, the function, and the selection criterion information of the operation procedure, such as ranking, scoring, operation hierarchy, basicity, and the like. Are described as existing operation data (step 1602). If it is difficult for steps 1601 and 1602 to be executed automatically, a human
The processing corresponding to step 1602 may be performed using a keyboard or the like. Next, the existing data storage means 1503
Stores the existing operation data internally (step 1
603). Next, the selection method input person 1513 inputs an initial selection method to the initial selection method input means 1512 (step 1604). Here, the initial selection method is, specifically, presented with several types of user interfaces by a menu method, and it is assumed that the user interface is selected by selecting a desired user interface.

Next, the data selection means 1504 selects an operation procedure corresponding to the function in the applicable function holding means 1505 from the existing operation data in the existing operation data storage means 1603 based on the selection method holding means 1506, and The target operation data is set (step 1605). The selection method holding unit 1506 holds the selection method input in step 1604, and holds a selection method indicating on what basis the applicable operation data should be selected from the existing operation data. Next, the data conversion unit 1507 converts the application-target operation data into operation-executable data in an executable format (step 1606). Next, the interpreter 1508 executes the part for generating the user interface in the operation execution data, and sends a command for generating the user interface to the operation interactive means 1509 (step 16).
07). Next, the operation dialogue means 1509 displays the user 1511
Is received and passed to the interpreter (step 1608). Next, the interpreter interprets the input and calls a function of the application 1510 corresponding to the input (step 1609). Next, the application executes the function called from the interpreter (step 1).
610). Next, the user interface management device 1501
And the application 1510 includes a step 1608
To 1610 are repeated to receive the input from the user, interpret the input, and execute the function based on the interpreted result.

As described above, in the present embodiment, in addition to the configuration of the second embodiment, the provision of the initial selection criterion input means allows the inputting person of the selection method to directly select the user interface, thereby enabling individual selection. It is possible to provide a user interface that suits the user's preference.

(Embodiment 4) FIG. 24 shows a fourth embodiment of the present invention.
It is a block diagram showing the structure of the user interface management apparatus in embodiment. In FIG.
Reference numeral 091 denotes various existing devices to be investigated for what kind of operation procedures, functions, and the like are adopted, and those that adopt general operation procedures, functions, and the like are selected. 20
Reference numeral 51 denotes an existing operation data input unit for acquiring an operation procedure, a function, and the like from the existing device 2091, constructing and inputting existing operation data 1 in which a correspondence relationship between the operation procedure and the function is described. Existing operation data storage means as storage means for storing the existing operation data 1 and creating a database; and 2002, an existing operation data storage means 20
01 selects a set of the existing operation data 1 to be used from the existing operation data 1 stored in the storage unit 01, and sets the set as the applicable operation data 3; A data conversion unit 2004 converts the executable data 4 into a data format that can be executed in response to the instruction input by the user. The application 2004 executes the executable data 4 and communicates with an application 2092 that realizes functions other than the user interface. Interpreter that performs input and output between the input and output of the user and the operation dialogue unit 2005 to which instruction data from the user is input. The interpreter 2005 presents information to the user in response to an input and output command from the interpreter 2004, Operation dialog that accepts input from the server and sends input information as a signal to the interpreter 2004 Stage, the application object function holding means 2006, 2007 is selected method holding means 2093 is a user performing an input operation of the instruction data by using a keyboard or the like. The data selection means 2002 is the selection method holding means 2
006 and a set of existing operation data to be used is selected from the existing operation data 1 stored by the existing operation data storage unit 2001 based on the input from the application target function holding unit 2007, and application is performed from the set. Target operation data 3
Create 2008 is a data conversion unit 2003.
Is data verification means for verifying whether the result of the conversion performed by the verification method satisfies the verification method holding means.

The operation of the thus configured user interface management device will be described below. FIG. 25 shows an overall flowchart. In FIG. 25, first, the existing operation data 1 is described in advance based on the know-how of the existing device 2091, input by the existing operation data input unit 2051, stored in the existing operation data storage unit 2001, and made into a database. When the user interface developer describes the specifications of a new development target system, that is, the development target device, first, in step 2101, the data selection unit 2002 executes the application target function list in which the developer describes the specifications of the development target device. Using the existing operation data held by the existing operation data storage unit 2001 and the selection method holding unit 2006, the application operation data 3 is created. The existing operation data 3 here is the data of the first embodiment.
In addition to the above case, information such as ranking, scoring, operation hierarchy, basicity, and the like is included and used by the data selection unit 2002. Next, the data conversion means 2003 creates the operation execution type data 4 in the same manner as in the second embodiment. At this time, it is determined whether the data verification means 2008 satisfies the verification method shown in FIG. 26, for example. Verify And
Until the verification method is satisfied, the processing operations in the data conversion means 2008 and, in some cases, the data selection means 2002 are redone to create operation execution data 4 satisfying the specified verification method (step 210).
3). Next, it is checked whether or not the method of summarizing the screen can be changed. If the screen cannot be changed, the process returns to the step 2101. If the screen can be changed, the process returns to the step 2102. Finally, the interpreter 2004 interprets and executes the operation execution data 4 to configure the user interface of the target device.

The use of the data conversion means 2003 and the data verification means 2008 will be further described with reference to specific examples. In the same manner as in the second embodiment, the application operation data 3 shown in FIG.
It is assumed that the operation execution data shown in FIG. At this time, in step 2103, the data verification unit 2008 verifies whether or not the verification method held in the verification method holding unit 2006 is satisfied. If the verification method is satisfied, the process ends. The processing in the conversion means 2003 or, in some cases, the data selection means 2002 is redone. For example, it is assumed that application target operation data 3 shown in FIG. 8 and corresponding operation execution type data 4 shown in FIG. 10 are created according to the above flow, as in the second embodiment. In this situation, the data verification unit 2008 executes step 2
It is assumed that the verification method in step 103 does not satisfy the verification method. In this case, first, as in the second embodiment, “video operation: home appliance 1” is selected and verified by the data verification unit 2008. As a result, the number of buttons is too large and the verification method is not satisfied. Data conversion means 2 again
003 or the process of the data selection means 2002, and the process is repeated to select another candidate “video operation: professional editing 1” (see FIG. 14), thereby obtaining the operation execution type data 4 shown in FIG. ing.

Here, an example of the above-described data verification method is shown in FIG. This data verification method verifies data according to the following rules. "・ The screen transition must be within three levels.・ "Basic operation" can be operated at any time. -The initial setting of the members of the "basic operation" is "return to the first page (menu)". -The operation sequence must be the same if the functions are the same, and different if the functions are different.・ The number of buttons must be within five.
] Has become a rule. On the flowchart of FIG. 25,
In step 2104, it is determined that the method of compiling the screen cannot be changed, and the process returns to step 2101. As a result, the applicable operation data 3 is re-created to obtain the applicable operation data 3 as shown in FIG. Through the data conversion means, the operation execution type data 4 shown in FIG. 28 is obtained. In this, an operation method corresponding to “Pro Edit 1” having a smaller number of buttons is embedded in “parallel playback” of each function of “WWW batch playback function”. In the fourth embodiment, as a result of verifying the applicable operation data and the operation execution type data 4 by the data verification unit 2008, if the verification method is not satisfied, the applicable operation data 3 is created again. The operation execution type data 4 shown in FIG. 28 is obtained through the conversion process by the data conversion unit 2003 again. However, if the data verification unit 2008 does not satisfy the verification method, the execution is stopped there Is also conceivable. In this case, an effect is obtained that only a user interface that satisfies the verification method can be obtained.

As described above, according to the present embodiment, in addition to the first and second embodiments, a user interface management device that configures a user interface that satisfies the constraint conditions to be satisfied by the user interface can be provided.

(Embodiment 5) FIG. 29 shows Embodiment 5 of the present invention.
1 is a configuration diagram of a user interface management device in FIG. In FIG. 29, reference numeral 2201 denotes a user interface management device, and 2202, various existing devices to be investigated for what kind of operation procedures, functions, and the like are adopted. The one adopted is selected. An existing operation data input unit 2203 acquires an operation procedure, a function, and the like from the existing device 2202, constructs existing operation data 1 describing a correspondence relationship between the operation procedure and the function, and inputs a predetermined input. The existing operation data storage means 2204 is a storage means for storing the existing operation data 1 and creating a database of the existing operation data 1 from the existing operation data 1 stored in the existing operation data storage means 2203. A data selection unit that selects a set and sets the set as the applicable operation data 3;
Reference numeral 2205 denotes an application target function holding unit; 2206, a selection method holding unit; 2207, a data conversion unit for converting the application target operation data 3 into operation executable data 4 which is an executable data format; Run,
An interpreter that performs input and output with an application 2210 that implements functions other than the user interface and input and output with an operation interactive unit 2209 to which instruction data from a user is input.
In response to an input / output command from the user 8, information is presented to the user, input from the user 2211 is accepted, and input information is sent as a signal to the interpreter 2208. It is a user who uses it. The data selection means 2204 is based on the input from the selection method holding means 2206 and the existing operation data 1 stored in the existing operation data storage means 2203 based on the input from the applicable function holding means 2205. Is selected, and the applicable operation data 3 is created from the set. Reference numeral 2212 denotes a user 2211 and an operation dialogue unit 2209.
This is an operation dialogue monitoring unit that monitors the state of the dialogue between the user and the server and transmits the information to the selection method holding unit 2206.

In this embodiment, the operation dialogue monitoring means 22
A case where the destination of the information 12 of the dialogue state is the selection method holding unit 2206 will be described. The operation dialogue monitoring unit 2212 in the present embodiment displays a list of used functions on a screen, and it is assumed that buttons are provided next to each element of the list. User 2
When a user uses a certain function and finds it difficult to use the user interface, the user 211 clicks a button corresponding to the function with a mouse.

The operation of the user interface management device configured as described above will be described below. FIG.
0 is a flowchart showing the operation of the user interface management device in the present embodiment. In FIG. 30, first, the existing operation data input unit 2251 operates the existing device 2202, which is a device generally considered to be used by the user, the operation procedure of the existing device 2202, and the function realized by the operation procedure and the function that is the selection reference information. The frequency of use is investigated (step 2301). Next, the existing operation data input means 225
Reference numeral 1 denotes an operation procedure and a function of the existing device 2202 based on the result of the investigation, and information such as ranking, scoring, operation hierarchy, and basicity, which are selection reference information of the operation procedure in claim 9. The corresponding relationship between them is described as existing operation data (step 2302). If it is difficult for steps 2301 and 2302 to be automatically executed, a human enters step 2301 and step 23
02 may be performed. Next, the existing data storage means 220
3 stores the existing operation data therein (step 2303). Next, the data selection unit 2204 selects an operation procedure in the application target function holding unit 2205 from the existing operation data in the existing operation data storage unit 2303 based on the selection method in the selection method holding unit 2206, and selects the application target operation data. (Step 2304). The selection method holding means 2206 is a means for holding a selection method when selecting an operation procedure. As a selection method, for example,
Among the operating procedures having the same function, there is a rule of selecting the one having the highest frequency value as the selection criterion information. Next, the data conversion means 2207 converts the applicable operation data into operation executable data which is an executable format (step 2305).

Next, the interpreter 2208 executes the part for generating the user interface in the operation execution data, and sends a command for generating the user interface to the operation interactive means 2209. At the same time, the operation dialogue unit 2209 also generates a list of used functions and buttons corresponding to elements of the list for the operation dialogue monitoring unit 2212. (Step 2306). Next, operation dialogue means 2209
Receives the input from the user 2211 and passes it to the interpreter (step 2307). Then the interpreter
Application 221 that interprets the input and responds to the input
The function 0 is called (step 2308). Next, the application executes the function called from the interpreter (step 2309). Next, the user interface management device 2201 and the application 2210
Repeats steps 2307 to 2309 to repeatedly receive an input from the user, interpret the input, and execute a function based on the interpreted result. This step 23
The operation when the button of the operation dialogue monitoring unit 2212 is pressed during the repetition of steps 07 to 2309, that is, when the user indicates that the user interface of a certain function is difficult to use, will be described below. Operation dialogue monitoring means 2212
When one of the buttons is pressed, first, the operation dialogue monitoring unit 2212 extracts the name of the function corresponding to the button. Next, the operation dialogue monitoring unit 2212 passes the name of the function to the selection method holding unit 2206. Next, the selection method holding unit 2206 adds a selection method holding unit that deteriorates the evaluation of the operation procedure in the existing operation data corresponding to the passed function name. For example, if the selection criterion information adopted at that time is displayed as a percentage, a selection method of evaluating the operation procedure as a value reduced by 20% is added to the original selection method holding means. Next, after executing steps 2304 to 2306 in FIG. 23, the process enters a loop of steps 2307 to 2309. The selection method of the user interface newly presented to the user 2211 is changed so that the evaluation of the operation procedure for the function that the user 2211 previously indicated is bad is deteriorated. It is likely that a different user interface has been provided. As a result, there is a high possibility that the user interface is changed for a function determined to be bad by the user, and the operation procedure is maintained for a function satisfied by the user. Therefore, by repeating the instruction to the operation dialog monitoring unit 2212, the user interface as a whole becomes more preferred by the user 2211.

As described above, in the present embodiment, in addition to the configuration of the second embodiment, the state of the dialogue performed between the user and the operation dialogue unit is monitored, and the information is stored in the selection method holding unit. By providing an operation dialogue monitoring means to communicate,
When the user repeats the instruction to the operation dialog monitoring means, the user interface management device can be configured such that the entire user interface approaches that which the user likes.

In the present embodiment, the configuration in which the operation dialog monitoring means inputs the information on the state of the dialogue to the selection method holding means has been described. For example, a configuration in which data is input to a data selection unit, a data verification unit, and an interpreter can be considered.

When the configuration for inputting the information on the dialogue state is a data selection means, there is an advantage that the existing data can be directly selected using the information on the dialogue state. . For example, it is possible to directly stop using the existing data used at that time and let the data selecting means select the next candidate.

When a configuration in which the information on the state of the conversation is input to the data verification means is used, it becomes possible to change the rules in the data verification means. For example,
If there is a rule that the number of buttons generated by the application target operation data is 7 or less, the number can be further reduced to 5 or less, and conversely, the restriction can be relaxed to 9 or less.

When the configuration in which the information on the state of the conversation is input to an interpreter is used, the user interface can be changed in a short time without performing selection or conversion at the time of execution. . For this purpose, it is necessary to prepare a plurality of operation execution data in advance, and to select and execute appropriate operation execution data from the plurality of operation execution data in accordance with the information on the state of the dialogue.

(Embodiment 6) FIG. 31 shows Embodiment 6 of the present invention.
1 is a configuration diagram of a user interface management device in FIG. In FIG. 31, reference numeral 2401 denotes a user interface management device; 2402, various types of existing devices to be examined to determine what operation procedures, functions, and the like are adopted. The one adopted is selected. An existing operation data input means 2403 acquires an operation procedure, a function, and the like from the existing device 2402, and constructs and inputs existing operation data 1 describing the correspondence between the operation procedure and the function. The existing operation data storage means 2404 serving as a storage means for storing the existing operation data 1 and storing the data into a database is used to store the existing operation data 1 used by the existing operation data 1 stored in the existing operation data storage means 2403. A data selection unit that selects a set and sets the set as the applicable operation data 3;
Reference numeral 2405 denotes an application target function holding unit, 2406 denotes a selection method holding unit, 2407 denotes a data conversion unit that converts the application target operation data 3 into operation execution type data 4 which is an executable data format, and 2408 denotes the operation execution type data 4 Run,
An interpreter that performs input and output with an application 2410 for realizing functions other than the user interface and input and output with an operation interactive unit 2409 to which instruction data from a user is input.
An operation interactive means for presenting information to the user in response to an input / output command from the user 8 and receiving an input from the user 2411 and sending the input information to the interpreter 2408 as a signal. It is a user who uses it. The data selection unit 2404 selects the existing operation data to be used from the existing operation data 1 stored in the existing operation data storage unit 2403 based on the input from the selection method holding unit 2406 and the input from the applicable function holding unit 2405. Is selected, and the applicable operation data 3 is created from the set. Reference numeral 2412 denotes a user 2411 and an operation interactive means 2409
2413 is an operation dialogue monitoring unit that monitors the state of the dialogue performed between the user and the information, and transmits the information to the selection method holding unit 2406. Reference numeral 2413 monitors the interpreter 2408 and extracts the name of the function being executed at that time. Function monitoring means.

Here, the operation dialogue monitoring means 2412 outputs information on the state of the dialogue to the selection method holding means 2406.
Further, the operation dialogue monitoring means 241 in this embodiment
2 is different from the operation dialog monitoring means described in the fifth embodiment.
It is assumed that there is only one button, and the user determines only whether the user interface at that time is good or bad, and presses the button only when it is determined that the user interface is bad.

The operation of the user interface management device configured as described above will be described below. Here, a description will be given mainly of a difference between the fifth embodiment and the fifth embodiment. The difference between the present embodiment and the fifth embodiment is that the function monitoring means 2413 monitors the operation of the interpreter 2408 and detects what function is being used at that time. The function is identified by the name of the function. The operation dialogue monitoring unit 2412 is the same as that of the fifth embodiment.
When the user 2411 feels that the user interface is bad, the user simply clicks the button. The operation when this button is clicked will be described.

FIG. 32 shows the user interface management device 2 when the button of the operation dialogue monitoring means 2412 is pressed.
FIG. 4 is a flowchart showing the operation of 401. The operation dialogue monitoring unit 2412 is clicked when the user feels that the user interface is bad (step 2501). next,
The operation dialogue monitoring unit 2412 indicates that the click has been made.
A notification is sent to the selection method holding unit 2406 (step 2502). At this time, at the same time, the function monitoring means 2413 monitors the operation of the interpreter 2408 and extracts the name of the function used at that time (step 2503).
Next, the function monitoring unit 2413 notifies the selection method holding unit 2406 of the name of the function (step 250).
4). Next, the selection method holding unit 2406 adds a selection method that lowers the priority of the currently used operation procedure corresponding to the function notified from the function monitoring unit 2413 (step 2505). More specifically, the operation of step 2505 will be described. The selection criterion information related to the currently used operation procedure corresponding to the notified function is evaluated by 20% less. Next, in the fifth embodiment, after executing steps 2304 to 2306, the same operation as entering the loop of steps 2307 to 2309 is performed by the user interface management device 2 in FIG.
Perform on 401. With this, in addition to the effects of the fifth embodiment, the user further clicks the button when he / she feels that the user interface is bad because he or she uses the entire user interface without selecting a function. By simply performing the operation, the operation procedure of the function used at that time can be improved.

As described above, in the present embodiment, in addition to the configuration of the fifth embodiment, there is provided a function monitoring unit 2413 that monitors the function executed by the interpreter 2408 and notifies the selection method holding unit 2406 of the function. As a result, it is possible to use a simple operation system as the means for monitoring the operation dialogue from the user, and to improve the user interface more quickly than in a case without the operation dialogue monitoring means. Further, when the operation dialog monitoring means is an equivalent simple operation system, the user interface can be improved more quickly than when the function monitoring means is not provided.

(Embodiment 7) FIG. 33 shows a seventh embodiment of the present invention.
It is a figure which shows the operation dialog monitoring means in the user interface management apparatus in embodiment. The circuit configuration of the user interface management device according to the present embodiment is the same as that of the sixth embodiment. Therefore, the reference numerals assigned to the respective functional units (means) are the same as those used in FIG. In the present embodiment, the operation dialogue monitoring means according to the sixth embodiment is a more specific sub-concept. The operation dialogue monitoring means detects the state of the operation dialogue by inputting one of the two values.

The operation of the thus configured user interface management device will be described below. Here, differences from the sixth embodiment will be mainly described.

FIG. 34 is a flowchart showing the operation of the user interface management device 2401 when an input is made to the operation dialogue monitoring means 2412 in the present embodiment. The operation dialog monitoring unit 2412 is different from that used in the sixth embodiment in that when a user uses a device including a user interface management device and an application and feels that the user interface is good, the user presses a button 2601 of ○. If you feel bad, press the X button 260
2 is to be clicked. The operation when this button is clicked will be described.

The operation dialog monitoring means 2412 is clicked when the user feels that the user interface is good or bad (step 2701). Next, the operation dialogue monitoring unit 2412 notifies the selection method holding unit 2406 which of the O button 2601 and the X button 2602 has been clicked (step 2702). At this time, at the same time, the function monitoring means 241
3 monitors the operation of the interpreter 2408 and extracts the name of the function currently used (step 270).
3). Next, the function monitoring unit 2413 notifies the selection method holding unit 2406 of the name of this function (step 2704). Next, the selection method holding unit 2406 presses the o button 2601 notified from the operation dialog monitoring unit 2412.
Based on the information of the or X button 2602, that is, information on whether the user interface is good or bad, raise the priority of the currently used operation procedure corresponding to the function notified from the function monitoring unit 2413, or A selection method for lowering is added (step 2705). The operation of step 2705 will be specifically described. The selection criterion information on the currently used operation procedure corresponding to the notified function is evaluated by 20% more or 20%.
Evaluate less. Next, after executing steps 2304 to 2306 in the fifth embodiment, the same operation as entering the loop of steps 2307 to 2309 is performed on the user interface management device 2401 in FIG. This allows the user to use the sixth embodiment.
In addition to the effect of, the user can also use the information when the user interface is good,
The operation procedure used at that time is used with higher priority than other operation procedures, and the user's preferences can be brought closer to a user interface that better reflects the user's preferences.

As described above, in the present embodiment, the operation dialog monitoring means in the configuration of the sixth embodiment is used to determine whether the user interface is superior or inferior.
By using one of the values as the operation dialogue monitoring means for detecting the state of the operation dialogue, the user interface can be more simply compared to a method in which the user inputs only when it is determined that the user interface is bad. A user interface close to the user's preference can be provided quickly.

(Embodiment 8) FIG. 35 shows an eighth embodiment of the present invention.
FIG. 14 is a diagram showing an operation dialogue monitoring unit in the user interface management device in the embodiment. The circuit configuration of the user interface management device according to the present embodiment is the same as that of the sixth embodiment. Therefore, the reference numerals assigned to the respective functional units (means) are the same as those used in FIG. In the present embodiment, the operation dialog monitoring means according to the sixth embodiment is used as a more specific sub-concept, in which the user judges the superiority of the user interface and inputs an evaluation value of three or more levels to perform the operation dialog. This is an operation dialogue monitoring means for detecting a state.

The operation of the user interface management device configured as described above will be described below. Here, differences between the processing operations of the present embodiment and the sixth embodiment will be mainly described. FIG. 36 is a flowchart showing the operation of the user interface management means 2401 when an input is made to the operation dialogue monitoring means 2412 in the present embodiment.

The operation dialogue monitoring means 2412 is different from the one used in the sixth embodiment when the user uses a device comprising a user interface management device and an application and feels that the user interface is good or bad. Then, a five-level evaluation is performed, and a numerical value from 1 to 5 is input. Very bad when 1 is input, slightly bad when 2 is input, not good or bad when 3 is input, slightly good when 4 is input, slightly good when 5 is input Is very good by the user. More specifically, buttons on which numbers 1 to 5 are written are lined up, and the user presses any one of them to input a determination of superiority or inferiority with respect to the user interface to the user interface management device. . The operation when this numerical value is input will be described.

When the user feels that the user interface is good or bad, a numerical value is input to the operation dialog monitoring means 2412 (step 2901). Next, the operation dialogue monitoring unit 2412 notifies the selection method holding unit 2406 of which numerical value has been input (step 2).
902). At this time, at the same time, the function monitoring means 2413 monitors the operation of the interpreter 2408 and extracts the name of the function used at that time (step 2903). Next, the function monitoring unit 2413 notifies the selection method holding unit 2406 of the name of this function (step 290).
4). Next, the selection method holding unit 2406 corresponds to the function notified from the function monitoring unit 2413 based on the numerical value information notified from the operation dialog monitoring unit 2412, that is, information on how good or bad the user interface is. , A selection method for raising or lowering the priority of the currently used operation procedure is added (step 2).
905). The operation of step 2905 will be specifically described. Selection criterion information relating to the currently used operation procedure corresponding to the notified function is 20 when the numerical value is 1.
% Less, when the value is 2, evaluate 10% less,
When the numerical value is 3, the evaluation is not changed, and when the numerical value is 4, 10 is obtained.
% Is evaluated, and when the numerical value is 5, 20% is evaluated. Next, step 2304 in the fifth embodiment.
From step 2307 to 2306
The same operation as entering the loop 309 is performed on FIG. This allows the user to use the information when the user feels that the user interface is good or bad, in addition to the effects of the sixth embodiment, and to use the information more finely. The operation procedure of raising or lowering the priority of the operation procedure compared to other operation procedures can be finely changed according to the level of the user's preference, and the preference of each user can be changed. , Better user interface,
You can get closer sooner.

As described above, in the present embodiment, the operation dialog monitoring means in the configuration of the sixth embodiment is designed so that the user judges the superiority of the user interface and inputs an evaluation value of three or more levels. By using the operation dialog monitoring means for detecting the state of the operation dialog, a user interface that is closer to the user's preference can be created faster than when the user performs input only when the user interface is simply determined to be bad. Can be provided.

(Embodiment 9) FIG. 37 shows a ninth embodiment of the present invention.
FIG. 14 is a diagram showing an operation dialogue monitoring unit in the user interface management device in the embodiment. The circuit configuration of the user interface monitoring device according to the present embodiment is the same as that of the sixth embodiment. Therefore, the reference numerals assigned to the respective functional units (means) are the same as those used in FIG. In the present embodiment, the operation dialog monitoring means according to the sixth embodiment is a more specific sub-concept, in which the user determines the superiority or inferiority of the user interface and inputs the evaluation value of the continuous amount to change the state of the operation dialogue. This is an operation dialog monitoring means for detecting.

The operation of the thus configured user interface management device will be described below. Here, differences between the processing operations of the present embodiment and the sixth embodiment will be mainly described. FIG. 38 is a flowchart showing the operation of the user interface management means 2401 when an input is made to the operation dialog monitoring means 2412 in the present embodiment.

The operation dialog monitoring means 2412 is different from that used in the sixth embodiment, when the user uses a device comprising a user interface management device and an application and feels that the user interface is good or bad. Then, a continuous amount is evaluated and a numerical value from -10 to 10 is input. It is assumed that the user judges that the input is very bad when -10 is input, is very good when 10 is input, and is not bad or bad when 0 is input. It is assumed that the numerical value changes continuously depending on the degree of judgment of the user. This numerical value may be input from a keyboard as a decimal number, or a continuous amount may be input by a mouse operation using a user interface such as a slide bar.

The operation when this numerical value is input will be described. The operation dialog monitoring unit 2412 receives a numerical value when the user feels that the user interface is good or bad (step 3101). Next, the operation dialogue monitoring unit 2412 stores the input numerical value in the selection method holding unit 2.
Notification is made to 406 (step 3102). At this time, at the same time, the function monitoring means 2413
Operation 08 is monitored, and the name of the function used at that time is extracted (step 3103). Next, the function monitoring unit 2413 stores the name of this function in the selection method holding unit 240
6 is notified (step 3104). Next, the selection method holding unit 2406 corresponds to the function notified from the function monitoring unit 2413 based on the numerical value information notified from the operation dialog monitoring unit 2412, that is, information on how good or bad the user interface is. Then, a selection method for increasing or decreasing the priority of the currently used operation procedure is added (step 3105). The operation of step 3105 will be specifically described. The evaluation of the selection criterion information relating to the currently used operation procedure corresponding to the notified function is changed based on the given numerical value. Here, the given number is multiplied by 2,
It is a numerical value of the percentage that changes the evaluation. For example, when 5 is given as a numerical value, an evaluation criterion for evaluating the selection criterion information by 10% is added to the selection method holding means for the operation procedure used at that time. Next, step 230 in the fifth embodiment.
After the execution of steps 4 to 2306, the same operation as entering the loop of steps 2307 to 2309 is performed on FIG. This allows the user to use the information when the user feels that the user interface is good or bad, in addition to the effects of the sixth embodiment, and to use the information more finely. The operation procedure of raising or lowering the priority of the operation procedure compared to other operation procedures can be finely changed according to the level of the user's preference, and the preference of each user can be changed. , Better user interface,
You can get closer sooner.

As described above, in the present embodiment, the operation dialog monitoring means in the configuration of the sixth embodiment is set so that the user judges the superiority of the user interface, inputs the evaluation value of the continuous amount, and performs the operation dialog. And providing a user interface that is closer to the user's preference faster than a method in which the user makes an input only when the user interface is simply determined to be bad by using the operation dialog monitoring means for detecting the state of the user. be able to.

(Embodiment 10) FIG. 39 is a block diagram of an operation dialogue monitoring means in a user interface management device according to a tenth embodiment of the present invention. The configuration of the present embodiment is the same as that of the sixth embodiment. In the present embodiment, the operation dialog monitoring means according to the sixth embodiment is related to a more specific lower concept, from information presentation to the user between the user and the operation dialog means to reception of input from the user. The operation dialog monitoring means measures the time and uses the measured value as the state of the operation dialog to detect the state of the operation dialog.

The operation of the thus configured user interface management device will be described below. Here, differences between the processing operations of the present embodiment and the sixth embodiment will be mainly described. FIG. 40 is a flowchart showing an operation of the user interface management device 2401 when an input is made to the operation dialogue monitoring unit 2412 in the present embodiment.

The operation dialog monitoring means 2412 is different from that used in the sixth embodiment in that the user does not make any input to the operation dialog monitoring means 2412. Instead, the operation dialog monitoring unit 2412 measures a time interval between the information presentation from the operation interaction unit to the user and the input from the user to the operation interaction unit as a response of the user to the information presentation. Then, this time interval is converted into a numerical value and used as an evaluation value for the user interface. The operation when this time interval is measured will be described.

When the operation dialogue means 2409 presents information to the user, the operation dialogue monitoring means 2412 measures the time until the user 2411 inputs a response to the information (step 3301). Next, the operation dialogue monitoring unit 2412 notifies the selection method holding unit 2406 of the numerical value of the measured time (step 3).
302). At this time, at the same time, the function monitoring means 2413 monitors the operation of the interpreter 2408 and extracts the name of the function used at that time (step 3303). Next, the function monitoring unit 2413 notifies the selection method holding unit 2406 of the name of this function (step 330).
4). Next, the selection method holding unit 2406 uses the numerical value information notified from the operation dialogue monitoring unit 2412, that is, the numerical value of the time required for the user 2411 to react to the information from the operation dialogue unit 2409, A selection method for increasing or decreasing the priority of the currently used operation procedure corresponding to the function notified from the function monitoring unit 2413 is added (step 3305). The operation of step 3305 will be specifically described. The evaluation of the selection criterion information on the currently used operation procedure corresponding to the notified function is changed based on the given numerical value. Here, it is assumed that the given numerical value indicates the time required for the user's reaction in seconds. Also,
For this function, it is assumed that the average value of the time required for the response of the general user is known to be a seconds.

In the present embodiment, when the given numerical value is less than a second, a selection method for estimating the frequency information with respect to the operation procedure is selected.
Add to Conversely, when the given numerical value is a second or longer, a selection method for evaluating the operation procedure with less frequency information is added to the selection method holding unit 2406. Specifically, assuming that a given numerical value is x, a selection method of holding a selection method of multiplying 1 + ((a−x) / 100) by frequency information on the operation procedure as a new evaluation criterion is held. Means 2406 are added. Next, after executing steps 2304 to 2306 in the fifth embodiment, the same operation as entering the loop of steps 2307 to 2309 is performed on FIG. This allows
The user, in addition to the effects of the sixth embodiment, further has a user interface reflecting the preferences of each user without having to input information on his / her preferences into the operation / interaction monitoring unit 2412. You can get closer.

As described above, in the present embodiment, the operation dialog monitoring means in the configuration of the sixth embodiment is changed from the information presentation to the user between the user and the operation dialog means to the input from the user. By measuring the time required for reception and using the measured value as the state of the operation dialogue, the operation dialogue monitoring means for detecting the state of the operation dialogue allows the user himself to input information regarding his / her preference into the operation dialogue monitoring means. It is possible to approach a user interface that reflects the preferences of each user without taking the trouble of doing so.

[0148]

As described above, according to the present invention, as a first configuration, the investigator analyzes the user interface of the existing device and finds the correspondence between the user's operation procedures and functions and the operation procedures and functions. Existing operation data input means for describing and entering them as existing operation data, existing operation data storage means for storing the input existing operation data, data selection means, script reselection means, data The provision of the conversion means, the interpreter, and the operation dialogue means provides the user with a user interface to which the user is accustomed, and also has the effect of reducing the number of user interface development steps.

Second, in addition to the first configuration, by providing a selection method holding unit and an applicable function holding unit, a user interface can be constructed only by specifying a function of a device newly developed by a developer. Thus, a user interface management device capable of performing the above is obtained. Third, in addition to the second configuration, by providing the initial selection method input means,

Thus, a user interface management device capable of selecting a desired user interface can be obtained.

Fourth, in addition to the second or third configuration,
With the provision of the data verification means, a user interface management device that can obtain a user interface that satisfies the constraints only by specifying the constraints on the user interface by the developer can be obtained.

Fifth, in addition to the second, third, or fourth configuration, the provision of the operation dialogue monitoring means makes it possible to approach the user interface that suits the user's preference while using the device. A user interface management device is obtained.

Sixth, in addition to the fifth configuration, the provision of the function monitoring means provides a user interface management device capable of quickly and accurately bringing the user interface closer to the user's preference. Seventh, the fifth or sixth effect is obtained by the fact that the operation dialog monitoring means in the fifth or sixth configuration is an operation dialog monitoring means for inputting either of two values. As compared with the above, a user interface management device that can quickly and accurately bring the user interface closer to the user's preference can be obtained.

Eighth, since the operation dialog monitoring means in the fifth or sixth configuration is an operation dialog monitoring means for inputting an evaluation value of three or more stages, the fifth or sixth operation dialog monitoring means is provided. As compared with the sixth effect, it is possible to obtain a user interface management device that enables the user interface to more quickly and accurately approach the user's preference.

Ninth, since the operation dialog monitoring means in the fifth or sixth configuration is an operation dialog monitoring means for inputting an evaluation value of a continuous quantity,
Alternatively, as compared with the sixth effect, it is possible to obtain a user interface management device that enables the user interface to approach the user's preference more quickly and accurately.

Tenthly, the operation dialogue monitoring means in the fifth or sixth configuration measures the reaction time of the user, and the numerical value of the time is used as an evaluation value to be the operation dialogue monitoring means. As a result, a user interface management device that can bring the user interface closer to the user's preference without requiring the user to perform inputting, compared to the fifth or sixth effect, is obtained.

[Brief description of the drawings]

FIG. 1 is a principle diagram schematically illustrating an execution state of creation and management of a user interface according to the present invention.

FIG. 2 is a block diagram illustrating a configuration of a user interface management device according to the first embodiment.

FIG. 3 illustrates a language specification used to describe existing operation data according to the first embodiment.

FIG. 4 is a diagram illustrating a first description example of application target operation data according to the first embodiment;

FIG. 5 is a diagram illustrating a second description example of application target operation data according to the first embodiment;

FIG. 6 is a diagram showing a third description example of application target operation data according to the first embodiment;

FIG. 7 is a diagram illustrating an outline of a tag option added to describe application target operation data according to the first embodiment;

FIG. 8 is a diagram illustrating a description example of application target operation data according to the first embodiment;

FIG. 9 is a diagram showing an outline of a language specification used to describe operation execution data according to the first embodiment;

FIG. 10 is a diagram showing a description example of operation execution data according to the first embodiment;

FIG. 11 is a flowchart for explaining the operation of the user interface management device according to the first embodiment;

FIG. 12 is a flowchart illustrating a conversion operation in a data conversion unit according to the first embodiment.

FIG. 13 is a block diagram illustrating a configuration of a user interface management device according to a second embodiment of the present invention.

FIG. 14 is a diagram illustrating a first description example of existing operation data according to the second embodiment;

FIG. 15 is a diagram illustrating a second description example of existing operation data according to the second embodiment;

FIG. 16 is a diagram illustrating a description example in which a function is listed as operation target operation data of a new development target system according to the second embodiment;

FIG. 17 is a diagram illustrating an example of data regarding a selection method held in a selection method holding unit according to the second embodiment.

FIG. 18 is a flowchart illustrating an operation of the user interface management device according to the second embodiment.

FIG. 19 is a flowchart illustrating a selection operation in a data selection unit according to the second embodiment.

FIG. 20 is a diagram illustrating an example of ranking in a selection method holding unit according to the second embodiment;

FIG. 21 is a diagram showing an example of application target operation data 3a created by embedding the operation method selected by the selection operation of the selection method holding unit in the second embodiment with a function.

FIG. 22 is a block diagram illustrating a configuration of a user interface management device according to a third embodiment of the present invention.

FIG. 23 is a flowchart showing the operation of the user interface management device according to the third embodiment.

FIG. 24 is a block diagram illustrating a configuration of a user interface management device according to a fourth embodiment of the present invention.

FIG. 25 is a flowchart showing the operation of the user interface management device according to the fourth embodiment.

FIG. 26 is a diagram illustrating an example of a data verification method according to the fourth embodiment;

FIG. 27 is a diagram illustrating an example of application-target operation data obtained by re-creating the screen based on a determination that the way of summarizing screens cannot be changed by the data verification operation in the fourth embodiment;

FIG. 28 is a diagram showing operation execution type data corresponding to the application target operation data shown in FIG. 27 in the fourth embodiment;

FIG. 29 is a block diagram illustrating a configuration of a user interface management device according to a fifth embodiment of the present invention.

FIG. 30 is a flowchart showing the operation of the user interface management device according to the fifth embodiment.

FIG. 31 is a block diagram illustrating a configuration of a user interface management device according to a sixth embodiment of the present invention.

FIG. 32 is a flowchart showing the operation of the user interface management device according to the sixth embodiment.

FIG. 33 is a diagram showing operation dialogue monitoring means in a user interface management device according to a seventh embodiment of the present invention.

FIG. 34 is a flowchart showing the operation of the user interface management device when an input is made to the operation dialogue monitoring means in the seventh embodiment.

FIG. 35 is a diagram showing operation dialogue monitoring means in the user interface management device according to the eighth embodiment of the present invention.

FIG. 36 is a flowchart showing the operation of the user interface management device when an input is made to the operation dialogue monitoring means in the eighth embodiment.

FIG. 37 is a diagram showing operation dialogue monitoring means in the user interface management device according to the ninth embodiment of the present invention.

FIG. 38 is a flowchart showing the operation of the user interface management device when an input is made to the operation dialogue monitoring means in the ninth embodiment;

FIG. 39 is a diagram showing operation dialogue monitoring means in the user interface management device according to the tenth embodiment of the present invention.

FIG. 40 is a flowchart showing the operation of the user interface management device when an input is made to the operation dialogue monitoring means in the tenth embodiment.

FIG. 41 is a block diagram showing a configuration of a conventional user interface management device.

[Explanation of symbols]

1 Existing operation data 2 Function description of new equipment 3 Applicable function description (data) 4 Operation execution type data 5 User input 6 Dialog control 7 Application 11, 991, 1502, 2091, 2202, 240
2 Existing equipment (inspected equipment) 12,951,1551,2051,2251,245
1 Existing operation data input means 13, 901, 1503, 2001, 2203, 240
3 Existing operation data storage means 14 Selection input means 15, 902, 1504, 2002, 2204, 240
4 Data selection means 16, 903, 1507, 2003, 2207, 240
7 Data conversion means 17, 904, 1508, 2004, 2208, 240
8 Interpreters 18, 992, 1510, 2092, 2210, 241
0 Application 19, 905, 1509, 2005, 2209, 240
9 Operation dialogue means 20, 993, 1511, 2093, 2211, 241
1 User (input unit) 900, 1501, 2000, 2201, 2401 User interface management device 906, 1506, 2006, 2206, 2406 Selection method holding means 907, 1505, 2007, 2205, 2405 Applicable function holding means 1512 Initial selection method Input means 1513 Selection method input person 2008 Data verification means 1513 2212, 2412 Operation dialog monitoring means 2413 Function monitoring means

 ──────────────────────────────────────────────────の Continuing on the front page (72) Inventor Fumiyuki Kato 1006 Kazuma Kadoma, Osaka Prefecture Inside Matsushita Electric Industrial Co., Ltd. (72) Inventor Kenshi Soma 1006 Odaka Kazama Kadoma City, Osaka Matsushita Electric Industrial Incorporated (72) Inventor: Isao Katagani 1006 Kadoma, Kadoma, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (24)

[Claims] 1. A database of a plurality of existing operation data describing an existing operation procedure and a function adopted in various electronic devices and a correspondence between the operation procedure and the function, and a user of the new device. In creating the interface, a set of existing operation data to be used is selected from the existing operation data stored in the existing operation data database and applied to the predetermined function of the new device. A user interface is created by generating operation execution data that enables the electronic device to operate in accordance with a command input operation from a user, based on the target operation data, and the application target operation data. How to create a user interface. 2. An operation of selecting a set of existing operation data to be used from the existing operation data stored in the database of the existing operation data for a predetermined function of a new device is performed by a development designer. 2. The method according to claim 1, wherein the method is performed by a determination and an operation. 3. An operation of selecting a set of existing operation data to be used from the existing operation data stored in the database of the existing operation data for a predetermined function of a new device is performed by a data selection unit. 2. The method according to claim 1, wherein the method is performed by a processing operation. 4. The method according to claim 2, wherein the generation of the operation execution type data is performed by the judgment and operation of a development designer. 5. The method according to claim 3, wherein the generation of the operation execution data is performed by a processing operation of a data conversion unit. 6. An existing operation data input means for constructing and inputting existing operation data describing an operation procedure, a function, and a correspondence relation between the operation procedure and the function, and an existing operation data storing means for storing the input existing operation data. Operation data storage means, selection input means for the developer to input an instruction to select existing operation data, and existing operation data stored in the existing operation data storage means based on the input from the selection input means. A data selecting means for selecting a set of existing operation data to be used, and setting the set as operation target operation data, and a data conversion means for converting the application target operation data into operation execution type data in a format executable by the interpreter And input / output between an application that executes operation-executable data and realizes functions other than the user interface, and input / output between an operation dialogue means. A user interface management device comprising: an interpreter; and an operation dialogue unit that presents information to a user and receives input from the user in accordance with an input / output command from the interpreter and sends the input information as a signal to the interpreter. 7. The user interface management device according to claim 6, wherein the operation procedure is an operation procedure obtained by investigating an operation procedure of an existing device. 8. An existing data input means for constructing and inputting existing operation data describing an operating procedure, a function, a corresponding relationship between the operating procedure and the function, and selection reference information of the operating procedure, Existing operation data storage means for storing existing operation data, a selection method holding means for providing a reference for selecting a set of existing operation data by the data selection means, and an application indicating an application function for realizing functions other than the user interface Based on the target function holding unit, the selection method holding unit, and the applicable target function holding unit, a set of existing operation data to be used is selected from the existing operation data stored by the existing operation data storage unit, and A data selection unit that sets a set as operation target operation data and an operation execution type data that is a format that can be executed by an interpreter. A data conversion means for converting, an interpreter for executing operation-executable data and performing input / output with an application, and input / output with an operation dialogue means, and information to a user by an input / output command from the interpreter. A user interface management device comprising: an operation interactive means for presenting, receiving input from a user, and transmitting input information as a signal to an interpreter. 9. The user interface management device according to claim 8, wherein the operation procedure is an operation procedure obtained from an operation procedure of an existing device. 10. The user interface management apparatus according to claim 8, further comprising an initial selection method input unit for inputting a selection method by a selection method input user. 11. Existing data input means for constructing and inputting existing operation data describing the correspondence between the operation procedure, the function, the operation procedure and the function, and the selection criterion information of the operation procedure. Existing operation data storage means for storing existing operation data, existing operation data storage means for storing existing operation data and selection reference information of each function, and a data selection means for providing a reference for selecting a set of existing operation data. Based on the selection method holding unit, the application target function holding unit indicating the function of the application realizing the function other than the user interface, and the selection method holding unit and the application target function holding unit, the existing operation data storage unit stores the data. Data selection means for selecting a set of existing operation data to be used from existing existing operation data and using the set as operation data to be applied. Data verification means for determining whether or not the applicable operation data and the operation execution data satisfy the constraint condition, and data conversion for converting the applicable operation data into operation execution data in a format executable by the interpreter Means, an interpreter for executing operation-executable data and performing input / output with an application, and input / output with operation / interaction means, information presentation to a user by an input / output command from the interpreter, A user interface management device having an operation dialogue means for receiving an input from a user and transmitting input information as a signal to an interpreter. 12. The data conversion means converts the application data to be applied to operation executable data in a format executable by the interpreter, and the data verification means restricts the application data to be applied and the operation executable data to a constraint condition. Is determined, and if so, the obtained operation-executable data is passed to the interpreter; if not, the constraint is satisfied, and the data selection method holding means 12. The user interface management device according to claim 11, wherein the user interface management device is a data conversion unit that selects the applicable operation data having the highest degree of adaptation to the selection method, converts the applicable operation data into operation-executable data, and passes the data to an interpreter. 13. The operation procedure according to claim 11, wherein the operation procedure is an operation procedure obtained by investigating an operation procedure of an existing device.
2. The user interface management device according to item 2. 14. An operation dialogue monitoring means for monitoring a state of a dialogue between a user and an operation dialogue means and outputting information on the state of the dialogue, and recreating a user interface based on an output from the operation dialogue monitoring means. 14. The user interface management device according to claim 8, wherein the user interface management device performs construction. 15. The user interface management device according to claim 14, wherein the output from the operation dialog monitoring means is input to the selection method holding means, and as a result, the user interface is reconstructed. 16. The user interface management device according to claim 14, wherein an output from the operation dialog monitoring means is input to the data selection means, and as a result, the user interface is reconstructed. 17. The user interface management device according to claim 14, wherein an output from the operation dialog monitoring unit is input to the data verification unit, and as a result, the user interface is reconstructed. 18. The user interface management device according to claim 14, wherein an output from the operation dialog monitoring means is input to an interpreter, and as a result, a user interface is reconstructed. 19. The user interface management device according to claim 14, further comprising a function monitoring unit that monitors a function instructed to be executed by the interpreter and inputs the function to a selection method holding unit. 20. The user interface management device according to claim 14, wherein one of the buttons for notifying that the user interface is inferior to the operation of the user interface is provided as operation dialog monitoring means. 21. The user interface management device according to claim 14, further comprising an operation dialogue monitoring unit that transmits one of two values as a determination regarding the superiority or inferiority of the operation of the user interface. 22. An operation dialogue monitoring means for transmitting an evaluation value of three or more levels as a judgment on superiority or inferiority of an operation of a user interface.
The user interface management device according to any one of the above. 23. The user interface management device according to claim 14, further comprising an operation dialogue monitoring unit that transmits an evaluation value of a continuous amount as the determination regarding the superiority or inferiority of the operation of the user interface. 24. An operation for measuring the time required for receiving an input from a user from information presentation to the user between the user and the operation dialogue means, and using the measured value as the state of the dialogue to detect the state of the dialogue. 20. The user interface management device according to claim 14, further comprising a dialogue monitoring unit.