JP2002281186A - User interface - Google Patents

Abstract

PROBLEM TO BE SOLVED: To resolve user's dissatisfactions by detecting the dissatisfactions from user's behaviors. SOLUTION: A user interface control method having an input device, a sensor device, an output device and a storage device, includes an information reading step for reading information on a device from the storage device, an information presentation step of presenting the information read out in the information reading step to a user on the output device in the form of at least one of voice, image and character information, a timing detection step of detecting changes in the external statuses of the devices or the statuses of the devices via the sensor device and comparing information about the detected status with a predetermined threshold for outputting a timing exceeding the threshold, and a determination step of receiving an output from the timing detection step and determining whether the output is a specific reaction displayed by the user to the device. When it is determined in the determination step that the output is a specific reaction, the information reading step is executed, and then the information presentation step is executed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a user interface, and more particularly, to a user interface for providing information on an appropriate operation method to a user who is unfamiliar with the operation method of a device.

[0002]

2. Description of the Related Art Conventionally, in a user interface for guiding an operation method of a device, (1) information on the operation method is provided by information for guiding the operation method incorporated in an object other than the device, such as a manual. (2) When the user operates a specific input means for guiding the operation method, such as a help key, incorporated in the device, information about the operation method is output to the output means to guide the operation method. 3) Information about the operation method is output to the output unit at a predetermined interval to guide the operation method, or (4) input instruction information from the user while guiding the operation method to the user from the beginning on the screen. The method is taken.

[0003]

However, in the user interface for guiding the device operation method by the methods (1) and (2), a user who is unfamiliar with the operation method and draws a manual. For users who do not know the "operation method or action to obtain information about the operation method", such as pressing the help key, or who are not familiar with such a user interface, information about the appropriate operation method However, there is a problem in that it is not possible to provide the user with an opportunity to provide the user with information on an appropriate operation method.

[0004] Further, in the user interface for guiding the device operation method as described in (3) above, it is possible to provide an "operation method for acquiring information on the operation method" at a predetermined interval. However, there is a problem that it is not possible to provide information on an appropriate operation method at a timing other than the provided timing.

[0005] In addition, as described in (4) above, inputting instruction information from the user by guiding the user on the screen from the beginning to operate the device requires securing that portion in the display area of the screen. Therefore, there is a problem that an area to be originally displayed is sacrificed.

That is, regarding a user who is unfamiliar with the operation method of the device, an operation method to be performed by the user to provide information on an appropriate operation method, and a timing to provide information on the appropriate operation method. At present, there is no definitive method, and the equipment provider expects the user to operate according to the method assumed in advance.

Here, a user who is unfamiliar with the operation method of the device or the operation principle of the device may not understand the operation method of the device, or may perform any operation with the intention of causing the device to perform a certain operation. Nevertheless, when the device does not perform the operation intended by the user, the device itself may be hit.

This is an action acquired by the user himself from the following experience of the user.

(1) Even if the equipment is operated properly, poor contact (electricity failure) due to inadequate solder technology and contact technology, aging of the solder and contacts, etc. in old home appliances and electrical devices, etc. (Opening of the circuit) has occurred and the normal operation has not been achieved due to this, and if the desired operation of the user has not been achieved, the state of the contact failure of the electric circuit is improved by hitting (vibrating) the device body. In some cases, the device operates normally, and a desired operation of the user can be achieved.

[0010] (2) When the device is operated properly, such as a home appliance or an electric device that has been used for a long time, conductive dust or the like may be generated during operation. Accumulates on the electric circuit, and when the electric circuit is short-circuited and the desired operation of the user cannot be achieved, the conductive dust or the like is moved by hitting (vibrating) the device body. In some cases, the state of the short circuit is improved, the device operates normally, and the desired operation of the user can be achieved.

(3) When a user, such as a child, who is acting mentally immature and behaving voluntarily, is allowed to take an action as desired by the user. When not taking it, or when words are not transmitted, there is a case where a threatening action of tapping forcibly conveys the intention of the user to the person and performs a desired action.

The above (1), (2) and (3) are experiences in which the user can perform the desired operation on the target object by hitting the user.

It is also a common experience in everyday life that even if the operation manuals of the equipment are stored carefully, they cannot be found when needed.

[0014] The present invention has been made in view of such a problem, and an object of the present invention is to hit an object by hitting the object when the user instruction is not executed as described above. It is possible to perform the desired operation of the user on the thing '', based on the common behavior style acquired from experience, to detect the dissatisfaction of the user from the behavior of the user and eliminate the content of the dissatisfaction, That is, the sensor device detects that the target device is performing an operation not desired by the user, for example, an action of the user hitting the device, and obtains an appropriate operation method desired by the user and information on the operation method. A user interface that decides when to provide it and outputs information about the appropriate operation method to achieve the desired operation by the user. To provide an interface.

[0015]

SUMMARY OF THE INVENTION In order to achieve the above object, according to the present invention, a user interface in a device having an input means for inputting an instruction from a user is provided. Sensor means for detecting and outputting a state change or a state of the device outside the device, and information on an operation method of the input means,
Alternatively, information storage means storing information indicating the location of the information, output means enabling presentation to the user in at least one form of voice, image, character information, and the sensor means The detection output is input, and it is determined that the user has made a specific reaction to the operation result of the user for the device or the processing mode of the device,
Timing determination means for outputting the determined timing, and information processing means for processing the information stored in the storage means and outputting the processed information to the output means when the timing determination means outputs the information. It is a feature.

The invention described in claim 2 is the first invention.
The user interface according to claim 1, wherein the sensor means includes a vibration sensor incorporated in the device main body that detects vibration of the device main body, or a microphone that detects sound near the device main body. is there.

The invention described in claim 3 is the first invention.
Or the user interface according to 2, further comprising a recording unit that records a history of processing of the device or a user operation to the input unit, wherein the timing determination unit records the recorded content recorded by the recording unit. On the basis of the specific reaction.

The invention described in claim 4 is the same as the invention described in claim 3.
The user interface according to claim 1, further comprising real-time clock means for obtaining an actual time, wherein said recording means records the time including the time data from said real-time clock means when recording, said timing determination means Comparing means for comparing the level or level change of the detection output from the sensor means with a predetermined threshold value, and outputting the result when the level is larger than the threshold value. And determining the specific response based on the information recorded by the recording unit, and further specifies the information stored in the storage unit to be processed by the information processing unit.

According to a fifth aspect of the present invention, there is provided an input device, a sensor device, an output device, and a storage device, wherein a predetermined operation of an operation switch of the input device is input, and a process corresponding to the operation is performed. A user interface control method included in a device to be executed, comprising: an information reading step of reading information related to an operation of the device or information indicating a location of information related to an operation of the device from the storage device; and reading the information in the information reading step. Information, audio, image, information presentation step of presenting to the user via the output device in at least one form of character information, the state change outside the device or the state of the device through the sensor device Detects and compares the detected state information with a predetermined threshold and outputs a timing exceeding the threshold Receiving the output from the timing detecting step and assessing whether the output is a result of a user operation on the device or a specific response indicated by the user to the processing mode of the device. And when the assessment step is determined to be a specific reaction, the information reading step is executed, and then the information presentation step is executed.

The invention described in claim 6 is the same as the invention in claim 5
The user interface control method according to claim 1, wherein the sensor device includes a vibration sensor incorporated in the device main body that detects vibration of the device main body, or a microphone that detects sound near the device main body. I do.

Further, the invention described in claim 7 is the same as claim 5
Or the user interface control method according to 6, further comprising a history recording step of recording the history of the user operation of the operation switch in the input device, or the history of the executed process in the storage device, wherein the assessment step includes: It is characterized in that whether the reaction is the specific reaction is evaluated based on the recorded contents recorded in the history recording step.

The invention described in claim 8 is the same as the invention described in claim 7.
The user interface control method according to claim 1, wherein the device further includes a real-time clock that obtains an actual time, and in the history record recording step, when recording, includes time data from the real-time clock. In the assessing step, when the output from the timing detecting step is obtained, time data from the real-time clock is recorded, and the specific reaction is performed based on the time data and the information recorded in the history recording step. And determining information to be read in the information reading step.

According to a ninth aspect of the present invention, there is provided a user interface control program.
It is characterized by including software code for causing a computer to realize each of the steps described in any one of Items 1 to 8.

According to a tenth aspect of the present invention, there is provided a storage medium storing the user interface control program according to the ninth aspect.

[0025]

Embodiments of the present invention will be described below with reference to the drawings.

FIGS. 1 and 2 are diagrams for explaining the gist of the present invention. FIG. 1 shows the basic configuration of a device to which the present invention is applied, and FIG. 2 shows the device shown in FIG. Fig. 2 shows a basic processing method according to the present invention for a user interface in the inside. In FIG. 1, devices include an input device 101 such as an operation switch, an output device 102 such as an image display device, a speaker device, and a printer device, a storage device 105 such as a memory or a hard disk device, and a user device 10. A sensor device 103 for receiving an indication of intention and a C for controlling these devices
A controller 104 having a PU is provided. The storage device 105 includes a program including software codes for realizing steps corresponding to flowcharts described later, display data, and the like. The controller 104 reads the program from the storage device 105,
By executing, the operation described below is realized. The storage device 105 may be a removable storage medium, or the program may be received from outside via a network and executed by the controller 104.

The user interface according to the present invention starts in step S200 of FIG.
Go to 02.

In step S202, the presence or absence of an input from the input device 101 is checked. If no, the process proceeds to step S210. If any input is performed from the input device 101, the process proceeds to step S204, where the history of button / switch operations on the input device 101 is recorded, and the process proceeds to step S206.

In step S206, it is checked whether a predetermined button / switch operation has been performed. If the operation is a predetermined operation, the process proceeds to step S208. Otherwise, the process returns to step S202.

In step S208, execution of a process corresponding to a predetermined button / switch operation is started in another job. At the same time, a history of what processing has been executed is stored in the storage device 105. In this history, date and time data from a real-time clock device (not shown) and an outline of processing corresponding to button / switch operation, for example, in the case of a printer device, whether printing has been performed or test printing has been performed are recorded. Then, the process proceeds to step S210.

In step S210, it is checked whether the detection signal level from the sensor device has an input level higher than a predetermined threshold level, or whether a change in the detection signal level has changed more than the predetermined threshold level. You. If the sensor information is smaller than the predetermined threshold, the process returns to step S202, and the above steps are repeated. If the detection signal level from the sensor device has an input level equal to or higher than the predetermined threshold level, or if the change in the detection signal level has a change equal to or higher than the predetermined threshold level, the process proceeds to step S212. .

In step S210, for example,
If it is a fixed time after the execution of step S202,
With the above-mentioned threshold level, after a certain period of time,
The threshold level can be raised to a threshold value that substantially masks the signal from the sensor device. In this case, when the sensor information from the sensor device is larger than the threshold value, it is assumed that the sensor information has a high probability of being a response to the process of step S202. When a change in the sensor information from the sensor device is detected, the average value of the sensor information immediately before the execution of the processing of step S202 and the sensor information after the execution of the processing of step S202 or after the execution is completed. May be compared to detect a change equal to or greater than a predetermined threshold value.

In step S212, the processing history is checked,
Whether or not the sensor information from the sensor device exceeding such a threshold is a user response to the processing result of the device, and if the sensor information is a response of the user to the processing result of the device, the operation is caused by any operation or processing. Then, information for subsequent processing is generated, and the process proceeds to step S214.

In step S212, step 2
10 is recorded based on the information from the real-time clock, and the process proceeds to step S204 or step S204.
The history information recorded in step 208 is compared, and step S210 is performed.
Determine what kind of sensor information is equal to or greater than the threshold value checked in. For example, the user inputs a button / switch operation from an input device but does not execute a predetermined process, or receives a predetermined button / switch operation and executes a corresponding process or immediately after the execution is completed. Find out if you performed this step. Alternatively, it is checked whether there is no history information.
In the latter case, the sensor information received is determined to be meaningless, and in the former case, it is determined to be a response to a user operation or process.

In step S214, step S
If it is determined in 212 that the sensor information is meaningless, the process returns to step S202, and if it is determined that the response is a response to a user operation or process, the process proceeds to step S216.

In step S216, the previous step S2
Based on the information determined in step 12, information on the stored and held device operation method is selected and output device 102 is selected.
To provide to the user through.

After execution of step S216, step S216
Returning to 202, the above processing is repeated.

As described above, the history information in step S204 or step S208 relates to how to handle sensor information and selection of information to be provided to the user. Thus, the latest history is important and the old history is less important.

As described above, by checking the sensor information from the sensor device after the execution of the processing is started or after the execution is completed, it is possible to obtain a user's evaluation or dissatisfaction with the processing. And a user interface that provides appropriate information to the user accordingly.

(First Embodiment) A first embodiment according to the present invention will be described below in detail with reference to FIGS.

FIG. 3 is a diagram showing a device configuration of the first embodiment including the above-described user interface of the present invention. FIG. 4 is a diagram showing a flowchart of a user interface to which the present invention is applied for the device and printer shown in FIG. FIG. 5 and FIG.
It is a table | surface figure explaining Embodiment of this invention.

In FIG. 3, a printer device 30 includes a button / switch input device 301 and a speaker output device 302,
The printer device includes a vibration sensor device 303, a controller 304, and a storage device 305.

The user 10 has, for example, the printer 3
0 is a user (human) operating.

The button / switch input device 301 is, for example, an input device including two button switches 301a and 301b.
By pressing, it is possible to instruct the controller 304 to execute a specific process for controlling the printer device 30.

The speaker output device 302 is, for example, a D-
A speaker output device having an A-conversion function, which converts audio data (digital) selected by the controller 304 from among audio data (digital) stored in the storage device 305 into an analog signal, Output as

The vibration sensor device 303 is, for example, a vibration sensor device provided with a semiconductor vibration sensor, and is incorporated in the main body of the printer device 30.
Is a device that detects vibrations of the printer device 30 generated by operations such as hitting, shaking, and dropping, and generates vibration detection information 303a.

The controller 304 is, for example, a microcomputer, which controls the printer device 30 in accordance with input information of the button / switch input device 301, and controls data stored in the storage device 305 for the speaker output device 302. Is output as audio data, or the vibration sensor 30
This is a device for controlling processes executed inside the printer device 30, such as processing a guidance process for a user based on the vibration detection information 303a from the third device.

The storage device 305 is, for example, a ROM, and is a device for storing voice data for guiding an operation method to a user and processing contents of the controller 304.

First, the operation specifications of the two button switches of the button switch input device shown in FIG. 3 will be described.

It is assumed that there are six operation modes indicated by reference numerals 511 to 516 as shown in FIG. These modes are determined by the processing contents of the printer device when two button switches are pressed. Operation modes 511-
Reference numeral 513 denotes each of the button switches 301a to 301 shown on the right when the printer device is not executing a process.
It is determined by the number of presses in the order of 1b. The operation mode 514 is
The operation modes during the processing of the modes 511 to 513, and the operation modes 515 and 516 are the operation modes during the operation guide processing.

These operation modes correspond to the printer 30
On the other hand, the combination of the order in which the two buttons of the button / switch input device 301 are pressed and the contents of the control processing performed by the controller 304 when the two buttons are pressed are represented by (1) test print processing 511, and (2) print density adjustment processing 512. ,
(3) Ink cartridge replacement processing 513, (4) In-process processing stop processing 514 in which processing currently being executed is stopped,
, And (5) operation guidance stop processing 521 of operation guidance, and (6) continuation processing 522 of next operation guidance.

For example, when the test print processing 511 is to be executed, when the guidance processing relating to the operation method of the printer is not executed, the button switch 301a is pressed once and then the button switch 301b is pressed once. As a result, a test print 511 is executed. Such an operation method is referred to as a test print processing operation method 511a.

Similarly, when the print density adjustment processing 512 is to be executed, when the guidance processing relating to the operation method of the printer is not executed, the button switch 301a is pressed twice and then the button switch 301b is pressed once. Then, the process 512 for increasing the print density is executed. Such an operation method is referred to as an operation method 512a for print density adjustment processing.

Similarly, ink cartridge replacement processing 5
13 is to be executed, when the guidance process relating to the operation method of the printer is not executed, the button switch 3
It is assumed that the ink cartridge replacement process 513 is performed by pressing the button switch 301b once after pressing the button 01a three times. Such an operation method is referred to as an ink cartridge replacement operation method 513a.

Similarly, the above processes 511, 512, 513
When the guidance process relating to the printer operation method is not being executed, when the button switch 301b is pressed twice, an interruption process 514 for canceling the process being executed is executed. Such an operation method is referred to as an in-process stop operation method 514a.

When the guidance processing relating to the operation method of the printer is being executed, the guidance processing relating to the currently processed operation method is performed by pressing the button switch 131a four times and then pressing the button switch 301b once. Is performed 521. Such an operation method is referred to as a guidance processing stop processing operation method 521a.

When the guidance process relating to the operation method of the printer is being executed, the guidance process relating to the operation method currently being processed is interrupted by pressing the button switch 301b twice, and the guidance process relating to the next operation method is performed. 522 is performed to continue. Such an operation method is referred to as a guidance processing continuation operation method 522a.

It is assumed that when the printer device 30 is operated in an input order other than the above, no processing is executed.

Now, the user 10 is a user who is unfamiliar with the operation method of the printer device 30 and wants to execute the ink cartridge exchange process 513.
Method of Operating Printer Apparatus 30 Appropriate to Execute (Operation Method 513a for Ink Cartridge Replacement Processing)
Assume that you do not know

Even if the user 10 attempts to press any of the button switches 301,
The probability that the operation method 513a for ink cartridge exchange processing is executed is low, and it can be said that the possibility that the ink cartridge exchange processing intended by the user 10 can be executed is sufficiently low.

Here, referring to FIG.
The flow of the process related to the control of the user interface in will be specifically described. Note that step S4 in FIG.
FIG. 6 shows the voice guidance that is started and controlled by
Shows an embodiment of the guidance voice.

The user interface of the printer device 30 starts in step S400, and starts in step S4.
Go to 02. Normally, it is checked in step S402 whether there is an input from the input device, and then in step S41.
The check is repeated as to whether or not sensor information of 0> threshold value. Here, the input device is the button / switch input device of FIG. 3, and the sensor information is information 3 from the vibration sensor device.
03a.

Steps S402 to S414
Correspond to steps S202 to S21 in FIG.
4, and a duplicate description will be omitted.

In step S410, it is checked whether or not the user 10 has hit or vibrated the printer device 30 by monitoring the signal level from the vibration sensor device or a change in the signal as described above. If a special vibration level or a special change in the vibration level has not been detected, that is, if the printer device 30 has not been hit or vibrated, the process returns to step S402.
Here, when the printer device 10 is hit or vibrated, the vibration sensor 303 incorporated in the main body of the printer device 30 detects the vibration of the printer device 30,
The vibration detection information 303a is sent to the controller 304. When the controller that has received the vibration detection information processes this information and determines that a special vibration level or a special change in the vibration level has been detected, the process proceeds to step S412.

In step S412, the processing history up to that point or the user's button / switch operation record is checked to make settings for subsequent steps, and the flow advances to step S414.

In step S414, whether or not to respond to the above-described special vibration level or special change in the vibration level is determined based on the processing result of the previous step S408. For example, if there is no record of the switch operation and no processing history, the above-described special vibration level or the special change of the vibration level is ignored, and step S
Return to the normal loop from 414. Otherwise, the process proceeds from step S414 to step S416.

In step S416, step S404
It is confirmed whether or not the process started in is being executed. If it is confirmed that the job is being executed, a flag indicating that the job is being executed is set, and the process proceeds to step S420. If it is confirmed that it is not being executed, the process proceeds to step S418. Step S4
In the step S18, a flag indicating that the program is not being executed is set, and
Go to 0. Steps S416 and S418 are provided to determine the specific processing contents in the first step S420 to be precise.

In step S420, start control of voice guidance is executed, and the flow advances to step S422. Step S42
The details of the voice guidance started in step 2 are described in step S4.
16 or S418, or depending on the data generated in step S412. Note that the voice guidance itself is executed by a job different from the processing flow of FIG. Here, the controller 304 processes guidance voice data set in the storage device 305 in advance as guidance processing for the user, outputs guidance voice to the speaker output device 302, and starts guidance to the user such as an operation method.

The voice guidance will be described below.

If any process is currently being executed, that is, if the process proceeds from step S416 to step S420, a guidance voice for asking whether or not this process is unsatisfactory, and a process 514 for canceling the process being executed. And a guidance voice relating to an operation method for executing. For example, a guidance voice 601a saying "Are you dissatisfied with the process currently being executed? If there is dissatisfaction, stop the process currently being executed" and "Press the button 301b twice to cancel the process being executed. If the other operation is performed or the button is not pressed, the processing is continued. " At the same time, the processing being executed due to step S408 is temporarily stopped.

If the process proceeds from step S418 to step S420, and if it is recorded in step S412 that the user performs meaningless button / switch operation, the user's button / switch operation is intended. Outputs guidance voice for asking for processing. For example, "You can use voice guidance about what you want to do. If you want to hear voice guidance, please wait.
If the operation method guided by voice is different from the one related to the processing intended by the customer, use the button / switch 3
If you press 01b twice, it will guide you on how to operate another process. The operation method guided by the voice is the process intended by the customer, and if the operation method can be understood by the guidance, press the button switch 301a four times and then press the button switch 301a.
Press b once to end the voice guidance. Is output.

After performing this start control, step S42 is executed.
Then, the process loops between step S422 and step S424 to wait for a button / switch input for a predetermined time. When the predetermined time has elapsed without performing an effective button / switch operation, the process proceeds from step S424 to step S438.

In the loop of steps S422 and S424, if an operation is performed in an input order other than the operation method shown in the table of FIG. 5, it is assumed that no processing is executed. Check whether any of the operations shown in the table have been performed. If confirmed, the process proceeds to step S426, at which point it is checked whether the voice guidance is actually continuing. If not, the process proceeds to step S430. If the voice guidance processing is being continued, the voice guidance processing being executed is stopped in step S428, and the process proceeds to step S430.

In step S430, the previous step S4
For example, it is determined whether the operation in step 22 is an operation method 514a for canceling an ongoing process, and if the operation method 514a for canceling an ongoing process is performed, it is determined that a process not intended by the user is being executed. Then, a guidance sound for notifying that the currently executing process is to be stopped because the process is not the intended process is output, and the process for which the execution is currently suspended is stopped. For example, the voice guidance 6 saying, "The currently executing process has been determined to be contrary to the customer's intention, and the ongoing process has been stopped."
02 is output. If the operation method 514a for canceling the ongoing process is not performed, it is determined that the process intended by the user is being executed, and the process that is currently suspended is resumed and continued.

In step S422, the button switch 3
If 01b has been pressed twice, the user has requested another guidance, and the subsequent processing is performed in step S43.
4 manipulates the information used by those steps to proceed to steps S436 and S438.

Further, when the guidance voice 603 is being output, the button
If the button switch 301b has been pressed once after the switch 301a has been pressed four times, the user operates the information to return from step S432 to step S402 since the user has requested that the voice guidance be stopped.

When the process proceeds from step S434 to step S436, if all the guidance has not been executed yet, the process proceeds to step S438. If all the guidance has been executed, the process returns to step S402.

In step S438, the next guidance voice is set, and the flow returns to step S420.

When the process proceeds from step S438 to step S420, the second voice guidance is started in step S420. For example, a guidance voice for guiding an operation method for executing the test printing process is output. For example, a guidance voice 604 is output, stating that "when the button switch 301a is pressed once and then the button switch 301b is pressed once, a test printing process is executed".

If the button switch 301b is pressed twice during the output of the guidance voice 604, the operation guidance is continued, so the output of the guidance voice 604 is stopped in step S428, and the process proceeds from step S434 to step S436. Proceed to S438.

In step S438, the next guidance voice is set, and in step S420, the third voice guidance is started.

Further, during output of the guidance voice 604, the button
When the button switch 301b is pressed once after the switch 301a is pressed four times, the output of the guidance voice 604 is stopped, and the steps S434 to S402 are performed.
Return to

In the third step S420, a guidance voice for guiding an operation method for executing the print density adjustment processing is output. For example, "button switch 301
Press a twice and then press the button switch 301b once to adjust the print density. "

If the button switch 301b is pressed twice while the guidance voice 605 is being output, the output of the guidance voice 605 is stopped, and the process proceeds from step S434 to step S438 as described above. The guidance voice is set, and the fourth voice guidance is started in the fourth step S420. Thereafter, the same operation is repeated.

In the fifth step S420, a guidance voice for guiding an operation method for executing the ink cartridge replacement process is output. For example, "Press the button switch 301a three times and then press the button switch 301a.
Press b once to replace the ink cartridge. "

In the sixth step S420, a guidance voice for guiding an operation method for canceling the process currently being performed is output, and the process returns to step S402. For example, a guidance voice 607 is output, stating that "pressing the button switch 301b twice allows the currently stopped processing to be stopped." If the button switch 301b is pressed twice during the output of the guidance voice 607, the output of the guidance voice 607 is stopped, and the process returns to step S402 via step S432. Alternatively, if the button switch 301a is pressed four times and then the button switch 301b is pressed once while the guidance voice 607 is being output, the process returns from step S432 to step S402.

As described above, the printer user
The processing of the interface proceeds. Step S43
In the case of 0, necessary control contents differ depending on whether or not this is the first step, or according to the button / switch input in step S422. In step S422,
When the test printing operation method 511a shown in FIG. 5 is performed by the user, since the operation is in the voice guidance mode, this operation is ignored, and the process returns from step S434 to step S422 to receive the button / switch operation by the user again. Will be.

The above is the description of the general processing contents in the first embodiment.

FIG. 4 is a flow chart of a process for providing the user 10 with an ink cartridge replacement process operation method 513a, which is an appropriate operation method for the ink cartridge replacement process 513 of the printer device 30, with reference to FIG. This will be described in further detail.

In the normal user interface process, a loop shown by a bold line in FIG. 4 from step S402 to step S410 and back to step S402 is repeated. Here, the user 10 presses the button switch 301a four times without being informed of the operation method. However, the operation of the button / switch in this case does not give a vibration to the device such that vibration sensor information> threshold. In addition, this user operation is performed from step S402 to step S404, and then to step S4.
Since step 06 is not included in the predetermined button / switch operation, the process does not proceed from step S406 to step S408. In this case, the process returns from step S406 to step S402. After that, the normal loop is still repeated.

In step S404, the fact that a button operation has been performed is recorded.

The user 10 has tried to operate the button / switch 301 several times, but has not yet proceeded to step S408, so that no processing is performed and there is no change in the device. For this reason, the user felt dissatisfied and hit the printer device 30. For this reason, vibrations that cannot be caused by the normal operation of the device occur in the device. Printer device 3
The vibration sensor 303 incorporated in the main body of the printer device 0 detects the vibration of the printer device 30 and notifies the controller 304 of vibration detection information 303a. The controller 304 includes:
In step S410, it is determined that vibration sensor information> threshold, and the process proceeds to step S412.

In step S412, it is determined that no processing is currently executed, but the operation input from the button / switch input device was obtained immediately before, and it is determined that this sensor information is due to the user. Then, the process proceeds from step S414 to step S416, and further proceeds to step S420.

In step S420, the controller 304
Processes the first guidance voice data preset in the storage device 105 as a guidance process for the user, and outputs a guidance voice to the speaker output device 302. As the voice guidance here, from the history information survey in step S412, it is determined that the button / switch operation has been performed, but there is no corresponding execution process, and a guidance voice 603 for inquiring about the process intended by the user is output. , The start control is performed so that the guidance voice 603 is output.

Upon hearing the voice guidance, the user 10 understood the operation method 521a for stopping the guidance process and the operation method 522a for continuing the guidance process. Furthermore, guidance voice 603
Since the user did not operate the button / switch during the output of, the process proceeds from step S424 to step S438, and in step S48, a guidance voice for guiding an operation method for executing a test printing process, which is the next guidance voice. 60
4 and, in the next step S420, the guidance voice 604
Is controlled to output voice guidance.

Since the user did not operate the button / switch during the output of the guidance voice 604, step S4 is repeated.
At step 38, a guidance voice 605 for guiding an operation method for executing the print density adjustment process, which is the next guidance voice, is set, and at the next step S420, voice guidance start control is performed so as to output the guidance voice 605. . Since the user did not operate the button switch while outputting the guidance voice 306,
Again in step S438, guidance voice 3 for guiding an operation method for executing the next ink cartridge replacement process
06 in the next step S414.
Is controlled to output voice guidance.

The user 1 who understood the operation method 513a for the ink cartridge exchange processing by the guidance voice 306
In the case of 0, since the operation of the guidance processing stop processing operation method 521a has been performed, the process returns from step S432 to step S402, and the normal loop is executed again.

At this stage, since the user 10 understands the operation method 513a for replacing the ink cartridge, the user 10 operates the operation method 513a for replacing the ink cartridge. This operation is confirmed in step S406, and in step S408, the ink cartridge exchange processing 513 of the printer device 30 is executed.

As described above, the user 10 who is unfamiliar with the operation method of the printer device 30 operates the printer device 30.
, The user's action was detected from the sensor, and it was determined that this was unsatisfactory with the user's operation result, and the user 10 was provided with an appropriate operation method for the printer device 30. When the user performs an appropriate operation based on the provided information, a process intended by the user who is unfamiliar with the operation method for the printer device 30 can be achieved.

In the first embodiment, in the printer device, the action of "hitting the printer device main body", which is an appearance of the user's dissatisfaction, is detected by the vibration sensor device, and the desired operation is achieved by voice output. It is shown that it is possible to provide an appropriate operation method for the purpose.

(Second Embodiment) In the facsimile apparatus according to the second embodiment, the microphone apparatus detects an action of "speaking loudly to the facsimile apparatus main body", which indicates the dissatisfaction of the user, and detects the facsimile. This indicates that the printer included in the device can provide link information for linking to a place having an appropriate operation method for achieving a desired operation by the user.

Hereinafter, a second embodiment according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 7 is an embodiment of a device including the user interface of the present invention. FIG. 8 is a diagram showing a flowchart of a user interface to which the present invention is applied for the apparatus and facsimile apparatus shown in FIG.
FIG. 9 is a table illustrating a user interface of the facsimile apparatus shown in FIG.

In FIG. 7, the facsimile machine 70
Button / switch input device 701 and printer output device 7
02, a microphone device 703, a controller 704, and a storage device 705.

The button / switch input device 701 is an input device composed of, for example, two button switches 701a and 701b.
By pressing, it is possible to instruct the controller 704 to execute a specific process for controlling the facsimile machine 70.

The printer output device 702 is a device in which the controller 704 uses selected data among the data stored in the storage device 705 as character / graphic information and prints it on paper.

The microphone device 703 is a facsimile device 7
0 is a device that detects a loud voice uttered around the facsimile device 70 and generates loud detection information 703a.

The controller 704 is, for example, a microcomputer, which controls the facsimile machine 70 in accordance with the input information of the button / switch input device 701, or controls the data stored in the storage device 705 with respect to the printer output device 702. Is a device for outputting a process executed inside the facsimile device 70, such as printing on a paper as a character graphic or performing a support process for a guidance process for a user based on voice input information 703a from a microphone device 703. .

The storage device 705 is, for example, a hard disk, and stores text data and link information for link information for guiding a user to an operation method.
Is a device for storing the contents of the processing.

The operating method guide hypertext data 706 is, for example, a hypertext placed on an HTTP server, and describes information on an operating method of the facsimile apparatus 70. The hypertext transfer server 707 is a server installed on the Internet, for example, and provides a hypertext distribution service in response to an information access request by http. The terminal 708 is, for example, a personal computer capable of browsing hypertext data at an arbitrary URL by Web browser software. Network 709
Is hypertext data 70 for guiding the operation method of the facsimile machine 70, for example, the Internet.
It is assumed that a hypertext transfer server 707 having a terminal 6 and a terminal 708 that can be used by a user are connected.

FIG. 8 shows a flow of processing relating to user interface control when the user interface of the present invention is applied to the facsimile apparatus 70.

The user interface of the facsimile machine 70 will be specifically described with reference to FIGS.

Now, the facsimile machine 70 transmits a process 911 to a pre-registered number in a combination of the order in which the two buttons of the button / switch input device 701 are pressed, and transmits a list of the pre-registered numbers. The process 912 for printing, the ink
It is assumed that four processes of the cartridge replacement process 913 and the currently executing process canceling process 914 for canceling the process currently being executed are achieved.

For example, when it is desired to execute transmission processing 911 to a number registered in advance, and when link information printing processing relating to a facsimile operation method is not being executed, after the button switch 701a is pressed once, the button It is assumed that the transmission process 911 to the number registered in advance is executed by pressing the switch 701b once. Such an operation method is referred to as a transmission processing operation method 911a addressed to the registered number.

Similarly, when the user wants to execute the process 912 of printing a list of numbers registered in advance, the user depresses the button switch 701a twice when the link information printing process relating to the facsimile operation method is not executed. Suppose that pressing the button switch 701b once later executes a process 912 of printing a list of numbers registered in advance. Such an operation method is referred to as a registered number list print processing operation method 912.
a.

Similarly, ink cartridge replacement processing 9
If the user wants to execute Step 13, when the link information printing process relating to the facsimile operation method is not being executed, the user presses the button switch 701a three times and then presses the button switch 701b once to replace the ink cartridge. Assume that operation 913 is performed. Such an operation method is referred to as an ink cartridge replacement operation method 913a.

Similarly, the above processing 911, 912, 913
If the user wants to cancel the execution of the process, when the link information printing process related to the facsimile operation method is not executed, pressing the button switch 701b twice executes the canceling process 914 for canceling the process being executed. Assume that Such an operation method is referred to as an in-execution processing stop operation method 914a.

It is assumed that the facsimile machine 70 does not execute the processing when operated in an input order other than the above.

Now, the user 10 is connected to the facsimile machine 7
A user who is unfamiliar with the operation method of the facsimile apparatus 70 and wants to execute the ink exchange processing 913, but operates the facsimile apparatus 70 appropriately to execute the ink exchange processing 913 of the facsimile apparatus 70 (ink It is assumed that the user does not know the operation method 913a) for the cartridge replacement process.

Even if the user 10 attempts to press any of the button switches 701,
The probability that the operation method 913a for the ink cartridge exchange process is executed is low, and it can be said that the possibility that the ink cartridge exchange process intended by the user 10 can be executed is sufficiently low.

Here, the flow of processing related to the control of the user interface in the facsimile machine 70 will be specifically described with reference to FIG.

The processing of the user interface according to the second embodiment is started in step S800.
Proceed to step S802. Normally, a loop shown by bold lines from step S802 to step S810 and back to step S802 is repeated. Here, when the user 10 operates the button / switch 701 by the operation method shown in FIG. 9, the process proceeds from step S802 to step S808. If the button switch 701 has not been operated by the operation method shown in FIG. 9, the process proceeds from step S802 to step S806, and returns from step S806 to a normal loop. In step S804 during this time,
The fact that the button / switch operation has been performed is recorded for subsequent processing.

In step S804, a predetermined process is executed in accordance with the previous switch operation, and a history of this process is obtained.
Proceed to. Normally, since a loud voice is not detected by the microphone, the process returns to the normal loop from step S810.

When the user 10 utters a loud voice around the facsimile apparatus 70 while repeating the normal loop, the microphone device 703 incorporated in the main body of the facsimile apparatus 70 transmits the sound wave around the facsimile apparatus 70. If the loudness detection information 703a has a volume equal to or greater than a predetermined threshold, or if the change in the detection signal after execution of step S808 is determined to be equal to or greater than the predetermined threshold, the controller 70
No. 4 executes the process of step S812.

In step S 812, the history information processed in step S 808 and the reception record are checked, and information for a subsequent step is set, and the flow advances to step S 814.

In step S814, for example, if it is determined in step S812 that the reception was performed immediately before, it is determined that the user has responded to the reception result, and a switch operation has been performed but there is no corresponding processing. If so, the process proceeds to step S816 as being caused by the switch operation. Alternatively, if there is no record of the switch operation, this loud voice detection is ignored because it is unrelated to the facsimile machine 70, and the step S8 is performed.
Return to the normal loop from 14.

In this embodiment, the controller 704
In step S816, for example, URL as link information to operation method guidance information preset in storage device 105 as guidance processing for the user
(Universal Resource Locat
or) convert the data into character / graphic information and print
At 05, an information sheet 702a having link information to the operation information of the facsimile apparatus is obtained. The hypertext transfer server at the address indicated by the URL has hypertext data 706 in which information on the operation method of the facsimile machine 70 is described.

The user 10 can use the printed information paper 702
a, a PC 708 available to the user 10 is connected to a hypertext transfer server via the Internet 707, the hypertext data 706 is browsed using a Web browser on the PC 708, and an operation method of the facsimile machine 70 is performed. Will know.

Here, the ink and facsimile machine 70
An operation method 913a for an ink cartridge replacement process which is an appropriate operation method for the cartridge replacement process 913
Will be described in more detail with reference to FIG.

In the normal user interface processing, a loop shown by a bold line in FIG. 8 from step S802 to step S808 and back to step S802 is repeated. Here, the user 10 presses the button switch 701b ten times without being informed of the operation method. However, since the user's button / switch operation is not included in the operation method shown in FIG. 9, there is no processing corresponding to the input operation, and nothing is executed. The user 10 complained after trying the operation of the button switch 701 several times, and uttered a loud voice around the facsimile machine 70.

A microphone device 703 incorporated in the main body of the facsimile device 70 detects a sound wave uttered by the user around the facsimile device 70, and
3a is notified to the controller 704. Controller 7
In step 04, the detected sound wave is equal to or higher than a predetermined volume (step S810), and immediately before that, it is checked that the button switch 701 has been operated several times. It is determined that the detection signal is due to dissatisfaction with the user's operation (step S814), and the operation method guidance link information 705a preset in the storage device 705 is processed as guidance processing for the loud user. And
An information sheet 702a describing link information for operating method guidance is printed out via the printer output device 702 (step S816).

The URL printed on the information paper 702a
Using the terminal 708, the user browses the operation method guidance hypertext data 706 using the terminal 708 based on the operation method guidance link information 705a.

The user 10 who has viewed the operation method guidance hypertext data 706 receives the information of the ink cartridge replacement processing operation method 913a described in the operation method guidance hypertext data 706 and uses the information of the facsimile apparatus 70. Understand the operation method 913a for the ink cartridge replacement process.

The user 10 who understood the operation method 913a for replacing the ink cartridge performed the operation method 913a for replacing the ink cartridge.

The operation of the ink cartridge replacement processing operation method 913a is executed, and the ink cartridge replacement processing 913 of the facsimile machine 70 is executed.

As described above, the facsimile apparatus 70
The user 10 who is unfamiliar with the operation method of the facsimile device 70 is caused by dissatisfaction with the operation method of the facsimile device 70.
The user 10 is provided with link information on an appropriate operation method for the facsimile apparatus 70 based on the action of uttering a loud voice around the user. By performing an appropriate operation on the facsimile device 70 with reference to the data 706, a process intended by the user 10 who is unfamiliar with the operation method for the facsimile device 70 can be achieved.

As described above, according to the present invention, for a user who is unfamiliar with the operation method of the device, the user's frustration that the user hits the device or utters a loud voice to the device appears. By detecting the behavior that becomes the user and notifying the user of an appropriate operation method to achieve the desired operation of the user or link information on the appropriate operation method, the user who is unfamiliar with the operation method of the device It is possible to provide information on the operation method of the device at an appropriate time.

As described above, the present embodiment of the present invention has been described using a printer and a facsimile, but it is easy to change to the following form without departing from the gist of the present invention.

A device (such as a copying machine or a personal computer) having an input device for performing an instruction from the user according to a combination of input orders of a plurality or a single input device operated by the user.
The present invention can be applied to cameras, video cameras, and home game machines.

In the present embodiment, the vibration sensor device and the microphone device have been described as examples of the sensor device.
This is another sensor device that can acquire information on a desire to execute an appropriate operation method issued by a user who is unfamiliar with an appropriate operation method for a device or information on dissatisfaction due to an inability to execute an appropriate operation method ( For example,
Temperature sensors, infrared sensors, magnetic sensors, ultrasonic sensors, brain wave sensors, X-ray sensors, blood sugar level sensors, hormone concentration sensors) may be used.

In the present embodiment, a speaker output device has been described as an example of an output device that directly presents data on an operation method to a user. Other output devices that can be operated by the user (e.g., a printer output device, a CRT output device, a stereoscopic output device, and the like), and a user such as a bone conduction output device that can obtain the operation method by hearing. Output device).

Further, in the present embodiment, as an example of indirectly presenting operation method data to a user, link information output on paper by a printer output device is used.
The example in which the operation method is presented by referring to another terminal has been described. However, as for the link information, output data that presents a method of referring to another guide data (for example, an operation method prepared separately) Audio output data to be presented so as to refer to the manual of
V broadcast program broadcast time designation data).

[0143]

As described above, according to the present invention, input means for inputting an instruction from a user, sensor means for detecting and outputting a change in an external state or a state of a device, and presenting information to the user Input means for inputting detection output from sensor means, output means for enabling output means, information on the operation method of the input means, or information indicating the location of the information, and the operation result of the user on the device Alternatively, it is determined that the user has made a specific reaction to the processing mode of the device, the timing determining means for outputting the determined timing, and when the timing determining means outputs the information, the information stored in the storage means is processed. And information processing means for outputting the data to the output means. The that information, via the output device, even for a weak user to the operation of the device it is possible to properly presented.

Also, since a recording means for recording the processing history of the device or the user operation to the input means is provided, a specific signal from the sensor means for detecting and outputting an external state change or the state of the device is output. Upon detection, by examining the recorded information, it is possible to remove so-called noise and determine that the signal is caused by the appearance of user dissatisfaction, and at the same time identify the content of the user dissatisfaction to some extent It is also possible to do.

Further, with the vibration sensor or the microphone device provided in the device, the content of dissatisfaction with the device can be accurately grasped from the behavior style of a normal user.

[Brief description of the drawings]

FIG. 1 is a diagram showing a configuration of a device including a user interface of the present invention.

FIG. 2 is a flowchart showing basic processing of a user interface according to the present invention.

FIG. 3 is a diagram illustrating a configuration of a printer device according to the first embodiment.

FIG. 4 is a flowchart illustrating a process according to the first embodiment.

FIG. 5 is a table showing processing contents according to the first embodiment.

FIG. 6 is a table illustrating voice guidance in the output device according to the first embodiment.

FIG. 7 is a diagram illustrating a configuration of a facsimile apparatus according to a second embodiment.

FIG. 8 is a flowchart illustrating a process according to the second embodiment.

FIG. 9 is a table showing processing contents according to the second embodiment.

FIG. 10 is a diagram illustrating an example of operation method guide link information output in the second embodiment.

[Explanation of symbols]

 Reference Signs List 10 user 100 device 101 input device 102 output device 103 sensor device 104 controller 105 storage device 30 printer device 301 button / switch input device 301a, 301b button / switch 302 speaker output device 303 vibration sensor device 304 controller 305 storage device 70 facsimile device 701 Button / switch input device 701a, 701b Button / switch 702 Printer device 702a Information paper 703 Microphone device 704 Controller 705 Storage device 706 Hypertext data 707 Hypertext transfer server 708 PC (terminal) 709 Network

Claims (10)

[Claims] 1. An apparatus provided with input means for inputting an instruction from a user, a sensor means for detecting and outputting a state change or a state of the apparatus outside the apparatus, and information relating to an operation method of the input means; Alternatively, information storage means for storing information indicating the location of the information; output means for enabling the user to present the information in at least one form of voice, image, and character information; and Timing determination means for determining that the user has made a specific reaction to the operation result of the user on the device or the processing mode of the device, and outputting the determined timing; and And an information processing means for processing the information stored in the storage means and outputting the processed information to the output means when is output. User interface characterized by: 2. The user according to claim 1, wherein the sensor means includes a vibration sensor incorporated in the device main body for detecting vibration of the device main body, or a microphone for detecting sound near the device main body. ·interface. 3. A recording device for recording a history of processing of the device or a user operation on the input device, wherein the timing determining device determines the specific reaction based on the recorded content recorded by the recording device. The user interface according to claim 1, wherein the user interface is determined. 4. A real-time clock means for obtaining an actual time, wherein said recording means records the time including the time data from said real-time clock means when recording, and said timing determining means detects the time from said sensor means. Comparing the output level or the level change with a predetermined threshold value and outputting when the output level or the level change is larger than the threshold value, and outputting the information recorded by the real-time clock and the recording means when output from the comparison means; 4. The user interface according to claim 3, wherein the specific response is determined based on the information, and the information stored in the storage unit to be processed by the information processing unit is specified. 5. A user interface control provided in a device including an input device, a sensor device, an output device, and a storage device, for inputting a predetermined operation of an operation switch of the input device and executing a process corresponding to the operation. A method, comprising: reading out information relating to the operation of the device from the storage device, or reading out information indicating the location of the information relating to the operation of the device; and reading out the information read out in the information reading step as a voice, an image, or a character. An information presenting step of presenting to the user via the output device in at least one form of information; detecting a state change or a state of the device outside the device via the sensor device; and detecting the detected state information. A timing detection step of outputting a timing exceeding the threshold value in comparison with a predetermined threshold value, Receiving an output from the timing detection step, assessing whether the output is a user's operation result of the device or a specific response indicated by a user to a processing mode of the device, When the assessing step assesses a particular reaction,
A user interface control method, comprising: performing the information reading step, and then performing the information presenting step. 6. The device according to claim 5, wherein the sensor device includes a vibration sensor incorporated in the device main body for detecting vibration of the device main body, or a microphone for detecting sound near the device main body. User interface control method. 7. A history recording step of recording, in the storage device, a history of a user operation of an operation switch in the input device or a history of executed processing, and in the assessment step, recorded contents recorded in the history recording step 7. The user interface control method according to claim 5, wherein whether or not the specific reaction is determined is determined based on the following. 8. The apparatus according to claim 1, further comprising: a real-time clock for obtaining a real time, wherein in the history recording step, when recording, the time and the time data from the real-time clock are recorded. When the output from the timing detection step is obtained, time data from the real-time clock is recorded, the specific reaction is determined based on the time data and the information recorded in the history recording step, and the information reading is further performed. 8. The user interface control method according to claim 7, wherein information to be read is specified in the step. 9. A user interface control program comprising software code for causing a computer to implement each of the steps described in claim 5. 10. A storage medium storing the user interface control program according to claim 9.