JP2003323081A - Machine operating device, program, recording medium, and image forming apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a machine operating device which makes it possible to easily and securely perform various operations of a machine without using eyes. <P>SOLUTION: The machine operating device arranges setting items for machine operation items as the hierarchical menus of a hierarchical structure. Selection of a required setting item of the hierarchy is carried out with a shift key, and the setting item is selected with an enter key, thereby operating the machine. According to a condition, information about an instruction to operate the machine and the result of it is transmitted by making sound icon, operating sound, and voice sound different from each other in attribute. Thus, the machine can be easily and securely operated without using eyes. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus operating device, a program and a recording medium, and an image forming apparatus, and more particularly, to the functions provided by a copying machine, a facsimile apparatus, a printer apparatus, a scanner apparatus and their OA equipment. In various operations in a multifunction machine integrated into one unit, an equipment operating device that can be operated without using vision, a program for executing the function of the equipment operating device, and a computer-readable recording medium recording the program, and The present invention relates to an image forming apparatus.

[0002]

2. Description of the Related Art In recent years, a multifunction machine (hereinafter, referred to as an MFP (Multi-Fu) that integrates the functions provided by a copying machine, a facsimile machine, a printer machine, a scanner machine, and OA equipment thereof.
devices such as nctionPeripherals)) have dramatically expanded the functions that can be handled due to the introduction of digital technology, etc., and it has become impossible to operate only with the numeric keypad and function keys.Therefore, a touch panel is provided on the display and the operation procedure is displayed on the screen. Characters and pictures showing the input location are displayed,
A touch panel input method in which a user inputs data by touching a preset input area corresponding to a picture is widely used.

[0003]

[Problems to be Solved by the Invention] From the standpoint of promoting social advancement for persons with physical disabilities, it is desirable to provide an office environment in which persons with physical disabilities can work in the same manner as sighted persons. Rehabilitation Act 5 in the United States
Article 08 came into effect on June 21, 2001, and the US federal government has an obligation to purchase equipment that can be used by people with disabilities in IT equipment procurement, and state governments, related facilities, and private companies are following suit. ing.

The operation of the MFP as described above tends to become more complicated, and it becomes difficult to use it properly unless the instruction is displayed on the display panel or the touch panel. Especially for people with visual impairment, this tendency results in a decisive barrier.

For example, when a visually handicapped person operates an MFP, if he / she operates with hard keys, he / she can operate to some extent by relying on the sense of touch by memorizing the layout of the keys, but on the liquid crystal touch panel that cannot be perceived by the sense of touch. It is completely impossible to operate virtual buttons. In this operation, the operating procedure and the position of the touch area must be remembered in advance, but if the operating procedure or the position of the touch area changes, the operating procedure and the position of the touch area remembered by the user are invalid. Become. This effectively renders the MFP unusable for people with visual impairments.

In order to solve this, the above-mentioned MF
When it is determined that there is a visual impairment by inserting an ID card or earphones that records information on the visually impaired person into P, voice guidance is performed by a voice synthesizer, or Braille guidance is performed using a braille output device. There is a device to go.

For example, when applied to an automated teller machine such as an automatic teller machine or an automatic teller machine used in a financial institution, an ID card or earphones that records information about a visually impaired person is used in the automated teller machine. When it is judged that there is a visual impairment by inserting it, it has a key with braille, a braille output device that outputs arbitrary braille, and a function to output voice guidance from the handset, and voice guidance from the handset for operation guidance. By using a key with braille to select the transaction type and input the amount of money and output the result of the input using a braille device, even visually impaired persons can perform transactions by their own operations.

However, the number of users with disabilities who need these measures is very small with respect to the number of users with sighted eyes, and all devices are required to cope with people with disabilities. Too expensive to implement. Also, if an automatic transaction device that does not have a device such as a braille output device or a handset or an automatic transaction device that has a different position or usage method of the braille output device or handset exists at the same time, the user will be confused.

Further, in the "composite device" of Japanese Unexamined Patent Publication No. 10-117263, when the operator switches to the voice guide mode in the off-hook state, the voice guide to be output as voice is switched from the speaker to the handset to provide the voice guide. Does not leak to the outside, and it becomes possible to use the compound device without disturbing the people around the compound device.

[0010] Such a voice-guided setting method is easy for an operator to understand for the first time, but has a drawback in that the operation time cannot be shortened even after being familiar with the apparatus. In addition, it is not possible to freely perform operations other than the prepared operation procedure, and it is not assumed that a function equivalent to that of a sighted person will be accessed. This prevents the visually impaired from participating in society.

Further, in the "image forming system" of Japanese Patent Laid-Open No. 2000-322178, when a visually handicapped person having an ID card comes near an image forming instruction device that outputs an image forming instruction to the image forming device, ID card to ID
If the person reading the code and referring to the personal information file determines that the person with the ID code has a visual impairment, use a voice synthesizer to give voice guidance for operating the image formation instructing device. Therefore, even visually impaired persons can easily perform various operations.

In such an image forming system, a visually impaired person is registered in a personal information file, but a person who is difficult to see the contents displayed on the operation panel, such as a person with low vision or presbyopia, or a person who is short. Those who can't see the contents of the display such as those who are in a wheelchair or who are looking up at the operation panel are excluded from the target, and it is still difficult to use.

The present invention has been made in consideration of the above-mentioned circumstances, and suppresses the manufacturing cost of the device and
A device operating device capable of easily and surely performing various operations without using vision, a program for executing the function of the device operating device, a computer-readable recording medium recording the program, and image formation The purpose is to provide a device. Another object of the present invention is to provide a device that can assist a person who can operate the device and a person who cannot operate the device.

[0014]

In order to solve the above problems, the device operating apparatus according to claim 1 of the present invention, when the user operates the device, outputs an operation instruction of the user and a result thereof. It is characterized in that the device can be operated without using the visual sense by notifying by voice. Also,
According to a second aspect of the present invention, in the device operating device according to the first aspect, when the operation of the device is in progress and / or finished, the operation result is notified to the user by sound and voice. It is characterized by According to a third aspect of the present invention, in the device operating device according to the first or second aspect, setting items for the operating items of the device are arranged as a hierarchical menu of a hierarchical structure, and a desired setting item on the hierarchy is displayed. It is characterized in that the device is operated by moving and selecting the setting item. Also,
According to a fourth aspect of the present invention, in the device operating device according to the third aspect, the setting item has a function number.

According to a fifth aspect of the present invention, in the device operating apparatus according to the third or fourth aspect, the operation of the device is determined by moving a setting item of a hierarchical structure on a hierarchical menu by using a direction moving key. It is characterized in that the selection of the setting item is confirmed by the key. According to a sixth aspect of the present invention, in the device operating apparatus according to the third, fourth or fifth aspect, the operation of the device specifies a setting item of a hierarchical structure on a hierarchical menu by voice recognition, and presses an enter key. It is characterized in that the selection of the setting item is confirmed. According to claim 7 of the present invention, in the device operating apparatus according to claim 4, 5 or 6, the operation of the device sets the hierarchical structure on the hierarchical menu by designating the function number by voice recognition. It is characterized in that an item is designated and the selection of the setting item is confirmed by the confirmation key. According to claim 8 of the present invention, in the device operating device according to claim 4, 5, 6 or 7, the operation of the device is performed by specifying the function number with a ten-key pad to create a hierarchical structure on a hierarchical menu. It is characterized in that a setting item is designated and the selection of the setting item is confirmed by the confirmation key.

According to a ninth aspect of the present invention, in the device operating apparatus according to any one of the third to eighth aspects, the sound output as the operation result is a sound icon corresponding to the type of the setting item. Is characterized in that. According to a tenth aspect of the present invention, in the device operating apparatus according to any one of the third to ninth aspects, the sound output as the operation result is an operation sound or a BGM that differs depending on the moving place on the hierarchy. It is characterized by outputting. According to claim 11 of the present invention, in the device operating device according to claim 9 or 10, the sound icon, the operation sound or the B
It is characterized in that the attribute of the sound is made different when the GM is output. In addition, claim 12 of the present invention is claim 3
In the device operating device according to any one of 1 to 11,
It is characterized in that the setting item name and the setting value of the setting item on the hierarchy moved by the operation are read aloud.

The thirteenth aspect of the present invention includes the twelfth aspect.
In the device operating device according to the item (1), when the setting item name or the function number is read aloud, a change in a sound attribute is added to the read voice. According to a fourteenth aspect of the present invention, in the device operating apparatus according to the thirteenth aspect, a setting item whose setting is currently invalid is read aloud with a voice lower than that of the setting item that can be selected or set. To do. A fifteenth aspect of the present invention is the apparatus operating device according to the thirteenth or fourteenth aspects, wherein,
The feature is that the selected or set setting item is read out with a higher voice than the setting item not selected or set. According to claim 16 of the present invention, in the equipment operating device according to claim 13, 14 or 15, an item set to present a new selection or setting item by selection or setting at present. The feature is that the sound is read aloud with reverberation.

A seventeenth aspect of the present invention is characterized in that, in the equipment operating device according to any one of the third to sixteenth aspects, BGM is output until the setting item is input. Further, claim 18 of the present invention includes claims 3 to 1.
In the device operating device according to any one of 7 above, when a confirmation operation is performed on each of the setting items, the setting content of the setting item is notified by voice. Further, in a nineteenth aspect of the present invention, in the equipment operating device according to any one of the third to eighteenth aspects, when a collective confirmation operation is performed, the preset items are sequentially moved to the setting item whose default value is changed, The feature is that the change in the setting contents is notified by voice. According to a twentieth aspect of the present invention, in the device operating device according to any one of the third to nineteenth aspects, a setting value of a setting item of a layer below a position currently being operated on the layer menu is a default value. When a return operation is performed, it is characterized by inquiring by voice whether each setting item may be returned to the default value. According to claim 21 of the present invention, in the device operating device according to claims 3 to 19, an operation of returning the setting value of the setting item of the hierarchy below the position currently being operated on the hierarchy menu to the default value is performed. When it is performed, it is characterized by inquiring by voice whether all the setting items in the hierarchy or below may be returned to the default values. A twenty-second aspect of the present invention is the device operating apparatus according to any one of the second to twenty-first aspects, further including a visual display device, and when the selection of the setting item is confirmed, the confirmed setting item is set. The device operating device is characterized in that the contents are confirmed by voice and the contents confirmed at this time are also displayed on the visual display device. A twenty-third aspect of the present invention is the device operating apparatus according to any one of the third to twenty-second aspects, further comprising a visual input device, and the visual input device is provided with respect to a setting status displayed on the visual display device. It is also characterized in that the user is notified by sound and voice even when input from.

A program according to a twenty-fourth aspect of the present invention is a program for causing a computer to function as the equipment operating device according to any one of the first to twenty-third aspects. A recording medium according to a twenty-fifth aspect of the present invention is a computer-readable recording medium recording the device operation program according to the twenty-fourth aspect. Further, an image forming apparatus according to a twenty-sixth aspect of the present invention is characterized in that the image forming apparatus is operated by using the equipment operating device according to any one of the first to twenty-third aspects without using a visual sense. .

Therefore, the manufacturing cost of the device can be suppressed, and various operations can be easily and surely performed without using the eyes. Further, it is possible to provide a device in which an operable person can easily assist an inoperable person.

Further, the position of the item in the hierarchical menu and the state of the item at the position are presented to the user intuitively and in a short time by changing the audio attribute. The operation comprehension and efficiency are improved.

[0022]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described in detail below with reference to the drawings. In the description of the present embodiment, the device operating apparatus of the present invention is referred to as an MFP (digital multifunction peripheral:
Multi-Function Peripherals). However, the device operation device according to the present invention is not limited to be incorporated in the MFP, and the same effect can be expected by incorporating the device having various functions.

A. M incorporating the device operating device of the present invention
FP FIG. 1 is a block diagram of an MFP incorporating the device operating apparatus of the present invention. In FIG. 1, an MFP 100 is a host connection device 101, F for connecting a host and an MFP.
FAX line connection device 10 for connecting to an AX line
2, a network connection device 103 for connecting to a network such as a LAN, an operation unit 104 for performing various setting operations of the MFP, a scanner device 105 for scanning an image from a document table to create image data, an image forming device or a feeder. A printer engine 106 including a paper discharge device, a control unit 107 for controlling the entire MFP, printer language processing, facsimile control, scanner control, user recognition processing, sound output control, image data editing processing, control for MFP operation, and the like. Storage device 10 for storing image data received by facsimile, communication records, and image data used in each function
8. A sound output device 109 such as a speaker and headphones that outputs sound and voice according to the operation result of the user.

When the printer function is used in such an MFP 100, print data transmitted from the host via the host connection device 101 or transmitted from a computer connected via the network connection device 103. The print data is temporarily stored in the reception buffer of the control controller 107,
In accordance with printer language processing, the image data is developed and sent to the printer engine 106 to execute printing. When using the copy function of the MFP 100, the scanner device 1 is instructed according to an instruction from the controller 107.
Image data read from the printer 05
The data is sent to 06 and printing is executed.

If the user is a person who can freely handle the MFP 100, a copy instruction is given according to the picture information displayed on the operation panel of the operation unit 104, and the image data read by the scanner device 105 is displayed. The image data is once stored in the storage device 108, the image data is edited by the controller 107 to edit the image data, the plural images are superposed, and the image data is printed by the printer engine 106 or the FAX line. It is possible to perform FAX transmission by the connection device 102. When the user is a person who cannot freely handle the MFP 100, an input device such as a numeric keypad that can be identified by the user and a sound output device 10 that outputs the operation status as a sound.
A copy instruction is given by 9 to operate the copy function.

Further, the scanner device 105 of the MFP 100
Image data read in, FAX line connection device 10
2 transmits the facsimile image data obtained through 2 or the image data obtained through the network connection device 103 to the computer through the host connection device 101 or the network connection device 103, and retransmits the image data received by the application of the computer. It can also be used for processing. Further, the MFP 100 can also acquire image data from an image data server connected to the Internet via the network connection device 103 and print it by the printer engine 106.

B. Operation Unit and Operation Panel FIG. 2 shows an MFP 10 equipped with the device operation device of the present invention.
3 is a front view of the operation unit 104 at 0. FIG. Operation unit 104
A liquid crystal display (LCD) 201 and a touch panel are provided in the center of the. In the liquid crystal display unit 201,
Setting items for the functions (FAX, copy, printer, etc.) incorporated in the MFP 100 are displayed, and the user operates the MFP 100 by setting values in the displayed setting items. The function is switched by the function key 206. This liquid crystal display unit 201
On the right side of, there are various numeric keys 20 commonly used for each function.
2, clear / stop key 203, start key 204
Various keys such as are arranged. Further, a function key 206 for switching the function is provided on the left side of the liquid crystal display unit 201.

C. Outline of Operation by MFP The users of the MFP 100 are classified into the following two types. (1) People who cannot operate this MFP freely People who fall into this category are visually impaired, physically handicapped, amblyopia, presbyopia and myopia (hereinafter referred to as visually impaired) He is a person who cannot operate by looking at the screen of the liquid crystal display unit 201 of the unit 104 or the touch panel 201. Alternatively, a person who is a healthy person who selects the operation by voice or sound is also included in this classification. A person who belongs to this category is the MFP 100
When operating, the operation guidance is given by voice and sound, and this processing form of the MFP will be referred to as "non-visual mode". (2) Person who can freely operate the MFP The persons classified in this category are persons who are not included in the above (1) and are normal eyesight persons. When a person belonging to this category operates the MFP 100, the operation is performed by the liquid crystal display unit 201 and the touch panel 201 of the operation unit 104, and this processing mode of the MFP will be referred to as a “visual mode”.

The outline of the operation of the MFP 100 will be described below with reference to the "operation for copying a document".
100 users, even if any of the above-mentioned users, know where the power supply and the numeric keypad of the MFP are located, and have studied all the basic functions and operation methods of the MFP. It is assumed that there is.

First, since the MFP 100 is set to operate in the "visual mode" when the power is turned on, a user of a normal person can make various instructions by directly using the screen display of the operation unit 104 and the touch panel. And give MF
The P100 can be operated. Once the "non-visual mode" is set, the instruction from the touch panel is locked, but it can be switched at any time by issuing a "mode" switching instruction. This mode switching key is a specific key, for example, the “* key” on the numeric keypad.
You can switch by holding down for more than a fixed time (3 seconds).

On the other hand, a person who wants to operate the MFP in the "non-visual mode" presses the above mode switching key and attaches a headset equipped with headphones and a microphone to the MFP 100.
"Entered non-visual mode" by connecting to and switching from "visual mode" to "non-visual mode"
Will be notified by voice. In addition, the headset and the MFP 10
The connection with 0 may be made using wireless communication or Bluetooth.

Next, by pressing the function key 206 “Copy” (see FIG. 2) of the operation unit 104 of the MFP 100, the user is informed by voice from the headphones that “copy operation is now possible”. . Also, this MF
The P100 creates a single menu with multiple layers by classifying all the operation items that can be operated in advance according to function for each function such as FAX and copy, and further subdividing the classification. deep. For example, "Cop
The "y" functions are classified into a hierarchy as shown in FIGS. 3 and 4 (this functional classification is only a partial view).

The user uses the directional movement keys installed on the operation section 104 or keys that can substitute for the directional movement keys (hereinafter collectively referred to as directional movement keys) to trace the hierarchy of this hierarchical menu and make a desired request. After the desired setting is completed by repeating the operation of moving to the operation item (1) and selecting it or setting a value, the start key 204 is pressed to make a copy of the document.

In the process of the user operating the hierarchical menu, the user is provided with a description of the selected function and the contents of the setting items that have been set up to the present, such as voice, sound and BGM (Back G).
Since the feedback is made by round music, the MFP 100 can be operated without looking at the screen of the liquid crystal display unit 201 of the operation unit 104 or inputting from the touch panel 201. Here, the voice, sound, and BGM are set by using attributes (pitch of sound, speed of sound, type of voice (male, female, mechanical voice, etc.), sound quality, tone, tone color, sound field feeling, etc.). It is changed and output according to the type of item, setting status, depth and location of hierarchy.

In addition, the liquid crystal display unit 201 of the operation unit 104 shows the selection process by the direction movement keys in the "non-visual mode".
It is displayed almost corresponding to the display screen of. Here, when the headphone is attached to the “visual mode” and an input instruction is given from the touch panel 201 of the operation unit 104, the operation result is fed back to the headphone,
Since it is possible to switch to the original position in the "non-visual mode" again, it becomes easier for a healthy person to assist a visually impaired person.

D. Details of Operations in this MFP (1) Structure of Hierarchical Menu All operable operation items are classified by function for each function such as FAX function, copy function, printer function, scanner function, and NetFile function handled in this MFP. A single menu having a multi-layer tree structure is created so that the classification is further subdivided, and stored in the menu database (DB).

For example, when there are more detailed setting items such as "magnification" and "duplex", "magnification" and "duplex"
Is set as one hierarchy name, and the hierarchy name to be selected such as “actual size”, “enlargement”, and “reduction” is arranged under the hierarchy, and the hierarchy name is “115%”, “93%”, etc. Subdivide until it becomes the final setting item.

The types of setting items on this hierarchical menu are as follows. -Selection item that can be selected only one in the same layer, for example, "115%" or "122" under the "Expansion" layer
% "Etc.-Toggle item that can toggle ON / OFF of the function, for example, whether to sort under the" Finisher "level, etc.-Numerical item for which a numerical value can be set. For example, in the case of the number of copies, etc. After selecting the setting item, enter the numerical value with the numeric keypad and start some action. For example, create a list of destinations registered with the FAX function.

For example, in the case of the copy function, first, as shown in FIGS. 3 and 4, the layer name of the first layer (copy number, original,
Paper, scaling, double-sided / consolidated / divided, finisher, etc.), and subdivided into the second and third layers, respectively.
Also, as shown in FIGS. 3 and 4, a numerical value corresponds to the hierarchy name and setting item of each hierarchy, and by specifying this numeral, the setting item can be directly selected without tracing each hierarchy. can do. Hereinafter, this number is referred to as "function number".

An example of the operation for making the copy result dark because the image of the original is light will be described with reference to FIG. At the time of starting the operation, the user is informed by voice of the current hierarchical name "number of copies", and the rightward movement key advances to the hierarchical name "manuscript". At this time, a voice informs that the user is at the "original" position. Next, in order to select "Density" which is a detailed classification of "Original", use the downward movement key to
Step down one level in the level menu. At this time, the user is informed by voice that he is in the "type" position.

Further, the rightward movement key is pressed in order to proceed to the hierarchical name "density" which is one of the subclassifications of "original". At this time, the user is informed by voice that he is in the "density" position.
Similarly, in order to select "dense" which is a detailed classification of "density", the downward movement key is used to move down one level in the hierarchical menu. At this time, a voice informs that the user is in the "automatic" position. Further, the rightward movement key is pressed in order to proceed to the hierarchical name “dark” which is one of the sub-classifications of “density”. At this time, the user is informed by voice that he is in the "density" position. As a result, the user's request for "copy the document darkly" has been achieved.

(2) Operation of Hierarchical Menu Next, a method of operating the hierarchical menu as described above will be described. In order to move and select the hierarchical names and setting items arranged on the hierarchical menu described above, the direction moving key or a key that can be used instead of the direction moving key is used, but in the following description, the numeric keypad 202 is used instead. . Figure 6
Indicates the function assigned to each key.

That is, the vertical movement of the hierarchy is performed by pressing the vertically arranged keys of the ten key, and the adjacent items of the same hierarchy are performed by the horizontally arranged keys of the ten key. In FIG. 6, pressing the "move upwards (" 2 ")" key moves up the hierarchy, and pressing the "move downwards (" 8 ")" moves down the hierarchy. Further, by pressing the "move left (" 4 ")" key, the same hierarchy is traced to the left, and by pressing the "move right (" 6 ")" key, the same hierarchy is traced to the right. Incidentally, the above-mentioned direction moving keys may be assigned in reverse.

When the user instructs to move to the lower layer of the hierarchical menu, if there are a plurality of lower layer setting items,
By one of the predetermined methods listed below,
Move to the next setting item.

Move to the first item in the lower layer. If none of the default values are used, for example, when selecting the type of document.・ Move to the already selected item in the lower layer. For example,
If there is an already set item in the setting items in the lower layer, the item is moved to the already set item in order to continue the setting after the item or to correct the contents of the item.・ Move to the item with the default value in the lower layer. For example, in the case of density setting, there are selection items of "light, normal, and dark", but generally, "normal" is set as the default value, so move to the setting item of the default value "normal". .

When the user operates the horizontal movement key to move the same level, if the end of the level is reached, the user moves to the opposite end of the level and cyclically moves. I do. By always moving in a certain direction, the user can find the item he or she wants to select. in this case,
The user cannot grasp how many items are in this hierarchy and is likely to get lost on the menu. Alternatively, this circulation movement may not be performed, and the movement may not be further performed when the end is reached. In this case, if the desired item has been overrun, the move key must be pressed in the opposite direction, but it is possible to know how many items are in that hierarchy.

Further, in FIG. 6, when the user does not know in which hierarchy in the middle of setting or wants to reselect from the beginning, for example, by pressing the "return to top (" 1 ") key. By pressing the button, it is possible to return from any layer to the top layer (in the example of FIG. 3, the “number of copies” of the first layer). In this case, the setting items that have been selected or set up to that point can be stored in the MFP 100, and can be moved to the items that have been set / selected so far by the move key or the confirmation key.

Further, in FIG. 6, by pressing a "direct jump (" 0 ")" key, the user can directly move to a hierarchy or item desired to be set. For example, by pressing the “direct jump” key and further inputting a function number from the ten keys, it is possible to move to the hierarchical name or item corresponding to the function number. For example,
If the user inputs a numerical value of “435” using the ten keys after pressing the “direct jump” key, the MFP 100
It is determined that the items are selected in the order of “variable magnification” → “reduction” → “71%” (see FIGS. 3 and 4).

Further, instead of inputting the function number of the item to be directly set by the "direct jump" key as described above, the "voice recognition (" 3 ")" key is pressed and the user selects "function number". , "Hierarchical name" or "Setting item name", the MFP 100 recognizes it and can move directly to the recognized item.

Further, in FIG. 6, by pressing the "partial clear (" 7 ")" key, the value of the setting item whose default value is changed among the setting items in the lower layer from the layer currently on the hierarchical menu is displayed. You can restore the default value.
When returning to the setting value, you may inquire about each setting item and only the items that may be returned may be returned to the default value, or you may inquire whether you can return all the setting items whose default values have been changed. Good. For example, now
If you are in the "Finisher" level of the level menu,
When the default value is changed in the setting items of "Sort / Stack", "Staple", and "Punch" under the hierarchy, the set value is cleared and returned to the default value.

Further, in FIG. 6, by pressing the "explanation of current position (" 9 ")" key, the level name or setting item currently on the level menu is fed back by voice. The feedback information includes, for example, a layer name or setting item name, a function number, and a set value (number of copies). For example, if the "explain current position" key is pressed after the paper has been set and confirmed to be A4 landscape, the feedback "voice paper is set to A4 landscape" is given by voice.

Further, in FIG. 2, a "setting confirmation" key 2
By pressing 05, the user can sequentially move to the setting item changed from the default value, and the setting value can be changed.

Further, in FIG. 6, when the setting of a desired setting item (end of selection or input of numerical values) is completed by operating the hierarchical menu by the above-mentioned keys, in order to confirm the setting item, “confirmation ( "#") "Key. As a result, the MFP 100 displays the content of the confirmed setting item on the screen of the liquid crystal display unit 201 of the operation unit 104.

Further, in FIG. 6, when the "mode switching (" * ") key is pressed, the current mode is switched. If the current mode is "non-visual mode", switch to "visual mode". However, if the headset remains connected, voice, sound, etc. are output to the headphones of the headset. Therefore, the headset also needs to be disconnected to fully return to "visual mode." If the current mode is the “visual mode”, the headset can be switched to the “non-visual mode” by connecting the headset to the MFP 100.

Further, the MFP 100 can recognize the non-contact type IC card, and the contents set by the above operation are stored in the IC card with an operation name, so that the IC can be stored from the next time. By designating the operation name and reading the operation content from the card, it is possible to configure so that the same operation need not be reset.

(3) Feedback of operation sound of operation result, sound icon and BGM to user When moving / selecting the hierarchical name and setting item arranged on the hierarchical menu using the ten keys as described above The confirmation of the result of the following operation is notified by outputting the operation sound, the sound icon, and the background music (BGM) to the user's headphone. Here, the sound icon is static information indicating the property of the object, and refers to a static sound (a short single sound) having different timbres for the purpose of discriminating the hierarchical name and the type of the setting item.

As for the operation sound, sounds of different tones of the same tone (chords and very short melody) are used to disambiguate the image of the operation result, and the operation and the music theory are associated with each other. For example, ascending and descending tones for up and down in the hierarchy, ups and down dissonances that make you feel uneasy at dead ends (failure to move), and a dominant to mean solution for selection and confirmation. Use motion.

For example, the operation sound for notifying the up and down movement of the layer is prepared, and the operation sound is output when the user moves to the upper and lower layers to notify that the user has moved up and down. This operation sound is different from the sound icon described above. Further, for example, if the BGM at this time is a BGM having a slow tone in the upper layer and a BGM having a faster tone in the lower layer, it is possible to recognize which side the layer is currently located. At this time,
It is possible to notify the user that the user cannot move by outputting an operation sound indicating whether or not there is a setting item in the lower layer of the destination. In addition, it is possible to inform the user of the number of setting items in the lower layer of the destination by the operation sound.

When the circular movement of the same level is not set, when the movement is instructed in the horizontal direction and there is no further movement item, the user is informed by a "dead end" operation sound. Furthermore, the user is also notified by an operation sound of "dead end" in the vertical direction of the hierarchy. Also, when a key such as move to the top, move in the horizontal direction, move directly, or press a key such as voice recognition is output, the operation sound confirming the selected operation is output, so that the user can be surely accepted the operation. I can recognize that.

Also, in the case of inputting a numerical value such as inputting the number of copies, it is possible to confirm that the numerical value is input by playing BGM until the input of the numerical value is completed.

In addition, the operating state of the MFP, for example,
"User is out of paper", "toner shortage", "paper jam", "front cover is open", etc. are notified to the user by voice. If such a state cannot be resolved immediately, if the voice is interrupted, the state cannot be grasped. For example, when the user is away from the apparatus while the copying operation is being performed and "a paper jam occurs", the user does not know only by this voice. However, if BGM is played after the voice, the user can recognize even in such a state.

Also, when the user designates 40 copies, the BGM is sent so that the user can recognize how much copying is finished, and the user can use the BGM.
Depending on which side of M is heard, it is possible to know how far copying has progressed.

In this way, by notifying the user with the operation sound or the BGM, the sound name indicating the hierarchy name and the type of the setting item, which makes the operation image clear to the user, it is possible to know the current state of the user. It is possible to recognize, and it is possible to reduce anxiety about whether or not the input is made surely or the operation is completed.

(4) Feedback to the user by voice of the operation result As described above, when the hierarchical name or setting item arranged on the hierarchical menu is moved / selected using the ten keys,
By outputting from the headphones also by voice,
By confirming the operation result with the user, the user can recognize whether the input and the operation result have been surely made, and anxiety can be reduced. The voice at this time was placed by the user by changing the attributes of the voice (pitch, voice type, sound quality, tone, tone color, speech speed, sound field feeling) according to the situation and feeding back. The situation can be grasped intuitively.

First, when a hierarchical menu is traced by a moving operation to reach a hierarchical name or a setting item, the hierarchical name or setting item is voice-fed with a predetermined content.
For example, when moving to a setting item such as “enlarge” or “114%”, the item name is read aloud. This allows the user to recognize which setting item the user has moved to.

When reading out the item name, the already selected item is read out with a voice higher than that of the unselected item. This gives a highly active image to the user and informs that the item is currently selected, more quickly and intuitively than by using a linguistic expression.

For example, in the hierarchical menus of FIGS. 3 and 4, any one of the “magnification” and the “magnification” under the “magnification” should be selected. If the user can know which one is selected, it is possible to save the waste of selecting "one size" even though "one size" is selected. For items such as “manuscript size mixed loading” that switch ON / OFF by selection, it must be known whether it is currently selected (that is, ON) or not (that is, OFF). For example, you cannot set it to your desired state.

When reading the item name, the invalid item is read by a voice lower than that of the valid item. This gives the user an image of low activity,
The fact that the item is currently invalid can be communicated more quickly and intuitively than by verbal expression. The selection of an item may affect other items, resulting in a situation where other items cannot be selected.

For example, when "automatic" or "tray 1" is selected for "paper", it is not effective to select "paper type of manual paper". At this time, if it is not possible to make a selection but it is possible to move to or select the item, this may give the user the misunderstanding that the item can be selected, which may cause confusion. However, if the item is temporarily deleted from the hierarchical menu or is not moved, the structure of the hierarchical menu will change dynamically, and for users who only understand the menu structure auditorily. It is difficult to understand why the menu structure has changed, which causes confusion.

At the time of reading aloud as described above, the amount of change above and below the pitch of the voice must be distinguishable from the normal pitch.
In addition, it is necessary to keep the utterance content within a range that can be clearly heard. For example, in consideration of the sound range in normal natural speech and the sound range in which clarity can be secured by voice synthesis, a change amount of about a half octave is given.

Further, when reading out the item name, reverberation is added to the item name having the item in the lower hierarchy and output. This gives the user a lingering image, and it is possible to convey that there is an item group that is further subdivided after the item, more quickly and intuitively than by using a linguistic expression. For example, the items on the hierarchical menu include those that do not have a lower hierarchy such as “actual size” and those that have a sub-classification item of a lower hierarchy such as “magnification”. To understand this difference without actually moving to a lower layer makes the work of moving the hierarchical menu by the user clearer.

The addition of reverberation can be realized, for example, by passing the output of the synthesized voice through the delay device and the attenuator and then adding it to the synthesized voice. In this case, the control parameters are the delay time of the delay device and the attenuation amount of the attenuator, but they are experimentally determined in consideration of improving the distinctiveness from normal voice and ensuring the clarity of voice. .

When the "partial clear (" 7 ") key is pressed, is it OK to read the setting change made to the setting item in the lower layer from the current position on the hierarchical menu and restore it to the default value? Inquire by voice. At this time,
Instead of inquiring whether or not to return the set values to the default values one by one, inquire whether all the setting items in the lower layers can be returned to the default values. If OK, return them to the default values at once. Good.

By pressing the "explain current position (" 9 ")" key, which setting item is currently on the hierarchical menu, information such as the setting item name and setting value for the setting item is provided. Feedback is given by voice with a predetermined content. For example, if you press the "Explanation of current position" key after confirming that "Paper" is set to "A4 landscape", "Paper is A
It is set to 4 horizontal. "

When the selection of the setting item is completed and the confirmation operation is performed by the "confirmation ("#") key, the confirmed content is fed back by the voice of the predetermined content. For example, when "200%" is selected / confirmed in "Enlargement", there is a voice feedback saying "Magnification was set to 200% enlargement".

When the setting confirmation key is pressed, the setting items which are below the setting items (including the intermediate layer) on the current hierarchical menu and the user has changed the setting from the default value are collectively voiced. Read aloud at. At this time, instead of giving voice feedback to all setting items at once,
Voice feedback for each setting item, if there is an error in the setting item, correct it, operate the move key to move to the next changed setting item, and finally press the enter key to finalize it. You may Also, if you want to know all the setting items that have been changed from the default values, move to the top of the hierarchical menu with the "Return to top (" 1 ") key and then press this setting confirmation key. You can check it.

When the setting of each setting item is completed and the start key is pressed, when the operation of the MFP is completed, a voice feedback having a predetermined content for notifying the success or failure of the operation is performed. For example, the results such as “copying is completed when the magnification is changed by 122%” and “copying could not be performed due to paper jam” are voice-feedbacked.

Further, during operation or operation, the state of the MFP is changed by the voice of the speaker different from the voice at the time of operating the setting items described above. Notify the user that "Toner is running low", "Paper jam has occurred", "Front cover is open", etc.

By providing the knobs for changing the attributes of the voice (pitch, voice type, sound quality, tone, tone color, voice speed, sound field feeling) by the above-mentioned voice feedback, a voice output that is easy for the user to hear. Can be Further, without waiting for the end of the voice feedback, the speech speed is automatically increased when the next key operation is performed, so that the user's irritability can be reduced.

By providing such a hierarchical menu structure and guidance by sound icons, operation sounds, BGM, and voice, the user can get accustomed to the operation by practicing for about 5 minutes when handling the MFP for the first time.

The operation result by the user described above is displayed in the MFP 1
00 is displayed almost in synchronization with the screen of the liquid crystal display unit 201, and based on the display, input can also be made from the touch panel 201 so that a normal person can assist a visually impaired person, It is also possible for people to see and operate the screen. For example, when the user becomes uncertain about the operation on the way, he or she can select a setting item on the touch panel with the assistance of a healthy person, and the setting is a sound icon,
Since the operation sound or voice is output to the headphones, even a visually impaired user or the like can know what has been set.

(5) Example of Operation Next, an example of operation for setting the number of copies to “2” using the above-mentioned MFP and completing the operation will be described. First, when the hierarchical menu is operated to move to the “copy number”, the setting item name “copy number” is read aloud from the headphone after the sound icon “(pylon) copy number”. At this time, since there is no hierarchy below the "number of copies", reverberation is not added. When the user presses the “Enter (“ # ”)” key, the headphone prompts the user to enter the number of copies following the sound icon “Enter the number of copies using the (calan) numeric keypad and press the Enter key” from the headphones. , BGM flows while inputting the number of copies. The user uses the numeric keypad to
Pressing "2" reads the number entered from the headphones, and when the user presses the "Confirm ("#") key, the headphone reads" (calan) is set to 2 "
Is heard. Here, the sounds of "(pyron)" and "(caran)" indicate operation sounds. After that, when the user presses the start key, BGM is played while copying from the headphones, and when it is finished, there is a voice guidance saying "two copies are finished".

E. Functional Configuration in MFP FIG. 7 is a functional configuration diagram of an MFP incorporating the device operating apparatus of the present invention. The MFP shown in FIG. 7 has a control unit 300 that performs execution control according to an instruction from a user and a support unit 400 that performs voice recognition and voice synthesis processing according to an instruction from the control unit 300.
Composed of and.

The control unit 300 includes a function control unit 310,
Operation control unit 320, operation input unit 330, visual input unit 34
0, a visual display unit 350, a menu control unit 360, a menu database (DB) 365, a voice input unit 370, a sound output unit 380, and a function execution unit 390.

The function control section 310 determines whether to use the visual mode or the non-visual mode, prompts the user to use which function such as a copy function or a facsimile function, and operates for that. Performs initial settings and overall control. Further, the function control unit 310 is normally in the visual mode, and controls the non-visual mode when the user inserts the headset including the headphones and the microphone by pressing the mode switching key.

The operation control section 320 controls various input operations by the user and operations such as displaying the processing result. The operation input unit 330 inputs numbers and the like from the ten keys. Further, in the non-visual mode, the operation input unit 330 gives various operation instructions from a direction key for moving the hierarchical structure of the hierarchical menu, various keys for selecting and confirming setting items, and a numeric keypad for inputting numbers. input. In the non-visual mode, the following information of the input function number and the type of the input numeric keypad are passed to the menu control unit 360 according to the type of the input numeric keypad.

(1) Direction key The input function number is set by performing the following operation on the function number corresponding to the layer name or setting item at the current layer menu position. This is because the structure of the function number is increased by 10 each time the hierarchy is lowered by 1, and is increased by 1 in the same hierarchy.・ Upward move (“2”) key input function number = current function number / 10 · Downward move (“8”) key input function number = current function number × 10 + 1 · Left move (“4”) key input function Number = current function number -1 ・ Move right ("6") key input function number = current function number +1

For example, if the rightward movement key is pressed from the initial state (current function number = 1), the input function number = 1 + 1
= 2. Here, when the downward movement key is pressed, the input function number = 2 × 10 + 1 = 21. Next, when any one of the up move key, down move key, and right move key is pressed, the input function number is 2,
211 and 22.

(2) In the case of direct jump Enter the "direct jump (" 0 ")" key to make it possible to enter numerical values, and the user enters the function number corresponding to the setting item from the ten keys, and finally Press the "Confirm (#)" key. As a result, the numerical value input from the numeric keypad is set as the input function number. For example, if the user wants to move to “text / photo”, pressing “2 → 1 → 2 → #” sets the input function number = 212.

(3) In the case of voice recognition When the "voice recognition (" 3 ") key is pressed, the voice input unit 370 is activated. Then, a word representing the item name or a function number is uttered from a microphone or the like. Voice input unit 3
At 70, the voice recognition unit 410 is used to recognize the uttered voice, the recognition result is converted into a function number, and the operation input unit 3 is used.
Return to 30. Thereby, the input function number is set as the input function number. For example, when uttering "Mojishashin", if correctly recognized, the input function number = 21
It is set to 2.

When the user gives an instruction to move to the lower layer of the hierarchical menu and there are a plurality of lower layer setting items, the operation input section 330 uses one of the methods listed below to determine the next item. You may move to a setting item.・ Move to the first item in the lower layer.・ Move to the currently selected item in the lower layer.・ Move to the default item in the lower layer. In addition, when the user operates a horizontal movement key to move a setting item in the same layer, the operation input unit 330 moves to the setting item at the opposite end after the setting item at the end, Alternatively, this cyclic movement is not performed, and since there is no item to be moved further when the end is reached, it is possible to prevent further movement.

The visual input unit 340 uses a touch panel installed on the screen to generally perform input for selecting various setting items displayed on the screen in the visual mode. The setting item can be selected by temporarily switching from the non-visual mode to the visual mode. Visual display unit 35
0 displays various functions on the screen in the visual mode.
In non-visual mode, the user selects from a hierarchical menu,
Display the confirmed setting items on the screen.

The menu control section 360 manages a menu database (DB) 365 that holds hierarchical menus. When the type of the input key passed from the operation input unit 330 involves movement on the menu, it is searched whether the input function number exists in the menu DB 365, and if there is, the current function number is set as the input function number. The replacement is performed, and the processing is performed by moving to the position indicated by the setting item corresponding to the replaced function number. If the key is not moved, the key is processed.

For example, when the upward movement key is pressed in the initial state (function number = 1), the input function number = 1/10 = 0, so it is not registered in the menu DB 365. In this case, no movement occurs. Similarly, when the rightward movement key is pressed, the input function number = 1 + 1 = 2, which is registered in the menu DB 365.
Move to ("Original"). If the left move key is pressed when the function number = 21, the input function number = 21-1 = 2
Since it is 0 and the corresponding function number is not registered in the menu DB 365, the movement does not occur. Even if the function number is input by direct jump or voice recognition, if the input function number does not exist in the menu DB 365 (for example, “2 → 1 → 6 → #”), the movement does not occur.

The voice input unit 370 is activated by the operation input unit 330, inputs the setting item name and function number uttered by the user, and recognizes the voice inputted through the voice recognition unit 410. A correspondence table of setting item names and function numbers as shown in FIG. 8 is stored in the memory, and when the setting item name is input by voice recognition, the correspondence table is searched and the setting item name is set to the function number. Convert to. The voice input unit 370 delivers the recognized function number to the operation input unit 330. This allows the user to directly move to the desired setting item in the hierarchical menu.

In the non-visual mode, the sound output section 380 outputs operation sounds, voice guidance, BGM and the like indicating success or failure of various operations and function executions by the ten keys in accordance with instructions from the menu control section 360 and the operation control section 320. . The voice guidance outputs the voice generated by the voice synthesizer 420. The function execution unit 390 is the operation control unit 32.
Setting values for various setting items passed from 0 are stored in the memory of the MFP 100 determined according to the function (for example, the copy function or the facsimile function). Also,
The function is executed according to the setting value stored in the memory of the MFP 100 according to an instruction from the operation control unit 320.

Further, the support unit 400 includes a voice recognition unit 4
10, a voice synthesis unit 420, a pitch changing unit 430, and a reverberation adding unit 440. The voice recognition unit 410 is called by the voice input unit 370 and uses a voice recognition dictionary (for example, a copy dictionary) for a function (copy function or facsimile function) currently operated by the user,
The result of voice recognition of the voice uttered by the user (the setting item name of the hierarchical menu, the function number, the operation command, etc.) is returned to the voice input unit 370.

The voice synthesizing unit 420 is called from the sound output unit 380, and when performing voice feedback to the user,
Using the voice synthesis dictionary, a voice synthesized from text is instructed by the menu control unit 360, and the pitch changing unit 4
30 and the sound transformed by the reverberation adding unit 440 to the sound output unit 3
Return to 80. Here, when performing voice feedback by the sound output unit 380, the recorded voice may be used instead of performing voice synthesis from the text in the voice synthesis unit 420.

The pitch changing unit 430 lowers the pitch of the voice sent from the voice synthesizing unit 420 if the setting item instructed by the menu control unit 360 is invalid, that is, the voice with the higher fundamental frequency. If the setting item is selected, the pitch is increased, that is, the sound is output with the fundamental frequency lowered. Since the amount of change above and below the pitch is required to be distinguishable from the normal pitch, and it is necessary to keep the utterance content within a range where it can be clearly heard, the clarity is ensured by the range and voice synthesis in normal natural speech. Considering the range of sound that can be produced, give a variation of about half an octave.

The reverberation adding unit 440 adds reverberation to the voice from the voice synthesizing unit 420 or the pitch changing unit 430 if the setting item instructed by the menu control unit 360 has a lower setting item. Reverberation can be realized, for example, by passing the voice through a delay device and an attenuator and then adding the voice to the input. In this case, the control parameters are the delay time of the delay device and the attenuation amount of the attenuator, but they are experimentally determined in consideration of improving the distinctiveness from the normal voice and ensuring the clarity of the voice.

In the above configuration, the sound field feeling control is performed by the pitch control and reverberation of the voice attributes.
When reading out the setting items, the sound field feeling may be given by changing the speech speed, voice type, sound quality, and the like.
Speaking speed control can be realized by expanding / contracting the waveform in recording synthesis and expanding / contracting the phoneme duration in regular synthesis. The voice type can be changed by changing the recording source speaker in the recording synthesis and by changing the segment waveform in the rule synthesis. The sound quality control can be realized by inserting a filter after the output of the voice synthesizer and controlling the cutoff frequency.

F. Operation of MFP The operation of the MFP configured as described above will be described by taking an operation of the copy function as an example. FIG. 9 is a flowchart showing the operation for the operation of the copy function. First,
When the mode switching key is pressed (YES in step S1), the current setting mode is switched (step S1).
2) Return to step S1 to process the next operation instruction. When switching from the “visual mode” to the “non-visual mode”, it is necessary to press the mode switching key and connect the headset including the headphones and the microphone to the MFP. In addition, when switching to the "non-visual mode", the input from the touch panel is locked, and the headphone gives an audible notification of "entering the non-visual mode". On the other hand, if the current setting mode is "non-visual mode", the mode is switched to "visual mode". If the headset remains connected, this "visual mode" is temporary, and the input operated from the touch panel is output to the headphones. Only after the headset is disconnected from the MFP, it is possible to switch to the "visual mode".

When the current mode is the "visual mode" (YES in step S3), the MFP is operated by the visual input unit 340 using the touch panel 201 (step S3).
4) and returns to step S1 to process the next operation instruction.

When the current mode is the "non-visual mode", the following processing is performed. When the function key (FAX, copy, printer, scanner, net file, etc.) 206 is pressed (YES in step S5), the hierarchical menu corresponding to the pressed function is retrieved from the menu DB 365 and initialized (step S6). ), And returns to step S1 to process the next operation instruction. Here, the function key "C
If you select "opy" (see Fig. 2), you can now copy from the headphones.
And inform the user by voice.

Next, when the direction movement key (up / down / left / right) is pressed (YES in step S7), the hierarchy is moved up or down or the item is moved to the adjacent item in the same hierarchy (step S8), and the next operation instruction is processed. To do so, the process returns to step S1. The operation input unit 330 manages where in the hierarchical menu by passing the type of the input key and the input function number to the menu control unit 360.

When moving, the menu control section 360
Calls the sound output unit 380, plays the operation sound and BGM, and also outputs the setting item name by voice to notify the user that the operation is being performed reliably. The voice at this time is a voice synthesized by the voice synthesizer 420, and if the setting item is invalid, the pitch is lowered, and if the setting item is selected, the pitch is raised and read out. . Furthermore, if the setting item has a setting item in the lower layer, reverberation is added and read aloud.

When the menu control section 360 reaches the end of the hierarchical menu and cannot move further, it calls the sound output section 380 to output a "dead end" operation sound to notify the user. . When a dead end is reached in the vertical direction on the hierarchical menu, the operation sound of "dead end" is output to inform the user.

Further, the menu control section 360 calls the sound output section 380 to output the operation sound, the sound icon, and the name of the setting item moved by the move key by voice, and also the BGM corresponding to this item. . The voice at this time is a voice synthesized by the voice synthesizer 420, and if the setting item is invalid, the pitch is lowered, and if the setting item is selected, the pitch is raised and read out. . Furthermore, if the setting item has a setting item in the lower layer, reverberation is added and read aloud.

Next, when the "return to top (" 1 ")" key is pressed (YES in step S9), the process moves to the setting item in the first menu of the highest hierarchy (step S9).
10) and returns to step S1 to process the next operation instruction. The menu control unit 360 manages the current position so that the setting item is in the first menu in the highest hierarchy. At the time of this movement, the menu control unit 360 calls the sound output unit 380, outputs the sound of the sound icon and the setting item name of the movement destination, and notifies the user that the operation is correct. As for the voice at this time, the item name is changed to the voice synthesizing unit 42.
It is a voice synthesized by 0, and if the setting item is invalid, the pitch is lowered, and if the setting item is selected, the pitch is increased and read out. Furthermore, if the setting item has a setting item in the lower layer, reverberation is added and read aloud.

Next, when the "direct jump (" 0 ")" key is pressed (YES in step S11), the setting item corresponding to the subsequently input function number is moved to (step S12), and the next operation is performed. Step S1 to process the instruction
Return to. When the “direct jump (“ 0 ”)” key is pressed, the operation input unit 330 calls the sound output unit 380, and outputs the operation sound, the voice “Please input the function number”, and BGM. While this BGM is playing, the user inputs a number from the numeric keypad. The input number is read aloud via the sound output unit 380.
Finally, when the user presses the enter key (“#”), the operation input unit 330 stops the BGM flow, and the menu control unit 360 causes the operation sound and the name of the setting item of the function number just input. Is output by voice and the setting item is managed as the current position.

When the item corresponding to the designated function number is a hierarchical name, it is a voice synthesized by the voice synthesizing unit 420, and if this hierarchical name has a setting item in the lower layer, reverberation is added. If the specified function number is a setting item, the pitch is lowered if this setting item is invalid, and the pitch is raised if the setting item is selected.
Read the setting items. For example, if the user presses the key "0" and then inputs "435" using the ten-key pad, the audible feedback "High magnification has been set to 71% reduction" is given in high tone. When the setting item having the lowest function number is designated, the menu control unit 360 holds the value corresponding to the setting item as the setting value of the setting item on the menu DB, and the operation control unit 320 causes the operation executing unit to execute the function. Part 390
The setting value that has just been designated is stored in the corresponding setting item of the memory of the MFP 100 via the visual display unit 350.
To display the confirmed content on the screen of the operation unit 104.

Next, when the "voice recognition (" 3 ")" key is pressed (YES in step S13), the voice input subsequently is voice-recognized and the setting item corresponding to the recognition result is moved (step S13). S14), and returns to step S1 to process the next operation instruction. When the “voice recognition (“ 3 ”)” key is pressed, the operation input unit 330 outputs the sound output unit 380.
Is called, and a voice message "Please say the setting item name or function number" is output along with the operation sound. Subsequently, the operation input unit 330 calls the voice input unit 370, passes the recognition result obtained by recognizing the “setting item name” or the “function number” uttered by the user by the voice recognition unit 410 to the menu control unit 360, The uttered setting item is managed as the current position. At this time, the menu control unit 360 calls the sound output unit 380, outputs the sound icon and the input setting item name by voice, and notifies the user that the voice input is correctly recognized.

When the designated item name or function number is a layer name, the layer name is a voice synthesized by the voice synthesizing unit 420, and reverberation is added if this layer name has a setting item in the lower layer. If the designated function number is a setting item, the pitch is lowered if the setting item is invalid, and the pitch is increased if the setting item is selected and the setting item is read aloud. When the menu name or function number designated by voice designates the setting item at the lowest level, the menu control unit 360 displays the value corresponding to the setting item in the menu DB.
The operation control unit 320 retains the setting value of the setting item on the 365, stores the setting value that has been specified via the function executing unit 390 in the corresponding setting item of the memory of the MFP 100, and calls the visual display unit 350. Then, the confirmed contents are displayed on the screen of the operation unit 104.

Next, when the partial clear key ("7") is pressed (YES in step S15), the setting value of the setting item in the hierarchy below the current position on the hierarchy menu is returned to the default value (step S16). , To return to step S1 to process the next operation instruction. When the partial clear key (“7”) is pressed, the menu controller 360 outputs the sound output unit 38.
0 is called, and the user is audibly notified of the operation sound and the content of the command (the message "Clear the current position on the hierarchy menu and the setting items in the hierarchy below it").

Subsequently, the menu control section 360 searches for a setting item in the hierarchy below the current position on the hierarchy menu,
If the setting item has been changed from the default value, ask the user whether to read the setting value of the setting item back to the default value. When the user indicates that the setting may be changed (for example, by the confirmation key), the setting value of the setting item is returned to the default value. After that, a sound icon and a voice message of operation completion are output to notify the user that the partial clear is completed. Alternatively, instead of inquiring one by one as described above, it may be possible to collectively inquire by voice whether the set values changed from the default values may be returned to the default values.

Further, the menu control section 360 displays the setting items returned to the default values and the default values in the menu DB 365.
The operation control unit 320 holds the setting values of the above setting items.
Stores the default value of the setting item currently specified via the function executing unit 390 in the corresponding setting item in the memory of the MFP 100, and calls the visual display unit 350 to display the confirmed content on the screen of the operation unit 104. indicate.

Next, when the "explanation of current position (" 9 ")" key is pressed (YES in step S17), information on which hierarchical name or setting item of the hierarchical menu is currently present is provided (step S18), and returns to step S1 to process the next operation instruction. Menu control unit 360
When the "explain current position (" 9 ")" key is pressed, the sound output unit 380 is called, and the sound icon, the hierarchical name of the current position or the setting item name and the setting value are notified to the user by voice. To do.

When the current position is a hierarchical name, the hierarchical name is a voice synthesized by the voice synthesizing unit 420, and reverberation is added if this hierarchical name has a setting item in the lower layer. If the current position is a setting item, the pitch is lowered if the setting item is invalid, and the pitch is increased if the setting item is selected, and the setting item is read aloud.

Next, if the "confirm setting" key is pressed (YES in step S19), the user is audibly notified of the setting item name and the setting value by selecting what setting item the user has selected so far. Then (step S20), the process returns to step S1 to process the next operation instruction. Menu control unit 3
When the "Confirm setting" key is pressed, the user 60 sequentially moves from the default value to the setting item whose setting has been changed, calls the sound output unit 380, and reads out the setting item name and its setting value by voice. , Notify the user. At this time, the menu control unit 360 manages the movement destination as the current position and can correct the setting item if there is an error. Further, when the setting item is changed, the menu control unit 360 holds the changed setting item and its setting value as the setting value of the setting item on the menu DB 365, and the operation control unit 320
The setting value of the setting item just specified via the function executing unit 390 is stored in the corresponding setting item of the memory of the MFP 100, and the visual display unit 350 is called to display the confirmed content on the screen of the operation unit 104. .

Next, when the "confirm ("#") key is pressed (YES in step S21), the selection of the setting item at the current position is confirmed (step S22), and the next operation instruction is processed. Return to step S1. Menu control unit 36
0 is the sound output unit 3 when the enter key (“#”) is pressed.
80 is called, the operation sound and the determined operation content are output by voice, and the user is notified. Further, the menu control unit 360, when the setting item of the current position is confirmed,
Menu DB3 of the confirmed setting item and its setting value
The operation control unit 3 holds the setting values of the setting items on the 65.
20 stores the set value of the set item that has been settled through the function execution unit 390 in the corresponding set item of the memory of the MFP 100, and calls the visual display unit 350 to display the set content on the screen of the operation unit 104. Display to.

Finally, when the setting key for each setting item is completed and the start key is pressed (YES in step S23)
S), the selected function (copy function, facsimile function, etc.) is executed (step S24), and the process returns to step S1 to process the next operation instruction. Operation control unit 32
0 indicates that when the start key is pressed, the function execution unit 390
To activate the function initially selected by the user. For example, if the designated function is a copy function, the copy operation is performed according to the values set so far. When this operation is completed, the operation control unit 320 calls the sound output unit 380 and notifies the user of the success or failure by voice. For example, the results such as “copying is completed when the magnification is changed by 122%” and “copying could not be performed due to paper jam” are voice-feedbacked. In addition, the operation control unit 3
When the user specifies the copy of “40 copies”, the 20 plays the BGM through the sound output unit 380 so that the user can recognize how many copies have been completed, and the user It is possible to know how much processing has been completed depending on the progress of BGM.

Further, the function control section 310 monitors the state of the apparatus during the operation of the MFP, and, for example, "out of paper", "insufficient toner", "paper jam", "front cover is open", etc. In this case, call the sound output unit 380, and after the sound icon, for example, "the paper is out",
The user is notified by outputting a voice message such as "Toner is running low,""Paper jam has occurred,""Front cover is open," and BGM.

G. Other Functional Configuration of MFP In the above-described embodiments, the device operation device (control unit 300 and support unit 400) of the present invention is incorporated in the MFP. Here, as another embodiment, FIG.
As described above, the control unit 300 of the device operation device may be incorporated in the MFP, the facsimile device, the printer device, the scanner device, or the like, and the support unit 400 may be incorporated in a general-purpose computer (hereinafter, referred to as a PC). in this case,
In order to perform communication between the control unit 300 and the support unit 400, a communication unit 500 and a communication unit 600 are connected by a cable, infrared communication, wireless communication or a communication line (including a network).
Etc. to connect.

In such a configuration, the control unit 300
When performing the voice recognition process, the key information indicating that the voice recognition process is requested and the voice data input by the voice input unit 370 are transmitted to the communication unit 600 via the communication unit 500. The communication unit 600 uses the key information to recognize the voice recognition unit 4
10 is called, the previous key information is added to the voice recognition result, and the result is sent back to the communication unit 500. The communication unit 500 determines that the received data is the voice recognition result from the key information, and returns it to the voice input unit 370.

When the voice synthesis processing is performed from the control unit 300, the key information indicating the voice synthesis processing request and the text sentence to be converted into voice data by the sound output unit 380 are communicated via the communication unit 500. It is transmitted to the section 600. The communication unit 600 calls the voice synthesis unit 420 or the pitch change unit 430 or the reverberation addition unit 440 as necessary from this key information, attaches the previous key information to the voice synthesis result, and sends it back to the communication unit 600. The communication unit 600 determines that this received data is a voice synthesis result from the key information, and returns it to the sound output unit 380. When obtaining voice data, the recorded voice data may be selected according to the key information of voice data (classification of what kind of voice data is desired) instead of synthesizing voice from text. .

By thus dividing the functions between the MFP or the like and the PC, each MFP or the like does not have the dictionary information having a large amount of data and the processing functions such as the voice recognition and the voice synthesis that require a long processing time, like the support unit 400. In addition, the maintenance of the dictionary of the support unit 400, the processing system, and the PC itself can be facilitated. In such a configuration,
The cost balance is better when a plurality of MFPs and the like are connected to one PC.

H. As yet another embodiment of the functional configuration of the MFP, as shown in FIG. 11, an operation system relating to the visual mode of the device operating apparatus and an input system such as a numeric keypad in the non-visual mode are used as the MFP, the facsimile apparatus, the printer apparatus, and the scanner. It may be configured to be incorporated in a device or the like (hereinafter, referred to as an MFP) and the non-visual mode process may be incorporated in a general-purpose computer (hereinafter, referred to as a PC). In this case, the MFP and the PC are connected by a cable, infrared communication, wireless communication, a communication line (including a network), or the like in order to communicate with the PC.

In such a configuration, when the non-visual mode is selected in response to the input made on the MFP side, the various ten-key instructions input from the operation input unit 330 via the communication unit 700 are sent to the PC. It is transmitted to the operation control unit 320 on the side. The operation control unit 320 processes the received instruction, and when there is a setting item and its value for the MFP, sets a value in the memory of the MFP to the function executing unit 390 via the communication unit 700.

By thus dividing the functions between the MFP and the PC, each MFP does not need to have a non-visual mode processing system, and maintenance of the non-visual mode processing system itself can be facilitated. In the case of such a configuration, the cost balance is better when a plurality of MFPs are connected to one PC.

Further, as a modification of the embodiment of FIG. 11, mode switching, selection of functions (copy function, facsimile function, etc.), and input from the non-visual mode to the processing system as shown in FIG. May be performed by a general-purpose computer (hereinafter referred to as a PC), and setting of values for set items and execution of selected functions may be performed by the MFP side. In this case, the MFP and the PC are connected by infrared communication, wireless communication, or the like in order to communicate with each other.

Further, the PC may be a portable terminal capable of connecting a ten-key pad, a start key, a microphone and a headphone, and may be connectable to the MFP by communication such as Bluetooth. Thus M
By allowing the FP and the PC to share the functions, it is possible to minimize the change on the MFP side and customize the processing system in the non-visual mode for each user having the PC.

In such a configuration, the user with the PC goes to the vicinity of the MFP and selects the non-visual mode from the PC.
A function is selected and a hierarchical menu corresponding to the function is operated, and the setting item of the operation result, its value, and execution of the function are transmitted from the operation control unit 320 to the communication unit 700 on the MFP side. In the case of an instruction for selecting a function, the communication unit 700 sets the function of the MFP (copy function, facsimile function, etc.) by the function setting unit 710, and performs initial setting by changing the function on the MFP side. The function execution unit 390 processes the setting of items and the execution of functions. These set results are transmitted to the operation control unit 320 on the PC side via the communication unit 700, and the results are notified to the user by voice or the like.

I. Embodiment as Program Each function constituting the above-described embodiment is programmed and written in advance in a recording medium such as a CD-ROM, and this CD-ROM is installed in a medium drive device such as a CD-ROM drive. By installing it in a computer equipped with it, storing these programs in the memory or storage device of the computer, and executing them,
It goes without saying that the object of the present invention is achieved. In this case, the program itself read from the recording medium realizes the functions of the above-described embodiments, and the program and the recording medium recording the program also constitute the present invention.

The recording medium is a semiconductor medium (for example, ROM, nonvolatile memory card, etc.), optical medium (for example, DVD, MO, MD, CD-R, etc.), magnetic medium (for example, magnetic tape, flexible disk). Etc.).

Further, not only the functions of the above-described embodiments are realized by executing the loaded program, but the operating system or the like performs some or all of the actual processing based on the instructions of the program, The case where the functions of the above-described embodiments are realized by the processing is also included.

Further, a program realizing the functions of the above-described embodiments is loaded into the memory provided in the function expansion board or the function expansion unit, and the CPU provided in the function expansion board or the function expansion unit based on the instruction of the program. Includes the case where some or all of the actual processing is performed and the processing realizes the functions of the above-described embodiments.

Further, the above-mentioned program is stored in a storage device such as a magnetic disk of a server computer,
When distributed in a format such as download from a user's computer connected by a communication network, the storage device of this server computer is also included in the recording medium of the present invention.

[0138]

As described above, according to the present invention, the manufacturing cost of the device can be suppressed, and various operations can be easily and surely performed without using eyes. Also,
It is possible to provide a device in which an operable person can easily assist an inoperable person.

Further, the position of the item in the hierarchical menu and the state of the item at that position can be intuitively and quickly presented to the user by changing the audio attribute. The operation comprehension and efficiency are improved.

[Brief description of drawings]

FIG. 1 is a block diagram of an MFP incorporating a device operation device of the present invention.

FIG. 2 is a front view of an operation unit.

FIG. 3 is a diagram showing an example of a hierarchical menu relating to a copy function.

FIG. 4 is a continuation of FIG.

FIG. 5 is a diagram showing an example of expanding a hierarchical menu.

FIG. 6 is a diagram showing an example of functional layout of a numeric keypad.

FIG. 7 is a functional configuration diagram of an MFP incorporating the device operating apparatus of the present invention.

FIG. 8 is an example of a correspondence table between voice recognition results and function numbers.

FIG. 9 is a flowchart showing an operation for a copy function operation.

FIG. 10 is an MFP incorporating the device operating apparatus of the present invention.
It is another functional block diagram of.

FIG. 11 is an MFP incorporating the device operating apparatus of the present invention.
It is another functional block diagram of.

12 is a modification of the functional configuration of FIG.

[Explanation of symbols]

100 ... MFP, 101 ... Host connection device, 102 ... F
AX line connection device, 103 ... Network connection device,
104 ... Operation unit, 105 ... Scanner device, 106 ... Printer engine, 107 ... Control controller, 108 ... Storage device, 109 ... Sound output device, 201 ... Liquid crystal display unit (L
CD) and touch panel, 202 ... Numeric keypad, 203
… Clear / Stop key, 204… Start key, 20
5 ... Setting confirmation key, 206 ... Function key, 300 ... Control unit, 310 ... Function control unit, 320 ... Operation control unit, 330
... operation input unit, 340 ... visual input unit, 350 ... visual display unit, 360 ... menu control unit, 365 ... menu database (DB), 370 ... voice input unit, 380 ... sound output unit, 390 ... function execution unit, 400 ... support unit, 410 ... voice recognition unit, 420 ... voice synthesis unit, 430 ... pitch change unit,
440 ... Reverberation adding section, 500, 600, 700 ... Communication section, 710 ... Function setting section.

   ─────────────────────────────────────────────────── ─── Continued front page    F-term (reference) 2C061 AP01 AP03 AP04 AP07 BB10                       CQ32 CQ43                 2H027 EF06 EF09 EF13 FA30 FA35                       FA37 FB06 GA14 GA15 GA16                       GA30 GA34 GA35 GA39 GA48                       GA52 GA56 GB05 GB09 GB10                       GB19 GB20 ZA07 ZA10                 5C062 AA05 AB20 AB26 AB41 AC05                       AE11 AE15 AF14 BA01                 5E501 AA06 AA15 BA05 CA04 CA08                       CB05 EB05 FA05 FA22 FA32                       FA42 FA43 FB03 FB22

Claims (26)

[Claims] 1. When the user operates the device, the operation instruction of the user and the result thereof are notified by sound and voice so that the device can be operated without using the visual sense. Equipment operation device. 2. The device operating apparatus according to claim 1, wherein when the operation of the device is in progress and / or finished, the operation result is notified to the user by sound and voice. Equipment operation device. 3. The equipment operating device according to claim 1, wherein the setting items corresponding to the operation items of the equipment are arranged as a hierarchical menu of a hierarchical structure, and the desired setting item on the hierarchy is moved to and set. A device operating device characterized in that the device is operated by selecting an item. 4. The equipment operating device according to claim 3, wherein the setting item has a function number. 5. The equipment operating device according to claim 3, wherein the operation of the equipment is performed by moving a setting item of a hierarchical structure on a hierarchical menu with a direction movement key and selecting the setting item with an enter key. An apparatus operating device characterized by being confirmed. 6. The device operating apparatus according to claim 3, 4 or 5, wherein the operation of the device specifies a setting item of a hierarchical structure on a hierarchical menu by voice recognition, and selects the setting item by an enter key. An apparatus operating device characterized by: 7. The device operating apparatus according to claim 4, 5 or 6, wherein the device operation specifies a setting item of a hierarchical structure on a hierarchical menu by specifying the function number by voice recognition, An apparatus operation device characterized in that the selection of the setting item is confirmed by a confirmation key. 8. The device operating apparatus according to claim 4, 5, 6 or 7, wherein the device operation is performed by designating a setting item of a hierarchical structure on a hierarchical menu by designating the function number with a ten key. An apparatus operation device characterized in that the selection of the setting item is confirmed by the confirmation key. 9. The device operating apparatus according to claim 3, wherein the sound output as the operation result is a sound icon according to the type of the setting item. Operating device. 10. The device operating device according to claim 3, wherein the sound output as the operation result outputs a different operation sound or BGM depending on the moving place on the hierarchy. Equipment operation device. 11. The device operating device according to claim 9, wherein when the sound icon, the operation sound, or the BGM is output, the attribute of the sound is made different. 12. The device operating apparatus according to claim 3, wherein the setting item name and the setting value of the setting item on the hierarchy moved by the operation are read aloud. Operating device. 13. The equipment operating device according to claim 12, wherein when the setting item name is read aloud, a change in a sound attribute is added to the reading voice. 14. The device operating device according to claim 13, wherein a setting item whose setting is currently invalid is read aloud with a voice lower than a setting item that can be selected or set. 15. The device operating device according to claim 13 or 14, wherein the currently selected or set setting item is read out with a voice higher than that of the setting item not selected or set. Operating device. 16. The equipment operating device according to claim 13, 14 or 15, wherein reverberation is added to an item which is currently set to additionally present a new selection or setting item by selection or setting. An equipment operating device characterized by reading aloud by voice. 17. The device operating device according to claim 3, wherein the device operating device outputs BGM until the setting item is input. 18. The apparatus operating device according to claim 3, wherein when a confirmation operation is performed on each of the setting items, the setting content of the setting item is notified by voice. A device operation device characterized by the above. 19. The apparatus operating device according to claim 3, wherein when a collective confirmation operation is performed, the preset contents are sequentially moved to change the setting contents. The device operating device is characterized in that it is notified by voice. 20. The device operating device according to claim 3, further comprising an operation of returning a setting value of a setting item of a layer below a position currently being operated on the layer menu to a default value. In the case of the above, the device operating device is characterized by inquiring by voice whether or not each setting item may be returned to the default value. 21. The device operating device according to claim 3, wherein when a setting value of a setting item of a layer below a position currently being operated on the layer menu is returned to a default value, An apparatus operating device characterized by inquiring by voice whether all setting items under the hierarchy may be returned to default values. 22. The equipment operating device according to claim 3, further comprising a visual display device, and when the selection of the setting item is confirmed, the content of the confirmed setting item is voiced. An equipment operating device characterized in that the contents displayed at this time are also displayed on the visual display device together with the notification. 23. The equipment operating device according to claim 3, further comprising a visual input device, wherein a setting status displayed on the visual display device is input from the visual input device. An apparatus operating device for notifying the user by sound and voice. 24. A program for causing a computer to function as the device operating device according to claim 1. 25. A computer-readable recording medium in which the device operation program according to claim 24 is recorded. 26. An image forming apparatus, wherein the apparatus operating device according to claim 1 is used to operate the image forming apparatus without using vision.