JP4010864B2 - Image forming apparatus, program, and recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present inventionImage formationDevice, program and recording mediumTo the bodyMore specifically, in various operations in a multifunction machine that integrates functions provided by a copying machine, a facsimile machine, a printer device, a scanner device, and their OA devices, it is possible to operate without using vision.Image formationDevice, itsImage formationProgram for executing functions of apparatus and computer-readable recording medium recording the programTo the bodyRelated.
[0002]
[Prior art]
In recent years, devices such as copiers, facsimile machines, printers, scanners, and multi-function peripherals (hereinafter referred to as MFP (Multi-Function Peripherals)) that integrate the functions provided by these OA devices have become digital technology. Since the functions handled by the introduction etc. are greatly diversified and operation is not possible only with the numeric keypad and function keys, a touch panel is provided on the display, characters indicating the operation procedure, pictures indicating the input location, etc. are displayed on the screen, A touch panel input method in which a user performs input by touching an input area set in advance corresponding to a picture is widely used.
[0003]
[Problems to be solved by the invention]
From the viewpoint of promoting social advancement of persons with physical disabilities, it is desirable to prepare an office environment in which persons with physical disabilities can work in the same way as sighted persons. Effective on June 21, 2013, the US federal government is obligated to purchase equipment that can be used by people with disabilities in IT equipment procurement, and the state government, related facilities, and private companies are also following up.
[0004]
In the MFP as described above, the operation tends to become more complicated, and it is difficult to use it correctly unless instructions are displayed on a display panel, a touch panel or the like. This tendency results in a decisive barrier, especially for those with visual impairments.
[0005]
For example, when a visually handicapped person operates an MFP, if it is an operation using hard keys, a key button on the liquid crystal touch panel that cannot be perceived by tactile sensation can be used to some extent by remembering the key arrangement. It is absolutely impossible to operate. In this operation, it is necessary to remember the operation procedure and the position of the touch area in advance, but if the operation procedure or the position of the touch area changes, the operation procedure or the touch area position that the user has learned is invalid. Become.
This makes the MFP virtually unusable for those who are visually impaired.
[0006]
In order to solve this problem, an audio guide is provided by the voice synthesizer when it is determined that there is a visual impairment by inserting an ID card or earphone in which information on the visually impaired is recorded into the MFP as described above. There is a device that performs Braille guide using a Braille output device.
[0007]
For example, when it is applied to an automatic transaction device such as an automatic teller machine or an automatic teller machine used in a financial institution, an ID card or an earphone that records information on a visually handicapped person is inserted into the automatic transaction device. When it is determined that there is a visual impairment, it is equipped with a key with braille, a braille output device that outputs arbitrary braille, and a function to output voice guidance from the handset, and operation guidance is performed by voice guidance from the handset, By selecting the transaction type and inputting the amount with a key with Braille, and outputting the input result by a Braille device, even a visually handicapped person can perform the transaction by his own operation.
[0008]
However, the number of users with disabilities who need these measures is very small compared to the number of users with sighted people. Is too expensive.
In addition, if there are automatic transaction apparatuses that are not equipped with devices such as a Braille output device and a handset, and automatic transaction devices that have different positions and usages of the Braille output device and the handset, the user will be confused.
[0009]
In addition, in the “composite device” disclosed in Japanese Patent Laid-Open No. 10-117263, when the operator switches to the voice guide mode in the off-hook state, the voice guide to be output is switched from the speaker to the handset, and the voice guide is externally provided. Will not leak, and the compound device can be used without inconvenience the people around the compound device.
[0010]
Such a setting method using voice guidance is easy to understand when the operator is first, but has a drawback that the operation time cannot be shortened even after the user has mastered the device. In addition, operations other than the prepared operation procedure cannot be freely performed, and access to functions equivalent to those of sighted persons is not assumed. This is the basis for visually impaired people's participation in society.
[0011]
Further, in the “image forming system” disclosed in Japanese Patent Laid-Open No. 2000-322178, when a visually handicapped person having an ID card comes in the vicinity of an image forming instruction device that outputs an image forming command to the image forming device, the ID card When an ID code is read and a personal information file is referred to and it is determined that a person with the ID code has a visual impairment, operation guidance in the image formation instruction apparatus is guided by voice using a voice synthesizer. Thus, even a visually handicapped person can easily perform various operations.
[0012]
In such an image forming system, people with visual impairments are registered in a personal information file. A person who looks up at the operation panel like a person who rides and cannot see the display content is excluded, and it is still difficult to use.
[0013]
  The present invention has been made in consideration of the above-described circumstances, and can reduce the manufacturing cost of the apparatus and can easily and reliably perform various operations without using vision.Image formationDevice, itsImage formationProgram for executing functions of apparatus and computer-readable recording medium recording the programBodyThe purpose is to provide.
  Another object of the present invention is to provide an apparatus that can easily assist a person who can operate the apparatus.
[0014]
[Means for Solving the Problems]
  In order to solve the above-mentioned problem, the claim 1 of the present inventionImage formationThe deviceFor each function of the image forming device, set up a hierarchical menu that classifies from the top layer classification to the bottom layer setting items so that all the operation items that can be operated have a multi-level tree structure. A function number is assigned to each node consisting of classification or setting items, menu storage means for storing this tree structure, a numeric keypad for designating a number, and a classification or function corresponding to the function number designated by the numeric keypad. Menu control means for obtaining a setting item from the menu storage means and moving the next operation position to the classification or setting item of the hierarchical menu;The feature is that the device can be operated without using vision.
  Moreover, Claim 2 of this invention is described in Claim 1.Image formationIn the deviceThe menu control means is operatedWhen is in progress and / or finishedoperationNotify the user by sound and voiceRukoAnd featuresThe
[0015]
  Further, the claims of the present invention3Claims1 or 2Described inImage formationIn the deviceThe menu control meansIs characterized in that the setting item of the hierarchical structure on the hierarchical menu is moved by the direction movement key, and the selection of the setting item is confirmed by the confirmation key.
  Further, the claims of the present invention4ClaimsAny one of 1 to 3Described inImage formationIn the deviceThe menu control meansIs characterized by designating a setting item of a hierarchical structure on a hierarchical menu by voice recognition and confirming selection of the setting item by a confirmation key.
  Further, the claims of the present invention5ClaimsAny one of 1 to 3Described inImage formationIn the deviceThe menu control meansSounds the function numberTo voiceTherefore, the setting item of the hierarchical structure on the hierarchical menu is specified by specifying, and the selection of the setting item is determined by the confirmation key.
  Further, the claims of the present invention6ClaimsAny one of 1 to 3Described inImage formationIn the deviceThe menu control meansIsIt was synthesized from the position on the tree structure that was moved by the direction key to follow the tree structure.A setting item of a hierarchical structure on a hierarchical menu is specified by specifying a function number, and selection of the setting item is determined by a confirmation key.
[0016]
  Further, the claims of the present invention7Claims2Described inImage formationIn the apparatus, the sound output as the operation result is a sound icon corresponding to a type of the setting item.
  Further, the claims of the present invention8Claims2Described inImage formationIn the apparatus, the sound output as the operation result outputs an operation sound or BGM that varies depending on a moving place on the hierarchy.
  Further, the claims of the present invention9Claims7Or8Described inImage formationIn the deviceThe menu control means includesWhen the sound icon, the operation sound, or the BGM is output, the sound attribute is made different.
  Moreover, Claim 1 of this invention0Claims1Thru9Any one ofImage formationIn the deviceThe menu control means includesThe setting item name and setting value of the setting item on the hierarchy moved by the operation is read out by voice.
[0017]
  Moreover, Claim 1 of this invention1Claim 10Described inImage formationIn the apparatus, when the setting item name is read out, a change in sound attribute is added to the read-out voice.
  Moreover, Claim 1 of this invention2Claim 11Described inImage formationIn the apparatus, a setting item whose setting is currently invalid is read out with a lower voice than a setting item that can be selected or set.
  Moreover, Claim 1 of this invention3Claim 11Or 12Described inImage formationIn the apparatus, a setting item that is currently selected or set is read out with a higher voice than a setting item that is not selected or set.
  Moreover, Claim 1 of this invention4Claim 1112Or 13Described inImage formationThe apparatus is characterized in that it reads out with a sound in which a reverberation sound is added to an item that is set to present a new selection or setting item by selection or setting.
[0018]
  Moreover, Claim 1 of this invention5Claims114Any one ofImage formationIn the deviceThe menu control means includesBGM is output until the setting item is input.
  Moreover, Claim 1 of this invention6Claims115Any one ofImage formationIn the deviceThe menu control means includesWhen a confirmation operation is performed on each setting item, the setting contents of the setting item are notified by voice.RukoAnd features.
  Moreover, Claim 1 of this invention7Claims116Any one ofImage formationIn the deviceThe menu control means includesWhen a batch confirmation operation is performed, the setting items whose default values have been changed are sequentially moved to notify the change of the setting contents by voice.RukoAnd features.
  Further, the claims of the present invention18Claims117Any one ofImage formationIn the deviceThe menu control means includesWhen an operation for returning the setting value of a setting item in a hierarchy below the current operation position on the hierarchy menu to a default value is performed, an inquiry is made by voice as to whether or not the setting value can be returned to the default value for each setting item. And
  Further, the claims of the present invention19Claims117Described inImage formationIn the deviceThe menu control means includesWhen an operation is performed to return the setting value of a setting item in the hierarchy below the position currently being operated on the hierarchy menu to the default value, whether or not all the setting items in the hierarchy menu may be returned to the default value by voice It is characterized by inquiring.
  Moreover, Claim 2 of this invention0Claims1Thru19Any one ofImage formationThe device comprises a visual display device,The menu control means includesWhen the selection of the setting item is confirmed, the content of the confirmed setting item is notified by voice, and the confirmed content is also displayed on this visual display device.RukoAnd featuresThe
  Moreover, Claim 2 of this invention1Claims120Any one ofImage formationThe apparatus includes a visual input device, and the user is notified by sound and voice even when the setting status displayed on the visual display device is input from the visual input device.
[0019]
  Moreover, Claim 2 of this invention2The computer program comprises a computer.1As described in any one ofImage formationapparatusEach meansIt is a program to make it function as.
  Moreover, Claim 2 of this invention3The recording medium of claim 22Described inNoA computer-readable recording medium that records a programThe
[0020]
Therefore, the manufacturing cost of the apparatus can be reduced, and various operations can be easily and reliably performed without using vision.
In addition, it is possible to provide a device that can be easily operated by a person who can operate the person who cannot perform the operation.
[0021]
In addition, by changing the audio attributes, you can intuitively present the user to the position of the item in the hierarchical menu and the state of the item at that position. Improve understanding and efficiency.
[0022]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
In the description of the present embodiment, it is assumed that the device operating device of the present invention is incorporated into an MFP (Multi-Function Peripherals). However, the installation target of the device operating device of the present invention is not limited to the MFP, and a similar effect can be expected by incorporating any device having diversified functions.
[0023]
A. MFP incorporating the device operating device of the present invention
FIG. 1 is a block diagram of an MFP incorporating an apparatus operating device according to the present invention.
1, an MFP 100 includes a host connection device 101 for connecting a host and the MFP, a FAX line connection device 102 for connecting to a FAX line, a network connection device 103 for connecting to a network such as a LAN, and the MFP. An operation unit 104 for performing various setting operations, a scanner device 105 that scans an image from a document table and creates image data, a printer engine 106 including an image forming device and a paper supply / discharge device, control of the entire MFP, printer language processing , Facsimile control, scanner control, user recognition processing, sound output control, image data editing processing, control for MFP operation, and the like, image data received by facsimile, communication record and image data used in each function are stored Storage device 108, sound and sound according to the operation result of the user Speaker for outputting voices, made from the sound output device 109 such as headphones.
[0024]
In such an MFP 100, when the printer function is used, print data transmitted from the host via the host connection device 101 or print data transmitted from a computer connected via the network connection device 103 is received. The data is temporarily stored in the reception buffer of the control controller 107, developed into image data by the control controller 107 in accordance with printer language processing, sent to the printer engine 106, and printing is executed.
When using the copy function of the MFP 100, printing is executed by sending the image data read from the scanner device 105 to the printer engine 106 in accordance with an instruction from the controller 107.
[0025]
If the user is a person who can handle this MFP 100 freely, a copy instruction is given according to the picture information displayed on the operation panel of the operation unit 104, and the image data read by the scanner device 105 is temporarily stored in the storage device. 108, the image data is edited by the control controller 107, the image data is edited, and a plurality of images are overlapped. Then, the image data is printed by the printer engine 106, or connected to the FAX line. 102 can be FAX-transmitted.
If the user cannot handle the MFP 100 freely, a copy instruction is given by the input device such as a numeric keypad and the sound output device 109 that outputs the operation status as sound. Operate functions.
[0026]
Further, image data read by the scanner device 105 of the MFP 100, facsimile image data obtained via the FAX line connection device 102, and image data obtained via the network connection device 103 are converted into the host connection device 101 and the network connection device 103. It can also be used to reprocess the image data sent to the computer via the computer and received by the computer application.
Further, the MFP 100 can obtain image data from an image data server connected to the Internet via the network connection device 103 and print it by the printer engine 106.
[0027]
B. Operation unit and operation panel
FIG. 2 is a front view of the operation unit 104 in the MFP 100 in which the device operation apparatus of the present invention is mounted.
In the center of the operation unit 104, a liquid crystal display unit (LCD) 201 and a touch panel are provided. The liquid crystal display unit 201 displays setting items for functions (FAX, copy, printer, etc.) incorporated in the MFP 100, and the user sets a value in the displayed setting item to thereby display the setting items of the MFP 100. Perform the operation. The function is switched by the function key 206.
On the right side of the liquid crystal display unit 201, various keys such as a numeric keypad 202, a clear / stop key 203, and a start key 204 that are commonly used for each function are arranged.
A function key 206 for switching functions is provided on the left side of the liquid crystal display unit 201.
[0028]
C. Overview of MFP operations
Users of the MFP 100 are classified into the following two types.
(1) Person who cannot operate this MFP freely
A person classified as such is a screen or a touch panel of the liquid crystal display unit 201 of the operation unit 104 such as a visually handicapped person, a physically handicapped person, a weakly sighted person, a presbyopia / myopic person (hereinafter referred to as a visually handicapped person). It is a person who cannot see and operate 201.
Or even if it is a healthy person, the person who selected the operation by voice or sound is also included in this classification.
When a person belonging to this category operates the MFP 100, guidance for operation is performed by voice and sound. This processing mode of the MFP is referred to as “non-visual mode”.
(2) Person who can operate this MFP freely
The person classified into this is a person who is not included in the above (1) and is a normal person who is sighted.
When a person belonging to this category operates the MFP 100, the operation is performed by the liquid crystal display unit 201 and the touch panel 201 of the operation unit 104. This processing mode of the MFP is referred to as a “visual mode”.
[0029]
Hereinafter, an outline of the operation of MFP 100 will be described using “operation for copying a document”. Regardless of the above-mentioned user, the user of MFP 100 can use any power source or numeric keypad of MFP. It is assumed that you know whether or not you have a basic function and operation method of the MFP.
[0030]
First, when the MFP 100 is turned on, it is set to operate in the “visual mode”. Therefore, a healthy user gives various instructions as it is through the screen display of the operation unit 104 and the touch panel. The MFP 100 can be operated.
Once the “non-visual mode” is set, the instruction from the touch panel is locked, but can be switched at any time by issuing a “mode” switching instruction. This mode switching key can be switched by continuously pressing a specific key, for example, the “* key” of the numeric keypad for a predetermined time (3 seconds) or more.
[0031]
On the other hand, a person who wants to operate the MFP in the “non-visual mode” presses the mode switching key, connects a headset including a headphone and a microphone to the MFP 100, and changes from the “visual mode” to the “non-visual mode”. By switching to, the voice notification “entered non-visual mode” is given.
In addition, the connection between the headset and the MFP 100 may be performed using wireless communication or Bluetooth.
[0032]
Next, by depressing the function key 206 “Copy” (see FIG. 2) of the operation unit 104 of the MFP 100, the user is notified by voice that “copy operation is now possible” from the headphones.
In addition, the MFP 100 classifies all the operation items that can be operated in advance for each function such as FAX and copy, and classifies the classification into functions, and further subdivides the classification into a single menu having multiple layers. Create it.
For example, the “Copy” function is classified into a hierarchy as shown in FIG. 3 and FIG. 4 (this function classification only shows a part).
[0033]
The user uses a direction movement key installed in the operation unit 104 or a key that can be substituted for this direction movement key (hereinafter, collectively referred to as a direction movement key) to trace a desired operation item in the hierarchy menu. After the desired setting is completed by repeating the operation of selecting and setting the value, the copy of the document is created by pressing the start key 204.
[0034]
As the user operates the hierarchical menu, the explanation of the selected function and the contents of the setting items set so far are fed back to the user by voice, sound or BGM (Back Ground Music). The MFP 100 can be operated without looking at the screen of the liquid crystal display unit 201 of the operation unit 104 or inputting from the touch panel 201.
Here, voice, sound and BGM are set using attributes (sound pitch, sound speed, voice type (male, female, mechanical voice, etc.), sound quality, tone, tone, sound field feeling, etc.) The output is changed according to the type and setting status of the item and the depth and location of the hierarchy.
[0035]
Further, the selection process by the direction movement key in the “non-visual mode” is displayed on the display screen of the liquid crystal display unit 201 of the operation unit 104 in a substantially correlated manner.
Here, when the headphone is turned on and the mode is shifted to the “visual mode” and an input instruction is given from the touch panel 201 of the operation unit 104, the operation result is fed back to the headphones, and the original “non-visual mode” is once again entered. Since it can switch to a position, it becomes easy for a healthy person to assist a visually impaired person etc.
[0036]
D. Details of operations on this MFP
(1) Structure of hierarchical menu
A multi-layered structure in which all the operation items that can be operated are classified by function for each function such as FAX function, copy function, printer function, scanner function, and NetFile function handled by this MFP, and the classification is further subdivided. A single menu having a tree structure is created and stored in a menu database (DB).
[0037]
For example, if there are more detailed setting items such as “scaling” and “double-sided”, “scaling” and “double-sided” are set as one layer name, and “same size” is further added under those layers. ”,“ Enlarge ”,“ reduced ”, and the like are arranged, and the hierarchical names are subdivided until final setting items such as“ 115% ”and“ 93% ”are arranged.
[0038]
There are the following types of setting items on this hierarchical menu.
・ Selectable items that can be selected only once in the same hierarchy
For example, “115%” or “122%” under the “enlargement” level
・ Toggle item that can toggle function ON / OFF
For example, whether or not to sort below the “Finisher” hierarchy
・ Numeric items that can be set
For example, in case of the number of copies, etc., enter the numerical value with the numeric keypad after selecting the setting item.
・ Operation items that start some operation
For example, creating a destination list registered with the FAX function
[0039]
For example, in the case of the copy function, first, as shown in FIG. 3 and FIG. 4, the hierarchy name of the first hierarchy is set to (number of copies, manuscript, paper, scaling, duplex / aggregation / division, finisher, etc.) Subdivided into the third level.
In addition, as shown in FIGS. 3 and 4, each hierarchy name and setting item is associated with a number. By specifying this number, the setting item can be selected directly without following each layer. can do. Hereinafter, this number is referred to as a “function number”.
[0040]
An example in which an operation is performed so that the copy result becomes dark because the image of the original is thin will be described with reference to FIG.
When the operation is started, the current hierarchy name “number of copies” is notified to the user by voice, and the rightward movement key is used to advance to the hierarchy name “original”. At this time, it is informed by voice that the user is at the position of “original”.
Next, in order to select “density” which is a subcategory of this “original”, the hierarchical menu is moved down to the next lower level by using the downward movement key. At this time, it is informed by voice that the user is in the “type” position.
[0041]
Further, in order to advance to the hierarchical name “density” which is one of the sub-categories of “original”, the right movement key is pressed. At this time, it is informed by voice that the user is in the “density” position.
Similarly, in order to select “dark” which is a subcategory of this “density”, the hierarchical menu is moved down to the next lower hierarchy by using the downward movement key. At this time, it is informed by voice that it is in the “automatic” position.
Further, the rightward movement key is pressed in order to advance to the hierarchical name “dark” which is one of the subclasses of “density”. At this time, it is informed by voice that the user is in the “density” position.
As a result, the setting of “copy the original darkly” requested by the user can be achieved.
[0042]
(2) Hierarchy menu operation
Next, a method for operating the hierarchical menu as described above will be described.
In order to move and select the hierarchy name and setting items arranged on the above-described hierarchy menu, the direction movement key or a key that can be substituted for it is used. In the following description, the numeric keypad 202 is used instead. . FIG. 6 shows functions assigned to each key.
[0043]
That is, moving up and down the hierarchy is performed by pressing a key arranged in the vertical direction in the numeric keypad, and adjacent items in the same hierarchy are carried out using keys arranged in the horizontal direction in the numeric keypad.
In FIG. 6, the hierarchy is moved up by pressing the “move up (“ 2 ”)” key, and the hierarchy is moved down by pressing the “move down (“ 8 ”)” key.
Further, the same level is traced to the left by pressing the “move left” (“4”) key, and the same level is traced to the right by pressing the “move right” (“6”) key.
Note that the direction movement key described above may be assigned in reverse.
[0044]
When the user instructs to move to the lower layer of the hierarchical menu, if there are a plurality of lower layer setting items, the user moves to the next setting item by any of the predetermined methods listed below.
[0045]
• Move to the first item below.
If none of them is a default value, for example, it is used when selecting the type of document.
• Move to the item already selected below.
For example, if there is an item that has already been set in the setting items in the lower layer, it moves to the item that has already been set in order to continue the setting after that item or to correct the content of that item.
-Move to the item with the default value in the lower layer.
For example, in the case of density setting, there is a selection item of “light, normal, dark”, but in general, “normal” is set as the default value, so that it moves to the setting item of the default value “normal”. .
[0046]
Further, when the user moves the same hierarchy by operating the horizontal movement key, when the user reaches the end of the hierarchy, the user moves to the opposite end of the hierarchy and performs a cyclic movement. By always moving in a certain direction, it is possible to find an item that the user wants to select. In this case, the user cannot grasp how many items are in this hierarchy and is likely to get lost on the menu.
Alternatively, this circular movement may not be performed, and no further movement may be performed when it reaches the end. In this case, if the desired item is overrun, the movement key must be pressed in the opposite direction, but the number of items in the hierarchy can be grasped.
[0047]
Furthermore, in FIG. 6, when the user does not know which level the user is in the middle of setting, or when he / she wants to select again from the beginning, for example, the “return to top (“ 1 ”)” key is pressed. Thus, it is possible to return from any hierarchy to the top hierarchy (in the example of FIG. 3, “the number of copies” of the first hierarchy).
In this case, the setting items selected or set so far can be stored in MFP 100 and moved to the items that have been set and selected so far by using the movement key and the confirmation key.
[0048]
In addition, in FIG. 6, by pressing a “direct jump (“ 0 ”)” key, the user can directly move to a hierarchy or item that the user wants to set.
For example, by pressing the “direct jump” key and inputting a function number from the numeric keypad, it is possible to move to a hierarchical name or item corresponding to the function number.
For example, when “435” is entered as a numeric value using the numeric keypad after the “direct jump” key is pressed, the MFP 100 selects items in the order of “magnification” → “reduction” → “71%”. Judgment is made (see FIGS. 3 and 4).
[0049]
Further, instead of inputting the function number of the item to be set directly by the “direct jump” key as described above, the user presses the “voice recognition (“ 3 ”)” key, and the user selects “function number”, “ It is also possible to say “hierarchy name” or “setting item name”, recognize this, and move directly to the recognized item.
[0050]
Further, in FIG. 6, by pressing the “partial clear (“ 7 ”)” key, the setting item value in which the default value is changed to the default value among the setting items below the current level on the level menu. Can be returned.
When returning to the setting value, you may inquire for each setting item and return only the items that can be returned to the default value, or ask whether you want to return all the setting items whose default value has been changed. Also good.
For example, if you are currently in the “Finisher” level of the hierarchy menu, if you change the default value in the “sort / stack”, “staple”, and “punch” setting items below that level, change that setting value. Clear and return to default value.
[0051]
Also, in FIG. 6, by pressing the “Description of current position (“ 9 ”)” key, the hierarchy name or setting item currently on the hierarchy menu is fed back by voice. Examples of feedback information include a hierarchy name or setting item name, a function number, and a set value (number of copies).
For example, if the “current position” key is pressed after the paper is set and fixed on the A4 side, “the paper is set on the A4 side” is fed back by voice.
[0052]
In FIG. 2, by pressing a “setting confirmation” key 205, the user can sequentially move from the default value to the setting item changed, and the setting value can also be changed.
[0053]
Further, in FIG. 6, when the hierarchical menu is operated by each of the above-described keys and setting of a desired setting item (selection or numerical input end) is completed, “confirmation (“ # ”) is used to confirm the setting item. ) "Key. As a result, the MFP 100 displays the content of the determined setting item on the screen of the liquid crystal display unit 201 of the operation unit 104.
[0054]
In FIG. 6, when the “mode change (“ * ”)” key is pressed, the current mode is changed. If the current mode is “non-visual mode”, the mode is switched to “visual mode”. However, if the headset remains connected, audio, sound, etc. are output to the headset's headphones. Therefore, in order to return to the “visual mode” completely, the headset also needs to be disconnected.
If the current mode is “visual mode”, the above-described headset can be switched to “non-visual mode” by connecting to the MFP 100.
[0055]
In addition, by enabling the MFP 100 to recognize a non-contact type IC card and storing the contents set by the above operation with an operation name attached to the IC card, it is possible to operate from the IC card from the next time. By specifying the name and reading the operation content, it is possible to configure so that the same operation does not have to be set again.
[0056]
(3) Feedback to the user through operation sound, sound icon and BGM of the operation result
As described above, when moving / selecting the hierarchy name and setting items arranged on the hierarchy menu using the numeric keypad, confirmation of the result of the operation as described below is performed using the operation sound, sound icon and BGM (background music) to output to the user's headphones.
Here, the sound icon is static information indicating the nature of the object, and refers to a sound (short single sound) that does not move with different timbres for the purpose of discriminating the hierarchy name and the type of setting item.
[0057]
The operation sound uses different sounds (chords and very short melody) of the same timbre to give an image of the operation result and to associate the operation with the meaning of the sound in music theory. For example, ascending and descending sounds are raised for rising and falling on the hierarchy, 4th dissonance sounds that make anxiety feel when the dead end (failed to move), and a dominant means that resolution is required for selection / confirmation. Use motion.
[0058]
For example, an operation sound for notifying the up and down movement of the hierarchy is prepared, and when the user moves up and down the hierarchy, the operation sound is output to notify that the hierarchy has been moved up and down. This operation sound is different from the above sound icon.
Also, the BGM at this time can be recognized as, for example, the side of the current layer if the BGM has a slow tone in the upper layer and the BGM has a faster tone as it goes to the lower layer.
At this time, it is possible to notify the user that the user cannot move by outputting with an operation sound whether there is a setting item in the lower layer of the moving destination. In addition, it is possible to inform the user of the number of setting items in the lower layer of the moving destination with an operation sound.
[0059]
If the same level of cyclic movement is not set, when the movement is instructed in the horizontal direction, if there are no more items to move, the user is informed with a “dead end” operation sound. Furthermore, the user is also informed of the “dead end” in the vertical direction of the hierarchy with an operation sound.
In addition, when a key such as moving to the top, moving in the horizontal direction, directly moving, or voice recognition is pressed, an operation sound for confirming the selection operation is output so that the user can be surely accepted the operation. I can recognize that.
[0060]
Also, in the case of numerical input such as inputting the number of copies, it can be confirmed that the numerical input is performed by playing BGM until the numerical input is completed.
[0061]
In addition, the user is notified by voice of the operating state of the MFP, for example, “out of paper”, “toner shortage”, “paper jam”, “front cover is open”, and the like. If such a condition cannot be resolved immediately, the condition cannot be grasped if the sound is interrupted.
For example, when the user is away from the apparatus during the copying operation and “paper jam occurs”, the user does not know from this sound alone. However, if BGM is played after the voice, the user can recognize it even in such a state.
[0062]
Also, when the user designates 40 copies, the BGM is run so that the user can recognize how much of the copy has been completed. You can know if copying has progressed.
[0063]
In this way, it is possible to recognize the user's current state by notifying the user with an operation sound, BGM, a hierarchy name, and a sound icon indicating the type of the setting item so that the user can understand the operation image. It is possible to reduce anxiety about whether the input has been performed reliably or the operation has been completed.
[0064]
(4) Feedback to users by voice of operation results
As described above, when moving / selecting the hierarchy name and setting items arranged on the hierarchy menu using the numeric keypad, the operation result is confirmed to the user by outputting from the headphones also by voice. Thus, the user can recognize whether the input and the operation result have been reliably performed, and the anxiety can be reduced.
The voice at this time was placed by the user by changing the voice attributes (pitch, voice type, tone quality, tone, tone, speaking speed, sound field feeling) according to the situation. The situation can be grasped intuitively.
[0065]
First, the hierarchical menu is traced by a moving operation, and when a hierarchical name or setting item is reached, voice feedback of a predetermined content is performed on the hierarchical name or setting item.
For example, when moving to a setting item such as “enlarge” or “114%”, the item name is read out. Thereby, it can be recognized which setting item the user has moved to.
[0066]
When this item name is read out, an already selected item is read out in a higher voice than an item that has not yet been selected. This gives the user a high-activity image and can inform the user that the item is currently selected more quickly and intuitively than with the language expression.
[0067]
For example, in the hierarchical menu of FIG. 3 and FIG. 4, “same size” and “enlarge” in the lower level of “magnification” are to be selected, but which one is currently selected If the user can know whether this is done, it is possible to eliminate the waste of selecting “same size” even though “same size” is selected.
In addition, in an item for switching ON / OFF by selection such as “mixed document size”, it is necessary to know whether it is currently selected (that is, whether it is ON) or not selected (that is, whether it is OFF). If you can not set it in your desired state.
[0068]
Also, when reading the item name, the invalid item is read out with a lower voice than the valid item. This gives the user a low-activity image and can quickly and intuitively tell the user that the item is currently invalid, rather than using linguistic expressions.
Selecting an item may affect other items, resulting in a situation where other items cannot be selected.
[0069]
For example, when “automatic”, “tray 1”, or the like is selected for “paper”, it is not effective to select “paper type of manual paper”. At this time, if the user can move to or select the item even though the item cannot be selected, the user may be misunderstood that the item can be selected, which may cause confusion.
However, if the item is temporarily deleted from the hierarchical menu or is not moved, the hierarchical menu structure will change dynamically. For users who know the menu structure only auditorily It is difficult to understand why the menu structure has changed, and it causes confusion.
[0070]
When reading out as described above, the upper and lower pitches of the voice need to have a change amount that can be distinguished from the normal pitch, and it is necessary to keep the utterance content in a clearly audible range.
For example, in consideration of a sound range in normal natural speech and a sound range that can ensure clarity by speech synthesis, a change amount of about a half octave is given.
[0071]
In addition, when reading out the item name, reverberation is added to the item name having the item in the lower hierarchy and output. This gives the user a lingering image, and can tell more quickly and intuitively that there is an item group that is further sub-classified after that item, rather than by language expression.
For example, the items on the hierarchy menu include items that do not have a lower hierarchy such as “same size” and items that have a further lower classification item such as “enlarge”.
Knowing this difference without actually moving to a lower level makes it easier for the user to move the level menu.
[0072]
This reverberation addition can be realized, for example, by passing the output of the synthesized speech through a delay unit and an attenuator and then adding it to the synthesized speech. In this case, the control parameters are the delay time of the delay device and the attenuation amount of the attenuator, but are determined experimentally in consideration of improving discrimination from normal speech and ensuring clarity of speech. .
[0073]
In addition, when the “partial clear (“ 7 ”)” key is pressed, it is spoken by voice whether the setting change made to the setting item in the lower layer from the current position on the hierarchical menu may be read out and returned to the default value. Inquire.
At this time, instead of inquiring whether or not to return the set values to the default values one by one, it is inquired whether the setting items in all lower layers can be returned to the default values. You may do it.
[0074]
By pressing the “description of current position (“ 9 ”)” key to determine which setting item is currently on the hierarchical menu, information such as a setting item name and a setting value for the setting item is provided with a predetermined content. Feedback with voice.
For example, after setting and confirming “paper” to “A4 landscape”, when the “description of current position” key is pressed, voice feedback “paper is set to A4 landscape” is performed.
[0075]
When the selection of the setting item is completed and a confirmation operation is performed with the “confirmation (“ # ”)” key, the confirmed content is fed back with sound of a predetermined content.
For example, when “200%” is selected / confirmed in “enlargement”, there is a voice feedback of the content “zooming is set to enlargement 200%”.
[0076]
When the setting confirmation key is pressed, the setting items that are below the setting items (including the intermediate layer) on the current hierarchy menu and whose settings have been changed from the default values by the user are collectively read out by voice.
At this time, instead of using voice feedback for all the setting items at once, feedback is made for each setting item, and if there is an error in that setting item, the next changed setting is made by operating the movement keys. It is also possible to move to the item and finally press the enter key to make the final decision.
Also, if you want to know all the setting items that have been changed from the default values so far, use the “Return to top (“ 1 ”)” key to move to the top of the hierarchical menu and then press this setting confirmation key Can be confirmed.
[0077]
When the setting of each setting item is completed and the start key is pressed, when the operation of the MFP is completed, voice feedback with a predetermined content for notifying the success or failure is performed.
For example, a result such as “Copying has been completed at a magnification of 122%” or “Copying has failed due to a paper jam” is fed back by voice.
[0078]
Also, during operation or during operation, the voice of the speaker, which is different from the voice during the operation of the setting items described above, continues after the operation sound, for example, “paper is exhausted”, “ Notify the user that "Remaining low", "Paper jam has occurred", "Front cover is open", etc.
[0079]
Providing a knob that changes the sound attributes (pitch, voice type, tone quality, tone, timbre, speech speed, sound field feeling) by voice feedback as described above, so that the user can easily hear the sound. Can do.
Further, when the next key operation is performed without waiting for the end of the voice feedback, the user can be frustrated by automatically increasing the speaking speed.
[0080]
By providing such a hierarchical menu structure and sound icons, operation sounds, BGM, and voice guidance, the user can get used to the operation with about 5 minutes of practice when handling the MFP for the first time.
[0081]
The above-mentioned operation result by the user is displayed almost synchronously with the screen of the liquid crystal display unit 201 of the MFP 100, and further, the normal person can assist the visually impaired person by inputting from the touch panel 201 based on the display. In addition, people with low vision or presbyopia can also operate by looking at the screen.
For example, when a user loses his or her operation on the way, setting items can be selected on the touch panel with the help of a healthy person, and the settings are output to the headphones with sound icons, operation sounds and voices. Users such as persons with disabilities can also know what is set.
[0082]
(5) Example of operation
Next, an example of operation until the operation is completed after setting “number of copies to 2” using the above-described MFP will be described.
First, when the hierarchical menu is operated to move to “number of copies”, the setting item name “number of copies” is read out from the headphones, followed by a sound icon “(pylon) copies”. At this time, since there is no layer below “number of copies”, no reverberation sound is added.
When the user presses the “confirmation (“ # ”)” key, an audio guidance of the number of copies is made following the sound icon “Please input the number of copies with the (Kalan) numeric keypad and press the confirmation key” from the headphones. The BGM flows during the numerical input of the number of copies.
When the user presses “2” using the numeric keypad, the number input from the headphones is read. When the user presses the “confirmation (“ # ”) key, the number of“ (Kalan) copies ”is set to 2 from the headphones. "I was able to hear you."
Here, the sound of “(pylon)” and “(caran)” indicates an operation sound.
After that, when the user presses the start key, BGM is played while copying from the headphones, and when the user finishes, there is a voice guidance saying that “two copies have been completed”.
[0083]
E. Functional configuration in MFP
FIG. 7 is a functional configuration diagram of an MFP incorporating the apparatus operating device of the present invention.
The MFP in FIG. 7 includes a control unit 300 that performs execution control according to an instruction from a user, and a support unit 400 that performs speech recognition and speech synthesis processing according to an instruction from the control unit 300.
[0084]
The control unit 300 includes a function control unit 310, an operation control unit 320, an operation input unit 330, a visual input unit 340, a visual display unit 350, a menu control unit 360, a menu database (DB) 365, a voice input unit 370, and a sound output. A unit 380 and a function execution unit 390.
[0085]
The function control unit 310 determines whether to use the visual mode or the non-visual mode, instructs the user to use which function such as a copy function or a facsimile function, and performs initial setting for the operation for the function. And do overall control.
In addition, the function control unit 310 is normally in the visual mode, and controls the non-visual mode when the user inserts a headset equipped with headphones and a microphone by pressing the mode switching key.
[0086]
The operation control unit 320 controls various input operations from the user and operations such as displaying the processing results.
The operation input unit 330 inputs numbers and the like from the numeric keypad.
In the non-visual mode, the operation input unit 330 receives various operation instructions from a direction moving key for moving the hierarchical structure of the hierarchical menu, various keys for selecting and confirming setting items, a numeric keypad for inputting numbers, and the like. input.
In the non-visual mode, the following input function number information and the input ten key type are transferred to the menu control unit 360 according to the input ten key type.
[0087]
(1) Directional movement key
The input function number is set by performing the following operation on the function name corresponding to the hierarchical name or setting item at the current hierarchical menu position. This is because the function number configuration is increased by 10 each time one level is lowered, and is increased by 1 in the same level.
・ Upward movement ("2") key
Input function number = current function number / 10
・ Down (8) key
Input function number = current function number × 10 + 1
-Move left ("4") key
Input function number = current function number-1
・ Move right ("6") key
Input function number = Current function number + 1
[0088]
For example, when the right movement key is pressed from the initial state (current function number = 1), the input function number = 1 + 1 = 2. Here, when the downward movement key is pressed, the input function number = 2 × 10 + 1 = 21.
Next, when any one of the upward movement key, the downward movement key, and the rightward movement key is pressed here, the input function numbers are 2, 211, and 22, respectively.
[0089]
(2) Direct jump
Enter the “direct jump (“ 0 ”)” key to enable the numeric input, the user inputs the function number corresponding to the setting item from the numeric keypad, and finally presses the “confirm (#)” key. .
As a result, the numerical value input from the numeric keypad is set as the input function number.
For example, in order to move to “text / photo”, when “2 → 1 → 2 → #” is pressed, the input function number = 212 is set.
[0090]
(3) For voice recognition
When the “voice recognition (“ 3 ”)” key is input, the voice input unit 370 is activated.
Then, a word representing the item name or a function number is uttered from a microphone or the like.
The voice input unit 370 recognizes the voice uttered by using the voice recognition unit 410, converts the recognition result into a function number, and returns it to the operation input unit 330.
As a result, the input function number is set as the input function number.
For example, when “Mojishashin” is uttered, if it is recognized correctly, the input function number = 212 is set.
[0091]
Further, when there are a plurality of lower level setting items when the user gives an instruction to move to the lower level of the hierarchical menu, the operation input unit 330 moves to the next setting item using one of the methods listed below. You may make it move.
• Move to the first item below.
• Move to the currently selected item below.
-Move to the default item below.
In addition, when the user operates the horizontal movement key to move the setting item on the same level, the operation input unit 330 moves to the setting item on the opposite end after the setting item on the end, Alternatively, this cyclic movement is not performed, and there is no item that moves any more when it reaches the end, so that no further movement may be performed.
[0092]
The visual input unit 340 uses a touch panel installed on the screen, and generally performs input for selecting various setting items displayed on the screen in the visual mode. The setting item can be selected by temporarily switching from the non-visual mode to the visual mode.
The visual display unit 350 displays various functions on the screen in the visual mode. In the non-visual mode, the user selects from the hierarchical menu and displays the set items that have been confirmed.
[0093]
The menu control unit 360 manages a menu database (DB) 365 that holds hierarchical menus.
When the type of the input key passed from the operation input unit 330 is accompanied by movement on the menu, it is searched whether or not the input function number exists in the menu DB 365, and if it exists, the current function number is set as the input function number. Replace, move to the position indicated by the setting item corresponding to the replaced function number, and the process is performed.
When there is no movement, the key is processed.
[0094]
For example, when the upward movement key is pressed in the initial state (function number = 1), the input function number = 1/10 = 0, so that it is not registered in the menu DB 365. In this case, no movement occurs.
Similarly, when the right movement key is pressed, the input function number = 1 + 1 = 2, and since it is registered in the menu DB 365, it moves to the corresponding item (“document”).
When the left movement key is pressed when the function number = 21, the input function number = 21-1 = 20, and the corresponding function number is not registered in the menu DB 365, so no movement occurs.
Even when a function number is input by direct jump or voice recognition, if the input function number does not exist in the menu DB 365 (for example, “2 → 1 → 6 → #”), no movement occurs.
[0095]
The voice input unit 370 is activated from the operation input unit 330, inputs a setting item name or function number uttered by the user, and recognizes the voice input via the voice recognition unit 410.
When the setting item name and function number correspondence table as shown in FIG. 8 is stored in the memory and the setting item name is input by voice recognition, the correspondence table is searched and the setting item name is assigned to the function number. Convert to
The voice input unit 370 passes the recognized function number to the operation input unit 330. This allows the user to move directly to the desired setting item on the hierarchical menu.
[0096]
In the non-visual mode, the sound output unit 380 outputs operation sounds, voice guidance, BGM, and the like that indicate success or failure of various operations using the numeric keypad and function execution in response to instructions from the menu control unit 360 and the operation control unit 320. The voice guidance outputs the voice generated by the voice synthesis unit 420.
Function execution unit 390 stores setting values for various setting items passed from operation control unit 320 in the memory of MFP 100 determined according to the function (for example, copy function, facsimile function, etc.). Further, a function is executed according to a setting value stored in the memory of MFP 100 in accordance with an instruction from operation control unit 320.
[0097]
The support unit 400 includes a speech recognition unit 410, a speech synthesis unit 420, a pitch change unit 430, and a reverberation addition unit 440.
The voice recognition unit 410 is called by the voice input unit 370, and the user uses a voice recognition dictionary (for example, a copy dictionary) for a function (copy function or facsimile function) currently operated by the user. The result of speech recognition of the uttered speech (hierarchical menu setting item name, function number, operation command, etc.) is returned to the speech input unit 370.
[0098]
The voice synthesizing unit 420 is called from the sound output unit 380 and, when performing voice feedback to the user, uses the voice synthesizing dictionary to synthesize the voice synthesized from the text according to an instruction from the menu control unit 360. Or the sound transformed by the reverberation adding unit 440 is returned to the sound output unit 380.
Here, when voice feedback is performed by the sound output unit 380, the recorded voice may be used instead of voice synthesis from the text by the voice synthesis unit 420.
[0099]
The pitch change unit 430 lowers the pitch of the voice sent from the voice synthesizer 420 if the setting item instructed by the menu control unit 360 is invalid, that is, outputs the voice with a higher fundamental frequency. If the setting item is selected, the sound is output with a higher pitch, that is, with a lower fundamental frequency.
The upper and lower pitches require a change that is distinguishable from the normal pitch, and it is necessary to keep the utterance content in a clearly audible range, so clarity is ensured in the normal natural speech range and speech synthesis. Considering the possible range, give a change of about a half octave.
[0100]
The reverberation adding unit 440 adds reverberation to the voice from the voice synthesizing unit 420 or the pitch changing unit 430 if the setting item designated by the menu control unit 360 has a setting item in the lower layer.
The reverberation addition can be realized, for example, by adding the sound to the input after passing through the delay device and the attenuator. In this case, the control parameters are the delay time of the delay unit and the attenuation amount of the attenuator, and are experimentally determined in consideration of improving the discrimination from normal speech and ensuring the clarity of the speech.
[0101]
In the above configuration, the sound field control is performed by pitch control and reverberation addition among the sound attributes. However, when reading the setting items, the sound field is controlled by changing the speech speed, voice type, sound quality, etc. You may comprise so that a feeling may be given.
Speaking speed control can be achieved by waveform expansion / contraction in recording synthesis, and phoneme duration length expansion / contraction in regular synthesis.
In addition, the voice type can be changed by changing the recording speaker in recording synthesis and by changing the segment waveform in rule synthesis.
The sound quality can be controlled by inserting a filter after the output of the speech synthesizer and controlling the cut-off frequency.
[0102]
F. MFP operation
The operation of the MFP configured as described above will be described by taking the copy function operation as an example. FIG. 9 is a flowchart showing the operation for the copy function operation.
First, when the mode switching key is pressed (YES in step S1), the current setting mode is switched (step S2), and the process returns to step S1 to process the next operation instruction.
When switching from the “visual mode” to the “non-visual mode”, it is necessary to press a mode switching key and connect a headset including headphones and a microphone to the MFP. Further, when the mode is switched to the “non-visual mode”, the input from the touch panel is locked, and the sound of “entering the non-visual mode” is notified from the headphones.
On the other hand, if the current setting mode is “non-visual mode”, the mode is switched to “visual mode”. If the headset remains connected, this “visual mode” is temporary, and the input operated from the touch panel is output to the headphones.
Only when the headset is disconnected from the MFP, it switches to the “visual mode”.
[0103]
When the current mode is “visual mode” (YES in step S3), the MFP is operated by the visual input unit 340 using the touch panel 201 (step S4), and the process returns to step S1 to process the next operation instruction. .
[0104]
When the current mode is “non-visual mode”, the following processing is performed.
When a function key (FAX, copy, printer, scanner, net file, etc.) 206 is pressed (YES in step S5), a hierarchical menu corresponding to the pressed function is taken out from the menu DB 365 and initialized (step S6). ), The process returns to step S1 to process the next operation instruction.
Here, assuming that the function key “Copy” (see FIG. 2) is selected, the user is informed by voice that “copy operation is now possible” from the headphones.
[0105]
Next, when the direction movement key (up / down / left / right) is pressed (YES in step S7), the user moves up and down the hierarchy or moves to an adjacent item in the same hierarchy (step S8) to process the next operation instruction. Return to step S1.
The operation input unit 330 manages the location of the hierarchical menu by passing the input key type and the input function number to the menu control unit 360.
[0106]
When moving, the menu control unit 360 calls the sound output unit 380 to play the operation sound and BGM, and further outputs the setting item name as a voice to notify the user that the operation is reliably performed.
The voice at this time is a voice obtained by synthesizing the item name by the voice synthesizer 420. If this setting item is invalid, the pitch is lowered, and if the setting item is selected, the pitch is raised and read. . Furthermore, if the setting item has a setting item in the lower layer, reverberation is added and read out.
[0107]
When the menu control unit 360 reaches the end of the hierarchical menu and cannot move any more, the menu control unit 360 calls the sound output unit 380 to output a “dead end” operation sound to notify the user. When a dead end is reached in the vertical direction on the hierarchical menu, a “dead end” operation sound is output to notify the user.
[0108]
In addition, the menu control unit 360 calls the sound output unit 380, outputs the operation sound, the sound icon, and the name of the previous setting item moved by the movement key, and outputs the BGM corresponding to this item.
The voice at this time is a voice obtained by synthesizing the item name by the voice synthesizer 420. If this setting item is invalid, the pitch is lowered, and if the setting item is selected, the pitch is raised and read. . Furthermore, if the setting item has a setting item in the lower layer, reverberation is added and read out.
[0109]
Next, when the “return to top (“ 1 ”)” key is pressed (YES in step S9), the setting item in the first menu in the highest hierarchy is moved (step S10), and the next operation instruction is issued. Return to step S1 for processing.
The menu control unit 360 manages the current position so as to be the setting item in the first menu in the highest hierarchy. Upon this movement, the menu control unit 360 calls the sound output unit 380, outputs a sound icon and the sound of the setting item name of the movement destination, and notifies the user that the operation has been performed correctly.
The voice at this time is a voice obtained by synthesizing the item name by the voice synthesizer 420. If this setting item is invalid, the pitch is lowered, and if the setting item is selected, the pitch is raised and read. . Furthermore, if the setting item has a setting item in the lower layer, reverberation is added and read out.
[0110]
Next, when the “direct jump (“ 0 ”)” key is pressed (YES in step S11), the process moves to a setting item corresponding to the subsequently input function number (step S12), and the next operation instruction is processed. Therefore, the process returns to step S1.
When the “direct jump (“ 0 ”)” key is pressed, the operation input unit 330 calls the sound output unit 380 and outputs an operation sound, a voice “Please enter a function number”, and BGM. While this BGM is playing, the user inputs a number from the numeric keypad. The input number is read out via the sound output unit 380.
Finally, when the user presses the enter key (“#”), the operation input unit 330 stops playing the BGM, and the menu control unit 360 causes the operation sound and the name of the setting item of the function number that has just been input. Is output by voice, and the setting item is managed as the current position.
[0111]
When the item corresponding to the designated function number is a hierarchical name, it is a voice synthesized by the speech synthesis unit 420, and reverberation is added if the hierarchical name has a setting item in the lower layer. If the designated function number is a setting item, the pitch is lowered if the setting item is invalid, and the pitch is increased if the setting item is selected, and the setting item is read out.
For example, following the depression of the key “0”, if “435” is input with the numeric keypad, a high-pitched voice feedback “the scaling is set to 71% reduction” is made.
When the setting item having the lowest function number is specified, the menu control unit 360 holds the value corresponding to the setting item as the setting value of the setting item on the menu DB, and the operation control unit 320 executes the function execution. The setting value now specified via the unit 390 is stored in the corresponding setting item in the memory of the MFP 100, and the visual display unit 350 is called to display the determined content on the screen of the operation unit 104.
[0112]
Next, when the “voice recognition (“ 3 ”)” key is pressed (YES in step S13), the input voice is voice-recognized and moved to a setting item corresponding to the recognition result (step S14). The process returns to step S1 to process the next operation instruction.
When the “voice recognition (“ 3 ”)” key is pressed, the operation input unit 330 calls the sound output unit 380 and outputs a voice “Please say the setting item name or function number” together with the operation sound.
Subsequently, the operation input unit 330 calls the voice input unit 370, and passes the recognition result obtained by recognizing the “setting item name” and “function number” uttered by the user to the menu control unit 360. The setting item that is uttered is managed as the current position.
At this time, the menu control unit 360 calls the sound output unit 380, outputs the sound icon and the input setting item name as a sound, and notifies the user that the sound input is correctly recognized.
[0113]
When the specified item name or function number is a hierarchical name, it is a voice synthesized by the voice synthesizing unit 420, and reverberation is added if this hierarchical name has a setting item in the lower layer. If the specified function number is a setting item, the pitch is lowered if this setting item is invalid, and the setting item is read aloud if the setting item is selected.
When the item name or function number designated by voice designates the lowermost setting item, the menu control unit 360 holds the value corresponding to the setting item as the setting value of the setting item on the menu DB 365, Operation control unit 320 stores the setting value now specified via function execution unit 390 in the corresponding setting item in the memory of MFP 100 and calls visual display unit 350 to display the determined content on the screen of operation unit 104. To display.
[0114]
Next, when the partial clear key (“7”) is pressed (YES in step S15), the setting value of the setting item in the hierarchy below the current position on the hierarchy menu is returned to the default value (step S16), and the next The process returns to step S1 to process the operation instruction.
When the partial clear key (“7”) is pressed, the menu control unit 360 calls the sound output unit 380, and the operation sound and its command contents (“the current position on the hierarchical menu and the setting items at the lower level” To the user by voice.
[0115]
Subsequently, the menu control unit 360 searches for a setting item in the hierarchy below the current position on the hierarchy menu, and when the setting item has been changed from the default value, the setting value of the setting item is read out to the default value. Ask the user whether to return.
When the user indicates that the change may be made (for example, with a confirmation key), the setting value of the setting item is returned to the default value.
Thereafter, a sound icon and a voice message indicating operation completion are output to notify the user that the partial clear has been completed.
Alternatively, instead of inquiring one by one as described above, it may be inquired by voice whether the set values changed from the default values may be returned to the default values all at once.
[0116]
Furthermore, the menu control unit 360 holds the setting item returned to the default value and the default value as the setting value of the setting item on the menu DB 365, and the operation control unit 320 is now designated via the function execution unit 390. The default values of the set items are stored in the corresponding set items in the memory of the MFP 100, and the visual display unit 350 is called to display the determined contents on the screen of the operation unit 104.
[0117]
Next, when the “description of current position (“ 9 ”)” key is pressed (YES in step S17), information on which hierarchy name or setting item is currently in the hierarchy menu is provided (step S18). The process returns to step S1 to process the next operation instruction.
When the “description of current position (“ 9 ”)” key is pressed, the menu control section 360 calls the sound output section 380 and makes a sound icon, a hierarchy name of the current position or a setting item name, a setting value, etc. by voice. Notify users.
[0118]
When the current position is a hierarchical name, the voice is synthesized by the speech synthesizer 420 and the reverberation is added if the hierarchical name has a setting item in the lower layer. If the current position is a setting item, the pitch is lowered if the setting item is invalid, and if the setting item is selected, the pitch is increased and the setting item is read out.
[0119]
Next, when the “confirm setting” key is pressed (YES in step S19), the setting item name and setting value are notified by voice of what setting item the user has selected so far (step S19). S20) Return to step S1 to process the next operation instruction.
When the “confirm setting” key is pressed, the menu control unit 360 sequentially moves from the default value to the setting item whose setting has been changed, and calls the sound output unit 380 to display the setting item name and its setting value. Read aloud and notify the user. At this time, the menu control unit 360 manages the movement destination as the current position, and can correct the setting item if there is an error.
Further, when the setting item is changed, the menu control unit 360 holds the changed setting item and the setting value as the setting value of the setting item on the menu DB 365, and the operation control unit 320 includes the function execution unit. The setting value of the setting item now specified via 390 is stored in the corresponding setting item in the memory of the MFP 100, and the visual display unit 350 is called to display the determined content on the screen of the operation unit 104.
[0120]
Next, when the “confirm (“ # ”)” key is pressed (YES in step S21), the selection of the setting item at the current position is confirmed (step S22), and the process proceeds to step S1 to process the next operation instruction. Return.
When the confirmation key (“#”) is pressed, the menu control unit 360 calls the sound output unit 380, outputs the operation sound and the confirmed operation content by voice, and notifies the user.
Further, when the setting item of the current position is confirmed, the menu control unit 360 holds the confirmed setting item and its setting value as the setting value of the setting item on the menu DB 365. The operation control unit 320 The setting value of the setting item that has been confirmed through the function execution unit 390 is stored in the corresponding setting item in the memory of the MFP 100, and the visual display unit 350 is called to display the determined content on the screen of the operation unit 104. .
[0121]
Finally, when the setting for each setting item is completed and the start key is pressed (YES in step S23), the selected function (copy function, facsimile function, etc.) is executed (step S24), and the next operation Return to step S1 to process the instructions.
When the start key is pressed, the operation control unit 320 calls the function execution unit 390 to operate the function selected by the user first. For example, if the designated function is a copy function, a copy operation according to the values set so far is performed. When this operation ends, the operation control unit 320 calls the sound output unit 380 and informs the user of the success or failure by voice.
For example, a result such as “Copying has been completed at a magnification of 122%” or “Copying has failed due to a paper jam” is fed back by voice.
In addition, when the user designates a copy of “40 copies”, the operation control unit 320 causes the BGM to flow through the sound output unit 380 so that it can recognize how much copy has been completed. The user can know how much processing has been completed according to the progress of the BGM.
[0122]
Further, the function control unit 310 monitors the state of the apparatus during the operation of the MFP. For example, in the case of “paper out”, “toner shortage”, “paper jam”, “front cover is open”, etc. , Call the sound output unit 380, and after the sound icon, for example, “paper is out”, “toner is low”, “paper jam has occurred”, “front cover is open” Etc. and the BGM are output and notified to the user.
[0123]
G. Other functional configurations of MFP
In the above-described embodiment, the device operation apparatus (the control unit 300 and the support unit 400) of the present invention has been described as being incorporated in the MFP.
Here, as another embodiment, as shown in FIG. 10, the control unit 300 among the device operation devices is incorporated into an MFP, a facsimile device, a printer device, a scanner device, or the like, and is supported by a general-purpose computer (hereinafter referred to as a PC) support unit 400. May be incorporated.
In this case, in order to perform communication between the control unit 300 and the support unit 400, the communication unit 500 and the communication unit 600 are connected by a cable, infrared communication, wireless communication, a communication line (including a network), or the like.
[0124]
In such a configuration, when voice recognition processing is performed from the control unit 300, key information indicating that the voice recognition processing is requested via the communication unit 500 and voice data input by the voice input unit 370 are transmitted to the communication unit. To 600.
The communication unit 600 calls the voice recognition unit 410 from this key information, adds the previous key information to the voice recognition result, and sends it back to the communication unit 500.
Communication unit 500 determines that the received data is a voice recognition result from the key information, and returns the received data to voice input unit 370.
[0125]
In addition, when speech synthesis processing is performed from the control unit 300, key information that is a request for speech synthesis processing and a text sentence that is desired to be converted into speech data by the sound output unit 380 are transmitted to the communication unit 600 via the communication unit 500. Send.
The communication unit 600 calls the voice synthesis unit 420 or the pitch change unit 430 and the reverberation addition unit 440 as needed from this key information, attaches the previous key information to the voice synthesis result, and sends it back to the communication unit 600.
The communication unit 600 determines that the received data is a voice synthesis result from the key information, and returns the received data to the sound output unit 380.
When obtaining voice data, the voice data recorded by the key information of the voice data (what kind of voice data is desired) may be selected instead of being synthesized from the text. .
[0126]
By assigning the functions to the MFP and the PC in this way, it is not necessary for each MFP or the like to have dictionary information with a large amount of data and a speech recognition and speech synthesis processing function that takes a long time as in the support unit 400. At the same time, the maintenance of the dictionary, processing system, and PC itself of the support unit 400 can be facilitated.
In the case of such a configuration, the cost balance is better when a plurality of MFPs are connected to one PC.
[0127]
H. Other functional configurations of MFP
As another embodiment, as shown in FIG. 11, an input system such as an operation system related to the visual mode and an input system such as a numeric keypad in the non-visual mode is used as an MFP, a facsimile apparatus, a printer apparatus, a scanner apparatus, etc. And non-visual mode processing may be incorporated into a general-purpose computer (hereinafter referred to as a PC).
In this case, in order to perform communication between the MFP and the PC, connection is made by a cable, infrared communication, wireless communication, a communication line (including a network), or the like.
[0128]
In such a configuration, when the non-visual mode is selected with respect to the input performed on the MFP side, instructions on the PC side are instructed by various numeric keys input from the operation input unit 330 via the communication unit 700. It transmits to the control part 320.
The operation control unit 320 processes the received instruction, and when there is a setting item and its value for the MFP, the operation control unit 320 sets a value in the memory of the MFP to the function execution unit 390 via the communication unit 700.
[0129]
By assigning functions to the MFP and the PC in this way, each MFP does not have to have a non-visual mode processing system, and maintenance of the non-visual mode processing system itself can be easily performed.
In such a configuration, the cost balance is better when a plurality of MFPs are connected to one PC.
[0130]
Further, as a modification of the embodiment of FIG. 11, the processing system is changed from a mode switching, a function (copy function, facsimile function, etc.) selection and a non-visual mode input as shown in FIG. (Hereinafter referred to as a PC), setting of values for set items and execution of selected functions may be performed on the MFP side. In this case, in order to perform communication between the MFP and the PC, connection is established by infrared communication or wireless communication.
[0131]
The PC may be a portable terminal that can connect a numeric keypad, a start key, a microphone, and headphones, and may be connectable to the MFP by communication such as Bluetooth.
By assigning the functions to the MFP and the PC in this way, it is possible to customize the non-visual mode processing system for each user having the PC while minimizing changes on the MFP side.
[0132]
In such a configuration, a user with a PC goes to the vicinity of the MFP, selects a non-visual mode, selects a function, and operates a hierarchical menu according to the function from the PC. The execution of the value and the function is transmitted from the operation control unit 320 to the communication unit 700 on the MFP side.
In the case of an instruction for function selection, the communication unit 700 sets an MFP function (such as a copy function or a facsimile function) by the function setting unit 710 and performs initial setting by changing the function on the MFP side. Also, the function execution unit 390 processes the setting of items and the execution of functions. These set results are transmitted to the operation control unit 320 on the PC side via the communication unit 700, and the result is notified to the user by voice or the like.
[0133]
I. Embodiment as a program
Each function constituting the above-described embodiment is programmed, written in advance on a recording medium such as a CD-ROM, and this CD-ROM is mounted on a computer equipped with a medium driving device such as a CD-ROM drive. Needless to say, the object of the present invention can also be achieved by storing these programs in a memory or storage device of a computer and executing them.
In this case, the program itself read from the recording medium realizes the functions of the above-described embodiment, and the program and the recording medium recording the program also constitute the present invention.
[0134]
As a recording medium, a semiconductor medium (for example, ROM, nonvolatile memory card, etc.), an optical medium (for example, DVD, MO, MD, CD-R, etc.), a magnetic medium (for example, magnetic tape, flexible disk, etc.) Either may be sufficient.
[0135]
In addition to executing the functions of the above-described embodiment by executing the loaded program, the operating system or the like performs part or all of the actual processing based on the instructions of the program, The case where the functions of the above-described embodiment are realized is also included.
[0136]
In addition, the program for realizing the functions of the above-described embodiment is loaded into the memory provided in the function expansion board or function expansion unit, and the CPU provided in the function expansion board or function expansion unit is actually installed based on the instructions of the program. This includes the case where the functions of the above-described embodiments are realized by performing part or all of the processing.
[0137]
Further, when the above-described program is stored in a storage device such as a magnetic disk of a server computer and distributed in the form of download from a user computer connected via a communication network, the storage device of this server computer is also included in the present invention. Included in the recording medium.
[0138]
【The invention's effect】
As described above, according to the present invention, the manufacturing cost of the apparatus can be reduced, and various operations can be easily and reliably performed without using vision.
In addition, it is possible to provide a device that can be easily operated by a person who can operate the person who cannot perform the operation.
[0139]
In addition, by changing the audio attributes, you can intuitively present the user to the position of the item in the hierarchical menu and the state of the item at that position. Improve understanding and efficiency.
[Brief description of the drawings]
FIG. 1 is a block diagram of an MFP incorporating an apparatus operating device according to the present invention.
FIG. 2 is a front view of an operation unit.
FIG. 3 is a diagram illustrating an example of a hierarchical menu related to a copy function.
FIG. 4 is a continuation of FIG.
FIG. 5 is a diagram illustrating a development example of a hierarchical menu.
FIG. 6 is a diagram illustrating an example of the functional layout of a numeric keypad.
FIG. 7 is a functional configuration diagram of an MFP in which the apparatus operating device of the present invention is incorporated.
FIG. 8 is an example of a correspondence table between speech recognition results and function numbers.
FIG. 9 is a flowchart showing an operation for a copy function operation;
FIG. 10 is another functional configuration diagram of the MFP in which the apparatus operating device of the present invention is incorporated.
FIG. 11 is another functional configuration diagram of the MFP in which the apparatus operating device of the present invention is incorporated.
12 is a modification of the functional configuration of FIG.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 100 ... MFP, 101 ... Host connection apparatus, 102 ... FAX line connection apparatus, 103 ... Network connection apparatus, 104 ... Operation part, 105 ... Scanner apparatus, 106 ... Printer engine, 107 ... Control controller, 108 ... Storage apparatus, 109 DESCRIPTION OF SYMBOLS ... Sound output device 201 ... Liquid crystal display part (LCD) and touch panel, 202 ... Ten key, 203 ... Clear / stop key, 204 ... Start key, 205 ... Setting confirmation key, 206 ... Function key, 300 ... Control part, 310 ... Function control unit 320 ... Operation control unit 330 ... Operation input unit 340 ... Visual input unit 350 ... Visual display unit 360 ... Menu control unit 365 ... Menu database (DB) 370 ... Voice input unit 380 ... Sound output unit, 390 ... function execution unit, 400 ... support unit, 410 ... voice recognition unit, 420 ... Voice synthesis unit, 430 ... pitch changing portion, 440 ... reverberation adding section, 500, 600, 700 ... communication unit, 710 ... function setting unit.

Claims (23)

For each function of the image forming device, set up a hierarchical menu that classifies from the top layer classification to the bottom layer setting items so that all the operation items that can be operated have a multi-level tree structure. A function number is assigned to each node consisting of classification or setting items, menu storage means for storing this tree structure, a numeric keypad for designating a number, and a classification or function corresponding to the function number designated by the numeric keypad. Menu setting means for acquiring setting items from the menu storage means and moving the next operation position to the classification or setting items of the hierarchical menu, and enabling the device to be operated without using vision. An image forming apparatus. The image forming apparatus according to claim 1, wherein the menu control means, when the operation is during and / or end progression, an image, wherein the benzalkonium be reported to the user the operation result by the sound and voice Forming equipment. 3. The image forming apparatus according to claim 1 , wherein the menu control unit moves a setting item of a hierarchical structure on the hierarchical menu with a direction movement key, and confirms selection of the setting item with a confirmation key. An image forming apparatus. 4. The image forming apparatus according to claim 1 , wherein the menu control unit designates a setting item of a hierarchical structure on the hierarchical menu by voice recognition and confirms selection of the setting item by a confirmation key. An image forming apparatus. The image forming apparatus according to any one of claims 1 to 3, wherein the menu control means, specifies the setting item of the hierarchical structure of the hierarchical menus by thus specifying the function number to voice, the confirmation key image forming apparatus characterized by determining the selection of the setting item by. 4. The image forming apparatus according to claim 1 , wherein the menu control unit specifies a function number synthesized from a position on a tree structure moved by a direction movement key that follows the tree structure. An image forming apparatus characterized by designating a setting item of a hierarchical structure on a menu and confirming selection of the setting item by a confirmation key. The image forming apparatus according to claim 2, sound is output as the operation result, an image forming apparatus which is a sound icon corresponding to the type of the setting item. The image forming apparatus according to claim 2, sound is output as the operation result, an image forming apparatus and outputs the operation sound or BGM vary depending mobile locations on the hierarchy. The image forming apparatus according to claim 7 or 8, wherein the menu control means, the sound icon, when outputting the operation sound or the BGM, the image forming apparatus being characterized in that the attributes of the sound different from . The image forming apparatus according to any one of claims 1 to 9, wherein the menu control means may read aloud by voice setting item name and set value of the setting items on the hierarchy that is moved by the operation Image forming apparatus. The image forming apparatus according to claim 1 0, when read aloud the setting item name, an image forming apparatus characterized by adding to the voice reading the change in the attribute of the sound. The image forming apparatus according to claim 1 1, currently, the image forming apparatus characterized by a setting item setting is invalid, read aloud at a lower sound than the set items can be selected or set. The image forming apparatus according to claim 1 1 or 1 2, currently, the image forming apparatus characterized by read the setting items that are selected or set, at a higher voice than the set items that are not selected or set. The image forming apparatus according to claim 1 1, 1 2 or 1 3, now, the voice obtained by adding reverberation to the set item to add presenting a new selection or setting items by selecting or setting An image forming apparatus characterized by reading aloud. The image forming apparatus according to any one of claims 1 to 1 4, before Symbol menu control unit, an image forming apparatus and outputting the BGM until entering the setting items. The image forming apparatus according to any one of claims 1 to 1 5, wherein the menu control means, wherein when performing the confirmation operation for each setting item, notifies the audio settings of the setting item an image forming apparatus comprising and Turkey. The image forming apparatus according to any one of claims 1 to 1 6, wherein the menu control means, when performing bulk verification operation are sequentially moved to the setting item to change the default value, the setting contents an image forming apparatus comprising a benzalkonium be notified by voice changes. The image forming apparatus according to any one of claims 1 to 17 , wherein the menu control unit is configured to return a setting value of a setting item of a layer below the position currently being operated on the hierarchical menu to a default value. An image forming apparatus characterized by inquiring by voice whether or not each setting item may be returned to a default value. The image forming apparatus according to claims 1 to 1 7, wherein the menu control means, when performing an operation to return the set value of the setting item of hierarchy in the following position presently being operated on the hierarchical menu to default An image forming apparatus characterized by inquiring by voice whether or not all setting items under the hierarchy can be returned to default values. Voice The image forming apparatus according to any one of claims 1 to 19, comprising a visual display device, the menu control means, when the selection of the setting item is finalized, the contents of the finalized setting items in notifies the image forming apparatus, wherein the benzalkonium displays also the confirmed at this time to the visual display device. The image forming apparatus according to any one of claims 1 to 2 0, visual input provided with a device, the visual display device sound when input from the visual input device for the setting status displayed on and An image forming apparatus that notifies the user by voice. The program for functioning a computer as each means of the image forming apparatus as described in any one of Claims 1 thru | or 21. Computer readable recording medium recording a program of claim 2 2.

Images