JP2007086856A - User interface device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable even a visually impaired person to easily perform a desired process on a touch-panel-type user interface device. <P>SOLUTION: A storage part 5 of a complex machine 100 stores process kind information indicating the processes executed by an image reading part 2 and an image forming part 3 and setting information indicating setting items applied to the processes. A control part 7 controls the display of a touch panel in a UI part 6 based on the information stored in the storage part 5. When a user touches a button indicating any of the setting items on the touch panel, the control part 7 creates a voice signal indicating the process to be performed at that time and the setting item applied to the process and causes a voice output part 4 to provide output. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to input support for a visually impaired person in a user interface device having a touch panel.

  The touch panel can be used both as a display device and an input device, so the operation is intuitive and easy to understand, and multiple functions can be realized by switching the display screen, so various input operations can be performed in a compact display area. There is an advantage that can be made. Therefore, a user interface device equipped with a touch panel (hereinafter referred to as a “touch panel type input device”) has the functions of a bank ATM (Automatic Teller Machine), a station automatic ticket vending machine, or an office multifunction device (copier and scanner). Used in various processing apparatuses.

  However, the above-described advantages are only advantageous for sighted persons (those who have no visual impairment). In the touch panel type input device, since the input buttons are recognized only visually, a visually handicapped person cannot recognize which input button is in which position. Also, since the displayed screen is not always constant, even if the position of the input button for performing the desired processing is empirically recognized, if the screen display is different from the intended one Cannot perform the desired processing. Therefore, for visually impaired persons, the input operation using the touch panel type input device is extremely difficult.

In order to remove such difficulties for visually impaired persons, efforts are being made to support input operations by visually impaired persons using a touch panel type input device. For example, Patent Document 1 discloses a technique for outputting information about a touched position as sound when a user touches a touch panel. If this technology is applied to a copying machine, for example, when the user touches a density setting button on the touch panel, guidance such as “density is“ normal ”” is obtained by voice. With this technology, visually impaired persons can recognize the buttons they are touching, so that inconveniences related to input operations can be eliminated to some extent.
JP-A-11-110107

  However, there are still inconveniences that cannot be solved only by the technique described in Patent Document 1 described above. For example, in the above-mentioned multifunction peripheral, copy processing and scanning processing can be performed. In such a case, a visually impaired user hears a voice message saying, for example, “the magnification is“ 100% ””. However, it is unclear to which processing magnification the magnification of “100%” indicates. When processing is executed in such a state, the original was originally copied at a magnification of “100%”, but the document was scanned at a magnification of “100%” against the user's intention. There is a risk of inconveniences such as

  Further, in many cases, the touch panel is configured such that when a certain item is to be set, the screen changes and further details or specific settings can be made. For example, in the case of a multifunction machine, options such as “100%” and “70%” are presented when selecting “magnification” for copy processing. Even in such a case, for example, when the user selects the button “magnification”, the processing is performed at a desired magnification even if it is simply described as ““ magnification ”” or “you can select“ magnification ””. It is unclear how to do this specifically. Even if the user touches an area (input button) indicating “70%”, if the guidance by voice at that time is merely ““ magnification ”is“ 70% ””, It is unclear whether there are such options.

In other words, in the conventional technology as described above, when the user is a visually handicapped person, there is a disadvantage that the process to be executed cannot be easily specified simply by touching a certain area on the touch panel. It was.
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a technique capable of easily executing a desired process even for a visually impaired person in a touch panel type user interface device. It is in.

  In order to achieve the above object, the user interface device according to the present invention includes processing type information indicating processing that can be executed by a processing device connected to the own device, and setting information indicating setting items applied to the processing. Storage means for associating and storing, first input means for inputting an instruction to read out the setting item by voice, and second input means for inputting an instruction to start execution of the processing by the processing device Display input means having a display area for sensing a user's contact, wherein the setting information stored in the storage means is displayed as an image on a part of the display area, and the user touches a position in the display area. When the image is displayed at the contact position, the display input means for supplying the setting information indicated by the image and the instruction input to the first input means Signal generation means for reading out the processing type information stored in association with the setting information supplied by the display input means from the storage means and generating an audio signal representing the processing and setting items indicated by the processing type information and the setting information. And, based on the audio signal generated by the signal generating means, a sounding means for sounding the processing and setting items represented by the sound signal as sound, the sounding means sounds the processing and setting items, and An output means for outputting, to the processing device, an instruction to execute the processing by applying the setting item indicated by the setting information supplied by the display input means when an instruction is input to the second input means; Is provided.

  According to such a user interface device, when the user touches a certain position in the display area of the display input means in order to execute a certain process, the voice representing the process indicated by the image displayed at the touch position and the setting item is displayed. Is output. Therefore, even a visually handicapped person who cannot recognize the display area can surely recognize the process performed by his / her own operation.

In the user interface device of the present invention, the setting information includes upper setting information indicating basic setting items that are basic setting items related to the processing, and lower setting information indicating detailed setting items related to the basic setting items. The signal generation means is a case where an instruction is input to the first input means, and the setting information supplied by the display input means is the lower setting information, The structure which produces | generates the audio | voice signal showing the detailed setting item which the said low-order setting information shows, and its basic setting item may be sufficient.
In the user interface device of the present invention, the setting information includes upper setting information indicating basic setting items that are basic setting items related to the processing, and lower setting information indicating detailed setting items related to the basic setting items. And the signal generation means is a case where an instruction is input to the first input means, and the setting information supplied by the display input means is the upper setting information, The structure which produces | generates the audio | voice signal showing the basic setting item which the said high-order setting information shows, and its detailed setting item may be sufficient.
With this configuration, the user can more specifically recognize the mode of processing to be executed.

In the user interface device of the present invention, the display input unit may be configured to display a setting indicated by an image displayed near the contact position when the image displayed at the contact position is not an image indicating the setting information. Information and direction information indicating the direction of the image when the contact position is used as a reference are supplied to the signal generation unit, and the signal generation unit is configured to input an instruction to the first input unit. Based on the setting information and the direction information supplied by the display input means, the processing type information stored in association with the setting information is read from the storage means, and the processing type information and the setting information are The structure which produces | generates the audio | voice signal showing the process and setting item to show, and the direction which the said direction information shows may be sufficient.
With such a configuration, even when the user touches an area to which a specific function is not assigned, it is possible to guide the user to perform desired processing.

In the user interface device of the present invention, when the display input unit senses that the contact position is moving in a certain direction, the direction information indicating the direction and the direction as viewed from the contact position are displayed. The setting information indicated by the image displayed on the screen is supplied to the signal generation means, and the signal generation means is configured to display the setting information indicated by the setting information based on the setting information and the direction information supplied by the display input means. The structure which produces | generates the audio | voice signal showing the direction which the item and the said direction information show may be sufficient.
With such a configuration, it is possible to recognize what setting items are present in the display area by sliding the contact position while the user touches the display area.

Further, in the user interface device of the present invention, the output means causes the display input means when the instruction is not input to the first input means and the instruction is input to the second input means. The configuration may be such that an instruction to execute the processing by applying the setting item indicated by the supplied setting information is output to the processing device.
By adopting such a configuration, it is possible to execute a mode (speech reading mode) in which processing is performed while reading processing and setting items, and a mode (normal mode) in which speech reading is not required, by one unit. . That is, it becomes possible for both the sighted person and the visually handicapped person to share the desired process with a simple operation.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Here, as an embodiment of the present invention, a multifunction device including a touch panel type user interface device will be described as an example. Here, the “multifunction device” is a processing device capable of executing copy processing and scan processing.

[1. Constitution]
FIG. 1 is a block diagram schematically showing the configuration of a multifunction peripheral 100 according to an embodiment of the present invention. As shown in the figure, the MFP 100 includes a communication unit 1, an image reading unit 2, an image forming unit 3, an audio output unit 4, a storage unit 5, a UI (User Interface) unit 6, and a control. Part 7.

  The communication unit 1 is a network interface device for transmitting / receiving data to / from an external device such as a computer. The image reading unit 2 is a so-called scanner, and optically reads a document placed by a user and generates image data corresponding to the document. The image forming unit 3 receives image data via the communication unit 1 or the image reading unit 2 and forms an image on a sheet supplied from the outside using a color material such as toner. The audio output unit 4 is a so-called speaker, and outputs audio according to the supplied audio signal.

  The storage unit 5 is a storage device such as a hard disk. The storage unit 5 stores information indicating processing that can be executed by the multifunction peripheral 100. The information stored in the storage unit 5 is, for example, as shown in FIG. The figure shows “processing type information” indicating processing that can be executed by the multifunction peripheral 100 and “setting information” indicating setting items applied in each processing. As described above, in the case of the MFP 100 according to the present embodiment, the copy process and the scan process can be executed, and therefore, there are two types of process type information, “copy” and “scan”.

  The setting information is information indicating how each process indicated by the process type information is performed. When copying is performed by a copying machine or a multifunction machine, it is common to select a copy magnification or a paper size, but the setting information indicates this type of information. In the case of the MFP 100 according to the present embodiment, first, there are three types of setting information related to copy processing: “basic copy”, “application copy”, and “other settings”. Each setting item is provided with more detailed setting items, and the setting items form a tree-like hierarchical structure.

  For example, setting information “basic copy” further includes setting information indicating setting items such as “magnification”, “density”, “paper”, and “original image quality”. Here, “magnification” is setting information indicating at what magnification a document is copied. The setting information further includes setting information indicating more specific magnifications such as “automatic”, “100%”, and “70%”.

  Although not shown in FIG. 2, for setting information such as “application copy”, “other settings”, or “density”, “paper”, and “original image quality”, more detailed setting items are set in the same manner. The setting information shown is pending in a tree shape. The same applies to the processing type information indicating the scanning processing, and has setting information about magnification, density, reading resolution, and the like.

  Here, the description returns to each part of the multifunction peripheral 100. The UI unit 6 is an interface device for a user to perform an input operation, and includes a touch panel and various hard buttons. The appearance of the UI unit 6 is, for example, as shown in FIG. As shown in the figure, the UI unit 6 includes a touch panel TP, a speech reading button B1, and a start button B2.

  The touch panel TP has a predetermined display area for displaying various screens related to the operation of the MFP 100, and has a function of detecting that the user has touched the display area, and information on the contact position (for example, coordinates) Information) is supplied to the control unit 7. In this display area, the message area t1 is an area indicating the status (state) of the multifunction peripheral 100, and displays, for example, messages such as “Can copy”, “Can scan”, and “Please wait”. The tab area t2 indicates the highest setting item (hereinafter referred to as “basic setting item”) among the setting items related to each process. For example, in the case of copy processing, “basic copy”, “application” It has three types of tabs: “Copy” and “Other settings”. When the user selects a tab of a basic setting item in the tab area t2, setting items related to the selected basic setting item (hereinafter referred to as “detailed setting items”) are displayed in a list in the detailed setting area t3.

  If there are further selectable setting items in the detailed setting items described above, the display of the detailed setting region t3 changes when the detailed selection item is selected. For example, when “other (magnification)” is selected in “magnification” of “basic copy”, the UI unit 6 displays a numeric keypad in the detailed setting area t3, and the user can select an arbitrary magnification. Can be entered.

  For each setting item, for example, “automatic” is set for “magnification”, “normal” is set for “density”, and “automatic” is set for “paper”. It is desirable. This makes it possible to apply the most common setting items to the process even if the user immediately executes the process without performing the setting on the touch panel TP.

  The voice reading button B1 is a push-type hard button, and is configured so that the multifunction device 100 operates in the “voice reading mode” when pressed. The start button B2 is also a push-type hard button, and is configured to execute copy or scan processing under the conditions set by the user when pressed. In addition, the voice reading button B1 and the start button B2 are provided with identification patterns such as letters and marks on the surfaces thereof so as to be a target when operated by a visually impaired person.

  Returning to the description of each part of the multifunction peripheral 100 again. The control unit 7 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and controls the operation of each unit described above based on a program stored therein. For example, the control unit 7 displays a screen for operation on the touch panel TP based on the data stored in the storage unit 5, switches the display according to the input from the user, or applies the setting item input by the user Then, the image reading unit 2 and the image forming unit 3 are caused to perform processing.

  In addition, the control unit 7 has a function of generating an audio signal representing the process or setting item indicated by the process type information or setting information based on the above-described process type information or setting information. When generating the voice signal, it is preferable to store a plurality of data representing voice messages having a predetermined pattern and generate the synthesized voice data.

[2. Operation]
Based on the above configuration, the multifunction peripheral 100 executes copy processing and scan processing. Specifically, first, the control unit 7 of the multifunction peripheral 100 displays a screen for starting various processes on the touch panel TP of the UI unit 6. If the process performed at this time is a copy process, the screen displayed on the touch panel TP is a screen as shown in FIG.

  Here, when the setting item related to the processing to be performed at this time is selected and the start button B2 is pressed, the control unit 7 applies the selected setting item and performs the entire processing of the multifunction peripheral 100 so as to perform the selected processing. Control. For example, if the process selected at this time is a copy process, the control unit 7 supplies information relating to the magnification, density, paper, and the like indicated by the selected setting item to the image forming unit 3 together with the image data. 3 forms an image according to the information.

  The above operation is the “normal mode” operation that the multi-function device 100 normally performs. On the other hand, when the voice reading button B1 is pressed, the multi-function device 100 operates in a “voice reading mode” in which processing performed by the apparatus 100 is described by voice. The operation at this time will be described below with reference to four types of operation examples.

[2-1. Operation example 1]
First, when the user's contact position is a setting item, the operation when the image displayed at the user's contact position is an image corresponding to the setting information will be described in detail. FIG. 4 is a flowchart showing the processing of the multi-function device 100 at this time, and will be described below with reference to this figure. In the figure, portions not related to the operation described in this operation example are omitted.

  First, the control unit 7 of the MFP 100 determines whether or not the speech reading button B1 of the UI unit 6 is pressed (S101). If this button is not pressed (S101; NO), the control unit 7 causes the multi-function device 100 to operate in the “normal mode” described above. On the other hand, if the voice reading button B1 is being pressed (S101; YES), the control unit 7 detects which position on the touch panel TP the user is touching via the UI unit 6 (S102). .

  Subsequently, the control unit 7 specifies an image drawn at the contact position on the currently displayed screen (S103). Further, the control unit 7 determines the type of the image (S104). If it is determined that the image corresponds to the setting information (S104; YES), the control unit 7 performs a process for reading the setting item, If the image does not correspond to the setting information (S104; NO), processing according to the area is performed. For example, when the contact position is the message area t1, the control unit 7 performs a process for reading a message displayed in the message area t1.

  When the contact position corresponds to the setting information, the control unit 7 reads out the setting item indicated by the setting information. At this time, the control unit 7 displays not only the setting item corresponding to the contact position but also the setting item. Also read out the higher setting items that are pending. That is, when the contact position is the above-mentioned detailed setting item, the control unit 7 simultaneously reads out the basic setting item to which the setting item is related and the process to which the basic setting item is related. When the contact position is a basic setting item, the control unit 7 simultaneously reads out the process to which the basic setting item is pending. In order to realize such an operation, the control unit 7 analyzes the hierarchical structure of the information stored in the storage unit 5 and determines whether there is a higher setting item or process that has not yet been read (S105). ).

  When there is information that has not been read out (S105; YES), the control unit 7 outputs a sound signal that represents a setting item corresponding to the contact position and a process (and a setting item) that the setting item is associated with. A signal is generated and supplied to the audio output unit 4 (S106). If there is no information that has not been read out (S105; NO), the control unit 7 generates an audio signal representing a setting item corresponding to the contact position, and supplies this to the audio output unit 4 (S107). The audio output unit 4 outputs audio corresponding to the supplied audio signal (S108).

  In the “normal mode”, the setting item is selected when the user touches the image corresponding to the setting item. In the “speech-to-speech mode”, the setting item is simply read out and can be selected. Not done. In the “speech reading mode”, the release state of the voice reading button B1 is an operation indicating that the selection by the user has been performed. Therefore, the control unit 7 determines whether or not the voice reading button B1 has been released after the voice is output (S109). When the voice reading button B1 is released (S109; YES), the control unit 7 temporarily stores the setting item read out (S110). If the voice reading button B1 is not released (S109; NO), the control unit 7 determines that the user has not selected the setting item read out, and performs the processing from step S102 again.

  After the voice reading button B1 is released, the control unit 7 determines whether or not the start button B2 is pressed (S111). When the start button B2 is pressed (S111; YES), the control unit 7 causes the image reading unit 2 or the image forming unit 3 to perform a process to which the setting item stored in step S110 is applied (S112). When setting a plurality of setting items, the processing from step S101 described above is repeated without pressing the start button B2 (S111; NO).

  By operating as described above, the multifunction peripheral 100 can read out the setting item that the user is trying to select. For example, when the user is in contact with the position A in FIG. 5, that is, the setting item of “magnification” in “basic copy” of “copy processing” and the magnification is “70%”. The MFP 100 plays the voice guidance such as “Currently,“ Copy processing ”is set to“ Basic copy ”. The“ Zoom ”currently selected is“ 70% ”.” ” To do. If the user wants to execute the process with this setting, the user may release the voice reading button B1 and press the start button B2. If the user wants to change the setting, the user may continue the operation without releasing the voice reading button B1. If the voice reading button B1 is not released, the setting is not confirmed and the voice guidance of the contact position is performed again.

  By performing the voice guidance described above, the multi-function device 100 according to the present embodiment can audibly recognize the processing to be performed thereafter and the setting items. As a result, according to the MFP 100 of the present embodiment, it is possible to easily execute a desired process even for a visually impaired person.

  In the example of FIG. 5 described above, the setting item read out by the MFP 100 is only the magnification, that is, the setting item corresponding to the contact position of the user. At the same time, the setting item selected at this time is set. You may read all of the items. In other words, in the example of FIG. 5, the voice guidance to be played in this case is “Currently,“ Copy processing ”is set to“ Basic copy ”. Is “70%”, “Current” is set to “Normal”, “Paper” is set to “Automatic”, and “Original image quality” is set to “Character”. Such processing can be performed by generating an audio signal after referring to the setting items set as initial values and the setting items stored in step S110 in the step of generating audio signals (S106). It becomes.

[2-2. Operation example 2]
Subsequently, another operation example in the present embodiment will be described. Here, a case will be described in which the setting item corresponding to the contact position of the user is a setting item that can be set in more detail according to options. FIG. 6 is a flowchart showing the processing of the multi-function device 100 at this time, and will be described below with reference to this figure. In addition, since the process of step S201-S204 is the same as the process of step S101-S104 of the operation example 1 mentioned above, description is abbreviate | omitted here. Also, as in the above-described operation example 1, those parts that are not related to the operation described in this operation example are also omitted in FIG.

  When the contact position corresponds to the setting information (S204; YES), the control unit 7 determines whether or not lower setting information related to the setting information exists (S205). When the lower setting information is associated with the setting information corresponding to the contact position, that is, when the setting item that the user is trying to select has a detailed setting item as an option (S205; YES), control is performed. The unit 7 analyzes the hierarchical structure of the information stored in the storage unit 5 and determines whether or not there is a higher setting item or process that has not yet been read out (S206). Note that when the lower setting information is not associated with the setting information corresponding to the contact position (S205; NO), the control unit 7 performs the same processing as in the first operation example.

  Here, when there is information that has not been read out (S206; YES), the control unit 7 performs an audio signal representing a setting item corresponding to the contact position, and a process (and setting item) to which the setting item is associated. Is generated and supplied to the audio output unit 4 (S207). When there is no information that has not been read out (S206; NO), the control unit 7 skips the process of step S207. Thereafter, the control unit 7 reads out lower setting information related to the setting information corresponding to the contact position from the storage unit 5, generates an audio signal representing the setting item indicated by the setting information, and supplies the audio signal to the audio output unit 4 ( S208). The audio output unit 4 outputs audio corresponding to these supplied audio signals (S209).

  Subsequently, the control unit 7 determines whether or not the voice reading button B1 is released after the voice is output (S210). When the voice reading button B1 is released (S210; YES), the control unit 7 temporarily stores the setting item read out (S211). If the voice reading button B1 is not released (S210; NO), the control unit 7 determines that the setting item read out by the user has not been selected or that more detailed setting will be performed from now on, and the step again is performed. The process from S202 is performed.

  The control unit 7 determines whether or not the start button B2 is pressed within a predetermined time after the voice reading button B1 is released (S212). When the start button B2 is pressed (S212; YES), the control unit 7 causes the image reading unit 2 or the image forming unit 3 to perform a process to which the setting item stored in step S212 is applied (S213). When changing the setting item or setting a plurality of setting items, the processing from step S201 described above is repeated without pressing the start button B2 (S212; NO).

  By operating as described above, the multifunction peripheral 100 can read out the setting item that the user is trying to select and the options (detailed setting items) that can be set in the item. For example, if the user is in contact with the position B in FIG. 7, that is, the position where the “Basic Copy” tab of “Copy Processing” is located, “Basic copy” is set.Here, the voice guidance such as “Zoom”, “Paper”, “Density”, “Original image quality” can be set. ” At this time, if an initial value is set in advance for each item, in addition to the voice guidance described above, for example, “currently,“ magnification ”is“ automatic ”,“ density ”is“ normal ”,“ Voice guidance such as “Paper” is set to “Automatic” and “Original image quality” is set to “Text” may be reproduced.

  If the user touches the position indicated by C in FIG. 7, that is, the position indicating the setting item of “magnification” in “basic copy” of “copy processing”, the multi-function device 100 displays “current, In addition to voice guidance such as “Copy processing” “Basic copy setting”, “Selectable“ Scale ”is“ Auto ”,“ 100% ”,“ 86% ”,“ 70% ” The voice guidance such as “141%” and “other magnifications” is reproduced. Also at this time, if initial values are set in advance for each item, a voice guidance explaining the initial values may be reproduced.

  By performing such voice guidance, the multifunction peripheral 100 according to the present embodiment aurally recognizes more detailed setting items applicable to the processing in addition to the processing to be performed thereafter and the setting items. Together with it. Therefore, according to the multifunction device 100, even a visually handicapped person can easily execute a desired process without hesitating selective setting items.

[2-3. Operation example 3]
The above-described operation examples 1 and 2 are operation examples when the contact position of the user corresponds to the selection item. However, in the display area of the touch panel TP, there is an area where no button is assigned. In the “normal mode”, no special processing is performed even if the user touches such a position. However, in the “speech reading mode”, the user can use such a position for the convenience of the visually impaired. Voice guidance is also provided when touching. In this operation example, processing performed in such a case will be described.

  FIG. 8 is a flowchart illustrating processing performed by the multifunction peripheral 100 in this operation example. In the figure, the processing in steps S301 to S303 is the same as the processing in steps S101 to S103 in the first operation example. Therefore, description of these steps is omitted here, and processing from step S304 will be described.

  In step S303, when the image drawn at the contact position of the user is specified, the control unit 7 determines whether this image is a “non-specific image” (S304). Here, the “non-specific image” is an image other than an image that is predefined to read out a specific voice when the user touches, such as a button indicating a predetermined setting item. The background part in the region and the part between the buttons correspond to the non-specific image.

  When the image at the contact position is a non-specific image (S304; YES), the control unit 7 specifies an image other than the non-specific image near the non-specific image (S305). At the same time, the control unit 7 specifies the direction viewed from the contact position of the specified image based on the screen display of the UI unit 6. The direction specified here may be relatively simple information such as “up”, “down”, “left”, and “right”. Of course, the direction may be defined in more detail. If the image at the contact position is not a non-specific image (S304; NO), the control unit 7 ends this process and performs the same process as in the first or second operation example.

  Subsequently, the control unit 7 generates an audio signal for explaining the image specified in step S305 (step S306). For example, when the identified image is an image corresponding to the setting information, the control unit 7 generates an audio signal representing the setting item indicated by the setting information. At this time, the control unit 7 includes information indicating the direction of the setting item with the contact position as a reference in the above-described audio signal. And the control part 7 supplies the produced | generated audio | voice signal to the audio | voice output part 4, and the audio | voice output part 4 outputs the audio | voice according to the supplied audio | voice signal (S307).

  When the voice is output, the control unit 7 determines whether or not the voice reading button B1 is released (S308). If the voice reading button B1 is not released (S308; NO), the control unit 7 executes the processing from step S302 again. On the other hand, when the speech reading button B1 is released (S308; YES), the control unit 7 ends this processing and performs the same processing as in the above-described operation example 1 or 2.

  By operating as described above, the MFP 100 according to the present embodiment can guide the buttons near the contact position by voice until the user touches the button having a specific function. In other words, even if the user touches a part other than the buttons on the touch panel TP, the MFP 100 according to the present embodiment teaches the user which direction the button should move from the contact position. be able to.

  For example, when the user is in contact with the position D in FIG. 9, the multi-function device 100 determines that “copy processing” / “basic copy” “paper” is “on the right side of the currently touched position”. "There is an item for setting" Density "for" Basic Copy "on the" left "of the currently touched position." Further, at this time, a voice guidance such as “There is a tab for selecting“ Other setting ”at“ above ”of the position currently touched” may be added. By performing such voice guidance, it becomes possible for a visually handicapped person to easily perform an operation for executing a desired process.

[2-4. Operation example 4]
Here, an application example of the above-described operation example 3 will be described. In the operation example 3 described above, the processing when the setting item in the vicinity of the contact position is guided by voice along with the direction thereof has been described. However, in this operation example, the contact position is changed by the user sliding the contact position. When moving continuously, the setting items in the moving direction are guided by voice.

  FIG. 10 is a flowchart showing processing performed by the multifunction peripheral 100 in this operation example, and will be described below with reference to this figure. Note that, as in the first and second operation examples described above, portions that are not related to the operation described in this operation example are also omitted in FIG. First, the control unit 7 of the MFP 100 determines whether or not the speech reading button B1 of the UI unit 6 is pressed (S401). If this button is not pressed (S401; NO), the control unit 7 causes the multi-function device 100 to operate in the “normal mode” described above. On the other hand, if the voice reading button B1 is being pressed (S401; YES), the control unit 7 detects which position on the touch panel TP the user is touching via the UI unit 6 (S402). .

  Here, the control unit 7 determines whether or not the contact position by the user changes continuously in time (S403). When the contact position changes with time (S403; YES), the control unit 7 specifies the moving direction (S404). On the other hand, when there is no change in the contact position (S403; NO), the control unit 7 performs the same process as in any of the above-described operation examples 1 to 3.

  After specifying the moving direction of the contact position, the control unit 7 specifies the image in the moving direction from the current contact position and the type (processing type information and setting information) of the image (S405). And the control part 7 reads the process classification information and setting information which the specified image shows from the memory | storage part 5, and produces | generates the audio | voice signal showing such information (S406). At this time, the control unit 7 includes information indicating the moving direction specified in step S404 in the audio signal. And the control part 7 supplies the produced | generated audio | voice signal to the audio | voice output part 4, and the audio | voice output part 4 outputs the audio | voice according to the supplied audio | voice signal (S407).

  When the voice is output, the control unit 7 determines whether or not the voice reading button B1 is released (S408). If the speech reading button B1 is not released (S408; NO), the control unit 7 executes the processing from step S402 again. On the other hand, when the speech reading button B1 is released (S408; YES), the control unit 7 ends this process and performs the same process as any one of the operation examples 1 to 3 described above.

  By operating as described above, when the user moves the contact position on the touch panel TP, the MFP 100 according to the present embodiment can guide the setting items in the moving direction by voice. For example, when the user touches the position E in FIG. 11 and slides the position to the right, the multi-function device 100 will change the “basic copy” A voice guidance such as “You can set the density” is played.

  By configuring so that such voice guidance can be performed, a visually impaired user touches an appropriate position on the touch panel TP when, for example, the finger is removed from the touch panel TP during the operation. By sliding, the finger can be easily returned to the original position. Further, by touching the touch panel TP with a finger and sliding the finger in an appropriate direction, the setting items on the screen of the touch panel TP can be grasped.

[3. Modified example]
Although the present invention has been described with reference to one preferred embodiment, the present invention is not limited to the above-described embodiment, and various modifications can be made. Some of the modifications are shown below.

  The voice guidance shown in the above-described embodiments is only an example. For the voice guidance, an appropriate message may be used as necessary. In the embodiment described above, for the sake of convenience, the sound is output in a state where appropriate words are added before and after the word representing the process or the setting item. Of course, only the word representing the process or the setting item is sequentially output. Also good.

  In the above-described embodiment, the sound is output only after the contact position is detected. However, for example, the setting item or the like is repeated at the timing when the start button B2 is pressed, so that the user can confirm again. It may be. Alternatively, the setting item may be repeated by simultaneously pressing the voice reading button B1 and the start button B2, and then the processing may be started by releasing only the voice reading button B1.

  Further, in the above-described embodiment, for the convenience of the visually impaired, the speech reading button B1 and the start button B2 are configured by hard buttons. However, of course, these buttons do not have to be hard buttons, and may be configured to be assigned to a certain area on the touch panel.

  In the above-described embodiment, the voice reading button B1 and the start button B2 are configured by different hard buttons. However, one button can serve both functions. For example, it may be configured such that a voice reading instruction is input in a state where a certain button is pressed, and a process execution start instruction is input by releasing this button pressing state.

  In the above-described embodiment, the multi-function apparatus in which the user interface device that receives input from the user and the processing device that executes the copy processing and the scanning processing is integrated has been described. However, the user interface device and the processing device are independent of each other. It may be a device that has been used.

  Further, the processing apparatus is not limited to a copying machine or a scanner, and can be applied to various processing apparatuses including a touch panel such as an ATM or an automatic ticket vending machine. Moreover, it is also possible to apply to a computer such as a personal computer by mounting a touch panel function on the display. For example, if the processing apparatus is an ATM, balance inquiry, deposit / withdrawal, transfer, etc. correspond to an example of the above-mentioned “processing type information”.

1 is a block diagram schematically showing the configuration of a multifunction machine that is a processing apparatus according to an embodiment of the present invention. FIG. 6 is a diagram illustrating information stored in a storage unit by a multifunction machine. FIG. FIG. 3 is a diagram illustrating an appearance of a UI unit of a multifunction machine. 6 is a flowchart illustrating processing performed by the multifunction peripheral (operation example 1). It is a figure for demonstrating a user's contact position. 10 is a flowchart illustrating processing performed by the multifunction machine (operation example 2). It is a figure for demonstrating a user's contact position. 10 is a flowchart illustrating processing performed by the multifunction peripheral (operation example 3). It is a figure for demonstrating a user's contact position. 10 is a flowchart illustrating processing performed by the multifunction peripheral (operation example 4). It is a figure for demonstrating a user's contact position.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Multifunction machine 101 ... Communication part 102 ... Image reading part 103 ... Image forming part 104 ... Audio | voice output part 105 ... Memory | storage part 106 ... UI part 107 ... Control part

Claims (6)

A storage unit that associates and stores processing type information indicating processing that can be executed by a processing device connected to the own device, and setting information indicating setting items applied to the processing;
First input means for inputting an instruction to read out the setting item by voice;
A second input means for inputting an instruction to start execution of the processing by the processing device;
Display input means having a display area for sensing a user's contact, wherein the setting information stored in the storage means is displayed as an image on a part of the display area, and the user touches a position in the display area. When the image is displayed at the contact position, display input means for supplying the setting information indicated by the image;
When an instruction is input to the first input unit, the processing type information stored in association with the setting information supplied by the display input unit is read from the storage unit, and the processing type information, the setting information, Signal generating means for generating an audio signal representing the processing and setting items indicated by:
On the basis of the sound signal generated by the signal generation means, sound generation means for generating the processing and setting items represented by the sound signal as sound,
When the sound generation unit sounds the process and the setting item and an instruction is input to the second input unit, the process is performed by applying the setting item indicated by the setting information supplied by the display input unit. And an output means for outputting an instruction to execute the processing to the processing device. The setting information includes
Upper setting information indicating basic setting items which are basic setting items related to the processing;
Lower setting information indicating detailed setting items related to the basic setting items,
The signal generating means includes
When an instruction is input to the first input unit and the setting information supplied by the display input unit is the lower setting information, the detailed setting item indicated by the lower setting information and its The user interface device according to claim 1, wherein an audio signal representing a basic setting item is generated. The setting information includes
Upper setting information indicating basic setting items which are basic setting items related to the processing;
Lower setting information indicating detailed setting items related to the basic setting items,
The signal generating means includes
When an instruction is input to the first input unit and the setting information supplied by the display input unit is the upper setting information, the basic setting item indicated by the upper setting information and its The user interface device according to claim 1, wherein an audio signal representing a detailed setting item is generated. The display input means includes
When the image displayed at the contact position is not an image indicating the setting information, the setting information indicated by the image displayed in the vicinity of the contact position and the direction of the image with reference to the contact position Direction information indicating the signal generating means,
The signal generating means includes
When an instruction is input to the first input means, based on the setting information and direction information supplied by the display input means, processing type information stored in association with the setting information is stored in the storage means. The user interface device according to claim 1, further comprising: generating an audio signal representing a process and setting items indicated by the processing type information and the setting information and a direction indicated by the direction information. The display input means includes
When it is detected that the contact position is moving in a certain direction, the signal generation means includes direction information indicating the direction and setting information indicated by an image displayed in the direction when viewed from the contact position. To supply
The signal generating means includes
The audio signal representing the setting item indicated by the setting information and the direction indicated by the direction information is generated based on the setting information and the direction information supplied by the display input unit. User interface device. The output means includes
When the instruction is not input to the first input unit and the instruction is input to the second input unit, the processing is performed by applying the setting item indicated by the setting information supplied by the display input unit. The user interface device according to claim 1, wherein an instruction to execute is output to the processing device.

Images