JP2012053925A - Information input device and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To implement a technique which utilizes an existing key constituted of hardware to feed back an operational feeling at the time of operating a virtual key, to a user with respect to an information input device using a touch panel.SOLUTION: The information input device has a plurality of touch panel keys constituted of an LCD (115) and a touch panel (112), and a hardware key (113) mechanically constituted so as to give an operational feeling to the user. The hardware key (113) is used for not only inputting a character or symbol but also selecting and settling a selection object key among the plurality of touch panel keys.

Description

  The present invention relates to an information input device and a control method thereof, and more particularly to an information input device including a touch panel and the control method thereof.

  In various devices including an image forming apparatus, an information input device using a touch panel is used. The touch panel is usually installed on the surface of a display device such as a CRT or LCD, and functions as a contact position detection device. Such an information input device specifies a virtual key from the coordinate position when the user touches a virtual pointing object (virtual key) displayed on the display device through the touch panel, and is assigned to the virtual key. Detected input.

  According to the information input device using such a touch panel, virtual keys having an arbitrary shape and size can be arranged on the screen displayed by the display device, and they can be freely displayed according to an input instruction. It is possible to switch. And since an operation instruction is input when the user touches the displayed virtual key, it is possible to provide operability that is intuitively easy for the user to understand.

  In addition, since virtual keys are displayed on the display device, it is possible to reduce the installation area by switching the screen each time the number of types of keys increases, which is far more costly than realization of keys by hardware. Can be suppressed.

  A technique using a touch panel is described in Patent Document 1, for example.

JP 7-319340 A

  However, on the other hand, the touch panel is a planar screen-like input device arranged on the display device, and therefore there is no clue to detect the position of an operation target such as a projection by touch. Also, there is no sense of pressing or clicking keys when touching the touch panel.

  For this reason, for users who rely on the tactile sensation of key operations, such as visually handicapped persons, even if the contents and information of the display screen are presented in a form other than visual information such as voice, the operation target on the display screen is not displayed. I cannot give instructions from the touch panel.

  In addition, in the case of a touch panel, the pressing stroke at the time of key operation is very small, so the feeling of operation is poor, even if a healthy person operates it, it does not know whether the operation of the touch panel is accepted or it is pressed many times, An erroneous operation may occur due to a displacement of the pressed position.

  As a solution to such a problem, for example, in addition to a virtual key by a touch panel, a key configured by hardware is separately provided, and the same function as the virtual key is assigned to this so that the user can select a favorite one. Conceivable. Since the hardware keys are mechanically configured, it is possible to give a feeling of operation to the operator.

  However, it is not preferable to add the same number of hardware keys as the virtual keys on the touch panel in terms of the occupied area and cost of the operation unit.

  Therefore, the present invention realizes a technology for feeding back a feeling of operation when operating a virtual key to an information input device using a touch panel using an existing key configured by hardware. An object of the present invention is to provide a configuration capable of reducing operational errors and ambiguity, not only for visually impaired people but also for sighted people.

  In order to solve the above-described problem, for example, an information input device according to one aspect of the present invention has the following configuration. That is, a hardware key for inputting a predetermined character or symbol, a display means for displaying a plurality of software keys assigned a predetermined function on the touch panel, and either the normal input mode or the voice assist operation mode And when the normal input mode is selected by the selection means, the predetermined character or symbol can be input using the hardware key, while the voice assist is provided by the selection means. When an operation mode is selected, the display unit has a control unit that controls the replacement operation of the plurality of software keys displayed on the touch panel by the display unit by the operation of the hardware key. When the control means further shifts to the voice assist operation mode, the control means The method of operating the hardware keys, characterized in that notification by voice.

  ADVANTAGE OF THE INVENTION According to this invention, in the information input device which uses a touch panel, the operation feeling at the time of operating a virtual key can be fed back to a user using the existing key comprised with hardware. Furthermore, since an operation method for operating a virtual key from a hardware key is notified by voice, it is possible to reduce mistakes and inconveniences in operation even for visually impaired persons as well as sighted persons.

It is a block diagram which shows an example of the hardware constitutions of the image processing apparatus in embodiment of this invention. It is a figure which shows an example of the external appearance structure of the operation part in embodiment of this invention. It is a figure which shows the numeric keypad group in detail of embodiment of this invention. It is a figure which shows the function structure of the image processing apparatus in embodiment of this invention. It is a figure which shows the example of an operation screen in a normal state displayed on LCD in embodiment of this invention. It is a figure which shows the example of an operation screen in focus display mode displayed on LCD in embodiment of this invention. It is a figure which shows the example of an operation screen when a focus moves from the state of FIG. 4B. It is a figure which shows the example of an operation screen when a determination key is pressed down in the state of FIG. 4C. 3 is a flowchart showing an operation procedure of the image processing apparatus according to the embodiment of the present invention. It is a flowchart which shows the focus movement process by the image processing apparatus in embodiment of this invention. It is a flowchart which shows the 1st audio | voice output process by the image processing apparatus in embodiment of this invention. It is a flowchart which shows the 2nd audio | voice output process by the image processing apparatus in embodiment of this invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating an example of a hardware configuration of an image processing apparatus to which the information input device of the present invention is applied. The image processing apparatus according to the present embodiment is a so-called multi function peripheral including functions such as a printer, image input, and document filing. In the figure, reference numeral 106 denotes a scanner as an image input device, and reference numeral 108 denotes a printer as an image output device. The image data scanned by the scanner 106 can be printed out to the printer 108.

  A CPU 101 is a central processing unit that controls the entire image processing apparatus. The CPU 101 is connected to each unit by a bus 104 such as a data bus. The ROM 102 stores a fixed program such as a boot program and BIOS and data. The RAM 103 functions as a work memory that provides a work area for executing processing by the main storage device and the CPU 101. The RAM 103 is also used when temporarily storing an image scanned by the scanner 106.

  The scanner controller 105 controls the operation of the scanner 106 according to the setting content by the operation unit 120 described later. The scanner 106 scans an original such as paper using an optical reading device such as a CCD, and converts image data of the original into electrical signal data.

  The printer controller 107 controls the printer 108 according to the setting content by the operation unit 120 to perform a printing operation. The printer 108 prints image data as an image on paper. Printing methods include electrophotographic methods using a photosensitive drum and a photosensitive belt, and ink jet methods that print ink directly on paper by ejecting ink from a micro nozzle array. Absent.

  The hard disk controller 109 controls a hard disk device (HDD) 110, which is an example of a storage device, and stores various data in the HDD 110 and acquires stored data. The HDD 110 stores a control program and control data for controlling the entire system, scanned image data obtained by scanning, print data, and the like.

  As shown in the figure, the operation unit 120 includes a touch panel 112, hardware keys (hereinafter referred to as “hardware keys” or “hard keys”) 113, and an LCD 115 which is an example of a display device. . The touch panel 112 is disposed on the display surface of the LCD 115. When the user touches a touch panel key (hereinafter referred to as “software key” or “soft key”) which is a virtual key displayed on the LCD 115 via the touch panel 112, the touch panel 112 displays the coordinates of the touched position. To detect. Based on the position coordinates, it can be determined which virtual key on the LCD 115 the user tried to press. On the other hand, the hardware key 113 is mechanically configured to give an operational feeling to the operator.

  The touch panel controller 111 inputs a user operation instruction via the touch panel 112. The LCD controller 114 controls the LCD 115 to display a setting operation screen.

  In the following description, for the sake of explanation, the case where it is determined that the position coordinates where the touch panel 112 has detected a touch coincides with the display position of the software key displayed on the LCD 115 is expressed as “the key has been pressed”.

  The image processing apparatus according to the present embodiment further includes a D / A converter 116, a power amplifier 117, and a speaker 118. By the operation of the control program, voice waveform data is created based on text data and phoneme data, and voice can be output from the speaker 117 via the D / A converter 116 and the power amplifier 117.

  FIG. 2A is a diagram illustrating an example of an external configuration of the operation unit 120 according to the present embodiment.

  In the figure, a touch panel 112 is overlaid on an LCD 115. The LCD 115 displays a system operation screen and software keys, and the touch panel 112 transmits the position information to the CPU 101 when the software keys are pressed.

  Each of 203 to 211 is configured as a hardware key 113, and specific functions thereof are as follows.

  A start key 203 is used when starting a document image reading operation by the scanner 106 or a printing operation by the printer 108. A stop key 204 serves to stop an operation in progress. A reset key 205 is used when initializing settings from the operation unit. The numeric keypad group 206 is usually used when inputting numerical values, such as when setting the number of copies. The clear key 207 is used when it is desired to clear the input numerical value. The ID key 208 is used when inputting a user ID.

  The guide key 209 is used to display help other than the key function regarding the setting and input method. Also, by pressing this key for a certain period of time, you can switch between the mode for normal touch panel operation and the mode for displaying focus on the screen and moving the focus with the hardware key. . This will be described in detail later.

  The user mode key 210 is used when performing special settings or detailed settings regarding the operation of the apparatus. The counter key 211 is used when checking the number of sheets printed by the apparatus. The power saving key 212 is used when the apparatus is in a standby state and it is desired to reduce power consumption. The power key 213 is used when turning on or off the power of the apparatus.

  FIG. 2B is a diagram showing the details of the numeric keypad group 206.

  The ten key group 206 is composed of 10 independent hardware keys 2060 to 2069. Each key is associated with a character or a symbol (in the example shown, any number 0-9). With this key, the user can quickly input a desired character or symbol. In addition, a physical protrusion 220 is disposed on the surface of the “5” key 2065 located substantially at the center of the numeric keypad. With this projection and a general key arrangement, a visually impaired person or the like can handle a numeric keypad with the help of tactile sensation.

  FIG. 3 is a diagram illustrating a functional configuration of the image processing apparatus according to the embodiment of the present invention. The function of each control unit surrounded by a broken line 300 is realized by a control program stored in the HDD 110. Various data used for realizing the functions described below are held by the HDD 110 or the RAM 103.

  The input control unit 301 detects a user input from the touch panel 112 and the hardware key 113, and determines which software key or hardware key the user has operated based on the screen display coordinate data 305. To do. The determination result is sent to the focus control unit 302 and the screen transition control unit 303.

  The focus control unit 302 controls the focus as an emphasis display that indicates which one of the plurality of software keys displayed on the LCD 115 is an operation target. Specifically, the focus is displayed on which key at present. Is stored, and movement of the focus is controlled based on the focus display order data 315 data. In addition, the focus control unit 302 notifies the screen display control unit 304 which key currently has focus.

  The screen transition control unit 303 controls a dialog or screen to be displayed next based on the screen transition data 311 when the key is actually pressed. The screen transition control unit 303 also stores setting values related to screen transitions and mode settings for whether to perform current focus display. The screen transition control unit 303 notifies the currently displayed screen information to the focus control unit 302, the screen display control unit 304, and the voice text data control unit 307. The screen transition control unit 303 further notifies the focus control unit 302 and the voice text data control unit 307 of information about whether or not the current focus display mode is set.

  The screen display control unit 304 creates image data of a screen that is actually displayed on the LCD 115 based on the data regarding the current screen from the screen transition control unit 303 and the screen configuration image data 306. Further, as necessary, the focus is drawn for a specific key arranged on the screen based on data from the focus control unit 302. The screen display control unit 304 also causes the LCD 115 to draw screen image data.

  Based on the screen transition information from the screen transition control unit 303 and the speech text data 312 associated with each screen or key, the voice text data control unit 307 performs some screen transition or When the focus is moved, text data for speech reading suitable for explanation is acquired from the speech text data 312. Thereafter, the voice text data control unit 307 passes the acquired voice text data to the voice synthesis utterance data control unit 308.

  The speech synthesis utterance data control unit 308 creates speech waveform data by speech synthesis based on the input speech text data and the utterance data 313 for each phoneme, and passes it to the speech output control unit 309.

  The audio output control unit 309 outputs the received audio waveform data to the D / A converter 116. Thus, the audio waveform data is D / A converted by the D / A converter 116, amplified by the power amplifier 116, and then output from the speaker 119.

  4A to 4D are diagrams illustrating examples of screens displayed on the LCD 115 according to the embodiment of the present invention.

  FIG. 4A shows an example of an operation screen in a normal state (normal mode). On this screen, software keys 401 to 416 are displayed. When the user performs key input by touching these software keys, the input control unit 301 performs input by the touch panel 112 arranged on the LCD 115. Detect. Thereafter, the input control unit 301 determines which key corresponds to the input from the input coordinates and the screen display coordinate data 305, and performs processing corresponding to the key.

  The software key shown in the figure is specifically as follows.

  A key 401 is a key for displaying a screen for performing settings relating to copy processing. A key 402 is a key for displaying a screen for performing settings relating to transmission processing of a scanned document by a network or FAX. A key 403 is a key for displaying a screen for performing settings relating to processing for saving a scanned document as scan data in the HDD 110 and printing the saved document. A key 404 is a key for displaying a screen for performing settings related to processing for saving an image scanned from a scanner to a PC or the like via a network.

  A key 405 is a key for displaying a screen for setting a document copy magnification in the copy process. A key 406 is a key for setting the copy magnification in the copy process to the same magnification (100% magnification).

  A key 407 is a key for displaying a screen for performing settings relating to a reading side of a scanned document in the copy process and settings relating to a printing side. A key 408 is a key for displaying a screen for setting processing related to finishing such as stapling processing and sorting processing of a printed document in copy processing.

  A key 409 is a key for changing the printing order of the printer job in the copy processing and setting preferential printing. A key 410 is a key for displaying a screen for selecting a sheet for printing in the copy process.

  A key 411 is a key for reducing the density at the time of printing in the copying process by one level. A key 412 is a key for setting an instruction to automatically determine the density at the time of printing in the copy process according to the scanned document. A key 413 is a key for increasing the density at the time of printing in the copying process by one level.

  A key 414 is a key for displaying a screen for setting the type of the scanned document in order to perform image processing for obtaining an optimum print result in accordance with the type of the scanned document in the copy process.

  A key 415 is a key for displaying a screen for setting complicated image processing of a scanned image such as reduced layout and binding margin setting in copy processing.

  A key 416 is a key for displaying a screen for displaying various states of the image processing apparatus such as a remaining amount of paper and a job holding state.

  When these software keys 401 to 416 displayed on the LCD 115 are touched via the touch panel 112, the processing specific to each key as described above is performed. Note that the area where some operation can be performed by the user touching the touch panel 112 is only the portion of these software keys 401 to 416, and nothing happens even if the other area is touched.

  For example, the image processing apparatus according to the present embodiment shifts to the focus display mode by pressing the guide key 209 for a predetermined time or longer. In the focus display mode, the normal state (normal mode) can be returned by pressing the guide key 209 again for a predetermined time or longer. The operation related to the mode transition may be performed by any means such as using a dedicated key, but it is not a software key but a hardware key or physical switch. Operation using is desirable.

  FIG. 4B shows an example of an operation screen in the focus display mode. In the figure, the key 406 is highlighted by a bold frame. This is the focus representing the key currently being operated. This focus display does not need to be in the form of a frame line as shown in the figure, and may be expressed such as displaying some mark or mark near the key or changing the color of the key itself. It doesn't matter. In the focus display mode, the focus is always displayed on any one of the keys displayed on the screen.

  In the focus display mode, the numeric keypad 206 is used as a key for moving this focus. In other words, the numeric keypad 206 is used as a key for selecting a touch panel key to be operated from a plurality of touch panel keys. In this example, a number 6 key 2066 is assigned as a key for moving the focus forward, and a number 4 key 2064 is assigned as the key for moving the focus backward. A number 5 key 2065 is assigned as a confirmation key for instructing to press the software key on which the focus is displayed. That is, the key 2065 is a key for inputting information assigned to the touch panel key selected as the operation target. Of course, if the focus movement key and the confirmation key are not the same, other key assignments may be used.

  Further, in the focus display mode, it is preferable to read aloud a description regarding information on a key or a screen on which the focus is currently displayed. An example of an explanatory text read out by voice is as follows.

“Moved to focus display mode. Voice guidance starts.”
“The numbers 4 and 6 move the focus. The numbers 5 confirm.”
“The current screen is the copy settings screen.”
“The same-size key has focus.”
“This key sets the copy magnification to 100%.”

  As described above, the shift to the focus display mode, the description of the assignment and operation method of the numeric keypad, the information on the current screen, the key displaying the current focus, and the information on the key with the focus are read out as voices.

  FIG. 4C shows an example of an operation screen when the focus is advanced in the forward direction by depressing the number “6” key 2066 once from the state of FIG. 4B. In FIG. 4B, the focus displayed on the key 406 moves to the key 405. In this manner, when the focus forward direction movement key 2066 is pressed, the focus moves from the key 402 to the key 416 to keys that can be operated on the display screen.

  In each screen, the key on which the focus is displayed and the order in which the focus of the key on which the focus is displayed moves are uniquely determined. When the focus moves to all the keys, the focus moves to the key that displayed the focus first on the screen.

  When the focus movement key 2064 in the reverse direction is pressed, the focus moves to each key one after another, but the order of movement is completely opposite to that of the focus movement key 2066 in the forward direction.

  Therefore, when the focus movement key 2064 in the reverse direction is pressed in the state of the operation screen shown in FIG. 4C, the focus moves from the key 405 to the key 406 and returns to the state shown in FIG. 4B.

  Similarly to the case of the forward focus movement key 2066, the focus movement key 2064 in the reverse direction also has the focus on the key that displayed the focus first on the screen when the focus display makes a round of each key. Return.

Even when the focus is moved by the operation of the focus movement key, it is preferable to read out the information of the key to which the focus has moved by voice. For example, when the focus moves from the state of FIG. 4B to the magnification setting screen display key 405 as shown in FIG. 4C,
“Magnification setting screen display key.”
“Opens the screen for setting the copy magnification.”
As described above, the name of the key to which the focus has moved and the description of the operation when the key is selected and determined are read out by voice.

  FIG. 4D shows an example of an operation screen when the key 2065 of the number “5” which is the confirmation key is pressed from the state of FIG. 4C. This screen is the same screen that is displayed when the area of the software key 405 is touched via the touch panel 112. In other words, touching the area of the key 405 of the touch panel 112 and placing the focus on the software key 405 with the focus movement key realized by the numeric keypad 206 and pressing the enter key in that state are the same operations. It ’s gone.

  Thus, the user can operate the operation screen displayed on the LCD 115 in exactly the same manner as the operation using the touch panel by moving the focus and confirming operation assigned to the numeric keypad 206 without touching the touch panel.

  In addition, since these two types of operations are not exclusive processes, the operations from the touch panel can be validated even in the focus display mode.

  As a result, the user can use both the direct operation using the touch panel and the operation from the numeric keypad 206, and can input instructions in a manner that is easy to operate on the display screen.

In addition, even when the display screen or setting is changed by the key selection confirmation operation using the confirmation key, it is preferable to read out information regarding the changed screen or setting by voice. For example, when the confirmation operation is performed with the confirmation key 2065 in the state of FIG. 4C and a screen as shown in FIG. 4D is displayed,
“The setting screen related to copy magnification has opened.”
“Please select the key to set the desired magnification.”
“The key that is currently set to 86% has focus.”
“This reduces A3 to B4 and A4 to B5.”
As described above, with respect to the newly displayed screen and the key on which the focus is displayed, the contents of the screen and information relating to settable items are read out by voice.

  By reading a series of voices and operating the numeric keypad as a hardware key, for example, even visually impaired users can rely on the information from the auditory sense by voice guidance and the tactile sense using the numeric keypad as a hardware key. By the input, it is possible to grasp the contents of the display screen displayed on the LCD and perform a setting operation.

  In the above description, it is necessary to perform a predetermined key operation in order to shift from the normal mode to the focus display mode. However, if the device is set to shift to the focus display mode by default when the apparatus is started up. This eliminates the need to be aware of the shift to the focus display mode.

  FIG. 5 is a flowchart showing an execution procedure of the operation screen display process and the audio output process described so far. A program corresponding to this flowchart is included in a control program stored in the HDD 110, loaded into the RAM 103 after the image processing apparatus is turned on, and executed by the CPU 101.

  First, in step S <b> 501, the input control unit 301 monitors instruction inputs from the touch panel 112 and hardware keys 113.

  Next, in step S502, it is determined whether or not an instruction is input from the touch panel 112 and the hardware key 113. If it is determined in step S502 that there is no instruction input, the process returns to step S501 to continue monitoring the instruction input. On the other hand, if it is determined that the instruction is input, the process proceeds to step S503.

  In step S503, it is determined whether the input is an input from the touch panel 112 or an input from the hardware key 113. If it is determined that the input is from the touch panel 112, the process advances to step S511 to perform input processing from a normal touch panel. As described above, based on the screen display coordinate data 305 and the input coordinates from the touch panel 112, it is determined which key on the screen display is the instruction input, and the process assigned to the key is performed. Thereafter, the process proceeds to step S508.

  On the other hand, if it is determined in step S503 that the input is from the hardware key 113, the process proceeds to step S504 to determine whether the current mode is the normal mode or the focus display mode. If it is determined that the current mode is the normal mode, the process advances to step S510 to perform hardware key processing in the normal mode. That is, the process originally assigned to the hardware key is performed. Therefore, in this case, the numeric keypad 206 performs processing for inputting the original numerical value displayed on each key. After the process of step S510, the process proceeds to step S508.

  On the other hand, if it is determined in step S504 that the current mode is the focus display mode, the process proceeds to step S505, where it is determined whether or not the input hardware key is a key assigned to the focus movement key. To do. If it is determined that the hardware key instructed to be input is a key assigned to the focus movement key, the process advances to step S509 to perform focus movement processing. This focus movement process will be described in detail later. After performing the focus movement process in step S509, in step S512, a first audio output process related to the focus movement is performed. The first audio output process will also be described in detail later. When the first audio output process of step S512 is completed, the process proceeds to step S508.

  On the other hand, if it is determined in step S505 that the hardware key designated as input is not a key assigned to the focus movement key, the process proceeds to step S506, where the hardware key designated as input is assigned as a confirmation instruction. It is determined whether it is a key. If it is determined that the input hardware key is not the key assigned to the confirmation instruction, the process proceeds to step S510, and the process originally assigned to the hardware key is performed as it is.

  On the other hand, if it is determined in step S506 that the hardware key that has been instructed to be input is a key that is assigned to the confirmation instruction, the process proceeds to step S507, and processing corresponding to the pressing of the key is performed. This is the same processing as when the currently selected target focus key is pressed on the touch panel. Specifically, a process of displaying a dialog as shown in FIG. 4D or setting some setting value is performed.

  Thereafter, in step S513, a second audio output process related to the key selection confirmation process is performed. The second audio output process will be described in detail later.

  When the second audio output process of step S513 is completed, a screen display update process is performed in step S508. In this case, in each touch panel process or key process, when a setting value is changed or a screen display is changed, a process of reflecting the change in the actual display device is performed.

  After the process of step S508, the process returns to step S501 to continue monitoring the input from the user.

  FIG. 6 is a flowchart showing the focus movement process in step S509. This focus movement process is basically realized by the focus control unit 302.

  First, in step S601, a currently selected key that is selected as an operation target is acquired.

  In step S602, it is determined whether the focus movement instruction is a forward movement instruction or a backward movement instruction. This determines whether the forward direction or the reverse direction is assigned to the numeric keypad, which is a hardware key for which input is instructed. If it is determined here that the instruction is to move the hardware key in the forward direction, the process proceeds to step S603.

  In step S603, it is determined whether there is a key for displaying the focus next to the key for which the focus is displayed on the current screen. If it is determined that there is a key for displaying the focus next, in step S604, the screen display control unit 304 is instructed to display the focus on the key for displaying the focus next.

  On the other hand, if it is determined in step S603 that there is no next key to display the focus, the process proceeds to step S605, where it is determined that the focus has been completed in the current screen, and the focus is set to the first key in the focus display order. The screen display control unit 304 is instructed to display. Further, in step S606, the user is notified that the key has made a round in the forward direction. This is performed by notification by sound such as a buzzer or instantaneous color reversal of the screen. Of course, voice notification may be used, but in that case, it is desirable to perform it together with the process of step S512.

  If it is determined in step S602 that the focus movement instruction is a reverse movement instruction, the process proceeds to step S607, and there is a key for displaying the focus before the key on which the focus is displayed on the current screen. Determine whether or not. If it is determined that there is a key for displaying focus, the process advances to step S608 to instruct the screen display control unit 304 to display the focus on the key for displaying focus.

  On the other hand, if it is determined in step S607 that there is no previous key for displaying the focus, the process proceeds to step S609, where it is determined that the focus has gone in the reverse direction on the current screen, and the last key in the focus display order is displayed. The screen display control unit 304 is instructed to display the focus. Further, in step S610, the user is notified that the key has made a round in the reverse direction. This is performed by notifying by sound such as a buzzer, instantaneous color reversal of the screen, or notifying by sound as in step S606 described above.

  FIG. 7 is a flowchart showing the first audio output process in step S512. The first voice output process is basically realized by the voice text data control unit 307, the voice synthesis utterance data control unit 308, and the voice output control unit 309.

  First, in step S701, a focus acquisition key after focus movement is identified.

  Next, in step S702, read-out text data relating to the name of the key is selected from the speech text data 312 associated with the key, and this is read out by speech synthesis.

  In step S703, it is determined whether this key is in a valid state or an invalid state. The valid state is a state in which the selection instruction from the user is correctly received and processed. The invalid state is a state in which the key selection instruction cannot be received depending on the state of the device, and the instruction from the user is ignored. It is a state to be done. If it is determined in step S703 that the key is valid, no processing is performed and the process proceeds to step S705. On the other hand, if it is determined in step S703 that the key is in an invalid state, in step S704, the fact that this key is currently in an invalid state and no instruction from the user is accepted is read out by speech synthesis.

  Next, in step S705, it is determined whether or not the explanatory text associated with this key exists as the voice text data 312. If it is determined here that there is no explanatory text associated with this key, no processing is performed and the process proceeds to step S707. On the other hand, if it is determined that there is an explanatory text associated with the key, in step S706, the explanatory text associated with the key is read out by speech synthesis.

  Further, in step S707, it is determined whether or not there is any setting value associated with this key. If it is determined that there is no set value associated with this key, this series of processes is terminated without performing any process. On the other hand, if it is determined that there is a setting value associated with this key, in step S708, the explanation regarding the associated setting value is read out by speech synthesis.

  FIG. 8 is a flowchart showing the second audio output process in step S513. The second voice output process is also basically realized by the voice text data control unit 307, the voice synthesis utterance data control unit 308, and the voice output control unit 309.

  First, in step S801, the selected and confirmed key is identified.

  In step S802, it is determined whether the selected and confirmed key is valid or invalid. If it is determined that the selected and confirmed key is in an invalid state, the process advances to step S809 to read out by voice synthesis that the key is in an invalid state and no confirmation operation is accepted. Thereafter, the process of step S513 is exited.

  On the other hand, if it is determined in step S802 that the selected and confirmed key is valid, the process proceeds to step S803.

  In step S803, it is determined whether or not a dialog screen has been displayed by the key determination process. This dialog screen is displayed when a new dialog screen is displayed on top of the current dialog, or when the dialog currently displayed at the top is closed, the dialog screen displayed below is displayed as the operation screen. Including the case of being redisplayed above.

  If it is determined in step S803 that the dialog is not displayed, the process advances to step S807 to determine whether any setting value has been changed due to the selection of the key. Here, if it is determined that the set value is not changed by the selection of the key, the process of step S513 is terminated without performing any process.

  On the other hand, if it is determined in step S807 that the setting value has been changed by this key selection confirmation process, the changed setting value is acquired, and information regarding the acquired setting value is read out by speech synthesis.

  If it is determined in step S803 that a dialog has been displayed, the process advances to step S804 to acquire a name associated with the displayed dialog and read the dialog name as speech.

  Further, in step S805, it is determined whether or not the explanatory text associated with the displayed dialog exists as the voice text data 312. If it is determined that there is no explanatory text associated with the dialog, no processing is performed and the processing in step S513 is terminated.

  On the other hand, if it is determined in step S805 that there is an explanatory text associated with the dialog, the associated explanatory text is acquired, and the explanatory text is read out by speech synthesis.

  According to the embodiment described above, a touch panel key to be operated is selected from among a plurality of software keys (touch panel keys) displayed on the LCD 115 by operating a hardware key, and the selection is performed by operating another hardware key. It becomes possible to confirm the operation of the hard key. According to such an operation method, since the touch panel key can be operated using the hardware key, the operator can obtain an operation feeling by the hardware key, which is caused by the lack of tactile feedback. It is possible to prevent erroneous operation.

  In the above-described embodiment, the touch panel key selection operation using the hardware keys is also notified by voice, so that the user who operates by relying on the sense of touch from the fingers and the hearing such as voice, such as the visually impaired In addition, the same operation as the touch panel operation can be performed.

(Other embodiments)
As mentioned above, although embodiment of this invention was explained in full detail, this invention may be applied to the system comprised from several apparatuses, and may be applied to the apparatus which consists of one apparatus.

  In the present invention, a software program that realizes the functions of the above-described embodiments is directly or remotely supplied to a system or apparatus, and the computer of the system or apparatus reads and executes the supplied program code. Is also achieved. In that case, as long as it has the function of a program, the form does not need to be a program.

  Therefore, in order to realize the functional processing of the present invention with a computer, the program code itself installed in the computer and the storage medium storing the program also constitute the present invention. In other words, the claims of the present invention include the computer program itself for realizing the functional processing of the present invention and a storage medium storing the program.

  In this case, the program may be in any form as long as it has a program function, such as an object code, a program executed by an interpreter, or script data supplied to the OS.

  As a storage medium for supplying the program, for example, flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R).

  As another program supply method, a client computer browser is used to connect to an Internet homepage, and the computer program of the present invention itself or a compressed file including an automatic installation function is downloaded from the homepage to a storage medium such as a hard disk. Can also be supplied. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the claims of the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  In addition to the functions of the above-described embodiments being realized by the computer executing the read program, the OS running on the computer based on the instruction of the program is a part of the actual processing. Alternatively, the functions of the above-described embodiment can be realized by performing all of them and performing the processing.

  Furthermore, after the program read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion board or The CPU or the like provided in the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

Claims (10)

A hardware key for entering a given character or symbol,
Display means for displaying a plurality of software keys to which a predetermined function is assigned on the touch panel;
A selection means for selecting either the normal input mode or the voice assist operation mode;
When the normal input mode is selected by the selection unit, the predetermined character or symbol can be input using the hardware key, while the voice assist operation mode is selected by the selection unit Control means for controlling the replacement operation of the plurality of software keys displayed on the touch panel by the display means to be performed by the operation of the hardware key;
Have
The information input device according to claim 1, wherein the control means further notifies the operation method of the hardware key for the substitute operation by voice when the voice assist operation mode is entered. In the voice assist operation mode, the substitute operation is a focus movement or a confirmation operation that is selected while moving the software key,
The information input device according to claim 1, wherein the control unit notifies the focus movement or the determination operation method by voice.   3. The information input device according to claim 2, wherein the control means notifies the information on the software key that has been moved in voice in the voice assist operation mode, and highlights the software key.   In the voice assist operation mode, the control means displays a plurality of software keys on a new screen when the confirmation operation is performed, and a predetermined one of the plurality of software keys in the new screen. 3. The information input device according to claim 2, wherein the information is displayed in a highlighted manner, and information on the new screen and information on the highlighted software key are notified by voice.   5. The control unit according to claim 1, wherein when the voice assist operation mode is selected by the selection unit, the control unit notifies by voice that the voice assist operation mode has been changed. Information input device. A determination means for determining whether the predetermined function of the operated software key is valid or invalid in the voice assist operation mode;
The control means further includes
When it is determined by the determining means that the predetermined function of the operated software key is valid, information about the operated software key is notified by voice,
The voice notification that the operated software key is invalid when the predetermined function of the operated software key is determined to be invalid by the determining means. 6. The information input device according to any one of items 1 to 5.   The information input device according to claim 3, wherein the control unit further does not perform the highlight display in the normal input mode. A control method for an information input device, comprising: a hardware key for inputting a predetermined character or symbol; and a display means for displaying a plurality of software keys assigned with a predetermined function on a touch panel.
A selection step for selecting either the normal input mode or the voice assist operation mode;
When the normal input mode is selected in the selection step, the predetermined character or symbol can be input using the hardware key, while the voice assist operation mode is selected in the selection step Is a control step of controlling the replacement operation of the plurality of software keys displayed on the touch panel by the display means to be performed by the operation of the hardware key;
Have
The control step further includes a method of notifying the operation method of the hardware key for the substitute operation by voice when the mode is shifted to the voice assist operation mode.   A computer-readable storage medium storing a program for causing a computer to execute the steps of the method for controlling the information input device according to claim 8.   The program for making a computer perform each step of the control method of the information input device of Claim 8.

Images