JP7103074B2 - Image forming device and operation method - Google Patents

Description

The present invention relates to an image forming apparatus and an operating method.

In recent years, the widespread use of voice operations has made it easier for visually impaired people to operate devices including image forming devices. On the other hand, for hearing-impaired people, voice operation is difficult, and conventional panel operation is easier to operate. Moreover, even if it is a healthy person, there are users who prefer voice operation and users who prefer panel operation, so it is necessary to provide a user interface suitable for each user.

Therefore, a mode switching key that activates the voice guidance mode that is easy for visually impaired people to understand is provided on the front side of the image forming device on the operation panel, and when the voice guidance mode is activated, the key is read aloud according to the key operation. The configuration to be performed is disclosed (see, for example, Patent Document 1).

In addition, it is determined whether the operator is a visually impaired person or a sighted person according to each setting of the PC set by the operator and the characteristics of the input operation of the operator, and the operator uses the operation screen. A configuration for switching to an easy-to-use operation screen is disclosed (see, for example, Patent Document 2).

In addition, a handset that guides the visually impaired to operate, a first speaker that sends voice guidance that guides the visually impaired to pick up the handset, and a notification sound that informs the visually impaired of the installation position of the handset. A configuration is disclosed in which a second speaker to be transmitted is provided, and a card inserted by the customer is used to determine that the person is visually impaired (see, for example, Patent Document 3).

By the way, in a device shared by a plurality of users such as an image forming device, it is shared by both healthy persons and persons with disabilities. Generally, when using the copy function or scan function using the user interface of the image forming apparatus main body, in order to determine whether each user is a healthy person or a disabled person, it is necessary to register the user in the image forming apparatus in advance. Disability information etc. are registered, and it is determined by performing user authentication.

For example, the technique described in Patent Document 1 describes personal authentication (authentication means by code input, authentication means by card reader, authentication means by voice recognition, authentication means by fingerprint recognition, etc.) as means for distinguishing between a healthy person and a visually impaired person. ) Is adopted. Further, the technique described in Patent Document 2 is determined from the difference in operating devices (mouse, keyboard) (the visually impaired person uses the keyboard), the PC setting, and the installation application as a means for distinguishing between a healthy person and a visually impaired person. The method is adopted. Further, the technique described in Patent Document 3 employs card authentication as a means for distinguishing between a healthy person and a visually impaired person.

Japanese Unexamined Patent Publication No. 2005-257973 Japanese Unexamined Patent Publication No. 2009-129313 JP-A-2015-230663

However, in the technique described in Patent Document 1, it is necessary to register disability information and the like in an image forming apparatus in advance, but a public user (for example, a user who is temporarily used during a business trip or an image forming apparatus at a convenience store is used. When used as a user, etc.), since the information is not registered in the image forming apparatus, it is not possible to determine the user's disability.
In addition, the method of judging from the difference in the operating device described in Patent Document 2 cannot discriminate a disability other than a visual disability. In addition, in the method of judging from the PC settings and installed apps, it is necessary to install the PC settings and apps in advance, but when using as a public user, the settings and apps are installed in the image forming device. Therefore, it is not possible to determine the user's disability.
Further, since the technique described in Patent Document 3 is a technique for determining that a customer is a visually impaired person by card authentication, it is necessary to register authentication information in an image forming apparatus in advance, but a public user. Since the authentication information is not registered in the image forming apparatus, it is not possible to determine the user's disability.

An object of the present invention is to provide an image forming apparatus and an operation method capable of ensuring user convenience even in a case where user authentication cannot be used in an apparatus shared by a plurality of users.

The invention according to claim 1 has been made in order to achieve the above object.
In an image forming apparatus including an image forming portion for forming an image on paper,
An operation panel with a display unit that displays various information to the user,
An audio input / output unit that accepts operation input by the user's voice and outputs voice guidance that prompts the user's operation.
An operation prediction unit that detects that a user in the vicinity of the own device is trying to operate the own device,
Based on the reaction of the user after prompting the user to perform a voice operation by the voice guidance output by the voice input / output unit in a state where the panel display by the operation panel is hidden for the user detected by the operation prediction unit. The operation control unit that switches to the user interface suitable for the user,
It is characterized by having.

The invention according to claim 2 is the image forming apparatus according to claim 1.
After prompting the voice operation, the operation control unit does not accept the voice operation by the voice input / output unit, and when the power saving key for shifting / returning to the power saving mode is pressed, the voice is turned on. It is characterized in that all sound input / output functions including the reception of the voice operation by the output unit and the output of the voice guidance are stopped, and the panel display by the operation panel is started to accept the panel operation by the user.

The invention according to claim 3 is the image forming apparatus according to claim 1 or 2.
When the operation control unit receives the voice operation by the voice input / output unit after prompting the voice operation, the operation control unit continues to accept the voice operation and output the voice guidance by the voice input / output unit. It is a feature.

The invention according to claim 4 is the image forming apparatus according to claim 3.
Equipped with an image reader that reads the image of the original
When the received voice operation is an operation that requires image reading by the image reading unit, the operation control unit causes the display unit to display an instruction for prompting the image reading unit to set the original. When the set of the originals is detected, the output of the voice guidance is continued, and when the set of the originals is not detected, the voice guidance is switched to the voice guidance for the visually impaired.

The invention according to claim 5 is the image forming apparatus according to any one of claims 1 to 4.
When the operation control unit detects a touch operation of the operation panel by the user without receiving the voice operation by the voice input / output unit after prompting the voice operation, the panel display by the operation panel is started. It is characterized in that the panel operation by the user is accepted.

The invention according to claim 6 is the image forming apparatus according to claim 5.
When the operation control unit starts the panel display by the operation panel, accepts the panel operation by the user, and continues the output of the voice guidance, and detects the panel operation by the user in the middle of the voice guidance, When the reception of the voice operation by the voice input / output unit and the output of the voice guidance are stopped and the panel operation by the user is detected after the end of the voice guidance, the reception of the voice operation by the voice input / output unit and the reception of the voice operation by the voice input / output unit are performed. It is characterized in that the output of the voice guidance is continued.

The invention according to claim 7 is the image forming apparatus according to any one of claims 1 to 6.
When the operation control unit does not detect the operation by the user for a certain period of time after prompting the voice operation, the operation control unit causes the display unit to display a display asking for switching to the panel operation by the user, and proceeds to the panel operation. When a predetermined operation to be switched is detected, the reception of the voice operation by the voice input / output unit is stopped, the panel display by the operation panel is started, the panel operation by the user is accepted, and the panel operation is switched to. When a predetermined operation is not detected, the voice input / output unit again outputs a voice guidance prompting the voice operation.

The invention according to claim 8 is the image forming apparatus according to claim 7.
When the operation control unit detects a predetermined operation for switching to the panel operation, the operation control unit stops the reception of the voice operation by the voice input / output unit, starts the panel display by the operation panel, and starts the panel display by the user. When the operation is accepted and the output of the voice guidance is continued, and the panel operation by the user is detected during the voice guidance, the output of the voice guidance by the voice input / output unit is stopped, and the voice guidance ends. When the panel operation by the user is detected later, the voice guidance output by the voice input / output unit is continued.

The invention according to claim 9 is the image forming apparatus according to any one of claims 1 to 8.
When the operation control unit detects that the user detected by the operation prediction unit is separated from the own device by a certain distance, the operation control unit outputs a voice guidance prompting the voice operation by the voice input / output unit and the voice operation. It is characterized by stopping the reception.

The invention according to claim 10
An operation panel having an image forming unit for forming an image on paper and a display unit for displaying various information to the user, accepting operation input by the user's voice, and outputting voice guidance prompting the user's operation. It is an operation method of an image forming apparatus including an audio input / output unit.
An operation prediction step for detecting that a user in the vicinity of the own device is trying to operate the own device, and
Based on the reaction of the user after prompting the user to perform a voice operation by the voice guidance output by the voice input / output unit in a state where the panel display by the operation panel is hidden for the user detected in the operation prediction step. And the operation control step to switch to the user interface suitable for the user,
including.

According to the present invention, in a device shared by a plurality of users, the convenience of the user can be ensured even in the case where the user authentication cannot be used.

It is a figure which shows the schematic structure of the image forming apparatus which concerns on this embodiment. It is a functional block diagram which shows the control structure of the image forming apparatus which concerns on this embodiment. It is a figure which shows the flowchart which shows the operation of the image forming apparatus which concerns on this embodiment. It is a figure which shows the flowchart which shows the operation of the image forming apparatus which concerns on this embodiment. It is a figure which shows an example of the state of the operation panel in a standby state. It is a figure which shows an example of the appearance that the voice guidance by a voice operation unit is started. It is a figure which shows an example of a state in which all sound input / output by a voice operation part is stopped, and panel display by an operation panel is started. It is a figure which shows an example of a state in which a voice operation (BOX transmission operation) by a user is performed. It is a figure which shows an example of a state in which a voice operation (copy operation) by a user is performed. It is a figure which shows an example of a state in which voice guidance for a voice operation (BOX transmission operation) by a user is performed. It is a figure which shows an example of the state which displayed the instruction prompting to set a document on the operation panel while performing voice guidance. It is a figure which shows an example of a state in which voice guidance for a manuscript set by a user is performed. It is a figure which shows an example of a state in which voice guidance was given to prompt a visually impaired person to set a manuscript. It is a figure which shows an example of a state in which a panel display by an operation panel is started, and voice guidance including the fact that voice operation is accepted is continuously performed. It is a figure which shows an example of a state in which voice guidance to prompt the next operation was continuously performed. It is a figure which shows an example of a state in which the voice guidance is turned off. It is a figure which shows an example of a state in which a panel touch instruction for a person who desires a panel operation is displayed on an operation panel. It is a figure which shows an example of the appearance that the voice guidance for prompting a voice operation is executed again. It is a figure which shows an example of the state when a user is separated from an image forming apparatus.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

[1. Configuration description]
The image forming apparatus 1 according to the present embodiment is, for example, a multifunction device having a plurality of functions such as a printer function, a scanner function, a copy function, and a facsimile function. The image forming apparatus 1 forms an image on paper based on the image data obtained by reading an image from a document or the image data received from an external device.

As shown in FIGS. 1 and 2, the image forming apparatus 1 includes a control unit 10, a storage unit 20, an image reading unit 30, an image forming unit 40, a printer controller 50, an operation panel 60, and a voice operation. A unit 70, a network I / F80, a wireless I / F90, a short-range wireless I / F100, and a camera 110 are provided. Each part of the image forming apparatus 1 is connected via the bus 2.

The control unit 10 includes a CPU 11, a ROM 12 in which a control program is stored, an S-RAM (Static Random Access Memory) 13 for work, and a battery-backed NV-RAM (nonvolatile memory) that stores various settings related to image formation. ) 14, the clock IC15 is provided. The CPU 11 expands the control program stored in the ROM 12 and various settings related to image formation stored in the NV-RAM 14 into the S-RAM 13, and collaborates with various programs expanded in the S-RAM 13 to obtain an image. The operation of the forming device 1 is comprehensively controlled.

The storage unit 20 is, for example, a hard disk device. The storage unit 20 stores various programs, various setting data, job data, and the like readable and writable from the control unit 10.

The image reading unit 30 includes an automatic document transporting unit 31 and a scanner unit 32, and scans an image of a document.
The automatic document transporting unit 31 is configured to include a mounting tray on which the document is placed, a mechanism for transporting the document, a transport roller, and the like, and transports the document to a predetermined transport path.
The scanner unit 32 is configured to include an optical system such as a light source and a reflecting mirror, irradiates a document transported along a predetermined transport path or a document placed on platen glass with a light source, and receives reflected light. Further, the scanner unit 32 converts the received reflected light into an electric signal and outputs it to the control unit 10.

The image forming unit 40 creates an image on the paper supplied from the paper feed tray T1 or the large capacity paper feed tray T2 based on the electric signal received from the image reading unit 30 or the print job received from the external device via the network N. And create a printed matter. In the image forming unit 40, the electrostatic latent image formed on the charged photoconductor is developed into a toner image, and the toner images of each color are superimposed on the intermediate transfer belt and then transferred to the paper, so-called electrophotographic. It is an image forming part of the method.

The printer controller 50 receives PDL (Page Description Language) data from an external device on the network N, rasterizes the PDL data, and generates image data in bitmap format. The printer controller 50 generates image data for each of the colors C (cyan), M (magenta), Y (yellow), and K (black), and outputs the image data to the control unit 10.

The operation panel 60 includes a display unit 61 that displays various information to the user and an operation unit 62 that receives operation input by the user.
The display unit 61 is composed of a color liquid crystal display or the like, and displays an operation screen or the like (various setting screens, various buttons, operating status of each function, etc.) according to a display control signal input from the control unit 10.
The operation unit 62 includes a touch panel provided on the screen of the display unit 61 and various hard keys arranged around the screen of the display unit 61. When the button displayed on the screen is pressed with a finger, a stylus, or the like, the operation unit 62 detects the XY coordinates of the pressed force point with a voltage value, and controls the operation signal associated with the detected position. Output to unit 10. The touch panel is not limited to the pressure-sensitive type, and may be, for example, an electrostatic type or an optical type. Further, when the hard key is pressed, the operation unit 62 outputs an operation signal associated with the pressed key to the control unit 10. The user can operate the operation unit 62 to perform image formation-related settings such as image quality setting, magnification setting, application setting, output setting, and paper setting, paper transport instruction, and stop operation of the device.

The voice operation unit (voice input / output unit) 70 includes a voice input unit such as a microphone and an AD converter, and a voice output unit such as a DA converter, an amplifier, and a speaker. The voice operation unit 70 receives the operation input by the user's voice from the microphone at the time of voice input, converts the voice input signal into digital voice input information, and outputs the voice input signal to the control unit 10. Further, the voice operation unit 70 converts the voice output signal into an analog voice output signal at the time of voice output and outputs the voice from the speaker (for example, outputs a voice guidance prompting the user to operate the voice).

The network I / F80 is a communication interface having a communication IC, a communication connector, and the like, and under the control of the control unit 10, sends and receives various information to and from an external device connected to the network N using a predetermined communication protocol. conduct.

The wireless I / F90 is composed of an antenna, a demodulation circuit, a signal processing circuit, etc., and performs wireless communication with an external device connected to the network N by a wireless communication method such as Wi-Fi (registered trademark). ..

The short-range wireless I / F100 is composed of an antenna, a demodulator circuit, a signal processing circuit, etc., and is possessed by a user who operates the image forming apparatus 1 by a wireless communication method such as Bluetooth (registered trademark) or IrDA (registered trademark). Wireless communication with mobile terminals.

The camera 110 captures a subject according to a user operation and generates image data. The image data generated by the camera 110 is combined with the information acquired by the short-range wireless I / F 100 (for example, the identification information of the mobile terminal owned by the user), and the user in the vicinity of the image forming apparatus 1 performs the image forming apparatus 1 It is used to determine whether or not you are trying to operate.

[2. Description of operation]
Next, the operation of the image forming apparatus 1 according to the present embodiment will be described with reference to the flowcharts of FIGS. 3 and 4. In the present embodiment, the image forming apparatus 1 has a voice operation mode in which voice guidance is provided by the voice operation unit 70 and voice operation by the user is received, and a panel operation mode in which panel display is performed by the operation panel 60 and panel operation is received by the user. And have. As shown in FIG. 5, the image forming apparatus 1 does not perform (hide) the panel display by the operation panel 60 (display unit 61) in the standby state (power saving state).

First, the control unit 10 determines whether or not there is a user who is trying to operate the own device (image forming device 1) in the vicinity of the own device (image forming device 1) (step S101). Specifically, the control unit 10 is in the vicinity of its own device based on the image data generated by the camera 110 and the information acquired by the short-range wireless I / F 100 (for example, the identification information of the mobile terminal possessed by the user). Determines whether or not there is a user and whether or not the user is standing facing the own device, and if there is a user near the own device and is standing facing the own device, the own device is placed near the own device. Determine that there is a user trying to operate. That is, the control unit 10 functions as the operation prediction unit of the present invention.
When the control unit 10 determines that there is a user who is trying to operate the own device in the vicinity of the own device (step S101: YES), the control unit 10 proceeds to the next step S102.
On the other hand, when the control unit 10 determines that there is a user who is trying to operate the own device in the vicinity of the own device (step S101: NO), the control unit 10 determines that there is a user who is trying to operate the own device in the vicinity of the own device. The process of step S101 is repeated until the above.

Next, the control unit 10 starts voice guidance (voice guidance) for prompting the user who is trying to operate the own device to perform voice operation (step S102). For example, as shown in FIG. 6, the control unit 10 gives voice guidance to the user U1 who is trying to operate the own device, such as "This device can be operated by voice. Please tell us the operation you want to perform." , The voice is output via the voice output unit of the voice operation unit 70. As a result, the voice operation mode is started. After that, control is performed to switch to a user interface (mode) suitable for the user based on the reaction of the user. That is, the control unit 10 functions as the operation control unit of the present invention.

Next, the control unit 10 determines whether or not the power key (power saving key for shifting to / returning to the power saving mode) is pressed by the user (step S103).
When the control unit 10 determines that the power key has been pressed by the user (step S103: YES), the control unit 10 proceeds to the next step S104.
On the other hand, when the control unit 10 determines that the power key has not been pressed by the user (step S103: NO), the control unit 10 proceeds to step S105.

In step S104, as shown in FIG. 7, the control unit 10 stops all sound input / output functions including the reception of voice operation by the voice operation unit 70 and the output of voice guidance, and displays the panel by the operation panel 60. Let's get started. That is, since the control unit 10 started the voice guidance without displaying the panel (step S102) and then the power key was pressed (step S103: YES), the user U1 who is the operator made a voice. It is determined that the image forming apparatus 1 is a hearing-impaired person who thinks that the image forming apparatus 1 is in the sleep state by looking at the hidden operation panel 60 because the guidance is not heard, and the voice operation mode is switched to the panel operation mode. After that, the control unit 10 shifts to step S121. In addition, in this embodiment, it is assumed that the sleep state is not entered by pressing the power key "during voice guidance" or "within a certain period of time from the end of voice guidance".

In step S105, the control unit 10 determines whether or not the voice operation by the user U1 is detected via the voice input unit of the voice operation unit 70. FIG. 8 shows an example in which the user U1 is performing a voice operation to the effect that “the data in the BOX is to be transmitted”.
When the control unit 10 determines that the voice operation by the user has been detected (step S105: YES), the control unit 10 proceeds to the next step S106. The users who may perform voice operations are healthy persons, visually impaired persons, and persons with limbs who have difficulty in touching the operation panel 60.
On the other hand, when the control unit 10 determines that the voice operation by the user has not been detected (step S105: NO), the control unit 10 proceeds to step S112.

In step S106, the control unit 10 determines whether or not the voice operation by the user is an operation (for example, a copy operation) that requires image reading (scanning) by the image reading unit 30 (scanner unit 32). FIG. 9 shows an example in which the user U1 performs a voice operation to the effect that he / she wants to copy.
When the control unit 10 determines that the operation requires scanning by the scanner unit 32 (step S106: YES), the control unit 10 proceeds to step S108.
On the other hand, when the control unit 10 determines that the operation does not require scanning by the scanner unit 32 (step S106: NO), the control unit 10 determines that the operator is a user who desires a voice operation, and continues the voice operation mode (step S106: NO). Step S107). For example, if the voice operation by the user U1 is a "BOX transmission operation" that does not require scanning, as shown in FIG. 10, a voice such as "I understand. Then, the BOX transmission operation will start." The guidance is output by voice via the voice output unit of the voice operation unit 70, and the voice operation mode is continued. After that, the control unit 10 shifts to step S121.

In step S108, the control unit 10 causes the operation panel 60 (display unit 61) to display an instruction prompting the image reading unit 30 (automatic document transporting unit 31) to set the document while performing voice guidance. For example, in FIG. 11, the voice operation unit 70 provides voice guidance such as "I understand. Then, the copy operation will start." And the operation panel 60 displays a panel such as "Please set the original in advance." An example of the display is shown.

Next, the control unit 10 determines whether or not the document set has been detected (step S109). Specifically, the control unit 10 determines that the document set has been detected when the document set is detected within a certain period of time after displaying the instruction for prompting the document set on the operation panel 60 in step S108. The users who may set the manuscript are healthy people and people with disabilities. Further, the user who may not set the document is a visually impaired person who cannot see the panel display by the operation panel 60.
When the control unit 10 determines that the document set in the image reading unit 30 has been detected (step S109: YES), the control unit 10 proceeds to the next step S110.
On the other hand, when the control unit 10 determines that the document set in the image reading unit 30 has not been detected (step S109: NO), the process proceeds to step S111.

In step S110, the control unit 10 determines that the operator is a user who desires voice operation, and continues the voice operation mode. For example, as shown in FIG. 12, a voice guidance such as "A document set has been detected. Please set a copy." Is output by voice via the voice output unit of the voice operation unit 70, and the voice operation mode is performed. To continue. After that, the control unit 10 shifts to step S121.

In step S111, the control unit 10 determines that the operator is a visually impaired person who cannot see the panel display by the operation panel 60, and sets the voice operation mode for the visually impaired person to perform more detailed voice operation / voice guidance. Switch. For example, as shown in FIG. 13, a voice guidance such as "First, place the manuscript at the position of XXX cm in the direction of 0 o'clock" is output by voice via the voice output unit of the voice operation unit 70, and the visually impaired person. Switch to voice operation mode. After that, the control unit 10 shifts to step S121.

In step S112, the control unit 10 determines whether or not the touch operation of the operation panel 60 by the user has been detected. Here, the reason why the touch operation of the operation panel 60 is performed without performing the voice operation is, for example, in the case of a healthy person, "Voice operation is embarrassing / I want to touch the screen, so let's touch the screen", "What kind of function I don't know if there is one, so let's check it on the screen. " Also, in the case of hearing-impaired people, there may be a reason such as "Nothing is displayed, but does it work if you touch it?" Also, in the case of a person with a language disability, there may be a reason such as "I can't operate the voice, but if I touch it, it works?"
When the control unit 10 determines that the touch operation of the operation panel 60 by the user has been detected (step S112: YES), the control unit 10 proceeds to the next step S113.
On the other hand, if it is determined that the touch operation of the operation panel 60 by the user has not been detected (step S112: NO), the process proceeds to step S117.

In step S113, the control unit 10 determines that the operator is the user who desires the panel operation, starts the panel display by the operation panel 60, and continues the voice guidance as it is. For example, as shown in FIG. 14, a voice including the fact that the panel display by the operation panel 60 is started and the voice operation such as "Please select the function to be executed from the display function. The voice operation is also accepted." Is accepted. The guidance is output by voice via the voice output unit of the voice operation unit 70, and the voice guidance is continued as it is. That is, in step S113, the control unit 10 starts the panel operation mode and continues the voice operation mode.

Next, the control unit 10 determines whether or not the panel operation (touch operation, key operation, etc.) is detected at the timing when the voice guidance ends (step S114). That is, the control unit 10 determines whether or not the user has performed the panel operation after listening to the voice guidance to the end. The users who may operate the panel after the voice guidance is completed are a healthy person and a person with a language disability. In addition, the users who may operate the panel before the voice guidance is completed are a healthy person, a hearing-impaired person who cannot hear the voice guidance, and a language-impaired person.
When the control unit 10 determines that the panel operation is detected at the timing when the voice guidance ends (that is, the panel operation is detected after the voice guidance is executed to the end) (step S114: YES), the operator operates the voice. (Voice guidance) is determined to be the desired user, and the process proceeds to the next step S115.
On the other hand, when the control unit 10 determines that the panel operation is not detected at the timing when the voice guidance ends (that is, the panel operation is detected before the voice guidance is executed to the end) (step S114: NO). It is determined that the user feels that the voice guidance is troublesome or the person is hearing impaired who cannot hear the voice guidance, and the process proceeds to step S116.

In step S115, the control unit 10 determines that the voice guidance is being heard, and continues the voice operation mode (voice operation / voice guidance). For example, as shown in FIG. 15, a voice guidance such as "The next operation is XX." Is output by voice via the voice output unit of the voice operation unit 70, and the voice operation mode is continued. After that, the control unit 10 shifts to step S121.

In step S116, as shown in FIG. 16, the control unit 10 determines that voice guidance is unnecessary, and stops the voice operation mode (voice operation / voice guidance). Specifically, the control unit 10 turns off the voice guidance and ends the reception of the voice operation. After that, the control unit 10 shifts to step S121.

In step S117, the control unit 10 determines whether or not a certain time has elapsed without detecting an operation by the user (voice operation, touch operation of the operation panel 60, etc.). Here, the fixed time is a time sufficient for the user to perform any operation, for example, 5 to 10 seconds. In addition, the reason why a certain period of time elapses without detecting the operation by the user is, for example, in the case of a healthy person, "what kind of setting should be made" or "embarrassing voice operation / want to perform touch operation, but what should I do?" Can be considered. Also, in the case of hearing-impaired people, there may be a reason such as "Nothing is displayed, what should I do?" In addition, in the case of visually impaired / physically handicapped people, there may be a reason such as "what kind of setting should be made". Also, in the case of a person with a language disability, there may be a reason such as "I can't operate the voice, but what should I do?"
When the control unit 10 determines that a certain time has elapsed (step S117: YES), as described above, "the operation content is being examined", "the operation method is unknown", "the voice operation is not desired, etc." Since various reasons can be considered, the process proceeds to the next step S118 in order to subdivide the user.
On the other hand, when the control unit 10 determines that a certain time has not elapsed (step S117: NO), the control unit 10 proceeds to step S121.

In step S118, the control unit 10 causes the operation panel 60 to display an instruction (display asking for switching to the panel operation) for the person who desires the panel operation to perform the touch operation. For example, FIG. 17 shows an example of a panel display such as "If you want to operate on the screen, please touch the screen" by the operation panel 60. At this time, since it is necessary to identify a visually impaired person, voice guidance is not performed.

Next, the control unit 10 determines whether or not the user has detected a touch operation (a predetermined operation for switching to the panel operation) of the operation panel 60 (step S119).
When the control unit 10 determines that the touch operation of the operation panel 60 by the user has been detected (step S119: YES), the control unit 10 determines that the operator is the user who desires the panel operation, proceeds to step S113, and performs voice. The acceptance of the operation is stopped, and the processing after step S113 is repeated again.
On the other hand, when it is determined that the touch operation of the operation panel 60 by the user has not been detected (step S119: NO), it is determined that the user cannot operate the panel or the user is still considering the operation content, and the next step S120 Move to.

In step S120, the control unit 10 again executes voice guidance prompting the voice operation. For example, as shown in FIG. 18, the control unit 10 gives a voice guidance to the user U1 such as "Please tell me when the operation you want to perform is decided" via the voice output unit of the voice operation unit 70. Output. After that, the control unit 10 shifts to step S121.

In step S121, the control unit 10 determines whether or not it has been detected that the user has separated from the own device (image forming device 1) by a certain distance.
When the control unit 10 determines that the user has detected that the user has separated from the own device by a certain distance (step S121: YES), the control unit 10 determines that the operation is completed and ends the process (voice operation / voice guidance). For example, FIG. 19 shows an example of a state when the user U1 is separated from the image forming apparatus 1, and shows a state in which the reception of voice operation and the voice guidance for prompting voice operation are stopped. ..
On the other hand, when the control unit 10 determines that the user has not detected that the user has separated from the own device by a certain distance (step S121: NO), the control unit 10 proceeds to step S103, and repeats the processes after step S103 again.

As described above, the image forming apparatus 1 according to the present embodiment receives the operation panel 60 having the display unit 61 for displaying various information to the user, the operation input by the user's voice, and prompts the user's operation. By the voice input / output unit (voice operation unit 70) that outputs voice guidance, the operation prediction unit (control unit 10) that detects that a user near the own device is trying to operate the own device, and the operation prediction unit. A user suitable for the user based on the reaction of the user after prompting the detected user to perform a voice operation by the voice guidance output by the voice input / output unit while the panel display by the operation panel 60 is hidden. It includes an operation control unit (control unit 10) for switching to an interface.
Therefore, according to the image forming apparatus 1 according to the present embodiment, even in a case where user authentication cannot be used in an apparatus shared by a plurality of users, it is possible to switch to a user interface suitable for each user. Convenience can be ensured.

Further, according to the image forming apparatus 1 according to the present embodiment, the operation control unit saves time for shifting to and returning to the power saving mode without receiving the voice operation by the voice input / output unit after prompting the voice operation. When the power key is pressed, all sound input / output functions including acceptance of voice operation by the voice input / output unit and output of voice guidance are stopped, and panel display by the operation panel 60 is started to perform panel operation by the user. accept.
Therefore, according to the image forming apparatus 1 according to the present embodiment, the hearing-impaired person can be identified, so that the convenience of the hearing-impaired person can be ensured at an early timing.

Further, according to the image forming apparatus 1 according to the present embodiment, when the operation control unit receives the voice operation by the voice input / output unit after prompting the voice operation, the operation control unit accepts the voice operation and the voice by the voice input / output unit. Continue to output guidance.
Therefore, according to the image forming apparatus 1 according to the present embodiment, it is possible to determine the user who desires the voice operation, so that the convenience of the user who desires the voice operation can be ensured at an early timing.

Further, according to the image forming apparatus 1 according to the present embodiment, the image reading unit 30 for reading the image of the original is provided, and the operation control unit is an operation in which the received voice operation requires the image reading unit 30 to read the image. In that case, an instruction prompting the image reading unit 30 to set the original is displayed on the display unit 61, and when the setting of the original is detected, the output of the voice guidance is continued, and when the set of the original is not detected, the setting of the original is not detected. , Switch voice guidance to voice guidance for the visually impaired.
Therefore, according to the image forming apparatus 1 according to the present embodiment, it is possible to discriminate between a user who desires voice operation and a visually impaired person. A suitable interface can be provided.

Further, according to the image forming apparatus 1 according to the present embodiment, the operation control unit detects the touch operation of the operation panel 60 by the user without receiving the voice operation by the voice input / output unit after prompting the voice operation. In this case, the panel display by the operation panel 60 is started to accept the panel operation by the user.
Therefore, according to the image forming apparatus 1 according to the present embodiment, it is possible to determine the user who desires the panel operation, so that the convenience of the user who desires the panel operation can be ensured.

Further, according to the image forming apparatus 1 according to the present embodiment, the operation control unit starts the panel display by the operation panel 60 to accept the panel operation by the user and continues the output of the voice guidance, and is in the middle of the voice guidance. When the panel operation by the user is detected, the reception of the voice operation by the voice input / output unit and the output of the voice guidance are stopped, and when the panel operation by the user is detected after the end of the voice guidance, the voice operation by the voice input / output unit is stopped. Continue to accept and output voice guidance.
Therefore, according to the image forming apparatus 1 according to the present embodiment, it is possible to distinguish between a user who desires voice operation (voice guidance) and a user who feels that voice guidance is troublesome or a hearing-impaired person who cannot hear voice guidance. Therefore, it is possible to provide an interface suitable for the user according to the user's situation (user's wishes and degree of disability).

Further, according to the image forming apparatus 1 according to the present embodiment, the operation control unit displays a display asking the user to switch to the panel operation when the operation by the user is not detected for a certain period of time after prompting the voice operation. When a predetermined operation to be displayed on the display unit 61 and switched to the panel operation is detected, the reception of the voice operation by the voice input / output unit is stopped, and the panel display by the operation panel 60 is started to perform the panel operation by the user. When the predetermined operation of accepting and switching to the panel operation is not detected, the voice input / output unit outputs the voice guidance prompting the voice operation again.
Therefore, according to the image forming apparatus 1 according to the present embodiment, it is possible to distinguish between a user who desires a panel operation and a user who cannot operate the panel or a user who is still considering the operation content. It is possible to provide an interface suitable for the user according to (the user's wishes and the degree of disability).

Further, according to the image forming apparatus 1 according to the present embodiment, when the operation control unit detects a predetermined operation for switching to the panel operation, the operation control unit stops accepting the voice operation by the voice input / output unit, and the operation panel 60 The panel display by the user is started to accept the panel operation by the user and the output of the voice guidance is continued. If the panel operation by the user is detected during the voice guidance, the output of the voice guidance by the voice input / output unit is stopped. When the panel operation by the user is detected after the end of the voice guidance, the voice guidance output by the voice input / output unit is continued.
Therefore, according to the image forming apparatus 1 according to the present embodiment, it is possible to distinguish between a user who desires voice operation (voice guidance) and a user who feels that voice guidance is troublesome or a hearing-impaired person who cannot hear voice guidance. Therefore, it is possible to provide an interface suitable for the user according to the user's situation (user's wishes and degree of disability).

Further, according to the image forming apparatus 1 according to the present embodiment, when the operation control unit detects that the user detected by the operation prediction unit is separated from the own device by a certain distance, the operation control unit performs a voice operation by the voice input / output unit. Stops the output of prompting voice guidance and the acceptance of voice operations.
Therefore, according to the image forming apparatus 1 according to the present embodiment, since it is possible to determine the end of the operation of the user, it is possible to suppress unnecessary operation of the apparatus and reduce power consumption.

Although the specific description has been given above based on the embodiment of the present invention, the present invention is not limited to the above embodiment and can be changed without departing from the gist thereof.

For example, in the above embodiment, when there is a user in the vicinity of the own device and the user is standing facing the own device, it is determined that there is a user who is trying to operate the own device in the vicinity of the own device. However, it is not limited to this. For example, when there is a user within a predetermined range from the own device, it may be determined that there is a user unconditionally.

Further, in the above embodiment, when it is detected that the user has left the own device, it is determined that the operation is completed and the process (voice operation / voice guidance) is terminated, but the present invention is limited to this. is not. For example, when it is detected that the user has left the own device and a predetermined time has elapsed from the detection, it may be determined that the operation is completed and the process may be terminated.

In addition, the detailed configuration of each device constituting the image forming device and the detailed operation of each device can be appropriately changed without departing from the spirit of the present invention.

1 Image forming device 2 Bus 10 Control unit (operation prediction unit, operation control unit)
11 CPU
12 ROM
13 S-RAM
14 NV-RAM
15 Clock IC
20 Storage unit 30 Image reading unit 31 Automatic document transfer unit 32 Scanner unit 40 Image forming unit 50 Printer controller 60 Operation panel 61 Display unit 62 Operation unit 70 Voice operation unit (audio input / output unit)
80 Network I / F
90 Wireless I / F
100 Near Field I / F
110 Camera N Network

Claims (10)

In an image forming apparatus including an image forming portion for forming an image on paper,
An operation panel with a display unit that displays various information to the user,
An audio input / output unit that accepts operation input by the user's voice and outputs voice guidance that prompts the user's operation.
An operation prediction unit that detects that a user in the vicinity of the own device is trying to operate the own device,
Based on the reaction of the user after prompting the user to perform a voice operation by the voice guidance output by the voice input / output unit in a state where the panel display by the operation panel is hidden for the user detected by the operation prediction unit. The operation control unit that switches to the user interface suitable for the user,
An image forming apparatus comprising. After prompting the voice operation, the operation control unit does not accept the voice operation by the voice input / output unit, and when the power saving key for shifting / returning to the power saving mode is pressed, the voice input is performed. A claim characterized in that all sound input / output functions including the reception of the voice operation by the output unit and the output of the voice guidance are stopped, and the panel display by the operation panel is started to accept the panel operation by the user. Item 1. The image forming apparatus according to Item 1. When the operation control unit receives the voice operation by the voice input / output unit after prompting the voice operation, the operation control unit continues to accept the voice operation and output the voice guidance by the voice input / output unit. The image forming apparatus according to claim 1 or 2. Equipped with an image reader that reads the image of the original
When the received voice operation is an operation that requires image reading by the image reading unit, the operation control unit causes the display unit to display an instruction for prompting the image reading unit to set the original. The claim is characterized in that when a set of manuscripts is detected, the output of the voice guidance is continued, and when the set of manuscripts is not detected, the voice guidance is switched to voice guidance for the visually impaired. The image forming apparatus according to 3. When the operation control unit detects a touch operation of the operation panel by the user without receiving the voice operation by the voice input / output unit after prompting the voice operation, the panel display by the operation panel is started. The image forming apparatus according to any one of claims 1 to 4, wherein the panel operation by the user is accepted. When the operation control unit starts the panel display by the operation panel, accepts the panel operation by the user, and continues the output of the voice guidance, and detects the panel operation by the user in the middle of the voice guidance, When the reception of the voice operation by the voice input / output unit and the output of the voice guidance are stopped and the panel operation by the user is detected after the end of the voice guidance, the reception of the voice operation by the voice input / output unit and the reception of the voice operation by the voice input / output unit are performed. The image forming apparatus according to claim 5, wherein the output of the voice guidance is continued. When the operation control unit does not detect the operation by the user for a certain period of time after prompting the voice operation, the operation control unit displays a display asking the user to switch to the panel operation on the display unit, and proceeds to the panel operation. When a predetermined operation to be switched is detected, the reception of the voice operation by the voice input / output unit is stopped, the panel display by the operation panel is started, the panel operation by the user is accepted, and the panel operation is switched to. The image forming apparatus according to any one of claims 1 to 6, wherein when a predetermined operation is not detected, the voice input / output unit outputs a voice guidance prompting the voice operation again. .. When the operation control unit detects a predetermined operation for switching to the panel operation, the operation control unit stops the reception of the voice operation by the voice input / output unit, starts the panel display by the operation panel, and starts the panel display by the user. When the operation is accepted and the output of the voice guidance is continued, and the panel operation by the user is detected during the voice guidance, the output of the voice guidance by the voice input / output unit is stopped, and the voice guidance ends. The image forming apparatus according to claim 7, wherein when the panel operation by the user is detected later, the output of the voice guidance by the voice input / output unit is continued. When the operation control unit detects that the user detected by the operation prediction unit is separated from the own device by a certain distance, the operation control unit outputs a voice guidance prompting the voice operation by the voice input / output unit and the voice operation. The image forming apparatus according to any one of claims 1 to 8, wherein the reception is stopped. An operation panel having an image forming unit for forming an image on paper and a display unit for displaying various information to the user, accepting operation input by the user's voice, and outputting voice guidance prompting the user's operation. It is an operation method of an image forming apparatus including an audio input / output unit.
An operation prediction step for detecting that a user in the vicinity of the own device is trying to operate the own device, and
Based on the reaction of the user after prompting the user to perform a voice operation by the voice guidance output by the voice input / output unit in a state where the panel display by the operation panel is hidden for the user detected in the operation prediction step. And the operation control step to switch to the user interface suitable for the user,
Operation method including.

Images