JP2021056810A - Information processing device, image forming device, information processing method, and program - Google Patents

Abstract

To provide a technique that enables users, even if they are unfamiliar with information processing devices, to execute jobs based on voice input.SOLUTION: An information processing device includes an acquisition unit 102 configured to acquire setting contents of a job, a generation unit 104 configured to generate voice data of the voice of wording indicating the setting contents acquired by the acquisition unit, and a transmission unit 106 configured to transmit the voice data to an external device that outputs the voice based on the voice data.SELECTED DRAWING: Figure 11

Description

The present disclosure relates to information processing devices, image forming devices, information processing methods, and programs.

There is an information processing device that displays a setting screen in which various setting contents are input by the user. The information processing device executes a job based on the input setting contents. Further, the information processing apparatus can execute a job based on voice input from the user (see, for example, Patent Document 1).

JP 2015-166912

In general, when the information processing device executes a job based on voice input, the burden on the user is lighter than when the information processing device executes the job by manually inputting the setting contents from the setting screen. When the user causes the information processing apparatus to execute a job based on voice input, the user needs to utter the wording of the setting contents by voice. Therefore, this user needs to remember the settings. However, the user who is unfamiliar with the information processing device does not remember the setting contents. In the invention described in Patent Document 1, there may be a problem that such an unfamiliar user cannot cause the information processing apparatus to execute a job based on voice input.

The present disclosure has been made to solve the above-mentioned problems, and the purpose in a certain aspect is to execute a job based on voice input to the information processing device even by a user who is unfamiliar with the information processing device. It is to provide the technology to make it.

According to a certain aspect of the present disclosure, an acquisition unit that acquires the setting contents of the job, a generation unit that generates audio data of the voice of the wording indicating the setting contents acquired by the acquisition unit, and an external that outputs the audio based on the audio data. An information processing device including a transmission unit that transmits voice data to the device is provided.

In a certain aspect, the acquisition unit acquires a plurality of setting contents, the generation unit generates audio data for each of the plurality of setting contents, and the transmission unit outputs audio based on each of the audio data for each of the plurality of setting contents. Sends audio data for each of multiple settings to an external device.

In a certain aspect, the information processing device further includes a microphone into which voice is input and a first promotion unit that executes a first promotion process for urging the user to input the user's voice into the microphone. , The voice data of the user's voice input to the microphone after the execution of the first promotion process is added to the voice data generated by the generation unit to generate new voice data, and the transmission unit generates new voice. Send new audio data to an external device that outputs data-based audio.

In a certain aspect, the first promotion unit executes a second promotion process that promotes the user to input the user's voice to the microphone when the voice based on the new voice data is input to the microphone from the external device. In the information processing device, further, when the characteristic information of the user's voice input to the microphone after the execution of the second promotion process and the characteristic information of the user's voice included in the voice based on the new voice data are the same. The first execution unit is provided to execute a job based on the setting contents indicated by the voice based on the new voice data.

According to another aspect of the present disclosure, if a microphone is input with audio, and the voice of the wording indicating the job settings and the user's voice are input to the microphone, the user is input with the user's voice into the microphone. The characteristic information of the user's voice input to the microphone before the promotion of the first promotion unit and the promotion of the first promotion unit is the same as the characteristic amount of the user's voice input to the microphone after the promotion of the first promotion unit. In this case, an information processing apparatus including a first execution unit that executes a job based on the setting contents of the job indicated by the voice input to the microphone before the promotion of the first promotion unit is provided.

In one aspect, the feature information of the voice is a voiceprint.

In a certain aspect, the generation unit generates voice data based on the content of the number of characters smaller than the number of characters of the wording indicating the setting content acquired by the acquisition unit, and the transmission unit generates the voice data based on the voice data based on the content of the small number of characters. The information processing device according to any one of claims 1 to 4, wherein voice data is transmitted to the external device so as to be output to the external device.

In a certain aspect, a second execution unit that executes a job based on the setting contents indicated by the voice output from the external device is provided, the acquisition unit acquires the change of the job setting contents, and the second execution unit acquires. Execute the job based on the settings that reflect the changes acquired by the department.

According to another aspect of the present disclosure, when a microphone to which a voice is input and a voice of a word indicating a job setting content are input to the microphone, an execution unit that executes a job based on the setting content indicated by the voice. And an acquisition unit that acquires changes in the setting contents of the job, and the execution unit is provided with an information processing device that executes a job based on the setting contents that reflect the changes input to the acquisition unit.

In a certain aspect, a second promotion unit that prompts the user to input a change in the setting content to the acquisition unit is further provided.

According to another aspect of the present disclosure, the selection acceptance procedure for accepting the selection of the setting contents of the job to be executed by the computer to be executed by the information processing apparatus, the decision acceptance procedure for accepting the decision of the selected setting contents, and the determined setting contents are performed. A program for executing an output procedure for outputting the voice of the indicated wording is provided.

In a certain aspect, the selection acceptance procedure is a procedure for accepting the selection of the setting content by designating the setting content displayed in the display area by the user.

In one aspect, the program causes the computer to further perform a request procedure that further requests the server device for voice data based on the determined settings, and the output procedure is the voice data received from the server device by the request procedure. It is a procedure for outputting audio, and the program further causes the computer to perform a storage procedure for storing the audio data received from the server device in a predetermined area according to the request procedure.

In a certain aspect, the program causes the computer to further execute a change procedure for changing the setting contents selected in the selection acceptance procedure to the setting contents according to the job that can be executed by the information processing apparatus.

According to another aspect of the present disclosure, an image forming apparatus including the above-mentioned information processing apparatus is provided.

According to another aspect of the present disclosure, the acquisition step of acquiring the setting contents of the job, the generation step of generating the voice data of the voice of the wording indicating the setting contents acquired in the acquisition step, and the voice based on the voice data are externally deviced. An information processing method is provided that includes a transmission step of transmitting audio data to an external device so as to output the data.

According to the present disclosure, even a user who is unfamiliar with the information processing device can cause the information processing device to execute a job based on voice input.

The above and other objectives, features, aspects and advantages of the invention will become apparent from the following detailed description of the invention as understood in connection with the accompanying drawings.

It is a figure which shows the application example of the image formation system of this embodiment. It is a figure which shows the relationship between the MFP and the information processing apparatus. It is a block diagram which shows an example of the hardware configuration of the MFP. It is a block diagram which shows an example of the hardware composition of an external device. This is an example of a screen for setting the resolution of image data transmitted by an email transmission job. This is an example of a screen for setting the file format of the image data to be sent by the mail sending job. This is an example of a screen for setting the destination of image data to be transmitted by an email transmission job. This is an example of a screen on which the send mail button is displayed. This is an example of an audio screen displayed by an external device. This is an example of a table in which the destination of voice data is specified. It is a figure for demonstrating the functional configuration example with an MFP and an external device. It is a figure which shows an example of the processing flow of an image formation system. It is a processing flow of the MFP and the external device of the 2nd Embodiment. This is an example of an audio screen displayed by the external device of the second embodiment. It is a processing flow of the MFP and the external device of the 3rd Embodiment. It is a figure which shows the functional configuration example of the MFP and the external device of 4th Embodiment. It is a processing flow of the MFP and the external device of 4th Embodiment. It is a processing flow of the MFP and the external device of 4th Embodiment. This is an example of a conversion table. 6 is a processing flow of the MFP and the external device of the sixth embodiment. This is an example of a screen for inputting changes in setting contents. It is a figure which shows the functional configuration example of the MFP and the external device of 7th Embodiment. It is a figure which shows the processing flow of the MFP and the external device of 6th Embodiment. This screen displays a list of jobs. This is an example of an audio screen corresponding to an email transmission job. It is a figure which shows the function of three MFPs. This is an example of an audio screen corresponding to a copy transmission job. It is a figure which shows the structural example of the image formation system of 8th Embodiment. It is a processing flow of the external device 20A of the 8th embodiment.

The information processing device, the image forming device, and the like in the embodiment based on the present invention will be described below with reference to the drawings. When the number, quantity, etc. are referred to in the embodiments described below, the scope of the present invention is not necessarily limited to the number, quantity, etc., unless otherwise specified. The same parts and equivalent parts may be given the same reference number, and duplicate explanations may not be repeated. In addition, it is planned from the beginning to use at least a part of the configurations in each embodiment in appropriate combinations. Hereinafter, the image forming apparatus is referred to as MFP10 (multifunction peripheral / product / printer).

[First Embodiment]
<Application example of the MFP of this embodiment>
First, an application example in a certain aspect of the MFP will be described. The MFP of the present embodiment can execute a copy job, a print job, a scan job, a fax job, and an email sending job. The scan job is a job of scanning image data related to a document set in the MFP by a user. The copy job is a job in which the MFP prints the image data scanned by the scan job. The print job is a job such as printing image data saved by the MFP. The fuck job is a job of faxing to another terminal device. The mail transmission job is a job for transmitting image data specified by the user to an external device. The external device is a PC (Personal Computer), a tablet, a smartphone, a wearable device that can be attached and detached by a user, and the like. Further, the external device is preferably a mobile terminal such as a smartphone that can be carried by the user.

The MFP of the present embodiment accepts the input of the job setting contents by the user. The job setting contents include the job type and the setting items of the job. The MFP 10 displays a setting screen on an operation panel (that is, a touch panel) described later. The MFP 10 accepts the input of the job setting contents based on the user's manual input to the setting screen and the user's voice input. Further, in general, inputting the setting contents of a job is less burdensome for the user to input by voice than by manually inputting to the setting screen.

The user visually recognizes the setting screen and manually inputs to the setting screen, so that the user causes the MFP to execute the first job based on the setting. After that, the user may want the MFP to execute a second job with the same settings as the settings by voice input. The "second job" means, for example, a job executed after the first job.

Here, if the user is accustomed to handling the MFP (hereinafter, also referred to as "first user"), he / she remembers the setting contents. Therefore, the first user can utter the wording of the setting content displayed on the setting screen without visually recognizing the setting screen. As a result, the first user can cause the MFP to execute the second job by voice input.

However, some users are unfamiliar with MFPs (hereinafter, also referred to as "second users"). Such a second user does not remember the settings. When the second user visually recognizes the setting screen, the second user can emit a voice of the wording of the setting content displayed on the setting screen. On the other hand, the second user cannot emit the voice of the wording of the setting content displayed on the setting screen unless he / she visually recognizes the setting screen. For example, when there is an esoteric word such as "resolution" in the setting content, the second user cannot emit the voice of the word "resolution" without visually recognizing the word "resolution" on the setting screen. If the second user cannot properly emit the voice of the wording of the setting content, there may be a problem that the MFP cannot execute the second job based on the voice input. As described above, for example, if the second user forgets the setting contents input for the first job, there may be a problem that the MFP cannot execute the second job by voice input. In addition, even if the second user does not understand the setting items entered in the setting screen for the first job, there arises a problem that the MFP cannot execute the second job by voice input. obtain.

Therefore, the MFP of the present embodiment understands, for example, the setting contents input by the second user for the first job and the setting contents input by the second user for the first job. Even if this is not the case, the second user can cause the MFP to execute the second job with the set contents by voice input.

As described above, the "second user" of the present embodiment can understand the setting item of the MFP 10 while visually recognizing the setting screen, but when the setting screen is not visually recognized, the setting item of the setting item is understood. Suppose you are a user who cannot generate wording.

FIG. 1 is a diagram showing an application example of the image forming system 1000 of the present embodiment. With reference to FIG. 1, the image forming system 1000 includes an MFP 10 and an external device 20. In the example of FIG. 1, the types of the first job and the second job are both "scan job", the setting contents are "image resolution" and "scan job", and the resolution is It is assumed that it is "300 x 300 dpi".

First, in step (1), the user inputs the setting contents of the first job to the MFP 10 from the setting screen in order to cause the MFP 10 to execute the first job. It is assumed that the setting content has a resolution of "300 x 300 dpi". The MFP 10 acquires the input setting contents.

Next, after inputting the setting contents to the MFP 10, the user performs a start operation to start the job on the MFP 10. In step (2), when the MFP 10 accepts the start operation, the MFP 10 executes a job (first job) based on the setting contents input in step (1).

Next, the MFP 10 generates a voice by synthesizing the voice of the wording of the setting content input by the user. In the example of FIG. 1, since the setting contents are "image resolution" and "scan job", the MFP10 generates the sound "Kaizoudsanbyakudipeeaiskanjobu". .. After that, the MFP 10 generates voice data related to this voice. In step (3), the MFP 10 transmits audio data to the external device 20. It is preferable that the means for transmitting is a means included in the external device 20 to which the image forming system 1000 of the present embodiment is not introduced, that is, an existing means of the external device 20. This means is, for example, NFC (Near Field Communication), mail, or the like. The external device 20 receives this voice data. The external device 20 stores the received voice data in a predetermined storage area.

After that, suppose that the user wants the MFP 10 to execute the second job by voice input. However, since the second user is unfamiliar with the MFP10, he / she cannot remember the setting contents of the first job without looking at the setting screen of the MFP10. Further, since the second user is unfamiliar with the MFP 10, the second user may not be able to understand the setting contents of the first job without looking at the setting screen of the MFP 10. Therefore, in step (4), the user performs a voice output operation on the external device 20. The voice output operation is an operation for the MFP 10 to output a voice based on the voice data transmitted from the MFP 10 in step (3). In the present mobile phone, the voice based on the voice data is assumed to be machine voice or synthetic voice.

In step (5), when the external device 20 receives the voice output operation, it outputs the machine voice based on the voice data. In the example of FIG. 1, the external device 20 outputs a machine voice of "Kaizoudo sanbyakudipeeaiskanjobu". In FIG. 1, the machine voice "Kaizoudo-sanbyakudipeeaiskanjobu" is abbreviated as "Kaizoudo ...". The external device 20 receives the input of the machine voice.

In step (6), when the MFP 10 receives the input of the machine voice, the MFP 10 executes the voice recognition process for the machine voice. The MFP 10 executes a job based on the result of the voice recognition process. That is, in step (6), the MFP 10 executes a job based on the machine voice. In the example of FIG. 1, the MFP 10 executes a scan job having a resolution of "300 x 300 dpi".

In the example of FIG. 1, even if the second user forgets the setting contents input for the first job, the second job with the setting contents is executed in the MFP by voice input. Can be made to.

<Relationship between information processing equipment and MFP>
FIG. 2 is a diagram showing the relationship between the MFP 10 and the information processing device 100 of the present disclosure. As shown in FIG. 2, the MFP 10 conceptually includes the information processing device 100 of the present disclosure. Further, the information processing device 100 of the present disclosure is not limited to the MFP, and may be applied to other devices. Other devices include, for example, PCs (Personal Computers), tablets, smartphones, wearable devices that can be attached and detached by the user, and the like.

<Hardware configuration example of MFP10>
FIG. 3 is a block diagram showing an example of the hardware configuration of the MFP 10. With reference to FIG. 3, the MFP 10 includes a controller 31, a fixed storage device 32, a short-range wireless IF (Inter Face) 33, a scan unit 12, an operation panel 34, a paper feed tray 14, and a microphone 16. It has an image forming unit 11, a printer controller 35, a network IF 36, and a speaker 37. The controller 31 includes a fixed storage device 32, a short-range wireless IF (Inter Face) 33, a scan unit 12, an operation panel 34, a paper feed tray 14, a microphone 16, an image forming unit 11, and a printer controller. The 35, the network IF36, and the speaker 37 are connected via the bus 38.

The controller 31 includes a CPU (Central Processing Unit) 311, a ROM (Read Only Memory) 312 in which a control program is stored, a working S-RAM (Static Random Access Memory) 313, and various settings related to image formation. It has a battery-backed NV-RAM (Non-Volatile RAM) 314 that stores the data. The CPU 311 and ROM 312, the S-RAM 313, and the battery-backed NV-RAM (Non-Volatile RAM) 314 that stores various settings related to image formation are connected via the bus 38. There is.

The operation panel 34 has a display device 342 and an input device 344. The display device 342 displays various images such as a setting screen and various information. The input device 344 accepts manual input operations and the like from the user. The operation panel 34 is integrally composed of a display device 342 and an input device 344. The operation panel 34 is typically a touch panel.

The network IF36 transmits and receives various information to and from the external device 20 and the like connected via the network 39.

The printer controller 35 generates a copy image from the print data received by the network IF36. The image forming unit 11 forms a copied image on paper.

The fixed storage device 32 is typically a hard disk device. Various types of data are stored in the fixed storage device 32.

Further, the controller 31 may be composed of, for example, at least one integrated circuit. The integrated circuit includes, for example, at least one CPU (Central Processing Unit), MPU (Micro Processing Unit), GPU (Graphics Processing Unit), at least one ASIC (Application Specific Integrated Circuit), and at least one FPGA (Field Programmable Gate Array). ) Or a combination thereof.

<Hardware configuration example of external device 20>
FIG. 4 is a block diagram showing an example of the hardware configuration of the external device 20. With reference to FIG. 4, the external device 20 includes a controller 41, an operation panel 44, a microphone 46, a network IF 46, and a speaker 47. A short-range wireless IF (Inter Face) 44, a scan unit 12, an operation panel 44, a microphone 16, a network IF 46, and a speaker 47 are connected to the controller 41 via a bus 48.

The controller 41 has a CPU 411, a ROM 412 in which a control program is stored, and an S-RAM 413 for work. The CPU 411, the ROM 412, and the S-RAM 414 are connected via the bus 48.

The operation panel 44 has a display device 442 and an input device 444. The display device 442 displays various images such as various screens and various information. The input device 444 accepts manual input operations and the like from the user. The operation panel 44 is integrally composed of a display device 442 and an input device 444. The operation panel 44 is typically a touch panel.

The network IF46 transmits and receives various information to and from the MFP 10 and the like connected via the network 39.

Further, the controller 41 may be composed of, for example, at least one integrated circuit. The integrated circuit may be composed of, for example, at least one CPU, MPU, at least one ASIC, at least one FPGA, or a combination thereof.

<Setting screen>
Next, the setting screen displayed by the display device 342 of the MFP 10 will be described. When the user performs an operation to display the menu screen on the input device 344 of the MFP 10, the display device 342 displays the menu screen (not particularly shown). On the menu screen, for example, an image of a copy job, an image of a print job, an image of a scan job, an image of a fax job, and an image of a mail sending job are displayed. The MFP 10 executes a job corresponding to an image determined by the user among these images. For example, when the user determines the image of the mail sending job, the MFP 10 executes the mail sending job.

5 to 8 are examples of setting screens for setting by the user of the mail transmission job. The controller 31 displays the setting screens of FIGS. 5 to 8 in the display area 342A of the display device 342. The matter of inputting the setting contents on the setting screens of FIGS. 5 to 8 corresponds to the step (1) of FIG.

FIG. 5 is a screen for setting the resolution of the image data transmitted by the mail transmission job. FIG. 6 is a screen for setting the file format of the image data transmitted by the mail transmission job. FIG. 7 is a screen for setting the destination of the image data to be transmitted by the mail transmission job. FIG. 8 is a screen on which the mail transmission button is displayed. The mail sending button is a button for executing the mail sending job by the setting by the user.

On the setting screen of FIG. 5, an image related to the resolution is displayed. In the example of FIG. 5, an image having a resolution of 200 × 200 dpi, an image having a resolution of 300 × 300 dpi, an image having a resolution of 400 × 400 dpi, an image having a resolution of 600 × 600 dpi, and an OK button 504 are displayed.

Of the plurality of images with respect to resolution shown in FIG. 5, the border of the image selected by the user (that is, touched by the user) is displayed thickly. In the example of FIG. 5, it is assumed that the image 503 with respect to the resolution of 300 × 300 dpi is selected. Further, when the user touches the OK button 504 while the image related to the resolution is selected, the MFP 10 sets the resolution corresponding to the selected image. In the example of FIG. 5, the MFP 10 sets a resolution of 300 × 300 dpi. Further, when the user touches the OK button 504 while the image related to the resolution is selected, the display device 342 displays the setting screen of FIG.

On the setting screen of FIG. 6, an image related to the file format of the image data is displayed. In the example of FIG. 6, an image related to the PDF (Portable Document Format) format, an image related to the compact PDF format, and the like are displayed.

Of the plurality of images related to the file format shown in FIG. 6, the border of the image selected by the user (that is, touched by the user) is displayed thickly. In the example of FIG. 6, it is assumed that the image 506 relating to the compact PDF is selected. Further, when the user touches the OK button 504 while the image related to the file format is selected, the MFP 10 sets the file format corresponding to the selected image. In the example of FIG. 6, the MFP 10 sets the file format of the compact PDF. Further, when the user touches the OK button 504 while the image related to the file format is selected, the display device 342 displays the setting screen of FIG. 7.

The setting screen of FIG. 7 is a screen for setting the destination of the image data. The setting screen of FIG. 7 includes a display area 508 and a soft keyboard 510. The soft keyboard 510 in the example of FIG. 7 is composed of a plurality of soft keys corresponding to letters "a to z", numbers "1 to 9", symbols, and the like. The plurality of letters include, for example, softkeys of the respective numbers, softkeys of the letters "az", and the like.

When the softkey is touched by the user, any of the letters, numbers, and symbols corresponding to the touched softkey is displayed in the display area 508. In the example of FIG. 7, it is assumed that the user inputs "user@test.jp" using the soft keyboard 510. In this case, "user@test.jp" is displayed in the display area 508. When the user touches the OK button 504, the MFP 10 sets the information displayed in the display area 508 (that is, the information input by the user in the soft keyboard 510) as the mail destination. In addition, when the information displayed in the display area 508 is information that does not serve as the destination of the mail, when the user touches the OK button 504, a pop-up screen (not shown in particular) indicating to the user that the destination cannot be set. ) Is displayed.

When the OB playback button 504 on the setting screen of FIG. 7 is touched and the MFP 10 sets an appropriate address destination, the MFP 10 displays the screen of FIG. On the screen of FIG. 8, the display area 516, the first button 512, and the second button 514 are displayed.

In the display area 516, the destination set on the setting screen of FIG. 7 is displayed. By visually recognizing the destination displayed in the display area 516, the user can confirm whether or not the destination set on the setting screen of FIG. 7 is accurate. In the area of the first button 512, the characters "voice data generation, output E-mail transmission" are displayed. The first button 512 indicates that the MFP 10 sends an image by e-mail, and that the MFP 10 sends the voice data of the characters of the setting items set on the screens of FIGS. 5 to 7 to the user's external device 20. It's a button. When the first button 512 is operated by the user, the MFP 10 executes a job based on the setting contents. In the example of FIGS. 5 to 8, the MFP 10 executes the mail transmission job. At the same time, the MFP 10 generates voice data of the voice of the characters related to the setting contents. After that, the MFP transmits the voice data to the external device 20.

When the second button 514 is operated by the user, the MFP 10 executes a job based on the setting contents. Further, when the second button 514 is operated by the user, the MFP 10 does not execute the generation of the voice data and the transmission of the voice data.

In this way, when the first button 512 or the second button 514 is operated by the user, the MFP 10 executes the job set by the user. Execution of this job corresponds to step (2) in FIG.

Further, when the second button 514 is operated by the user, the MFP 10 transmits the voice data of the voice of the character indicating the setting content set by the user to the external device 20. The transmission of this voice data corresponds to step (3) of FIG.

In the examples of FIGS. 5 to 7, the MFP 10 is set to have a resolution of 300 × 300 dpi, a file format of a compact PDF format, and a destination of user@test.jp. Further, the MFP 10 has performed a mail transmission job. Therefore, the MFP10 is "Kaizoud, Sanbyakudipeeai, File Keishiki, Konpakutopediefu, Atesaki, Arufabetto, Yuesuiaru, Suuji," Ichi, Attomark, Arufabetto, Teeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee The MFP 10 stores a plurality of voices in the smallest unit. The minimum unit voice is the voice of the wording of the minimum unit of the setting content. For example, "Ichi", "Ni", "Atesaki", "Kaizoudo" and the like. The MFP 10 generates voice by synthesizing the voice of these minimum units. After that, the MFP 10 generates voice data related to this voice.

As a modification, the MFP 10 may store a plurality of minimum units of audio data. The MFP 10 may generate voice data related to voice by combining a plurality of minimum units of voice data.

Further, as a modification, the MFP 10 may not store a plurality of minimum units of audio data. The MFP 10 may directly generate voice data based on the wording of the set contents by another method without using the voice data of the minimum unit.

The MFP 10 transmits the generated voice data to the external device 20. The external device 20 stores the voice data. Further, when the user performs a predetermined operation on the external device 20, the external device 20 displays an audio screen for outputting the audio of the audio data.

FIG. 9 is an example of an audio screen displayed by the external device 20. The controller 41 displays the audio screen of FIG. 9 in the display area 442A of the display device 442. The audio screen of FIG. 9 includes an audio content 502 and a play button 504. The audio content 502 in FIG. 9 has the content of "resolution: 300 dpi, compact PDF, destination: user1@test.jp, E-mail transmission". Further, the audio content displayed on the audio screen of FIG. 9 can be selected by the user. Further, although one audio content is displayed on the audio screen of FIG. 9, two or more audio contents may be displayed.

The user selects the audio content 502 (for example, the user touches the audio content 502) and touches the play button 504. The operation of the user selecting the audio content 502 and pressing the play button 504 corresponds to the audio output operation of step (4) of FIG.

When the play button 504 is operated by the user, the external device 20 outputs the sound related to the sound content 502 selected by the user. Here, the external device 20 is "Kaizoud, Sanbyakudipeeai, File Keishiki, Konpakutopediefu, Atesaki, Arufabetto, Yuesuiaru, Yuesuiaru," Outputs the voice "Suji, Ichi, Attomark, Arufabetto, Teeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee". This audio output corresponds to step (5) in FIG.

When this voice is input to the microphone 16 of the MFP 10, the MFP 10 executes voice recognition for the voice. The MFP 10 specifies the setting contents of the job by this voice recognition. The MFP 10 executes a job based on the result of this voice recognition. Here, the MFP 10 transmits an image having a resolution of 300 × 300 dpi and a file format of the compact PDF format to a destination of user@test.jp. This transmission is a mail transmission job, and the MFP 10 executing this mail transmission job corresponds to step (6) in FIG.

<Destination of audio data>
As described in step (3) of FIG. 1 and FIGS. 5 to 8, the MFP 10 transmits audio data. Next, the destination of this voice data will be described. FIG. 10 is an example of a table in which the destination of voice data is specified. The MFP 10 stores the table of FIG. In the example of FIG. 10, the destination of the voice data is associated with each user ID. In the example of FIG. 10, "B1" is associated with the user whose user ID is A1 as the destination of voice data. Further, in the example of FIG. 10, "B2" is associated with the user whose user ID is A2 as the transmission destination of the voice data.

For example, in step (1) of FIG. 1, the MFP 10 can execute user authentication before the user inputs the setting contents. The user authentication may be a method in which the user is made to input the user ID and the password into the MFP 10 and it is determined whether or not each of the user ID and the password is accurate. Further, the user authentication may be any of face authentication, voice authentication, and fingerprint authentication.

The MFP 10 acquires a user ID by user authentication. The MFP 10 refers to the table of FIG. 10 to specify the destination corresponding to the acquired user ID. When the MFP 10 generates the voice data, the MFP 10 transmits the voice data to the specified destination in the step (3). After the external device 20 receives the voice data, the external device 20 stores the voice data.

<Example of functional configuration of MFP 10 and external device 20>
FIG. 11 is a diagram for explaining a functional configuration example of the MFP 10 and the external device 20. The controller 31 of the MFP 10 has functions of an acquisition unit 102, a generation unit 104, a transmission unit 106, a voice reception unit 110, a voice recognition unit 112, a setting unit 114, and an execution unit 116. In this embodiment, for convenience, the units that execute each job may be expressed separately. The job unit 120 of FIG. 5 includes a copy job unit, a print job unit, a scan job unit, a fax job unit, and a mail transmission job unit. A copy job unit is a unit that executes a copy job. A print job unit is a unit that executes a print job. The scan job unit is a unit that executes a scan job. A fax job unit is a unit that executes a fax job. The mail sending job unit is a unit that executes a mail sending job. The scan job unit corresponds to, for example, the scan unit 12.

The controller 41 of the external device 20 has the functions of the receiving unit 202, the storage unit 204, the operation receiving unit 206, and the output control unit 208.

When the user inputs the setting contents of the job to the operation panel 34 (see step (1) in FIG. 1), the setting contents of the job are input to the acquisition unit 102 and the setting unit 114. As described above, the job setting contents accept the job type and the setting items of the job. In the examples described with reference to FIGS. 5 to 8, the job type is "mail transmission job", and the job setting items are "300 x 300 dpi resolution", "file format is compact PDF format", and "user". The destination is @ test.jp.

The acquisition unit 102 acquires the setting contents of the job. The generation unit 104 generates voice data of the voice of the characters related to the setting contents acquired by the acquisition unit 102. In the example of FIG. 1, the "job type" in the job setting contents is "scan job", and the "job setting item" in the job setting contents has a resolution of "300 x 300 dpi". ". Therefore, the generation unit 104 generates the voice "Kaizoudo-sanbyakudipeeaiskanjobu". After that, the generation unit 104 generates voice data related to this voice.

Further, in the examples of FIGS. 5 to 8, the "job type" in the job setting contents is the "mail transmission job". Further, in the examples of FIGS. 5 to 8, the "job setting item" in the job setting contents has a resolution of 300 x 300 dpi, a file format of a compact PDF format, and a destination of user@test.jp. It is an item that is.

Therefore, the generation unit 104 is set to "Kaizoud, Sanbyakudipeeai, File Keishiki, Konpakutopediefu, Atesaki, Arufabetto, Yuesuiaru, Su". Uji, Ichi, Attomark, Arufabetto, Teeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee After that, the generation unit 104 generates voice data related to this voice.

The transmission unit 106 transmits the generated voice data to the external device 20. When the MFP 10 authenticates the user, the MFP 10 refers to the table in FIG. 10 and transmits voice data to the external device 20 corresponding to the user ID obtained by the user authentication (see step (3) in FIG. 1). ).

Further, the setting unit 114 sets the setting contents of the job input from the operation panel 34. For example, information related to job settings is stored in a predetermined storage area. Further, the execution unit 116 causes the job unit 120 corresponding to the job to execute a job based on the set setting content (that is, information related to the setting content of the job). In the example described with reference to FIG. 1, the execution unit 116 causes the scan job unit of the job units 120 to execute the scan job. Further, in the example described with reference to FIGS. 5 to 9, the execution unit 116 causes the mail transmission job unit of the job units 120 to execute the mail transmission job.

Further, the receiving unit 202 of the external device 20 receives the audio data transmitted by the controller 31. The voice data received by the receiving unit 202 is stored in the storage unit 204. Further, as described with reference to FIG. 9, the user performs a voice output operation on the operation panel 44 of the external device 20 (corresponding to step (4) of FIG. 1).

The operation reception unit 206 receives the voice output operation performed on the operation panel 44. The output control unit 208 outputs the mechanical voice of the voice content selected by the voice output operation received by the operation reception unit 206 from the speaker 47 (see step (5) in FIG. 1). This sound is input to the microphone 16 of the MFP 10. The microphone 16 generates voice data by digitally converting the voice. The voice reception unit 110 receives this voice data. The voice recognition unit 112 executes voice recognition processing on this voice data. The voice recognition method by the voice recognition unit 112 may be any method. For example, the voice recognition unit 112 includes an acoustic model, a language model, and the like, and executes voice recognition processing based on the acoustic model and the language model. The voice recognition result by the voice recognition process is input to the setting unit 114.

The setting unit 114 makes settings based on the voice recognition result. The execution unit 116 causes the job unit 120 corresponding to the job to execute a job based on the setting contents set by the setting unit 114 (see step (6) in FIG. 1).

<Processing flow of image formation system>
FIG. 12 is a diagram showing an example of the processing flow of the image forming system 1000. With reference to FIG. 12, in step S2, the controller 31 determines whether or not the acquisition unit 102 has acquired the job setting contents. The controller 31 repeats the process of step S2 until the acquisition unit 102 determines that the job setting contents have been acquired. When the controller 31 determines that the acquisition unit 102 has acquired the job setting contents (YES in step S2, see step (1) in FIG. 1), the execution unit 116 executes the job with the acquired setting contents. Let the job unit 120 execute the job (see step S4 and step (2) of FIG. 1).

Next, in step S6, the generation unit 104 generates audio data of the set contents. Next, in step S8, the transmission unit 106 transmits voice data (see step (3) in FIG. 1).

Next, in step S10, the receiving unit 202 of the external device 20 receives the audio data. Next, in step S12, the storage unit 204 stores the voice data. Further, the “three-point reader” in FIG. 12 means that an arbitrary time has passed.

Next, in step S14, the controller 41 determines whether or not the operation reception unit 206 has accepted the voice output operation. The controller 41 repeats the process of step S14 until it is determined that the operation reception unit 206 has accepted the voice output operation (NO in step S14). When the controller 41 determines that the operation receiving unit 206 has received the voice output operation (YES in step S14, see step (4) in FIG. 1), the speaker 47 outputs the machine voice.

Next, in step S18, machine voice is input to the microphone 16. The voice reception unit 110 receives the voice data of the machine voice from the microphone 16. Next, in step S20, the voice recognition unit 112 executes voice recognition on the voice data. The setting unit 114 makes settings based on the voice recognition result. Next, in step S22, the execution unit 116 causes the job unit 120 corresponding to the job to execute a job based on the setting contents set by the setting unit 114 (that is, a job based on the voice recognition result).

<Summary>
A second user manually sets a setting item on the setting screen of the MFP 10 for the above-mentioned MFP 10, and causes the MFP to execute the first job based on the setting. After that, the user may want the MFP to execute a second job with the same settings as the settings by voice input. Such a second user cannot emit the voice of the wording of the setting content displayed on the setting screen without visually recognizing the setting screen. Therefore, if the second user cannot properly emit the voice of the wording of the setting content, there may be a problem that the MFP cannot execute the "subsequent jobs". In particular, there is a problem that the MFP cannot execute the second job by voice input when the second user forgets the setting items or the like input on the setting screen.

Therefore, when the first button 512 is operated by the second user, the transmission unit 106 of the MFP 10 uses the voice data of the wording of the setting contents input by the second user for the first job. It is transmitted to the external device 20 of the second user (see step (3) in FIG. 1 and step S8 in FIG. 12). Further, when the first button 512 is operated by the second user, the MFP 10 transmits the voice data to the external device 20.

The external device 20 can store the audio data, and the external device 20 can display an audio screen as shown in FIG. The second user is unfamiliar with the MFP 10 and cannot remember the setting items without visually recognizing the screen displaying the setting items. However, the second user can understand the setting items by visually recognizing the audio screen of FIG. The second user can output a voice based on the voice content 502 on the voice screen. That is, the transmission unit 106 transmits the voice data to the external device 20 so as to output the voice based on the voice data to the external device 20. The MFP 10 executes a job based on the voice.

Therefore, even a second user who is unfamiliar with the MFP 10 can have the MFP 10 execute a job based on voice input (in the present embodiment, the second job).

Further, for example, a first user (that is, a user who is accustomed to the MFP 10) can cause the MFP 10 to execute a job by operating the second button 514 without transmitting voice data. Therefore, the MFP 10 of the present embodiment can reduce the amount of communication from the MFP to the external device as compared with the "MFP that always transmits voice data to the external device". Further, the MFP 10 of the present embodiment determines whether or not to transmit the voice data to the external device 20 based on the operation of the user (that is, based on the operation of either the first button 512 or the second button 514). decide. Therefore, the convenience of the user can be improved.

The MFP 10 may be controlled to either a first mode in which a job is executed by voice input or a second mode in which a job based on the voice input is not executed even if voice input is performed. .. Further, when the MFP 10 is controlling to the first mode, the MFP 10 may perform user authentication. Further, when the MFP10 is controlled to the first mode, the job is executed by voice input if it is within the expiration date of user authentication, while the job is not executed by voice input if it is outside the expiration date of user authentication. You may do it.

Further, in step (3) of FIG. 1, after the external device 20 receives the voice data, the user executes a job based on the machine voice based on the voice data to an MFP different from the MFP that transmitted the voice data. You may let it. As described above, in the image forming system 1000 of the present embodiment, the user may cause the MFP that transmits the voice data to execute a job based on the machine voice based on the voice data, and the MFP that transmits the voice data and the MFP. May be run by a different MFP.

[Second Embodiment]
The MFP 10 of the first embodiment has been described as transmitting audio data of two or more setting contents to the external device 20 in a batch. The MFP 10 of the second embodiment individually generates audio data for each of two or more setting contents. After that, the MFP 10 individually transmits the audio data for each of the two or more setting contents to the external device 20.

The MFP 10 and the external device 20 of the second embodiment are as shown in FIG. FIG. 13 is a processing flow of the MFP 10 and the external device 20 of the second embodiment. In step S102, the controller 31 determines whether or not the acquisition unit 102 has acquired the setting content of job 1. In the example of FIGS. 5 to 8, the resolution setting of FIG. 5, the file format setting of FIG. 6, the destination setting of FIG. 7, and the job execution setting of FIG. 8 are the setting contents of 1, respectively. .. In step S102, the controller 31 repeats the process of step S102 until the acquisition unit 102 determines that the setting content of job 1 has been acquired (NO in step S102). In step S102, when the controller 31 determines that the acquisition unit 102 has acquired the setting content of job 1 (YES in step S102), the process proceeds to step S104.

In step S104, the generation unit 104 generates audio data of the setting contents of job 1 by the acquisition unit 102. Next, in step S106, the controller 31 determines whether or not the job setting is completed.

Step S102, step S104, and step S106 will be described with reference to the examples of FIGS. 5 to 8. In FIG. 5, when the resolution is selected and the OK button 504 is operated, the controller 31 determines that the acquisition unit 102 has acquired the setting content of job 1 (YES in step S102). Next, in step S104, the generation unit 104 generates voice data of the voice of the wording indicating the resolution set in FIG. In the example of FIG. 5, the voice data of the voice "Kaizoudo, Sanbyaku dipee" is generated. After that, in step S106, the controller 31 determines whether or not the job setting is completed. When the resolution shown in FIG. 5 is set, the process returns to step S102 because the job setting is not completed.

In such a process, in each step S104, the generation unit 104 generates voice data according to the order of FIGS. 5, 6, 7, and 8. In the first step S104, the generation unit 104 generates the voice data of the voice "Kaizoudo, Sanbyaku dipee" described with reference to FIG. In the second step S104, the generation unit 104 generates the voice data of the voice "File Keishiki, Konpaku to Pidi Efu" described with reference to FIG. In the third step S104, the generation unit 104 generates the voice data of the voice "File Keishiki, Konpaku to Pidi Efu" described with reference to FIG. 7. In the fourth step S104, the generation unit 104 generates the voice data of the voice "I-mail-so-shin" described with reference to FIG. 7. As described above, in the example of FIGS. 5 to 8, the generation unit 104 generates four voice data.

In step S106, when the user performs an operation to execute the job, the controller 31 determines that the job setting is completed (YES in step S106). In the example of FIGS. 5 to 8, when the first button 512 of FIG. 8 is operated, the controller 31 determines that the job setting is completed.

In step S4, the execution unit 116 causes the job unit 120 to execute the job with the acquired setting contents. Next, in step S108, the generation unit 104 combines the plurality of voice data (four voice data in the present embodiment) generated by the generation unit 104 in step S104 into one voice data. Next, in step S8, one voice data collected by the generation unit 104 in step S108 is transmitted to the external device 20.

In step S10, the external device 20 receives one voice data. Next, in step S112, the external device 20 stores a plurality of voice data (four voice data in the present embodiment) included in the voice data received in step S10 in different storage areas. In the present embodiment, the external device 20 stores four voice data in different storage areas.

FIG. 14 is an example of an audio screen displayed by the external device 20 of the second embodiment. The controller 41 displays the audio screen of FIG. 14 in the display area 442A of the display device 442. Comparing FIG. 9 and FIG. 14, FIG. 9 shows a plurality of audio contents as one audio content 502. On the other hand, in FIG. 14, each of a plurality of audio contents (four audio contents in the present embodiment) is displayed. Further, each of the plurality of displayed audio contents corresponds to the audio data generated by the generation unit 104.

In the example of FIG. 14, the audio content 5021 "resolution: 300 dpi", the audio content 5022 "filecon compact PDF", the audio content 5023 "destination: user1@test.jp", and "destination: user1 @ test" The audio content 5023 ".jp" is displayed.

In the present embodiment, a plurality of audio contents displayed in the display area 442A can be selected by the user. For example, among a plurality of audio contents, the audio content selected by the user is displayed in a mode different from the audio content not selected. For example, the border of the audio content not selected by the user is displayed thinly, while the border of the selected audio content is displayed thick.

Further, when the play button 504 is touched while one or more audio contents are selected by the user, the audio of the selected one or more audio contents is output. For example, when the play button 504 is touched while "resolution: 300 dpi" and "destination: user1@test.jp" are selected, the external device 20 is set to "kaizoudo, sanbyakudipeeai". , Atesaki, Arufabetto, Yuesuiaru, Suuji, Ichi, Attomaku, Arufabetto, Teeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee Output.

The acquisition unit 102 of the MFP 10 of the present embodiment acquires a plurality of setting contents (see step S102 in FIG. 13). Next, the generation unit 104 generates audio data for each of a plurality of setting contents (see step S104 in FIG. 13). Next, the transmission unit 106 transmits voice data for each of the plurality of setting contents (see step S8 in FIG. 13). The external device 20 stores the audio data for each of the plurality of setting contents in different storage areas. Further, as shown in FIG. 14, the external device 20 displays the audio content (in the example of FIG. 14, audio content 5021 to audio content 5024) corresponding to each of the plurality of stored audio data. The user can select one or more audio contents from a plurality of audio contents. The external device 20 can output audio data of one or more selected audio contents determined by the user. Therefore, the user can output the machine voice combining the voice data desired by the user from the external device 20. Therefore, the user can make the MFP 10 set a desired job by voice input, and as a result, the convenience of the user can be improved.

[Third Embodiment]
FIG. 15 is a processing flow of the MFP 10 and the external device 20 of the third embodiment. Comparing FIG. 13 and FIG. 15, in FIG. 13, as shown in steps S108 and S8, the MFP 20 collectively transmits audio data for each of the plurality of setting contents. On the other hand, as shown in FIG. 15, the MFP 10 of the present embodiment transmits the audio data of the setting content of 1 to the external device 20 every time the audio data of the setting content of 1 is generated.

In step S104, the generation unit 104 generates voice data. Next, in step S150, the transmission unit 106 transmits the generated voice data to the external device 20. In step S10, the external device 20 receives the audio data transmitted from the MFP 10. In step S12, the MFP 10 stores the voice data transmitted in step S10 in the storage area.

As shown in step S150, step S10, and step S12 of FIG. 15, every time the acquisition unit 102 acquires the setting content of 1, the MFP 10 transmits the audio data corresponding to the setting content of 1 to an external device. Send to 20. The external device 20 stores the voice data in the storage area each time the voice data is received. Further, when the external device 20 stores a plurality of voice data, the external device 20 stores the plurality of voice data in different storage areas. Therefore, the MFP 10 and the external device 20 of the third embodiment have the same effects as those described in the second embodiment.

[Fourth Embodiment]
FIG. 16 is a diagram showing a functional configuration example of the MFP 10 and the external device 20 of the fourth embodiment. Comparing FIG. 11 and FIG. 16, the controller 31 of the MFP 10 shown in FIG. 16 has a first promotion unit 122, and the voice data received by the voice reception unit 110 is output to the generation unit 104. , FIG. 11 and FIG. 16 are different. The first promotion unit 122 encourages the user to input the user's voice into the microphone 16. Further, the "first execution unit" of the present disclosure corresponds to the execution unit 116.

17 and 18 are processing flows of the MFP 10 and the external device 20 of the fourth embodiment. In step S6, after the generation unit 104 generates the voice data, in step S202, the first promotion unit 122 promotes the user to input the user's voice into the microphone 16. The accelerating process in step S202 is also referred to as "first accelerating process".

Here, the first promotion process is, for example, a process of asking the user for some question by voice. For example, the first promotion process is a process of outputting the question "Please say your name" by voice from the speaker 37.

In step S204 after the first promotion process of step S202, the controller 31 determines whether or not the user's voice has been input to the microphone 16. In step S204, the controller 31 repeats the process of step S204 (NO in step S204) until the controller 31 determines that the user's voice has been input to the microphone 16. If the controller 31 determines in step S204 that the user's voice has been input to the microphone 16 (YES in step S204), the process proceeds to step S206.

In step S206, the generation unit 104 generates new voice data by adding the voice data of the user's voice input to the microphone 16 to the voice data generated by the generation unit 104. The voice data of the user's voice is also referred to as "user voice data". The “user's voice input to the microphone 16” is the user's voice based on the determination of YES in step S204. As described above, the new voice data includes the voice data generated in step S6 and the voice data of the user's voice.

Next, in step S8, the transmission unit 106 transmits new voice data to the external device 20.

Next, in step S14 shown in FIG. 18, when the user performs a voice output operation on the external device 20 (YES in step S14), in step S16, the voice based on the new voice data is output. In step S16 of the present embodiment, the speaker 47 of the external device 20 uses the voice of the wording indicating the job setting contents (that is, the machine voice) and the voice of the user described in step S204 as the voice based on the new voice data. And output. The speaker 47 of the external device 20 may output the user's voice after outputting the machine voice. Further, the speaker 47 of the external device 20 may output the machine voice after outputting the user's voice.

In step S18, the controller 31 of the MFP 10 determines that the voice based on the new voice data has been input from the external device 20 to the microphone 16. The voice based on the new voice data is the machine voice and the user's voice. After step S18, in step S210, the first promotion unit 122 prompts the user to input the user's voice into the microphone 16. The accelerating process in step S210 is also referred to as "second accelerating process".

Here, the MFP 10 has a plurality of questions and answers corresponding to the plurality of questions for the processing of step S210. Multiple questions include, for example, the question "Please say Japan", the question "Please say America", and the question "Please say Germany". The answer to the question "Please say Japan" is "Japan". The answer to the question "Please say America" is "America". The answer to the question "Please say Germany" is "Germany".

The MFP 10 selects one question from these plurality of questions, and executes a second promotion process that outputs a voice based on the selected one question. When the MFP10 selects the question "Please say Japan", the MFP10 executes the second promotion process for outputting the voice "Please say Japan".

In step S212 after the first promotion process of step S210, the controller 31 determines whether or not the user's voice has been input to the microphone 16. In step S212, the controller 31 repeats the process of step S212 until it determines that the user's voice has been input to the microphone 16 (NO in step S212). If the controller 31 determines in step S212 that the user's voice has been input to the microphone 16 (YES in step S212), the process proceeds to step S214.

In step S214, the controller 31 determines whether or not the voice response of the user determined to have been input in step S212 is correct. For example, in step S210, it is assumed that the MFP 10 outputs a voice saying "Please say Japan". In this case, the answer is "Japan". In step S214, the controller 31 determines that the answer is correct when the user's voice determined to have been input in step S212 is "Japan". Further, in step S214, when the voice of the user determined to have been input in step S212 is a voice other than "Japan", the controller 31 determines that the answer is incorrect.

If the controller 31 determines in step S214 that the answer is incorrect (NO in step S214), the process ends. If the controller 31 determines in step S214 that the answer is correct (YES in step S214), the process proceeds to step S216.

In step S216, the controller 31 includes the feature information of "the user's voice input to the microphone 16 after the execution of the second promotion process" and the feature information of "the user's voice included in the voice based on the new voice data". Determine if they match.

Here, the "user's voice input to the microphone 16 after the execution of the second promotion process" is the user's voice determined to have been input in step S212. The “user's voice included in the voice based on the new voice data” is the user's voice included in the voice output in step S16. In other words, the "user's voice included in the voice based on the new voice data" is the voice of the user determined to have been input in step S204.

That is, in the process of step S216, the feature information of the voice from the external device 20 (that is, the “user's voice included in the voice based on the new voice data”) and the response voice (that is, “the second promotion process”). This is a process of comparing with the feature information of "user's voice input to the microphone 16 after execution").

Further, the feature information may be any information as long as it is information indicating the characteristics of the voice. The feature information includes at least one of voiceprints, voice frequencies, voice amplitudes, and the like. The feature information of this embodiment is assumed to be "voiceprint".

Further, the controller 31 may determine that the characteristic information of the voice from the external device 20 and the characteristic information of the voice of the answer are the same only when they are the same. Further, the controller 31 may determine that the characteristic information of the voice from the external device 20 and the characteristic information of the voice of the answer are the same or substantially the same. .. Further, in the comparison between the voice feature information from the external device 20 and the voice feature information of the answer, for example, the controller 31 matches the voice feature information from the external device 20 with the voice feature information of the answer. Calculate a score that indicates the degree. When this score is equal to or higher than a predetermined threshold value, the controller 31 determines that the characteristic information of the voice from the external device 20 and the characteristic information of the voice of the answer match. On the other hand, when this score is less than the threshold value, the controller 31 determines that the characteristic information of the voice from the external device 20 and the characteristic information of the voice of the answer do not match.

When the controller 31 determines that the voice feature information from the external device 20 and the voice feature information of the answer are the same (YES in step S216), the process proceeds to step S20. Further, in this step S20, the controller 31 specifies the setting contents of the job by executing the voice recognition process for the machine voice input in step S18. Next, in step S22, the execution unit 116 (that is, the first execution unit) executes a job based on the voice recognition result.

On the other hand, when it is determined that the voice feature information from the external device 20 and the voice feature information of the answer are not the same (NO in step S216), the processes of steps S20 and S22 are not executed. End the process.

The generation unit 104 of the MFP 10 of the present embodiment transmits the voice data of the user's voice input to the microphone 16 after the execution of the first promotion process (that is, step S202 of FIG. 17) with respect to the voice data generated in step S6. A new voice data is generated by adding the data (step S206 in FIG. 17). Further, the transmission unit 106 transmits the new voice data to the external device 20 so as to output the voice based on the new voice data to the external device 20 (step S8 in FIG. 17). Therefore, the user can have the external device 20 output the voice of the wording indicating the setting content and the voice of the user.

Further, when the voice of the wording indicating the setting content and the voice of the user are input to the microphone 16 of the MFP 10 (that is, step S18 in FIG. 18), the first promotion unit 122 uses the microphone 16 of the user's voice. The second promotion process for prompting the user to input to is executed (step S210). Further, the controller 31 determines whether or not the characteristic information of the user's voice input to the microphone after the execution of the second promotion process matches the characteristic information of the user's voice included in the voice based on the new voice data. Is determined (step S216). If YES is determined in step S216, the execution unit 116 executes a job based on the setting content indicated by the voice included in the voice based on the new voice data (step S22). On the other hand, if it is determined to be BO in step S216, the execution unit 116 does not execute the job based on the setting content indicated by the voice included in the voice based on the new voice data.

For example, when a legitimate user causes the MFP 10 to execute the first job (the job in step S4 of FIG. 17), a malicious user different from the legitimate user uses the voice of the external device 20 to perform 2 You may try to run the second job. A legitimate user is a user who is properly authenticated to the MFP 10. Further, the malicious user is, for example, a user who has not been properly authenticated to the MFP 10. Even when such a malicious user executes the processes after step S14 in FIG. 18, it is determined as NO in step S216. Therefore, the malicious user cannot cause the MFP 10 to execute the second job using the voice of the external device 20. Therefore, the MFP 10 can appropriately prevent a malicious user from executing a second job on the MFP 10.

Hereinafter, the processes of step S2, step S4, step S6, step S202, step S204, step S206, and step S8 in FIG. 17 are collectively referred to as "first process". Further, the processes of step S8, step S210, step S212, step S214, step S216, step S20, and step S22 in FIG. 18 are collectively referred to as "second process".

In the third embodiment, it has been described that the MFP 10 executes both the first process and the second process. However, the user may have the external device 20 store the voice of the wording indicating the setting content and the voice data of the user's voice by causing the first MFP to execute the first process. In addition, the user may cause a second MFP different from the first MFP to execute a job based on the voice from the external device 20. According to such a configuration, the user can select the MFP to execute the first process and the MFP to execute the second process, so that the degree of freedom of the user can be improved.

The controller of the second MFP has the functions of the setting unit 114, the voice recognition unit 112, the voice reception unit 110, the execution unit 116, and the first promotion unit 122 shown in FIG. Further, in step S216, the controller of the second MFP includes the feature information of "the user's voice input to the microphone 16 before the promotion of the first promotion unit 122" and "the microphone 16 after the promotion of the first promotion unit 122". It is determined whether or not the feature amount of "user's voice input to" is the same. Here, the "user's voice input to the microphone 16 before the promotion of the first promotion unit 122" is the user's voice input in step S18. Further, "the voice of the user input to the microphone 16 after the promotion of the first promotion unit 122" is the voice of the user determined to be YES in step S212.

[Fifth Embodiment]
In the above-described embodiment, the generation unit 104 of the MFP 10 generates voice data of the voice as it is in the wording indicating the setting content acquired by the acquisition unit 102. The generation unit 104 of the fifth embodiment generates voice data based on the content of the number of characters smaller than the number of characters of the wording indicating the setting content acquired by the acquisition unit 102. In the following, the content having a number of characters smaller than the number of characters in the wording indicating the setting content acquired by the acquisition unit 102 may be referred to as “shortened content”.

The MFP 10 and the external device 20 of the fifth embodiment are as shown in FIG. Further, the processing flow of the MFP 10 and the external device 20 of the fifth embodiment will be described with reference to FIG. In step S6, the generation unit 104 converts the setting content acquired by the acquisition unit 102 into a content having a number of characters smaller than the number of characters of the wording indicating the setting content, based on the conversion table. FIG. 19 is an example of a conversion table. The conversion table of FIG. 19 is stored in a predetermined storage area of the MFP 10.

The left column of FIG. 19 defines the setting contents before conversion, and the right column of FIG. 19 defines the setting contents of the conversion degree (that is, the setting contents having a small number of characters). In the example of FIG. 19, "resolution 200 x 200 dpi" is associated with "2d". "Resolution 300 x 300 dpi" is associated with "3d". "Resolution 400 x 400 dpi" is associated with "4d". "Resolution 600 x 600 dpi" is associated with "6d". "File format compact PDF" is associated with "cdpf". "File format compact XPS" is associated with "cpps". "Email transmission" is associated with "ms".

For example, a case where "resolution 400 x 400 dpi", "file format compact PDF", "user@test.jp", and "email transmission" are set by the user will be described. In this case, the acquisition unit 102 acquires "resolution 400 x 400 dpi", "file format compact PDF", "user@test.jp", and "email transmission" as job setting contents. Of these, the setting contents of the conversion target are "resolution 400 x 400 dpi", "file format compact PDF", and "email transmission". With reference to the conversion table of FIG. 19, the generation unit 104 converts "resolution 400 x 400 dpi" to "4d", converts "file format compact PDF" to "cdpf", and changes "Email transmission" to "ms". To convert to.

In step S6, the generation unit 104 generates audio data based on the converted content. Here, the generation unit 104 is "Nidi, Sidy Peafu, Arufabetto, Yuesuiaru, Suuji, Ichi, Attomark, Arufabetto". , Teeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee

In step S8, audio data based on the content with a small number of characters (that is, the shortened content) is transmitted to the external device 20. The external device 20 stores this voice data. In step S14, when the user performs a voice output operation on the external device 20, "Nidi, Peripheral, Arufabetto, Yuesuiaru, Suji" , Ichi, Attomark, Arufabetto, Teeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee When the machine voice is input to the microphone 16, in step S20, the voice recognition unit 112 executes the voice recognition process for the machine voice. The controller 31 returns the shortened content indicated by the result of the voice recognition process to the setting content before conversion with reference to the conversion table of FIG. As a result, the controller 31 can specify the setting contents before conversion. The setting unit 114 makes settings based on the setting contents before conversion. In step S22, the execution unit 116 executes a job based on the setting.

According to the MFP of the present embodiment, the generation unit 104 generates the audio data of the shortened content, and the transmission unit 106 transmits the audio data of the shortened content to the external device 20. Therefore, the MFP of the present embodiment can reduce the capacity of the voice data as compared with the "MFP that transmits the voice data of the voice as it is in the wording indicating the setting content acquired by the acquisition unit to the external device". ..

[Sixth Embodiment]
In the MFP of the sixth embodiment, when the setting contents of the job based on the machine voice output from the external device 20 include variable contents that can be changed by the user, the user changes the variable contents. Can be done.

The MFP 10 and the external device 20 of the sixth embodiment are as shown in FIG. The execution unit 116 of FIG. 11 corresponds to the “second execution unit” of the present disclosure. Further, FIG. 20 is a diagram showing a processing flow of the MFP 10 and the external device 20 of the sixth embodiment. In step S20, the voice recognition unit 112 executes voice recognition for the input machine voice. Next, in step S302, the controller 31 determines whether or not the setting content shown in the voice recognition result includes variable content. Here, the variable content is a content that improves the convenience of the user if it can be freely changed by the user. The variable contents are predetermined for each job. For example, the variable content of the mail sending job is "mail destination". The destination of the mail includes at least one of the destination and the destination folder. The variable content of the copy job and the printer job is "the number of prints".

When the controller 31 determines that the setting content shown in the voice recognition result includes variable content (YES in step S302), the process proceeds to step S304. In step S304, the controller 31 displays a screen for inputting a change in the setting contents on the operation panel 34. When the change of the setting content is input from this screen, the acquisition unit 102 acquires the change of the setting content.

FIG. 21 is an example of a screen for inputting a change in the setting contents. On the screen of FIG. 21, the display area 516, the third button 552, and the fourth button 554 are displayed. In the display area 516, the destination of the mail transmission job is displayed. The characters "destination input completed" are displayed in the area of the third button 552. In the area of the fourth button 554, the characters "use voice data destination" are displayed.

When the user sets the destination of the machine voice output from the external device 20, the user operates the fourth button 554. Further, when the user changes the destination of the machine voice output from the external device 20, the user operates the third button 552.

When the screen of FIG. 21 is displayed, if neither the third button 552 nor the fourth button 554 is operated, the user can input a new destination in the display area 516. When the user inputs a destination to the display area 516 and operates the third button 552, the setting unit 114 deletes the destination of the machine voice output from the external device 20 and sets the destination input to the display area 516. Set anew. Further, when the user operates the fourth button 554, the setting unit 114 sets the destination of the machine voice output from the external device 20.

After that, in step S22, the execution unit 116 executes the job based on the voice recognition result when the setting contents are not changed. Further, in step S22, when the setting content is changed, the execution unit 116 changes the job based on the "setting content from the voice recognition result" and the "setting content reflecting the change acquired by the acquisition unit 102". Execute the job based on the settings made.

In the MFP 10 of the present embodiment, the user can change the variable content of the audio setting content output from the external device 20. Therefore, the convenience of the user can be improved.

Hereinafter, the processes of step S2, step S4, step S6, and step S8 of FIG. 20 are collectively referred to as a "third process". Further, the processes of step S18, step S20, step S302, step S304, and step S22 in FIG. 20 are collectively referred to as a "fourth process".

In the sixth embodiment, it has been described that the MFP 10 executes both the third process and the fourth process. However, the user may have the external device 20 store the voice of the wording indicating the setting content and the voice data of the user's voice by causing the first MFP to execute the third process. In addition, the user may cause a second MFP different from the first MFP to execute a job based on the voice from the external device 20. According to such a configuration, the user can select the MFP to execute the first process and the MFP to execute the second process, so that the degree of freedom of the user can be improved.

The controller of the second MFP has the functions of the microphone 16 shown in FIG. 11, the acquisition unit 102, the setting unit 114, the voice recognition unit 112, the voice reception unit 110, and the execution unit 116. The acquisition unit 102 acquires the change of the setting content. Further, the controller of the second MFP executes the processes of steps S302, S304, and S22 when the process of step S20 of FIG. 20 is completed.

[7th Embodiment]
The MFP of the sixth embodiment has been described as allowing the user to change this variable content. The MFP of the seventh embodiment can facilitate the change of this variable content. FIG. 22 is a diagram showing a functional configuration example of the MFP 10 and the external device 20 according to the seventh embodiment. Comparing FIG. 11 and FIG. 22, the controller 31 of the MFP 10 shown in FIG. 16 is different from FIG. 22 and FIG. 16 in that it has a second promotion unit 130. The second promotion unit 130 prompts the user to input the change of the setting content to the acquisition unit 102.

FIG. 23 is a diagram showing a processing flow of the MFP 10 and the external device 20 of the sixth embodiment. Comparing FIG. 23 and FIG. 20, both drawings differ in that step S304 is replaced by step S310.

If YES is determined in step S302, in step S310, the second promotion unit 130 promotes the input of the change of the setting content. For example, the second promotion unit 130 promotes the input of the change of the setting content by voice. For example, the second promotion unit 130 outputs a voice such as "Do you want to change the destination?" When it is determined that the voice of the mail transmission job is included based on the voice recognition result in step S20.

After this voice is output, the user causes the microphone 16 to input a voice such as "Change the destination. The destination is" XXX@test.jp "". In this case, the setting unit 114 makes a setting based on the input voice. In addition, the second promotion unit 130 may execute the promotion by voice and display the screen of FIG. 21. In this case, the acquisition unit 102 acquires the change of the setting content from the screen of FIG. 21.

The MFP 10 of the present embodiment can prompt the user to change the variable content of the audio setting content output from the external device 20. Therefore, for example, even if the user is not accustomed to handling the MFP 10, the user can be made aware of the change in the variable content.

[8th Embodiment]
In the first to seventh embodiments, the external device 20 has been described as storing the voice data from the MFP 10 and outputting the voice based on the stored voice data. The external device 20A of the eighth embodiment makes it possible to download, for example, an application that outputs audio of the setting contents. Hereinafter, this application is referred to as an "MFP application". This MFP application is an application provided by a predetermined server device (not particularly shown). The external device 20A outputs the machine voice based on the user's operation while the MFP application is running.

FIG. 24 is a screen displayed in the display area 442A of the operation panel 442 of the external device 20A when the external device 20A activates the MFP application. FIG. 24 is a screen on which a list of jobs is displayed. In the example of FIG. 24, a mail sending job, a copy job, and the like are displayed as a list of jobs. From the list of jobs, the user can select a job for which machine voice is to be output, that is, a job for which the MFP 10 is to be executed. When the enter button 611 is operated while the job is selected by the user, the external device 20A displays the setting screen corresponding to the selected job. This setting screen is a screen on which one or more setting items corresponding to the selected job are displayed. When the setting item is selected by the user and the setting item is determined, the external device 20A outputs the sound corresponding to the setting item.

FIG. 25 is an example of an audio screen corresponding to an email transmission job. In the example of FIG. 25, a list of setting items 610, an execute button 612, and a save button 614 are displayed. The list of setting items 610 in FIG. 25 includes "resolution 200 x 200 dpi", "resolution 300 x 300 dpi", "resolution 400 x 400 dpi", "resolution 600 x 600 dpi", "file format: compact PDF", and "file format:". It consists of "TIFF", "File format: XPS", "File format: PPTX", "File format: Compact PDF", "File format: JPEG", and "File format: Compact XPS".

In the example of FIG. 25, the displayed setting item is selected by being specified (for example, touched) by the user while the setting item is displayed. In the example of FIG. 25, "resolution: 300 x 300 dpi" and "file format: compact PDF" are selected by the user. For setting items with the same attributes, two or more setting items cannot be selected. In the present embodiment, the attributes are "resolution", "file format", and the like. Therefore, for example, for a setting item whose attribute is "resolution", one setting item can be selected, and two or more setting items cannot be selected. For example, if "resolution: 400 x 400 dpi" is selected while "resolution: 300 x 300 dpi" is selected, the selection of "resolution: 300 x 300 dpi" is canceled.

When the execution button 612 is operated while the setting item is selected by the user, the external device 20A outputs a voice (for example, machine voice) of the wording indicating the selected selection item. When the execute button 612 is operated while "resolution 300 x 300 dpi" and "file format: compact PDF" are selected by the user, the external device 20A sends a request signal to the server device. And send. The request signal is a signal for requesting the server device for voice data of the voice of the wording indicating the selected setting item. When the server device receives the request signal, it transmits the voice data requested by the request signal to the request source external device 20A. When the external device 20A receives the voice data, it outputs a machine voice based on the voice data. In the example of FIG. 25, the external device 20A outputs a mechanical sound such as "kaizoudo, sanbyakudipeeai, file keishiki, konpakutopideiefu".

Further, when the save button 614 is operated while the setting item is selected by the user, the external device 20A transmits the request signal to the server device. When the server device receives the request signal, it transmits the voice data requested by the request signal to the request source external device 20A. When the external device 20A receives the voice data, the external device 20A stores the voice data in a predetermined storage area of the external device 20A. As a result, the user can make the application that outputs the voice output the voice of the stored voice data without starting the MFP application.

As described above, the external device 20A of the present embodiment stores the voice data of the selected setting item when the save button 614 is operated without storing the voice data when the MFP application is downloaded. To do. Therefore, the external device 20A of the present embodiment can reduce the storage capacity as compared with the "external device that stores the audio data of all the setting items when the MFP application is downloaded".

By the way, there may be a plurality of MFPs having different functions. FIG. 26 is a diagram showing the functions of the three MFPs 10X, 10Y, and 10Z. In the example of FIG. 26, the MFP 10A is capable of performing color printing and monochrome printing. Further, the MFP 10B can execute color printing and monochrome printing. Further, the MFP10C cannot execute color printing and can execute monochrome printing. The information in FIG. 26 is information included in the MFP application. When the MFP application is downloaded, the external device 20A stores the information of FIG. 26 in a predetermined area of the external device 20A.

FIG. 27 is an example of an audio screen corresponding to a copy transmission job. In the example of FIG. 27, a list of setting items 650, an MFP10X execution button 652, an MFP10Y execution button 654, an MFP10Z execution button 656, and a save button 614 are displayed. The list of setting items 650 in FIG. 25 includes "number of copies: 3", "number of copies: 4", "number of copies: 5", "number of copies: 6", "number of copies: 7", "number of copies: 8", and "number of copies: 9". , "Number of copies: 10", "Number of copies: set", "Color copy", "Monochrome copy". The number of copies is the number of copies made by the copy job.

In the example of FIG. 27, "number of copies: 5" and "color copy" are selected. Here, for example, when the MFP10X execution button 652 or the MFP10Y execution button 654 is operated, the external device 20A determines the selected setting content and emits a voice of a word indicating the determined setting content. Output. Therefore, the external device 20A outputs the machine voice "Busuugomai, Karakopee".

Next, a case where the MFP10Z execution button 656 is operated with "number of copies: 5" and "color copy" selected will be described. As also described in FIG. 26, the MFP10Z cannot perform color copying. Therefore, even if the external device 20A outputs the machine voice "Karakopee", the MFP10Z cannot execute the color copy. Therefore, the user has to change the setting content from the color copy to the monochrome copy, which increases the burden on the user.

Therefore, in the present embodiment, the external device 20A changes the setting content selected by the user to the setting content according to the job that can be executed by the MFP. In the examples of FIGS. 26 and 27, the external device 20A changes the setting contents selected by the user (here, color copy) to the setting contents (here, monochrome copy) according to the job that the MFP10Z can execute. To do. For example, the external device 20A pops up an image "May I change to a monochrome copy because the MFP10Z cannot perform color copying?", A YES button, and a NO button. When the NO button is operated by the user, the initial state of the audio screen corresponding to the copy transmission job is returned.

On the other hand, when the YES button is operated by the user, the external device 20A changes from the state in which the color copy is selected to the state in which the monochrome copy is selected. For example, the state in which the border of the color copy is a thick line is switched to the state in which the border of the monochrome copy is a thick line. After that, the external device 20A outputs a mechanical voice saying "Busuugomai, Monokurokopee".

FIG. 28 is a diagram showing a configuration example of the image forming system 1000A. In the example of FIG. 28, the server device 70, the MFP 10, and the external device 20A (computer) to which the MFP application is downloaded are provided.

The controller 41A of the external device 20A has a storage unit 204, an operation reception unit 206, an output control unit 208, a display control unit 210, and a request unit 212.

The storage unit 204 stores the program of the MFP application. The operation reception unit 206 receives an operation of the operation panel 44 by the user. In the present embodiment, the operation reception unit 206 accepts the selection of the setting contents of the job to be executed by the MFP 10. The "selection of setting contents" is, for example, a user's selection from the list 610 of the setting items described with reference to FIG. 25. Further, the "selection of setting contents" is, for example, a user's selection from the list of setting items 650 described with reference to FIG. 27.

Further, the operation reception unit 206 accepts the determination of the selected setting content. “Determining the selected content” is, for example, an operation on the execution button 612 described with reference to FIG. 25. Further, the "determination of the selected content" is, for example, an operation on any one of the MFP10X execution button 652, the MFP10Y execution button 654, and the MFP10Z execution button 656 described with reference to FIG. 27.

Further, the display control unit 210 displays the screens described with reference to FIGS. 25 and 27 in the display area 442A of the display device 442 of the operation panel 44. Further, the request unit 212 requests the server device 70 for voice data based on the setting contents determined by the user by the output control unit 208. The output control unit 208 outputs the machine voice based on the voice data received from the server device 70 at the request of the request unit 212 from the speaker 47. The MFP 10 executes a job based on the machine voice.

Further, when the save button 614 is operated, the controller 41A stores the voice data received from the server device 70 in the storage unit 204 at the request of the request unit 212.

FIG. 29 is a processing flow of the external device 20A of the present embodiment. When the process of initiating the MFP application by the user is executed for the external device 20A, the external device 20A starts the process of FIG. 29.

In step S402, the display control unit 210 displays the list screen of FIG. 24 on the operation panel. Further, the display control unit 210 displays a setting screen (for example, the screen of FIG. 25 or FIG. 27) corresponding to the selected job.

In step S404, the controller 41A determines whether or not the operation reception unit 206 has accepted the selection of the set contents. The controller 41A repeats the process of step S404 until it is determined that the operation receiving unit 206 has accepted the change of the set contents (NO in step S404). When the controller 41A determines that the operation receiving unit 206 has accepted the change of the set contents (YES in step S404), the process proceeds to step S406.

In step S406, the controller 41A determines whether or not the operation reception unit 206 has accepted the operation of the save button 614. When the controller 41A determines in step S406 that the operation receiving unit 206 has accepted the operation of the save button 614 (YES in step S406), the process proceeds to step S416. In step S416, the requesting unit 212 requests the server device 70 for voice data based on the determined setting contents. In step S416, when the requesting unit 212 receives the requested voice data, the requesting unit 212 stores the requested voice data in the storage unit 204.

When the controller 41A determines in step S406 that the operation receiving unit 206 has not received the operation of the save button 614 (NO in step S406), the process proceeds to step S408.

In step S408, the controller 41A determines whether or not the operation reception unit 206 has accepted the operation of the execution button. Here, the execution buttons are the execution button 612, the MFP10X execution button 652, the MFP10Y execution button 654, and the MFP10Z execution button 656 described with reference to FIG. 25. When the controller 41A determines in step S406 that the operation reception unit 206 has accepted the operation of the execution button (YES in step S408), the process proceeds to step S410.

In step S410, the controller 41A determines whether or not the "setting content determined to be selected in step S404" is the "setting content corresponding to the job that can be executed by the MFP specified by the execute button". To do. For example, on the screen of FIG. 27, when the MFP10X execution button 652 is operated while the color copy is selected, the color copy corresponds to the job that the MFP10X specified by the MFP10X execution button 652 can execute. This is the setting content. In this case, YES is determined in step S410, and the process proceeds to step S412.

Further, when the MFP10Z execution button 656 is operated in the state where the color copy is selected on the screen of FIG. 27, the color copy corresponds to the job that the MFP10Z specified by the MFP10Z execution button 652 can execute. It is not the setting content. In this case, NO is determined in step S410, and the process proceeds to step S414.

In step S412, the requesting unit 212 requests the server device 70 for voice data based on the selected setting contents. In step S412, when the output control unit 208 receives the requested voice data, the output control unit 208 outputs the voice based on the voice data from the speaker 47.

Further, in step S414, the controller 41A changes the setting contents. This change is a change from "setting contents determined to be selected in step S404" to "setting contents according to a job that can be executed by the MFP specified by the execute button determined to have been operated in step S408". Is. In the next step S412, the requesting unit 212 requests the server device 70 for voice data based on the selected setting content and the changed setting content. In step S412, when the output control unit 208 receives the requested voice data, the output control unit 208 outputs the voice based on the voice data from the speaker 47.

As described above, when the second user visually recognizes the setting screen, he / she can emit a voice of the wording of the setting content displayed on the setting screen, but if he / she does not visually recognize the setting screen, the setting screen is displayed. The voice of the displayed setting contents cannot be emitted. Therefore, the external device 20A of the present embodiment accepts the selection and determination of the job setting contents (that is, the job setting items and the job type) by downloading the MFP application (FIGS. 24, 25, 27). , And step S404 and step S408 of FIG. 20). Further, the output control unit 208 of the external device 20A outputs the voice of the wording indicating the determined setting content from the speaker 47 (step S412). Therefore, the second user can appropriately cause the MFP 10 to execute a voice-based job.

Further, when the setting content displayed by the external device 20A is determined, the external device 20A may be configured to transmit the setting content to the MFP 10. However, with such a configuration, it is necessary to provide a communication means between the external device 20A and the MFP 10, which increases the cost. With the external device 20A of the present embodiment, it is not necessary to provide such a communication means. Therefore, the external device 20A and the image forming system 1000 can suppress the increase in cost.

Further, the external device 20A accepts the selection of the setting contents when the setting contents displayed in the display area 442A are specified by the user (see step S404). Therefore, the user can easily select the setting contents.

Further, when the setting content is determined by the user, the requesting unit 212 requests the server device 70 for voice data based on the selected setting content. Further, when the output control unit 208 receives the requested voice data, the output control unit 208 outputs the voice based on the voice data from the speaker 47. Further, when the save button 614 is operated by the user, the request unit 212 requests the server device 70 for voice data based on the selected setting content. Further, when the output control unit 208 receives the requested voice data, the output control unit 208 stores the voice data (step S416 in FIG. 29). After the audio data is stored, the external device 20A does not start the MFP application (that is, even if the user does not perform an operation to start the MFP application), the external device 20 stores the storage. It is possible to output a voice based on the voice data. For example, with respect to the setting contents frequently used by the user (that is, the setting contents for frequently outputting the voice), the user preferably stores the voice data of the setting contents in the external device 20A. As a result, the user can output the voice based on the voice data of the setting contents from the external device 20A without performing the operation of starting the MFP application. Therefore, the operation load on the user can be reduced.

Further, the controller 41A changes the setting contents selected by the user to the setting contents according to the job that can be executed by the MFP designated by the execution button operated by the user (step S414). Therefore, the external device 20A can prevent the user from burdening the user with the change.

Further, the external device 20A of the eighth embodiment may store the audio data of all the setting contents by downloading the MFP application.

The processing in the external device 20A is realized by the software executed by each hardware and the CPU 411. Such software may be pre-stored in a predetermined storage device (eg, ROM412, or flash memory (not shown)). In addition, the software may be stored in a memory card or other storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by an IC card reader / writer or other reading device, or downloaded via a communication IF, and then temporarily stored in the ROM 412. The software is read from ROM 412 by CPU 411, and CPU 101 executes the program.

The recording medium is not limited to DVD-ROM, CD-ROM, FD (Flexible Disk), and hard disk, but also magnetic tape, cassette tape, optical disc (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital). A medium such as a Versatile Disc)), an optical card, a mask ROM, an EPROM (Electronically Programmable Read-Only Memory), an EEPROM (Electronically Erasable Programmable Read-Only Memory), or a semiconductor memory such as a flash ROM may be used. .. Further, the recording medium is a non-temporary medium in which the program or the like can be read by a computer.

The program includes not only a program that can be directly executed by the CPU, but also a source program format program, a compressed program, an encrypted program, and the like.

In addition, each embodiment disclosed this time should be considered to be exemplary in all respects and not restrictive. The scope of the present invention is shown by the scope of claims rather than the above description, and it is intended to include all modifications within the meaning and scope equivalent to the scope of claims. In addition, the inventions described in the embodiments and the modifications are intended to be implemented, either alone or in combination, wherever possible.

100 Information processing device, 102 Acquisition unit, 104 Generation unit, 106 Transmission unit, 110 Voice reception unit, 112 Voice recognition unit, 114 Setting unit, 116 Execution unit, 120 Job unit, 122 First promotion unit, 202 Reception unit, 204 Storage unit, 206 operation reception unit, 208 output control unit.

Claims (16)

The acquisition unit that acquires the job settings and
A generation unit that generates voice data of voice of words indicating the setting contents acquired by the acquisition unit, and a generation unit.
An information processing device including an external device that outputs voice based on the voice data and a transmission unit that transmits the voice data. The acquisition unit acquires a plurality of setting contents and obtains them.
The generation unit generates the voice data for each of the plurality of setting contents, and generates the voice data.
The information processing device according to claim 1, wherein the transmission unit transmits the voice data for each of the plurality of setting contents to the external device that outputs voice based on the voice data for each of the plurality of setting contents. The information processing device further
A microphone to which voice is input and
It is provided with a first promotion unit that executes a first promotion process that promotes the input of the user's voice to the microphone to the user.
The generation unit generates new voice data by adding the voice data of the user's voice input to the microphone after the execution of the first promotion process to the voice data generated by the generation unit. ,
The information processing device according to claim 1 or 2, wherein the transmission unit transmits the new voice data to the external device that outputs voice based on the new voice data. The first promotion unit executes a second promotion process for encouraging the user to input the user's voice into the microphone when the voice based on the new voice data is input to the microphone from the external device. ,
The information processing device further
When the characteristic information of the user's voice input to the microphone after the execution of the second promotion process and the characteristic information of the user's voice included in the voice based on the new voice data are the same, the new The information processing apparatus according to claim 3, further comprising a first execution unit that executes a job based on a setting content indicated by voice based on voice data. A microphone to which voice is input and
When the voice of the wording indicating the setting contents of the job and the voice of the user are input to the microphone, the first promotion unit that prompts the user to input the voice of the user into the microphone, and
When the feature information of the user's voice input to the microphone before the promotion of the first promotion unit and the feature amount of the user's voice input to the microphone after the promotion of the first promotion unit are the same. An information processing device including a first execution unit that executes a job based on a job setting content indicated by a voice input to the microphone before promotion of the first promotion unit. The information processing device according to any one of claims 3 to 5, wherein the voice feature information is a voiceprint. The generation unit generates voice data based on the content of the number of characters smaller than the number of characters of the wording indicating the setting content acquired by the acquisition unit.
The method according to any one of claims 1 to 4, wherein the transmission unit transmits the voice data to the external device so as to output the voice based on the voice data based on the content of the small number of characters to the external device. Information processing equipment. It is provided with a second execution unit that executes a job based on the setting contents indicated by the voice output from the external device.
The acquisition unit acquires changes in the job settings and obtains them.
The information processing device according to any one of claims 1 to 7, wherein the second execution unit executes a job based on the setting contents reflecting the changes acquired by the acquisition unit. A microphone to which voice is input and
When the voice of the wording indicating the setting contents of the job is input to the microphone, the execution unit that executes the job based on the setting contents indicated by the voice, and the execution unit.
It is equipped with an acquisition unit that acquires changes in job settings.
The execution unit is an information processing device that executes a job based on the setting contents reflecting the changes input to the acquisition unit. The information processing apparatus according to claim 8 or 9, further comprising a second promotion unit that prompts the user to input a change in the setting content to the acquisition unit. On the computer
The selection acceptance procedure that accepts the selection of the setting contents of the job to be executed by the information processing device, and
The decision acceptance procedure to accept the decision of the selected setting contents, and
A program for executing the output procedure that outputs the voice of the wording indicating the determined setting contents. The program according to claim 11, wherein the selection acceptance procedure is a procedure for accepting selection of setting contents by designating the setting contents displayed in the display area by the user. The program is applied to the computer and further
Further execute the request procedure for requesting the server device for voice data based on the determined setting contents.
The output procedure is a procedure for outputting the voice of the voice data received from the server device according to the request procedure.
The program is applied to the computer and further
The program according to claim 11 or 12, further executing a storage procedure for storing the voice data received from the server device in a predetermined area according to the request procedure. The program causes the computer to further execute a change procedure for changing the setting contents selected in the selection acceptance procedure to the setting contents according to a job that can be executed by the computer. The program described in any one of the items. An image forming apparatus including the information processing apparatus according to any one of claims 1 to 10. The acquisition step to acquire the job settings and
A generation step for generating voice data of the wording indicating the setting contents acquired in the acquisition step, and a generation step.
An information processing method including a transmission step of transmitting the voice data to the external device so as to output the voice based on the voice data to the external device.

Images