JP2021056633A - Voice setting system, voice setting support program and voice setting support device - Google Patents

Abstract

To facilitate the operation of setting up jobs by voice.SOLUTION: A voice setting system comprises an MFP capable of executing multiple types of jobs and a voice setting support server that supports generation of jobs to be executed by the MFP based on voice information obtained from voice, the voice setting support server comprises a determining part 255 for determining a job type of a job and a parameter to be set for the job based on voice information, and an output part 257 for outputting the determined job type and parameter, and the determining part 255 prioritizes one of the job type and the parameter over the other when the job type and the parameter are inconsistent.SELECTED DRAWING: Figure 4

Description

The present invention relates to a voice setting system, a voice setting support program, and a voice setting support device. In particular, a voice setting system that sets a job to be executed by an image processing device based on voice, and a voice setting support device included in the voice setting system. The voice setting support program executed in the above and the voice setting support device thereof.

Generally, a multifunction device (hereinafter referred to as "MFP") is installed in an office. The user causes the MFP to execute a job that defines processes such as printing image data, copying a document, reading a document, storing image data, and transmitting image data. A technique for setting the parameters of a job executed by an MFP by voice is known.

When setting job parameters by voice, the parameters specified by voice may conflict with the parameters specified separately. In order to deal with this problem, Japanese Patent Application Laid-Open No. 2005-164944 includes a capture means for capturing the current dialogue state, a search means for searching an operation parameter based on the captured dialogue state, and the search. Described is an operation parameter determining device including an integration means for integrating operation parameters and an output means for outputting an operation parameter which is an integration result of the integration means.

However, if a plurality of parameters are integrated in the parameter setting that determines the job executed by the MFP, a parameter different from the parameter to be set by the user is set. Therefore, there is a problem that it is difficult to set a job.

Japanese Unexamined Patent Publication No. 2005-164944

One of the objects of the present invention is to provide a voice setting system that facilitates the operation of setting a job by voice.

Another object of the present invention is to provide a voice setting support program that facilitates the operation of setting a job by voice.

Still another object of the present invention is to provide a voice setting support device that facilitates the operation of setting a job by voice.

According to one aspect of the present invention, the voice setting system supports a job execution device capable of executing a plurality of types of jobs and a job execution device to execute a job based on voice information obtained from the voice. The voice setting support device includes a voice setting support device, and the voice setting support device outputs a determination means for determining a job type of a job and parameters set in the job based on voice information, and a determined job type and parameters. The output means and the determination means determine one of the job type and the parameter in preference to the other when the job type and the parameter do not match.

According to this aspect, when the job type and the parameter determined based on the voice information obtained from the voice do not match, one of the job type and the parameter is determined with priority over the other. Therefore, it is possible to provide a voice setting system that facilitates the operation of setting a job by voice.

Preferably, the job is set with parameters corresponding to one or more setting items defined for the job type, and the determination means can be set corresponding to one or more setting items for each of the plurality of job types. It is judged whether or not the job type and the parameter match by using the parameter table in which a plurality of parameters are defined.

According to this aspect, since it is determined whether or not the job type and the parameter match using the parameter table, it is possible to prevent the parameter that cannot be set according to the job type from being set.

Preferably, the job execution device further includes setting means for setting the job type and parameters output from the voice setting support device.

According to this aspect, the job execution device can execute the job according to the job type and the parameters determined by the voice setting support device.

Preferably, the voice setting support device further includes job generation means for generating a job based on the job type and parameters output by the output means.

According to this aspect, the job execution device can execute the job according to the job type and the parameters determined by the voice setting support device.

Preferably, the determining means does not determine the parameters that are determined to be inconsistent with the job type.

According to this aspect, since the parameter determined to be inconsistent with the job type is not determined, it is possible to prevent an erroneous parameter from being set for the job type.

Preferably, the determining means predicts new new parameters that match the job type based on the parameters that are determined to be inconsistent with the job type.

According to this aspect, the operation of setting a job by voice can be facilitated.

Preferably, the voice setting support device further includes a notification means for notifying the user who has spoken the voice when the determination means determines that the job type and the parameter do not match.

According to this aspect, it is possible to inform the user that the job type and the parameter do not match.

Preferably, the voice setting support device further includes voice information acquisition means for acquiring voice information from the voice information extraction device that extracts voice information from the voice collected by the voice collection device.

According to this aspect, since it is not necessary to extract the voice information from the voice, the configuration of the voice setting support device can be simplified.

Preferably, the determination means determines the consistency between the job type and the parameter included in the voice information acquired at an arbitrary time by the voice information acquisition means.

According to this aspect, the consistency between the job type and the parameter included in one voice information is determined, so that the job can be set from one voice information.

Preferably, when the first voice information acquired by the voice information acquisition means at the first time does not include the job type and includes the parameters, the determination means is based on the parameters included in the first voice information and the voice information acquisition means. The consistency with the job type included in the second voice information acquired at the second time different from the first time is determined.

According to this aspect, a job can be set from a plurality of voice information.

Preferably, when the voice information acquired by the voice information acquisition means does not include the job type and includes the parameters, the determination means determines the consistency with the job type set in the job execution device.

According to this aspect, a job can be set even if the voice information does not include the job type.

Preferably, the voice setting support device further includes voice information extraction means for extracting voice information from the voice collected by the voice collecting device.

Preferably, the job execution device includes a voice setting support device.

Preferably, the determination means determines the job type in preference to the parameter when the job type and the parameter do not match.

Preferably, the job execution device is an image processing device.

According to another aspect of the present invention, the voice setting support program is a determination step of determining the job type to be executed and the parameters set in the job among a plurality of types of jobs based on the voice information obtained from the voice. And an output step that outputs the determined job type and parameters, is executed by the computer that controls the voice setting support device, and the determination step is performed with the job type and parameters when the job types and parameters do not match. Includes the step of determining one in preference to the other.

According to this aspect, it is possible to provide a voice setting support program that facilitates the setting of a job by voice by the user.

Preferably, each job is set with parameters corresponding to one or more setting items defined for the job type, and the determination step is set corresponding to one or more setting items for each of the plurality of job types. It includes a step of determining whether or not the job type and the parameter match by using a parameter table that defines a plurality of possible parameters.

Preferably, the determination step includes a step of determining a job type and parameters for a job execution device capable of executing a plurality of types of jobs.

Preferably, the determination step includes a step of determining the consistency between the parameters included in the voice information and the job type set in the job execution device.

Preferably, the output step includes a step of sending the job type and parameters to the job executor and causing the job executor to set the job type and parameters.

Preferably, the job execution device is an image processing device.

Preferably, the computer is further executed in a job generation step that generates a job based on the job type and parameters output in the output step.

Preferably, the determination step includes a step that does not determine a parameter that is determined to be inconsistent with the job type.

Preferably, the determination step includes predicting new parameters that match the job type and determining the predicted new parameters based on the parameters that are determined to be inconsistent with the job type.

Preferably, if the decision step determines that the job type and parameters do not match, the computer is further subjected to a notification step that notifies the user who spoke the voice.

Preferably, the computer is further subjected to a voice information acquisition step of acquiring voice information from the voice information extraction device that extracts voice information from the voice collected by the voice collection device.

Preferably, the determination step includes a step of determining the consistency between the job type and the parameter included in the voice information acquired at an arbitrary time in the voice information acquisition step.

Preferably, the determination step is performed in the parameter and voice information acquisition step included in the first voice information when the first voice information acquired at the first time in the voice information acquisition step does not include the job type and includes the parameter. It includes a step of determining consistency with the job type included in the second voice information acquired at the second time different from the first time.

Preferably, the computer is further subjected to a voice information extraction step of extracting voice information from the voice collected by the voice collector.

Preferably, the determination step includes a step of determining the job type in preference to the parameter when the job type and the parameter do not match.

According to still another aspect of the present invention, the voice setting support device is a determination means for determining the job type to be executed and the parameters set in the job among a plurality of types of jobs based on the voice information obtained from the voice. And an output means for outputting the determined job type and parameters, and the determination means determines one of the job type and the parameter in preference to the other when the job type and the parameter do not match. ..

According to this aspect, it is possible to provide a voice setting support device that facilitates the setting of a job by voice by the user.

Preferably, the determination means determines the job type and the parameters for the job execution device capable of executing a plurality of types of jobs.

Preferably, the determining means determines the consistency between the parameters included in the voice information and the job type set in the job execution device.

Preferably, the parameters are set for each of the one or more setting items defined for the job type, and the determination means is set for each of the one or more setting items for each of the plurality of job types. Use a parameter table that defines multiple possible parameters to determine whether the job type and parameters match.

Preferably, the job execution device is further provided with setting means for transmitting the job type and parameters to the job execution device and causing the job execution device to set the job type and parameters.

Preferably, the job execution device is an image processing device.

Preferably, a job generation means for generating a job based on the job type and parameters output by the output means is further provided.

Preferably, the determining means does not determine the parameters that are determined to be inconsistent with the job type.

Preferably, the determining means predicts new new parameters that match the job type based on the parameters that are determined to be inconsistent with the job type.

Preferably, when the determination means determines that the job type and the parameter do not match, the notification means for notifying the user who has spoken the voice is further provided.

Preferably, the voice information acquisition means for acquiring the voice information from the voice information extraction device for extracting the voice information from the voice collected by the voice collection device is further provided.

Preferably, the determination means determines the consistency between the job type and the parameter included in the voice information acquired at an arbitrary time by the voice information acquisition means.

Preferably, when the first voice information acquired by the voice information acquisition means at the first time does not include the job type and includes the parameters, the determination means is based on the parameters included in the first voice information and the voice information acquisition means. The consistency with the job type included in the second voice information acquired at the second time different from the first time is determined.

Preferably, a voice information extraction means for extracting voice information from the voice collected by the voice collecting device is further provided.

Preferably, the determination means determines the job type in preference to the parameter when the job type and the parameter do not match.

It is a figure which shows the whole outline of the voice setting system in one of the Embodiments of this invention. It is a block diagram which shows an example of the outline of the hardware configuration of a voice setting support server. It is a block diagram which shows the outline of the hardware structure of the MFP. It is a block diagram which shows an example of the function which a CPU included in a voice setting support server has. It is a figure which shows an example of a parameter table. It is a figure which shows an example of a setting command. It is a block diagram which shows an example of the function which the CPU included in the MFP has. It is the first figure which shows an example of the setting screen. It is the 2nd figure which shows an example of the setting screen. It is a flowchart which shows an example of the flow of voice setting support processing. It is a flowchart which shows an example of the flow of a device setting process. It is a block diagram which shows an example of the function which the CPU provided in the voice setting support server in the 1st modification. It is a flowchart which shows an example of the flow of the apparatus setting process in 1st modification. It is a figure which shows an example of the display order information.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are the same. Therefore, detailed explanations about them will not be repeated.

FIG. 1 is a diagram showing an overall outline of a voice setting system according to one of the embodiments of the present invention. With reference to FIG. 1, the voice setting system 1 includes an MFP (Multi Function Peripheral) 100, a voice setting support server 200, a voice information generation server 300, and a smart speaker 400. The smart speaker 400 is arranged within a predetermined distance from the MFP 100. The predetermined distance is preferably a distance at which the sound uttered by the user while browsing the operation panel of the MFP 100 can be collected by the smart speaker 400. The smart speaker 400 may be arranged next to the MFP 100.

The MFP 100 is an example of a job execution device. In the present embodiment, the MFP 100 is an image processing device that processes an image by executing a job. The MFP 100 is connected to the network 3. The network 3 is, for example, a local area network (LAN). In the network 3, the connection form may be wired or wireless. Further, the network 3 may be a wide area network (WAN), a public switched telephone network (PSTN), the Internet, or the like.

An access point (AP) 9 is connected to the network 3. The AP9 is a relay device having a wireless communication function. The smart speaker 400 is connected to the network 3 by communicating with the AP9.

The gateway (G / W) device 7 is connected to the network 3 and also to the Internet 5. The gateway device 7 relays between the network 3 and the Internet 5. The voice setting support server 200 and the voice information generation server 300 are connected to the Internet 5. Therefore, each of the MFP 100 and the smart speaker 400 can communicate with the voice setting support server 200 or the voice information generation server 300 via the gateway device 7. Further, the voice setting support server 200 and the voice information generation server 300 can communicate with each other via the Internet 5.

The voice information generation server 300 provides a virtual assistant service using the smart speaker 400 as a user interface. Therefore, the user can talk with the smart speaker 400. The virtual assistant is also called an AI (Artificial Intelligence) assistant and is a well-known technique. The smart speaker 400 has a microphone, a speaker, and a communication function. The voice information generation server 300 receives the user's voice collected by the smart speaker 400, and controls the smart speaker 400 to speak by voice. The voice information generation server 300 has a function of performing natural language processing based on voice. The voice information generation server 300 may have a learning function using artificial intelligence technology including machine learning for natural language processing.

In the voice setting system 1 of the present embodiment, the user can set a job in the MFP 100 by voice by using the service of the virtual assistant provided by the voice information generation server 300. A voice setting support server 200 is arranged between the MFP 100 to be controlled and the voice information generation server 300 that provides the service of the virtual assistant. The voice setting support server 200 controls the MFP 100.

Specifically, the smart speaker 400 and the device to be controlled are registered in the voice information generation server 300. The device to be controlled is the MFP 100, but here, since the voice setting support server 200 controls the MFP 100, the voice setting support server 200 is registered in the voice information generation server 300 instead of the MFP 100 as the device to be controlled. To.

For example, in the voice setting system 1, an authentication server can be provided to associate the smart speaker 400 with the MFP 100. The voice setting support server 200 may have the function of the authentication server. Specifically, the authentication server issues a password in response to a request including an identification ID from the MFP 100. The administrator who manages the MFP 100 operates the MFP 100 and requests the authentication server to issue a password. The administrator operates a personal computer or the like to access the voice information generation server 300, associates the smart speaker 400 with the MFP 100, and registers the authentication server. The registration operation is an operation of associating the URL (Uniform Resource Locator) of the smart speaker with the identification ID and password of the MFP 100.

When the smart speaker 400 and the MFP 100 are associated with each other, the voice information generation server 300 requests the authentication server to issue an authentication token. Specifically, when the voice information generation server 300 sends an issuance request including the identification ID and password of the MFP 100 to the authentication server, the authentication server issues an authentication token if the identification information and the password are registered, and voices. Reply to the information generation server 300. After receiving the authentication token for the MFP 100, the voice information generation server 300 transmits the voice information generated based on the voice collected by the smart speaker 400 to the voice setting support server 200 together with the authentication token of the MFP 100.

The voice setting support server 200 transmits an authentication token to the authentication server. Since the authentication server that receives the authentication token returns the identification ID of the MFP 100 corresponding to the authentication token, the voice setting support server 200 can identify the MFP 100 from the identification ID.

Further, a keyword prepared in advance as information for extracting information for controlling the MFP 100 from the voice is registered in the voice information generation server 300. The keyword is information about a parameter set for the controlled MFP 100 to execute a job. Specifically, the keywords include the type of job and the parameters used by the MFP 100 to execute the job. The parameter is a value set for each of a plurality of setting items defined for each type of job. The voice information generation server 300 extracts information for controlling the MFP 100 from the voice spoken by the user, generates voice information including the extracted information, and outputs the voice information to the voice setting support server 200. A parsing rule may be registered in the voice information generation server 300 in order to extract a keyword from the voice.

For example, the user speaks a word prepared in advance to identify the MFP 100 to be controlled, for example, a name assigned to the MFP 100 to the smart speaker 400. In this case, the voice information generation server 300 refers to the keyword registered corresponding to the MFP 100, and the voice information is generated. The voice information generation server 300 transmits the generated voice information to the voice setting support server 200. Here, character information is used as the voice information. The voice information is not limited to the character information, and may be voice or code.

For example, a case where the name assigned to the MFP 100 is "Biz Hub" will be described as an example. When the user utters "copy in color with three copies in BizHub, two-in-one", the voice information is transmitted to the voice information generation server 300. The voice information generation server 300 identifies the MFP 100 from the word "biz hub", refers to the keyword stored in advance for the MFP 100, and refers to the words "three copies", "two-in-one", "color", and "copy". Is extracted. Then, the voice information generation server 300 determines that the job type is copy from the word "copy" according to the parsing rule, determines that "three copies", "two-in-one", and "color" are parameters, and determines that they are parameters. Generate audio information including. Then, the voice information generation server 300 transmits the voice information to the voice setting support server 200.

When setting a job by voice, the user must remember the parameters that can be set for the job that he / she wants to set. Therefore, parameters different from the parameters that can be set for the job may be emitted by voice. For example, a user may utter a parameter that can be set for a different type of job than the job that the user intends to set, but cannot be set for that job. In the voice setting system 1 of the present embodiment, the voice setting support server 200 has a function corresponding to such a case. Hereinafter, the voice setting system 1 will be described in detail.

FIG. 2 is a block diagram showing an example of an outline of the hardware configuration of the voice setting support server. With reference to FIG. 2, the voice setting support server 200 has a central processing unit (CPU) 201 for controlling the entire voice setting support server 200, and a ROM (Read Only) for storing a program for the CPU 201 to execute. Memory) 202, RAM (Random Access Memory) 203 used as a work area of CPU 201, a hard disk drive (HDD) 204 for non-volatile storage of data, a communication unit 205 for connecting CPU 201 to network 3, and information. The display unit 206 for displaying the above, the operation unit 207 for receiving the input of the user's operation, and the external storage device 210 are included.

The CPU 201 downloads a program from a computer connected to the Internet 5 and stores it in the HDD 204. Further, when the computer connected to the network 3 writes the program to the HDD 204, the program is stored in the HDD 204. The CPU 201 loads the program stored in the HDD 204 into the RAM 203 and executes the program.

The external storage device 210 is equipped with a CD-ROM (Compact Disk Read Only Memory) 211. In the present embodiment, an example in which the CPU 201 executes a program stored in the ROM 202 or the HDD 204 will be described. However, the CPU 201 may control the external storage device 210 to read a program for the CPU 201 to execute from the CD-ROM 211, store the read program in the RAM 203, and execute the program.

The recording medium for storing the program to be executed by the CPU 201 is not limited to the CD-ROM211. It is not limited to the CD-ROM211. )), An IC card, an optical card, a mask ROM, a medium such as a semiconductor memory such as an EPROM (Erasable Program ROM) may be used. The program referred to here includes not only a program that can be directly executed by the CPU 201, but also a source program, a compressed program, an encrypted program, and the like.

FIG. 3 is a block diagram showing an outline of the hardware configuration of the MFP. With reference to FIG. 3, the MFP 100 includes a main circuit 110, a document reading unit 130 for reading a document, an automatic document transporting device 120 for transporting a document to the document reading unit 130, and a document reading unit 130. The image forming unit 140 for forming an image on paper or the like based on the image data to be read and output, the paper feeding unit 150 for supplying the paper to the image forming unit 140, and the paper on which the image is formed are processed. The post-processing unit 155 and the operation panel 160 as a user interface are included.

The post-processing unit 155 executes a sorting process for rearranging and ejecting one or more sheets on which an image is formed by the image forming unit 140, a punching process for punching holes, and a staple processing for driving staples.

The main circuit 110 is equipped with a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a large-capacity storage device, a facsimile unit 116, and a CD-ROM 118. External storage device 117 and the like. The CPU 111 is connected to the automatic document transfer device 120, the document reading unit 130, the image forming unit 140, the paper feeding unit 150, the post-processing unit 155, and the operation panel 160, and controls the entire MFP 100.

The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. Further, the RAM 114 temporarily stores image data continuously sent from the document reading unit 130.

The communication I / F unit 112 is an interface for connecting the MFP 100 to the network 3. The CPU 111 communicates with the smart speaker 400 via the communication I / F unit 112 to transmit and receive data. Further, the communication I / F unit 112 can communicate with a computer connected to the Internet 5 via the network 3.

The facsimile unit 116 is connected to a public switched telephone network (PSTN) and transmits facsimile data to or receives facsimile data from PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115 or outputs the received facsimile data to the image forming unit 140. The image forming unit 140 prints the facsimile data received by the facsimile unit 116 on paper. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data and transmits the data to the facsimile apparatus connected to the PSTN.

A CD-ROM 118 is attached to the external storage device 117. The CPU 111 can access the CD-ROM 118 via the external storage device 117. The CPU 111 loads the program recorded in the CD-ROM 118 mounted on the external storage device 117 into the RAM 114 and executes the program. The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM 118, and may be a semiconductor memory such as an optical disk, an IC card, an optical card, a mask ROM, or an EPROM.

Further, the program executed by the CPU 111 is not limited to the program recorded in the CD-ROM 118, and the program stored in the HDD 115 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network 3 may rewrite the program stored in the HDD 115 of the MFP 100, or may add and write a new program. Further, the MFP 100 may download the program from another computer connected to the network 3 and store the program in the HDD 115. The program referred to here includes not only a program that can be directly executed by the CPU 111, but also a source program, a compressed program, an encrypted program, and the like.

The operation panel 160 is provided on the upper surface of the MFP 100 and includes a display unit 161 and an operation unit 163. The display unit 161 is, for example, a liquid crystal display (LCD) or an organic LE (electroluminescence) display, and displays an instruction menu for the user, information on acquired image data, and the like. The operation unit 163 includes a touch panel 165 and a hard key unit 167. The touch panel 165 is provided on the upper surface or the lower surface of the display unit 161 so as to be superimposed on the display unit 161. The hard key unit 167 includes a plurality of hard keys. The hard key is, for example, a contact switch. The touch panel 165 detects a position designated by the user on the display surface of the display unit 161.

FIG. 4 is a block diagram showing an example of the functions of the CPU included in the voice setting support server. The function shown in FIG. 4 may be realized by hardware, or may be realized by CPU 201 by causing CPU 201 included in the voice setting support server 200 to execute a program stored in ROM 202, HDD 204 or CD-ROM 211. May be good. Here, a case where the CPU 201 included in the voice setting support server 200 executes the voice setting support program will be described as an example.

With reference to FIG. 4, the CPU 201 included in the voice setting support server 200 includes a voice information acquisition unit 251, a notification control unit 253, a determination unit 255, and an output unit 257. The voice information acquisition unit 251 acquires voice information received by the communication unit 205 from the voice information generation server 300. The voice information includes the job type and parameters. The job type indicates the types of jobs that the MFP 100 can execute. The parameter indicates a value that can be set in the setting item. The setting item indicates the type of parameter defined for the job type.

The MFP 100 can execute a plurality of types of jobs. In the present embodiment, a case where a plurality of types of jobs that can be executed by the MFP 100 are a copy job that executes a copy process and a scan job that executes a scan process will be described as an example. Further, the job type of the copy job is set to copy, and the job type of the scan job is set to scan. In this case, the keywords registered in the voice information generation server 300 include copy and scan.

The determination unit 255 determines the job type and parameters of the job to be executed by the MFP 100 based on the voice information acquired by the voice information acquisition unit 251. Since the parameters are set corresponding to one or more setting items defined for the job type, the determination unit 255 determines the parameters corresponding to each of the one or more setting items.

The determination unit 255 includes a job type extraction unit 261, a parameter extraction unit 263, a consistency determination unit 265, and a priority determination unit 267. The job type extraction unit 261 extracts the job type from the voice information and outputs the extracted job type to the consistency determination unit 265. The parameter extraction unit 263 extracts parameters from the voice information and outputs the extracted parameters to the consistency determination unit 265. The parameter extraction unit 263 refers to the parameter table and extracts parameters from the voice information. For example, the parameter extraction unit 263 extracts the same words as the words defined as parameters in the parameter table from the voice information.

FIG. 5 is a diagram showing an example of a parameter table. With reference to FIG. 5, the parameter table associates job types, setting items, and parameters. The parameter table contains multiple parameter records. The parameter record includes a job type item, a setting item item, and a parameter item. The job type is set in the job type item. The name of the setting item is set in the item of the setting item. Parameters that can be set are set in the parameter item.

The parameter record in which the copy is set in the job type item includes four parameter records in which the name of the setting item is color, read / print, number of copies, and 2in1.

The setting items whose names are colors correspond to the parameters that determine the number of colors that form the image. The parameter record in which the color is set as the name in the setting item includes three parameters of black and white, auto color, and full color in the parameter item. This indicates that one of black and white, auto color, and full color parameters can be set for the setting item whose name is color.

The setting items whose names are read and printed correspond to the parameters that determine the reading surface of the original and the forming surface on which the image is formed. The parameter record for which reading printing is set as a name in the setting item includes four parameters of double-sided reading double-sided printing, single-sided reading double-sided printing, double-sided reading single-sided printing, and single-sided reading single-sided printing. This indicates that any parameter of double-sided reading double-sided printing, single-sided reading double-sided printing, double-sided reading single-sided printing, and single-sided reading single-sided printing can be set for the setting item whose name is reading printing.

The setting item whose name is the number of copies corresponds to a parameter that determines the number of sheets on which an image is formed. A parameter record in which the number of copies is set as a name in the setting item includes a numerical parameter in the parameter item. This indicates that any number can be set as a parameter for the setting item whose name is the number of copies.

The setting item whose name is 2in1 corresponds to a parameter that determines whether or not the process of forming two pages on one sheet is executed. A parameter record in which 2in1 is set as a name in the setting item includes two parameters, ON and OFF, in the parameter item. This indicates that either the ON or OFF parameter can be set for the setting item whose name is 2in1.

The parameter record for which scan is set for the job type item includes six parameter records whose setting item names are resolution, destination, color, reading size, reading surface, and format.

The setting item whose name is resolution corresponds to the parameter that determines the resolution for reading the original. The parameter record in which the resolution is set as the name in the setting item includes three parameters of 300 dpi, 400 dpi, and 600 dpi in the parameter item. This indicates that any of 300 dpi, 400 dpi, and 600 dpi parameters can be set for the setting item whose name is color.

The setting item whose name is the destination corresponds to the parameter that determines the output destination of the data obtained by scanning the original. The parameter record in which the destination is set as the name in the setting item includes the parameter of the name of the output destination address in the parameter item. This indicates that the output destination address can be set as a parameter for the setting item whose name is the destination.

The setting item whose name is color corresponds to the parameter that determines the number of colors to read the document. The parameter record in which the color is set as the name in the setting item includes three parameters of black and white, auto color, and full color in the parameter item. This indicates that one of black and white, auto color, and full color parameters can be set for the setting item whose name is color.

The setting item whose name is the scanning size corresponds to the parameter that determines the size of the original. The parameter record in which the reading size is set as the name in the setting item includes four parameters A4, A3, Letter, and Leger in the parameter item. This indicates that any of the parameters A4, A3, Letter, and Leger can be set for the setting item whose name is the reading size.

The setting item whose name is the scanning surface corresponds to the parameter that determines the scanning surface of the document. A parameter record in which a reading surface is set as a name in a setting item includes two parameters, double-sided and single-sided, in the parameter item. This indicates that either the double-sided or single-sided parameter can be set for the setting item whose name is the reading surface.

The setting item whose name is the format corresponds to the parameter that determines the format of the image data obtained by scanning the original. The parameter record in which the format is set as the name in the setting item includes three parameters of pdf, jpeg, and tiff in the parameter item. This indicates that one of the parameters of pdf, jpeg, and tiff can be set for the setting item whose name is the format.

Returning to FIG. 4, the consistency determination unit 265 determines the consistency between the job type extracted from the voice information by the job type extraction unit 261 and the parameters extracted from the voice information by the parameter extraction unit 263. The consistency determination unit 265 refers to the parameter table and determines the consistency between the job type and the parameter. The consistency determination unit 265 determines in the parameter table that if any of the plurality of parameter records for which the job type is set contains a parameter, the two are matched, but the plurality of parameter records for which the job type is set If any of the parameters is not included, it is judged that they do not match.

When the set of the job type and the parameter is extracted from one voice information, the consistency determination unit 265 determines the consistency between the job type and the parameter. When either the job type or the parameter is extracted from one voice information, the consistency determination unit 265 determines the consistency between the parameter or the job type extracted from the other voice information. For example, when the job type is extracted from the previous voice information and the parameter is extracted from the later voice information, the consistency determination unit 265 will extract the job type from the previous voice information at the stage when the parameter is extracted. Judge the consistency with. Further, when the parameter is extracted from the previous voice information and the job type is extracted from the later voice information, the consistency determination unit 265 will extract the parameter extracted from the previous voice information at the stage when the job type is extracted. Judge the consistency with. Further, if the job type is not extracted at the time when the parameter is extracted from one voice information, the consistency determination unit 265 sets the job type of the job set in the MFP 100 and the parameter extracted from the voice information. You may judge the consistency of.

The consistency determination unit 265 outputs the determination result to the priority determination unit 267. Further, when it is determined that the consistency is not consistent, the consistency determination unit 265 outputs a notification instruction including a set of the job type and the parameter determined to be inconsistent to the notification control unit 253.

When the consistency determination unit 265 determines that the job type does not match, the priority determination unit 267 determines the job type to a value to be set in the job in preference to the parameter, and outputs the job type to the output unit 257. When the consistency determination unit 265 determines that the parameters do not match, the priority determination unit 267 discards the parameters determined to be inconsistent with the job type.

The output unit 257 is input with a job type or a parameter from the priority determination unit 267. The output unit 257 outputs a set of the job type and one or more parameters to the MFP 100. The output unit 257 outputs the job type and one or more parameters input from the priority determination unit 267 to the MFP 100. Each time a job type or parameter is input from the priority determination unit 267, the output unit 257 temporarily stores the job type or parameter, and outputs the stored job type and one or more parameters. When different parameters are input from the priority determination unit 267 at different timings for the same setting item, the output unit 257 updates the previously input parameter with the parameter input later from the priority determination unit 267.

The output unit 257 includes a setting control unit 271 and a setting confirmation unit 273. The setting control unit 271 transmits a setting command including a set of the job type and one or more parameters to the MFP 100, and causes the MFP 100 to set the job type and one or more parameters. Specifically, the setting control unit 271 transmits the parameters of each of the plurality of setting items defined for each job type to the MFP 100. The setting control unit 271 transmits a setting command to the MFP 100. The setting control unit 271 does not transmit the parameters of the setting items that have not been input from the priority determination unit 267 to the MFP 100. The setting control unit 271 acquires the parameters set in the MFP 100 from the MFP 100, and for the parameters of the setting items not input from the priority determination unit 267, includes the parameters acquired from the MFP 100 in the setting command and transmits the parameters. You may.

The setting confirmation unit 273 verbally sets the parameters determined corresponding to each of the plurality of setting items according to the output order determined based on the relative positional relationship of the plurality of parameters arranged on the setting screen displayed on the MFP 100. Output. The setting screen includes a plurality of parameters corresponding to a plurality of setting items. The setting confirmation unit 273 determines the output order based on the position where a plurality of parameters are arranged on the setting screen. When a plurality of parameters arranged on the setting screen are arranged in the horizontal direction, the setting confirmation unit 273 determines the order in which the plurality of parameters are arranged from left to right in the output order. When a plurality of parameters arranged on the setting screen are arranged in the vertical direction, the setting confirmation unit 273 determines the order in which the plurality of parameters are arranged from top to bottom in the output order.

The setting screen displayed by the MFP 100 is determined for each of the plurality of job types. Here, the MFP 100 has a setting screen corresponding to a copy job whose job type is copy and a setting screen corresponding to a scan job whose job type is scan. Therefore, the setting confirmation unit 273 stores in advance the output order of the plurality of parameters arranged on the setting screen for each of the plurality of job types. When the arrangement of the plurality of parameters arranged on the setting screen is changed in the MFP 100, the setting confirmation unit 273 determines the display order based on the arrangement of the plurality of parameters on the changed setting screen. In this case, the setting confirmation unit 273 may acquire the display order from the MFP 100, or may acquire the arrangement of a plurality of parameters on the setting screen from the MFP 100.

The setting confirmation unit 273 generates audio output information for outputting the parameters of each of the plurality of setting items defined for each job type by audio according to the output order. The setting confirmation unit 273 transmits a confirmation command instructing the reproduction of the audio output information to the audio information generation server 300. When the voice information generation server 300 receives the confirmation command, the voice information generation server 300 reproduces the voice output information by voice from the smart speaker 400. Therefore, the user can confirm a plurality of parameters set in the job by voice while looking at the setting screen displayed on the display unit 161 of the MFP 100. Therefore, the parameters set in the job can be easily confirmed. Further, since the plurality of parameters are played back in the order in which they are arranged on the setting screen, it becomes easy to specify the position of the parameter being played back by voice in the setting screen.

The setting confirmation unit 273 generates audio output information that does not include the parameters of the setting items that have not been input from the priority determination unit 267 so that the parameters are not output by audio. The setting confirmation unit 273 acquires the parameters set in the MFP 100 from the MFP 100, and includes the parameters acquired from the MFP 100 in the audio output information for the parameters of the setting items not input from the priority determination unit 267. May be good.

FIG. 6 is a diagram showing an example of a setting command. With reference to FIG. 6, the configuration command includes a job type and a plurality of parameters. The setting command "create copy job" indicates that the job type is copy. The setting command duplicate: null indicates that no parameter is set in the setting item for scanning and printing the name. The setting command "color": "color" indicates that the color parameter is set in the setting item whose name is color. The setting command "number": "3" indicates that the color parameter is set in the setting item whose name is color. The setting command "combine": "2in1" indicates that the ON parameter is set in the setting item whose name is 2in1.

Returning to FIG. 4, the setting control unit 271 outputs the set of the job type and the parameter transmitted to the MFP 100 to the consistency determination unit 265. When the job type is extracted from one voice information and the parameters are not extracted, the setting control unit 271 transmits the job type to the MFP 100 and outputs the job type to the consistency determination unit 265. After that, when the consistency judgment unit 265 extracts the parameters without extracting the job type from one voice information, the consistency judgment unit 265 will perform the parameters and the setting control unit 271 at the stage when the parameters are extracted. Judge the consistency with the job type entered from.

The notification control unit 253 notifies the user that the parameter has not been set in response to the input of the notification instruction. Specifically, a voice message for notifying that the parameter has not been set is generated, and a notification command instructing the reproduction of the voice message is transmitted to the voice information generation server 300. When the voice information generation server 300 receives the notification command, the voice information generation server 300 causes the smart speaker 400 to play a voice message by voice. Therefore, the user can know that the parameter has not been set, and can set the parameter again by voice. Further, the notification control unit 253 generates a character information message notifying that the parameter has not been set, and transmits a display command instructing the display of the message to the MFP 100. Upon receiving the display command, the MFP 100 displays a message on the display unit 161. Therefore, since the user can know that the parameter has not been set, the parameter can be set again from the voice or the operation panel 160.

FIG. 7 is a block diagram showing an example of the functions of the CPU 111 included in the MFP. The function shown in FIG. 7 may be realized by hardware, or is realized by the CPU 111 when the CPU 111 included in the MFP 100 executes the voice setting program and the job control program stored in the ROM 113, HDD 115, and CD-ROM 118. It is a function to be performed. The voice setting program is a part of the voice setting support program. With reference to FIG. 7, the CPU 111 includes a connection control unit 51, a setting unit 53, a display control unit 55, a setting operation reception unit 57, a job generation unit 59, and a job execution unit 61. The connection control unit 51, the setting unit 53, and the display control unit 55 are functions realized by the CPU 111 when the CPU 111 executes a voice setting program. The setting operation reception unit 57, the job generation unit 59, and the job execution unit 61 are functions realized by the CPU 111 when the CPU 111 executes a job control program.

The setting operation receiving unit 57 displays a setting screen on the display unit 161 and receives a setting operation input by the user on the operation panel 160. The setting operation receiving unit 57 outputs the accepted setting operation to the job generation unit 59.

The job generation unit 59 generates a job according to the setting operation accepted by the setting operation reception unit 57. The job generation unit 59 sets the job type or parameter according to the setting operation received by the setting operation reception unit 57. Specifically, the job generation unit 59 stores the job type and the parameters for each of the plurality of setting items in a predetermined area of the RAM 114. Default values for job types and parameters are stored in a predetermined area of the RAM 114. The job generation unit 59 updates the job type stored in the predetermined area of the RAM 114 and the parameters for each of the plurality of setting items with the job type or parameters specified by the setting operation received by the setting operation receiving unit 57. To do.

The job execution unit 61 controls hardware resources to execute a job. The job execution unit 61 executes a job according to the job type and parameters stored in the RAM 114.

The hardware resources controlled by the job execution unit 61 are the communication I / F unit 112, HDD 115, facsimile unit 116, automatic document transfer device 120, document reading unit 130, image forming unit 140, paper feeding unit 150, and post-processing unit 155. And the operation panel 160 is included. Jobs include copy jobs and scan jobs here. The jobs that can be executed by the job execution unit 61 are not limited to these, and may include other jobs. The copy job includes a scanning process for causing the document reading unit 130 to read the document, and a printing process for causing the image forming unit 140 to form an image of data that the document reading unit 130 reads the document and outputs. The scan job includes a scan process for causing the document reading unit 130 to read the document, and an output process for outputting the image data to be output by the document reading unit 130 for reading the document. The output process includes a data storage process for storing the data in the HDD 115 and a data transmission process for transmitting the data to the communication I / F unit 112 to the outside.

The connection control unit 51 controls the communication I / F unit 112 to communicate with the voice setting support server 200. The connection control unit 51 includes a setting command receiving unit 71 and a display command receiving unit 73. The setting command receiving unit 71 controls the communication I / F unit 112 to receive the setting command from the voice setting support server 200. The setting command receiving unit 71 outputs the setting command to the setting unit 53 in response to receiving the setting command. The display command receiving unit 73 controls the communication I / F unit 112 to receive the display command from the voice setting support server 200. The display command receiving unit 73 outputs the display command to the display control unit 55 in response to receiving the display command.

The setting unit 53 sets the job type and parameters included in the setting command in response to the setting command being input from the setting command receiving unit 71. Specifically, the setting unit 53 updates the job type stored in the predetermined area of the RAM 114 and the parameters for each of the plurality of setting items with the job types and parameters included in the setting command.

The display control unit 55 displays the message included in the display command on the display unit 161 in response to the display command receiving unit 73 receiving the display command.

FIG. 8 is a first diagram showing an example of a setting screen. FIG. 8 shows a setting screen displayed on the display unit 161 when the name of the job type is copy. In the figure, the reverse display is indicated by hatching. With reference to FIG. 8, the setting screen 500 includes areas 501 to 504 for displaying parameters. In the area 501, three parameters whose names can be set in the setting item of the number of copies are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the case where the parameter "1" is set in the setting item of the number of copies of the name is shown. In the area 502, three parameters whose names can be set in the color setting items are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the case where the parameter "auto color" is set in the setting item whose name is color is shown. In the area 503, four parameters whose names can be set in the reading and printing setting items are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the name shows a case where the parameter "single-sided scanning single-sided printing" is set in the setting item of scanning printing. In the area 504, two parameters that can be set in the setting item whose name is 2in1 are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the case where the parameter "OFF" is set in the setting item whose name is 2in1 is shown.

FIG. 9 is a second diagram showing an example of the setting screen. FIG. 9 shows a setting screen displayed on the display unit 161 when the name of the job type is scan. In the figure, the reverse display is indicated by hatching. With reference to FIG. 9, the setting screen 510 includes areas 511-516 for displaying parameters. Each of the areas 511 and 511A is an area for inputting a parameter whose name is set in the destination setting item. Here, the state in which the parameter is not set is shown. In the area 512, three parameters whose names can be set in the color setting items are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the case where the parameter "auto color" is set in the setting item whose name is color is shown. In the area 513, two parameters whose names can be set in the setting items of the reading surface are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the case where the parameter "single side" is set in the setting item of the reading surface is shown.

In the area 514, three parameters whose names can be set in the resolution setting items are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the name shows the case where the parameter "300 dpi" is set in the setting item of the resolution. In the area 515, three parameters whose names can be set in the format staple setting items are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the case where the parameter "PDF" is set in the setting item of the format of the name is shown. In the area 516, four parameters whose names can be set in the reading size setting item are displayed, the set parameters are highlighted, and a mark is added to the left. Here, the case where the parameter "A3" is set in the setting item whose name is the reading size is shown.

FIG. 10 is a flowchart showing an example of the flow of the voice setting support process. The voice setting support process is a process executed by the CPU 201 when the CPU 201 included in the voice setting support server 200 executes a voice setting support program stored in the ROM 202, HDD 204, or CD-ROM 211.

With reference to FIG. 10, the CPU 201 included in the voice setting support server 200 determines whether or not the voice information has been acquired (step S01). When the voice information is received from the voice information generation server 300, the process proceeds to step S02, but if not, the process returns to step S01. In step S02, it is determined whether or not the execution instruction has been accepted. It is determined that the execution instruction has been accepted when the voice information contains a word indicating the execution instruction. The words indicating the execution instruction are, for example, "start", "job execution", and the like, and may be predetermined. If the execution instruction is accepted, the process proceeds to step S03, otherwise the process proceeds to step S04. In step S03, the execution instruction command is transmitted to the MFP 100, and the process ends. In the MFP 100, the job specified by the job type set at the time when the execution instruction command is received is executed according to the parameters set at that time.

In step S04, it is determined whether or not the job type is extracted from the voice information. If the job type is extracted, the process proceeds to step S05, otherwise the process proceeds to step S07. In step S05, the job type extracted from the voice information is determined, and the process proceeds to step S06. In step S06, the determined job type is set in the job, and the process proceeds to step S07. If the job type is set and the job type is not set up to that point, or if the job type is changed from the job type that was set up to that point, multiple settings corresponding to the set job type are set. The parameter set in the item is set to a value in which nothing is set, for example, null.

In step S07, it is determined whether or not the parameter is extracted from the voice information. If the parameters are extracted, the process proceeds to step S08, otherwise the process returns to step S01. In step S08, it is determined whether or not the parameters extracted from the voice information match the job type. If the parameters match the job type, the process proceeds to step S09, otherwise the process proceeds to step S14. The job type to be compared is the job type set in step S06 when step S06 is executed after the result is YES in step S01. In this case, the job type and parameters are extracted from one voice information. The job type to be compared is the job type set at that time when step S08 is executed without executing step S06 after the result is YES in step S01. If step S06 is executed before the time when step S08 is executed, the job type is set at the time when step S06 is executed. If the job type is not set, there is no comparison target, so the process proceeds to step S14. Before step S06 is executed for the first time, the job type set in the MFP 100 may be set as the job type.

When the job type and the parameter do not match, the job type is determined with priority over the parameter. Experiments have shown that when a user sets a job by voice, the probability of making a mistake in the job type is smaller than the probability of making a mistake in the parameters. In addition, when the user sets a job by voice, parameters that cannot be set for the job type may be set. For example, when setting a copy job such as "Copy with PDF", the name that can be set for the scan job may utter the parameter of the format setting item. In this way, when the job type and the parameter do not match, the job type is prioritized, so that the job type that the user originally intends to set can be set reliably. Therefore, it is possible to prevent the job type from being set incorrectly, and the job can be easily set.

In step S09, the parameters extracted in step S07 are determined, and the process proceeds to step S10. In step S10, the determined parameter is set in the job, and the process proceeds to step S11. In step S11, the setting command is transmitted to the MFP 100, and the process proceeds to step S12.

In step S12, audio output information is generated, and the process proceeds to step S13. For example, when copy is determined as the job type, the setting screen shown in FIG. 8 is displayed on the MFP 100. In this case, the output order is in the order of the number of copies, color, scanning printing, and 2in1 for the name of the setting item. The name of the setting item arranged at the top in the vertical direction of the setting screen is the first parameter corresponding to the number of copies. The name of the setting item placed on the second line in the vertical direction of the setting screen is color, the name of the setting item placed on the leftmost of 2in1 is the second parameter corresponding to color, and the right The name of the setting item arranged in is the third parameter corresponding to scanning and printing, and the name of the setting item arranged to the right is the fourth parameter corresponding to 2in1.

When scanning is determined as the job type, the setting screen shown in FIG. 9 is displayed on the MFP 100. In this case, the output order is the order in which the names of the setting items are destination, color, scanning surface, resolution, format, and scanning size. The name of the setting item arranged at the top in the vertical direction of the setting screen is the first parameter corresponding to the destination. The name of the setting item placed on the second line in the vertical direction of the setting screen is color, the reading surface, resolution, format, and the name of the setting item placed on the leftmost of the reading size is the second parameter corresponding to color. The name of the setting item placed to the right is the third parameter corresponding to the reading surface, the name of the setting item placed to the right is the fourth parameter corresponding to the resolution, and the right side. The name of the setting item arranged in is the fifth parameter corresponding to the format, and the name of the setting item arranged to the right is the sixth parameter corresponding to the reading size. Since the parameter whose name is the destination of the setting item is not set, it is not included in the audio output information.

In step S13, the audio output information is reproduced, and the process returns to step S01. Specifically, a confirmation command instructing the reproduction of the audio output information is transmitted to the audio information generation server 300, and the audio output information is reproduced from the smart speaker 400. Therefore, the user can visually confirm the parameters reproduced by voice and the parameters included in the setting screen displayed on the display unit 161 of the MFP 100.

In step S14, the parameters extracted in step S07 are discarded, and the process proceeds to step S15. In step S15, the notification process is executed, and the process returns to step S01. Specifically, the notification command is transmitted to the voice information generation server 300, and the display command is transmitted to the MFP 100.

The voice setting support server 200 in the present embodiment transmits a confirmation command to the voice information generation server 300 after receiving voice information from the voice information generation server 300. Although the voice setting support server 200 transmits the confirmation command after transmitting the setting command, the confirmation command may be transmitted without transmitting the setting command. For example, the voice setting support server 200 may send a confirmation command to the voice information generation server 300 after issuing a voice for confirming the setting contents by the user.

FIG. 11 is a flowchart showing an example of the flow of the device setting process. The device setting process is a process executed by the CPU 111 when the CPU 111 included in the MFP 100 executes the voice setting program and the job control program stored in the ROM 113, HDD 115, and CD-ROM 118. With reference to FIG. 11, the CPU 111 requests the voice setting support server 200 to synchronize (step S21), and proceeds to the process in step S22. Specifically, the CPU 111 requests the voice setting support server 200 to transmit the job type and a plurality of parameters set in the voice setting support server 200. The voice setting support server 200 transmits one of a setting command, an execution instruction command, and a display command in response to a request from the MFP 100.

In step S22, it is determined whether or not the setting command has been received from the voice setting support server 200. If the setting command is received, the process proceeds to step S23, otherwise the process proceeds to step S25. In step S23, the job type is set to the job according to the setting command, and the process proceeds to step S24. In step S24, the parameter is set in the job according to the setting command, and the process returns to step S21.

In step S25, it is determined whether or not the display command has been received from the voice setting support server 200. If the display command is received, the process proceeds to step S26, otherwise the process proceeds to step S27. In step S26, the message included in the display command is displayed on the display unit 161 and the process returns to step S21.

In step S27, it is determined whether or not the execution instruction command has been received from the voice setting support server 200. If the execution instruction command is received, the process proceeds to step S28, otherwise the process proceeds to step S29. In step S28, the job is executed and the process ends.

In step S29, it is determined whether or not the execution instruction operation input by the user is accepted by the operation panel 160. If the execution instruction operation is accepted, the process proceeds to step S30, otherwise the process proceeds to step S31. In step S30, the job is executed and the process ends.

In step S31, it is determined whether or not the setting operation input by the user is accepted by the operation panel 160. If the setting operation is accepted, the process proceeds to step S32, otherwise the process returns to step S21. In step S32, it is determined whether or not the setting operation is an operation for setting the job type. If it is an operation for setting the job type, the process proceeds to step S33, but if not, the process proceeds to step S34. In step S33, the job type specified by the setting operation is set in the job, and the process returns to step S21. In step S34, it is determined whether or not the setting operation is an operation for setting a parameter. If it is an operation for setting a parameter, the process proceeds to step S35, but if not, the process returns to step S21. In step S35, the parameter specified by the setting operation is set in the job, and the process returns to step S21.

<First Example>
For example, a case where the user utters "with BizHub, copy 3 copies of PDF in color" will be described as an example. The voice information generation server 300 copies the job type based on the voice acquired from the smart speaker 400, generates voice information including the parameters "3 copies", "PDF", and "color", and sets the voice information as voice. Send to the support server 200.

The voice setting support server 200 that receives the voice information refers to the parameter table and determines the consistency between the job type and the parameter based on the voice information. In the case of this example, the parameters "3 copies" and "color" are matched for the job type of copy, but "PDF" is not matched. In this case, the notification command is transmitted to the voice information generation server 300, and the display command is transmitted to the MFP 100.

The notification command includes, for example, a voice message "PDF parameters were not set." The voice information generation server 300 that receives the notification command causes the smart speaker 400 to output a voice message by voice. As a result, the user can know from the voice that the parameter "PDF" has not been set.

The display command contains, for example, the message "PDF parameters were not set." The MFP 100 that receives the display command displays the message on the display unit 161. As a result, the user can know from the message displayed on the display unit 161 that the parameter "PDF" has not been set.

Further, the voice setting support server 200 generates voice output information including the character information of "Do you want to copy three copies in color?" Based on the voice information, and a confirmation command instructing the reproduction of the voice output information. Is transmitted to the voice information generation server 300. The voice information generation server 300 that receives the confirmation command causes the smart speaker 400 to output the character information specified by the voice output information by voice. As a result, the user can confirm the parameters from the audio output information reproduced by audio and the setting screen.

<Second Example>
For example, the case where the user says "copy in color with 3 copies in Biz Hub, 2 in 1" will be described as an example. The voice information generation server 300 copies the job type based on the voice acquired from the smart speaker 400, generates voice information including the parameters "3 copies", "two-in-one", and "color", and sets the voice information as voice. Send to the support server 200.

The voice setting support server 200 that receives the voice information refers to the parameter table and determines the consistency between the job type and the parameter based on the voice information. In the case of this example, the parameters "3 copies", "two-in-one" and "color" match for the job type of copy. Therefore, the voice setting support server 200 generates voice output information including the character information of "Do you want to copy three copies in color in two-in-one?" Based on the voice information, and instructs the playback of the voice output information. The confirmation command to be executed is transmitted to the voice information generation server 300. The voice information generation server 300 that receives the confirmation command causes the smart speaker 400 to output the character information specified by the voice output information by voice. As a result, the user can confirm the parameters from the audio output information reproduced by audio and the setting screen.

As described above, the voice setting system 1 in the present embodiment supports the generation of a job to be executed by the image processing device based on the MFP 100 capable of executing a plurality of types of jobs and the voice information obtained from the voice. The voice setting support server 200 is provided, and the voice setting support server 200 determines the job type of the job and the parameters set in the job based on the voice information, but when the job type and the parameters do not match, the voice setting support server 200 is provided. Determine the job type with priority over the parameters. Therefore, it is possible to provide a voice setting system that facilitates the setting of a job by voice by the user.

Further, since the voice setting support server 200 determines whether or not the job type and the parameter match by using the parameter table, it is possible to prevent the parameter that cannot be set according to the job type from being set.

Further, the voice setting support server 200 causes the MFP 100 to set the job type and the parameters. Therefore, the MFP 100 can execute the job according to the job type and the parameters determined by the voice setting support server 200.

Further, since the voice setting support server 200 does not determine the parameter determined to be inconsistent with the job type, it is possible to prevent an erroneous parameter from being set for the job type.

Further, when it is determined that the job type and the parameter do not match, the voice setting support server 200 notifies the user who spoke the voice, so that the job type and the parameter do not match, or the parameter setting is incorrect. You can let the user know that you were there.

Further, the voice setting support server 200 acquires voice information from the voice information generation server 300 that extracts voice information from the voice collected by the smart speaker 400. Therefore, since the voice setting support server 200 does not need to extract voice information from the voice, the configuration of the voice setting support server 200 can be simplified.

Further, when the voice setting support server 200 includes the job type and the parameter in one voice information, the voice setting support server 200 determines the consistency between them, so that the job can be set from one voice information.

Further, when the voice setting support server 200 does not include the job type and includes the parameters in the first voice information acquired at the first time, the parameters included in the first voice information and the second time different from the first time. The consistency with the job type included in the second voice information acquired at the time is determined. Therefore, one job can be set from a plurality of voice information.

Further, the voice setting support server 200 may determine the consistency between the job type set in the MFP 100 and the parameter when the voice information does not include the job type and includes the parameter. In this case, the job can be set even if the voice information does not include the job type.

<First modification>
FIG. 12 is a block diagram showing an example of a function of the CPU included in the voice setting support server in the first modification. With reference to FIG. 12, the difference from the function shown in FIG. 4 is that the prediction unit 269 is added and the priority determination unit 267 is changed to the priority determination unit 267A. Since the other functions are the same as those shown in FIG. 4, the description is not repeated here.

When the consistency determination unit 265 determines that the job type does not match, the priority determination unit 267A determines the job type to a value to be set in the job with priority over the parameter, and outputs the job type to the output unit 257. The priority determination unit 267A outputs a prediction instruction to the prediction unit 269 when it is determined by the consistency determination unit 265 that they do not match.

The prediction unit 269 predicts another new parameter that matches the job type based on the parameter that is determined to be inconsistent with the job type in response to the input of the prediction instruction. The prediction unit 269 predicts a new parameter by referring to the history of parameter changes in the past. For example, when the voice information includes the character string "copy on both sides", the copy is determined for the job type, and the "double-sided" parameter is determined to be an inconsistent parameter. In this case, when "double-sided reading single-sided printing" is frequently set as a parameter of the setting item whose name is read-printing in the past history, "double-sided reading single-sided printing" is predicted as a new parameter. The prediction unit 269 may have a learning function using artificial intelligence technology including machine learning.

FIG. 13 is a flowchart showing an example of the flow of the device setting process in the first modification. The difference from the device setting process shown in FIG. 10 is that step S08A is added after NO in step S08. Since the other processes are the same as the processes shown in FIG. 10, the description is not repeated here.

If it is determined in step S08 that the parameters do not match the job type, the process proceeds to step S08A. In step S08A, it is determined whether or not a new parameter is predicted based on the parameter determined to be inconsistent with the job type. If a new parameter is predicted, the process proceeds to step S09, otherwise the process proceeds to step S14. In step S09, if the process proceeds from step S08A, the new parameters predicted in step S08A are determined, and the process proceeds to step S10. In step S10, the determined parameter is set in the job, the setting command is transmitted in the next step S11, and the process returns to step S01.

Since the voice setting support server 200 in the first modification predicts new parameters that match the job type based on the parameters that are determined to be inconsistent with the job type, it is easy to set the job by voice. Can be.

<Second modification>
The voice setting system 1 in the second modification generates a job executed by the MFP 100 on the voice setting support server 200, and the voice setting support server 200 transmits the job to the MFP 100. In this case, the voice setting support server 200 determines the default value of the job that can be executed by the MFP 100, and generates the job by updating the default value with the job type and the parameter extracted from the voice information. The voice setting support server 200 in the second modification does not need to send a setting command to the MFP 100.

Since the voice setting support server 200 in the second modification generates a job based on the job type and the parameter, the MFP 100 can execute the job according to the job type and the parameter.

<Third modification example>
In the voice setting system 1 in the third modification, the voice setting support server 200 may have the function of the voice information generation server 300 described above. Further, the MFP 100 may have the function of the voice setting support server 200.

<Fourth modification>
In the voice setting system 1, one MFP 100 is associated with one smart speaker 400. The voice setting system 1 in the fourth modification associates a plurality of controlled devices with one smart speaker 400. Here, a case where two MFPs 100 and 100A are used as control target devices will be described as an example. The devices to be controlled are distinguished by using the names given to the MFPs 100 and 100A, respectively. For example, the name of the MFP 100 is the first MFP, and the name of the MFP 100A is the second MFP. In this case, the voice setting support server 200 identifies the MFP 100 as the control target device if the voice information includes the word of the first MFP, and controls the MFP 100A if the voice information contains the word of the second MFP. Specify the target device.

The setting screen with the same job type may differ between the MFP100 and the MFP100A. Therefore, in the fourth modification, the setting confirmation unit 273 acquires the output order from each of the MFPs 100 and 100A. For example, the setting confirmation unit 273 receives output order information including the output order from each of the MFP100 and the MFP100A.

FIG. 14 is a diagram showing an example of output order information. FIG. 14 shows the output order information acquired from the MFP 100A. With reference to FIG. 14, the output order information “MFP_12345” indicates that the source of the output order information is the MFP 100A. According to the order of "number", "combine", "duplex", and "color" shown in the "read_order" column of the output order information, the output order is the number of copies, 2in1, read printing, and color in the name of the setting item. Is shown.

As a result, even if the setting screens having the same job type are different between the MFP 100 and the MFP 100A, a plurality of parameters can be output by voice in the order in which the plurality of parameters are arranged on the setting screen.

The setting confirmation unit 273 may acquire arrangement information of a plurality of parameters arranged on the setting screen from each of the MFPs 100 and 100A. The arrangement information indicates the relative positional relationship in which a plurality of parameters are arranged, and indicates the positional relationship in the horizontal direction and the vertical direction. The setting confirmation unit 273 determines the output order from the arrangement information.

Since the voice setting support server 200 in the fourth modification receives the display order from each of the plurality of MFPs 100 and 100A, even if the arrangement of the plurality of parameters is different on the setting screens of the plurality of MFPs 100 and 100A, a plurality of MPs are set. The parameters can be output by voice in the output order corresponding to each of the MFPs 100 and 100A.

In the present embodiment, the MFP 100 has been described as an example of the job execution device, but the job execution device is, for example, a computer or the like that executes a job for which data processing is defined, as long as the job can be executed. It may be an information processing device.

It should be considered that the embodiments disclosed this time are exemplary in all respects and not restrictive. The scope of the present invention is shown by the scope of claims rather than the above description, and it is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

1 voice setting system, 100 MFP, 200 voice setting support server, 300 voice information generation server, 400 smart speaker, 3 network, 5 internet, 7 gateway device, 110 main circuit, 111 CPU, 112 communication I / F section, 113 ROM , 114 RAM, 115 HDD, 116 facsimile unit, 117 external storage device, 118, CD-ROM, 120 automatic document transfer device, 130 document reader, 140 image forming unit, 150 paper feed unit, 155 post-processing unit, 160 operations Panel, 161 display unit, 163 operation unit, 165 touch panel, 167 hard key unit, 201 CPU, 202 ROM, 203 RAM, 204 HDD, 205 communication unit, 206 display unit, 207 operation unit, 210 external storage device, 51 connection control Unit, 53 setting unit, 55 display control unit, 57 setting operation reception unit, 59 job generation unit, 61 job execution unit, 71 setting command reception unit, 73 display command reception unit, 251 voice information acquisition unit, 253 notification control unit, 255 determination unit, 257 output unit, 261 job type extraction unit, 263 parameter extraction unit, 265 consistency judgment unit, 267,267A priority determination unit, 269 prediction unit, 271 setting control unit.

Claims (45)

A job execution device that can execute multiple types of jobs,
A voice setting support device for supporting the generation of the job to be executed by the job execution device based on the voice information obtained from the voice is provided.
The voice setting support device includes a determination means for determining a job type of the job and parameters set for the job based on the voice information.
It is provided with an output means for outputting the determined job type and the parameter.
The determination means is an audio setting system that determines one of the job type and the parameter with priority over the other when the job type and the parameter do not match. In the job, the parameters are set corresponding to one or more setting items defined for the job type.
Whether the job type and the parameter are matched by the determination means by using a parameter table in which a plurality of the parameters that can be set corresponding to one or more of the setting items in each of the plurality of job types are defined. The voice setting system according to claim 1, which determines whether or not. The voice setting system according to claim 1 or 2, wherein the job execution device further includes setting means for setting the job type and the parameters output from the voice setting support device. The voice setting according to any one of claims 1 to 3, further comprising a job generation means for generating the job based on the job type and the parameter output by the output means. system. The voice setting system according to any one of claims 1 to 4, wherein the determination means does not determine the parameter determined to be inconsistent with the job type. The voice setting system according to any one of claims 1 to 5, wherein the determination means predicts a new new parameter that matches the job type based on the parameter that is determined to be inconsistent with the job type. Any of claims 1 to 6, wherein the voice setting support device further includes a notification means for notifying the user who has spoken the voice when it is determined by the determination means that the job type and the parameter do not match. The voice setting system described in Crab. Any of claims 1 to 7, wherein the voice setting support device further includes a voice information acquisition means for acquiring the voice information from a voice information extraction device that extracts the voice information from the voice collected by the voice collection device. The audio setting system described in. The voice setting system according to claim 8, wherein the determination means determines the consistency between the job type and the parameter included in the voice information acquired at an arbitrary time by the voice information acquisition means. When the first voice information acquired by the voice information acquisition means at the first time does not include the job type and includes the parameters, the determination means includes the parameters and the voice included in the first voice information. The voice setting system according to claim 8 or 9, wherein the information acquisition means determines the consistency with the job type included in the second voice information acquired at a second time different from the first time. .. When the voice information acquired by the voice information acquisition means does not include the job type and includes the parameters, the determination means determines the consistency with the job type set in the job execution device. , The voice setting system according to any one of claims 8 to 10. The voice setting system according to any one of claims 1 to 11, further comprising a voice information extraction means for extracting the voice information from the voice collected by the voice collecting device. The voice setting system according to any one of claims 1 to 12, wherein the job execution device includes the voice setting support device. The voice setting system according to any one of claims 1 to 13, wherein the determination means determines the job type with priority over the parameters when the job type and the parameters do not match. The audio setting system according to any one of claims 1 to 14, wherein the job execution device is an image processing device. A decision step for determining the job type to be executed and the parameters set for the job among a plurality of types of jobs based on the voice information obtained from the voice.
The computer that controls the voice setting support device is made to execute the determined output step for outputting the job type and the parameter.
The determination step is a voice setting support program including a step of determining one of the job type and the parameter with priority over the other when the job type and the parameter do not match. The parameters are set for each of the jobs corresponding to one or more setting items defined for the job type.
In the determination step, whether the job type and the parameter are matched by using a parameter table in which a plurality of the parameters that can be set corresponding to one or more of the setting items in each of the plurality of job types are defined. The voice setting support program according to claim 16, which includes a step of determining whether or not. The voice setting support program according to claim 16 or 17, wherein the determination step includes a step of determining the job type and the parameter for a job execution device capable of executing a plurality of types of jobs. The voice setting support program according to claim 18, wherein the determination step includes a step of determining consistency between the parameter included in the voice information and the job type set in the job execution device. The voice setting according to claim 18 or 19, wherein the output step includes a step of transmitting the job type and the parameter to the job execution device and causing the job execution device to set the job type and the parameter. Support program. The audio setting support program according to any one of claims 18 to 20, wherein the job execution device is an image processing device. The voice setting support program according to any one of claims 16 to 21, further causing the computer to execute a job generation step for generating the job based on the job type and the parameter output in the output step. The voice setting support program according to any one of claims 16 to 22, wherein the determination step includes a step of not determining the parameter determined to be inconsistent with the job type. The determination step includes a step of predicting a new parameter matching the job type based on the parameter determined to be inconsistent with the job type, and determining the predicted new parameter. The voice setting support program according to any one of 16 to 23. The method according to any one of claims 16 to 24, wherein when it is determined in the determination step that the job type and the parameter do not match, the notification step of notifying the user who has spoken the voice is further executed by the computer. Voice setting support program. The voice according to any one of claims 16 to 25, wherein the computer further executes the voice information acquisition step of acquiring the voice information from the voice information extraction device that extracts the voice information from the voice collected by the voice collecting device. Setting support program. The voice setting support according to claim 26, wherein the determination step includes a step of determining consistency between the job type and the parameter included in the voice information acquired at an arbitrary time in the voice information acquisition step. program. In the determination step, when the job type is not included in the first voice information acquired at the first time in the voice information acquisition step and the parameter is included, the parameter and the voice included in the first voice information are included. The voice setting support according to claim 26 or 27, which includes a step of determining consistency with the job type included in the second voice information acquired at a second time different from the first time in the information acquisition step. program. The voice setting support program according to any one of claims 16 to 28, wherein the computer further executes the voice information extraction step of extracting the voice information from the voice collected by the voice collecting device. The voice setting support program according to any one of claims 16 to 29, wherein the determination step includes a step of determining the job type in preference to the parameter when the job type and the parameter do not match. .. A determination means for determining a job type to be executed among a plurality of types of jobs and parameters set in the job based on voice information obtained from voice, and
It is provided with an output means for outputting the determined job type and the parameter.
The determination means is a voice setting support device that determines one of the job type and the parameter with priority over the other when the job type and the parameter do not match. The parameters are set for each of the jobs corresponding to one or more setting items defined for the job type.
Whether the job type and the parameter are matched by the determination means by using a parameter table in which a plurality of the parameters that can be set corresponding to one or more of the setting items in each of the plurality of job types are defined. The voice setting support device according to claim 31, which determines whether or not. The voice setting support device according to claim 31 or 32, wherein the determination means determines the job type and the parameter for a job execution device capable of executing a plurality of types of jobs. The voice setting support device according to claim 33, wherein the determination means determines the consistency between the parameters included in the voice information and the job type set in the job execution device. The voice setting support device according to claim 33 or 34, further comprising a setting means for transmitting the job type and the parameters to the job execution device and causing the job execution device to set the job type and the parameters. .. The voice setting support device according to any one of claims 33 to 35, wherein the job execution device is an image processing device. The voice setting support device according to any one of claims 31 to 36, further comprising a job generation means for generating the job based on the job type and the parameter output by the output means. The voice setting support device according to any one of claims 31 to 37, wherein the determination means does not determine the parameter determined to be inconsistent with the job type. The voice setting support device according to any one of claims 31 to 38, wherein the determination means predicts a new parameter matching the job type based on the parameter determined to be inconsistent with the job type. .. The voice setting support according to any one of claims 31 to 39, further comprising a notification means for notifying the user who has spoken the voice when it is determined by the determination means that the job type and the parameter do not match. apparatus. The voice setting support device according to any one of claims 31 to 40, further comprising a voice information acquisition means for acquiring the voice information from the voice information extraction device that extracts the voice information from the voice collected by the voice collection device. .. The voice setting support device according to claim 41, wherein the determination means determines the consistency between the job type and the parameters included in the voice information acquired at an arbitrary time by the voice information acquisition means. When the first voice information acquired by the voice information acquisition means at the first time does not include the job type and includes the parameters, the determination means includes the parameters and the voice included in the first voice information. The voice setting support device according to claim 41 or 42, which determines the consistency with the job type included in the second voice information acquired at a second time different from the first time by the information acquisition means. The voice setting support device according to any one of claims 31 to 43, further comprising a voice information extraction means for extracting the voice information from the voice collected by the voice collecting device. The voice setting support device according to any one of claims 31 to 44, wherein the determination means determines the job type with priority over the parameters when the job type and the parameters do not match.

Images