JP2022007018A - Voice setting system, voice setting support device and voice setting support program - Google Patents

Abstract

To provide a voice setting system, a voice setting support device, and a voice setting support program for efficiently setting parameters when the parameters are set by voice to a job execution device.SOLUTION: A voice setting system includes: a job execution device that executes a job according to a plurality of parameters; and a voice setting support device (voice setting support server) that supports generation of a job to be executed by the job execution device based on voice information obtained from voice. A CPU of the voice setting support device includes: a parameter determination unit 253 that determines the plurality of parameters based on the voice information; a prohibited set acquisition unit 257 that acquires a prohibited set in which a combination of the plurality of parameters is prohibited in the job execution device; and a consistency determination unit 255 that determines whether or not the plurality of parameters determined by the parameter determination unit 253 includes the prohibited set.SELECTED DRAWING: Figure 6

Description

The present invention relates to a voice setting system, a voice setting support device, and a voice setting support program, and in particular, a voice setting system for setting a job executed by a job execution device based on voice, and a voice setting support device included in the voice setting system. , And the voice setting support program executed by the voice setting support device.

Generally, a multifunction device (hereinafter referred to as "MFP") is installed in an office. The user causes the MFP to execute a job that defines processes such as printing image data, copying a document, reading a document, storing image data, and transmitting image data. Since this MFP executes the job according to the parameters, the user needs to set the parameters in the MFP. A technique for setting parameters by voice to cause an MFP to execute a job is known.

For example, Japanese Patent Application Laid-Open No. 2019-185734 is an information processing system including an external device and an information processing device, which recognizes the voice information and an acquisition unit for acquiring voice information for operating the external device. The voice recognition unit, an extraction unit that extracts instruction information indicating information processing to be instructed to the external device based on the recognition result of the voice information by the voice recognition unit, and the external device can interpret the instruction information. Described is an information processing system including a conversion unit that converts information into operation information in an information form and an output unit that outputs the operation information to the external device. According to Japanese Patent Application Laid-Open No. 2019-185734, in the information processing apparatus, in order to input the operation information to the external device, the voice is recognized and the operation information is output to the external device.

In addition, the MFP may have a combination of functions that cannot be executed depending on the functions that the MFP has. This combination of functions that cannot be combined is called a prohibition condition. For example, in Japanese Patent Application Laid-Open No. 2019-123106, if the set value of the received job corresponds to the prohibition condition and does not correspond to the prohibition condition based on the printing authority of the job issuer, the mobile terminal is prohibited. A technique for notifying a printing device of a combination of set values is described.

However, in order to operate the MFP by voice, as described in Japanese Patent Application Laid-Open No. 2019-185734, since the operation information is input to the MFP from the information processing device that recognizes the voice, in the MFP to which the operation information is input. It is determined whether or not the function set according to the operation information corresponds to the prohibited condition. Therefore, the user who operates the MFP by voice confirms whether or not the prohibition condition is satisfied in the MFP by the error message displayed on the MFP. Therefore, when the setting content output by voice corresponds to the prohibited condition, the process may be executed without noticing the error in the setting content. As a result, there are problems that a setting error occurs and the efficiency of the setting work is lowered.

Japanese Unexamined Patent Publication No. 2019-185734 Japanese Unexamined Patent Publication No. 2019-123106

One of the objects of the present invention is to provide a voice setting system capable of efficiently setting parameters when parameters are set by voice in a job execution device.

Another object of the present invention is to provide a voice setting support device capable of efficiently setting parameters when parameters are set by voice in the job execution device.

Still another object of the present invention is to provide a voice setting support program capable of efficiently setting parameters when parameters are set by voice in a job execution device.

According to one aspect of the present invention, the voice setting system assists in generating a job execution device that executes a job according to a plurality of parameters and a job to be executed by the job execution device based on the voice information obtained from the voice. It is a voice setting support system including a voice setting support device, and the voice setting support device is prohibited from combining a plurality of parameters with a parameter determination means for determining a plurality of parameters based on voice information and a job execution device. It is provided with a prohibited set acquisition means for acquiring the prohibited set, and a consistency determination means for determining whether or not a plurality of parameters determined by the parameter determining means include the prohibited set.

According to this aspect, in the voice setting support device, a plurality of parameters are determined based on the voice information, a prohibited set in which a combination of a plurality of parameters is prohibited in the job execution device is acquired, and a plurality of parameters are prohibited sets. It is judged whether or not it is included. Therefore, it can be determined that the plurality of parameters uttered by the user include the prohibited set. Therefore, since it is not necessary for the job execution device to determine the combination of a plurality of parameters, the load on the job execution device can be reduced. As a result, it is possible to provide a voice setting system capable of efficiently setting the parameters when the parameters are set by voice in the job execution device.

Preferably, the notification means for notifying by voice that the plurality of parameters include the prohibited set is further provided.

According to this aspect, you will be notified by voice that the parameters cannot be combined. Therefore, the user can know by voice that a plurality of parameters uttered by voice cannot be set for the setting.

Preferably, the notification means gives a voice notification after a predetermined time has elapsed from the acquisition of the voice information.

According to this aspect, it is possible to prevent the voice uttered by the user and the voice notification from overlapping.

Preferably, the preferred parameter is determined from the plurality of parameters based on the evaluation value for each of the plurality of parameters included in the prohibited set among the plurality of parameters determined by the parameter determining means, and the parameters other than the preferred parameter are changed. Further provide priority changing means.

According to this aspect, the priority parameter is determined based on the evaluation value from among the plurality of parameters that cannot be combined, and the parameters other than the priority parameter are changed. Therefore, a plurality of parameters that can be combined can be automatically set.

Preferably, the priority changing means determines the priority parameter by using the volume at which each of the plurality of parameters determined by the parameter determining means is uttered as an evaluation value.

According to this aspect, the priority parameter is determined by the volume at which each of the plurality of parameters is uttered as an evaluation value. Therefore, it is possible to correct the wrong setting by the user to the correct setting. In addition, it is possible to increase the probability that the modified setting will be the setting desired by the user.

Preferably, the priority changing means determines the priority parameter by using the order in which the plurality of parameters determined by the parameter determining means are uttered as an evaluation value.

According to this aspect, the priority parameter is determined in the order in which each of the plurality of parameters is uttered as an evaluation value. Therefore, it is possible to correct the wrong setting by the user to the correct setting. In addition, it is possible to increase the probability that the modified setting will be the setting desired by the user.

Preferably, the parameter notification means for notifying the priority parameter and the changed parameter other than the priority parameter is further provided.

According to this aspect, the priority parameter and the changed parameter other than the priority parameter are notified, so that the user can know a plurality of the set modified parameters.

Preferably, the display control means is further provided so that the priority parameter and the changed parameter other than the priority parameter are associated with the corresponding evaluation values and displayed on the job execution device.

According to this aspect, the evaluation value is displayed on the job execution device in association with the parameter, so that the user can know the reason why the parameter spoken by voice is changed.

Preferably, the display control means for causing the job execution device to display a plurality of parameters included in the prohibited set among the plurality of parameters determined by the parameter determination means in a changeable manner is further provided.

According to this aspect, the user can check a plurality of set parameters and change a plurality of parameters.

Preferably, the display control means causes the job execution device to display a plurality of parameters included in the prohibited set among the plurality of parameters determined by the parameter determination means in association with the evaluation values corresponding to each.

Preferably, there are a plurality of job execution devices, and the execution device determination means for determining the execution device for executing the job from the plurality of job execution devices and the plurality of parameters determined by the parameter determination means are acquired from the execution device. When a prohibited set is included, the alternative device determination means for determining an alternative device capable of executing a job according to a plurality of parameters determined by the parameter determination means from among one or more other job execution devices and the alternative device are notified. Further provided with an alternative device notification means.

According to this aspect, when a prohibited set acquired from an execution device that executes a job from a plurality of job execution devices is included in a plurality of parameters, a job is executed from one or more other job execution devices. Possible alternative devices are determined and notified. Therefore, the user can know that the job can be executed by a device other than the job execution device operated by the user.

Preferably, the voice setting support device includes the restriction information acquisition means for acquiring the restriction information that defines the restriction parameter whose setting is restricted among the plurality of parameters, and the case where the restriction parameter is included in the determined plurality of parameters. Further provided with a restriction notification means for notification.

According to this aspect, the user can know that a restriction parameter that cannot be set has been set.

Preferably, the voice setting support device further includes an intermediate server provided between the voice setting support device and the job execution device.

According to this aspect, the load on the voice setting support device can be reduced.

According to another aspect of the present invention, the voice setting support device is a voice setting support device that sets parameters in a job execution device that executes a job in which a plurality of parameters are set according to a plurality of parameters, and is obtained from voice. A parameter determining means for determining a plurality of parameters based on the voice information obtained, a prohibited set acquisition means for acquiring a prohibited set for which a combination of a plurality of parameters is prohibited by the job execution device, and a plurality determined by the parameter determining means. It is provided with a consistency determination means for determining whether or not the parameter of is included in the prohibited set.

According to this aspect, it is possible to provide a voice setting support device capable of efficiently setting parameters when parameters are set by voice in the job execution device.

According to still another aspect of the present invention, the voice setting support program is executed by a computer that controls a voice setting support device that sets parameters in a job execution device that executes a job in which a plurality of parameters are set according to the plurality of parameters. It is a voice setting support method to be performed, and it is prohibited to acquire a parameter determination step that determines a plurality of parameters based on voice information obtained from the voice and a prohibited set in which the combination of a plurality of parameters is prohibited in the job execution device. Have the computer execute the set acquisition step and the consistency judgment step of determining whether or not the plurality of parameters determined in the parameter determination step include the prohibited pair.

According to this aspect, it is possible to provide a voice setting support program capable of efficiently setting the parameters when the parameters are set by voice in the job execution device.

It is a figure which shows the whole outline of the voice setting system in one of the Embodiments of this invention. It is a block diagram which shows an example of the outline of the hardware configuration of a voice setting support server. It is a block diagram which shows the outline of the hardware composition of the MFP. It is a 1st chart diagram which shows an example of the flow of the voice setting processing in a voice setting system. It is a 2nd chart figure which shows an example of the flow of the voice setting processing in a voice setting system. It is a block diagram which shows an example of the function which a CPU included in a voice setting support server has. It is a figure which shows an example of a parameter table. It is a figure which shows an example of the prohibited group information. It is a figure which shows an example of the user restriction information. It is a figure which shows an example of the apparatus state information. It is a figure which shows an example of a setting instruction command. It is a flowchart which shows an example of the flow of voice setting support processing. It is a flowchart which shows an example of the flow of a parameter setting process. It is a block diagram which shows an example of the function which the CPU provided in the voice setting support server in the 1st modification. It is a flowchart which shows an example of the flow of a parameter setting process in 1st modification.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are the same. Therefore, detailed explanations about them will not be repeated.

FIG. 1 is a diagram showing an overall outline of a voice setting system according to one of the embodiments of the present invention. With reference to FIG. 1, the voice setting system 1 includes MFPs (Multifunction Peripherals) 100, 100A, 100B, 100C, 100D, a voice setting support server 200, a voice information generation server 300, and smart speakers 400, 400A. Includes 400B, 400C, 400D, and so on. The smart speaker 400 corresponds to the MFP 100 and is arranged within a predetermined distance from the MFP 100. The smart speaker 400 may be arranged next to the MFP 100. The smart speakers 400A to 400D correspond to the MFPs 100A to 100D, respectively, and are arranged within a predetermined distance from the corresponding devices of the MFPs 100A to 100D. The predetermined distance is preferably a distance at which the smart speaker 400 can collect the sound that the user utters while browsing the operation panel of the MFP 100.

Each of the MFPs 100 and 100A to 100D is an example of a job execution device. Each of the MFPs 100 and 100A to 100D is connected to the network 3. The network 3 is, for example, a local area network (LAN). In the network 3, the connection form may be wired or wireless. Further, the network 3 may be a wide area network (WAN), a public switched telephone network (PSTN), the Internet, or the like.

Access points (AP) 9, 9A are connected to the network 3. AP9 and AP9A are relay devices having a wireless communication function. Each of the smart speakers 400, 400A to 400D is connected to the network 3 by communicating with any of AP9 and 9A.

The gateway (G / W) device 7 is connected to the network 3 and also to the Internet 5. The gateway device 7 relays between the network 3 and the Internet 5. The voice setting support server 200 and the voice information generation server 300 are connected to the Internet 5. Therefore, each of the MFPs 100, 100A to 100D, and the smart speakers 400, 400A to 400D can communicate with the voice setting support server 200 or the voice information generation server 300 via the gateway device 7. Further, the voice setting support server 200 and the voice information generation server 300 can communicate with each other via the Internet 5.

The voice information generation server 300 provides a virtual assistant service using smart speakers 400, 400A to 400D as a user interface. Therefore, the user can talk with the smart speakers 400, 400A to 400D. The virtual assistant is also called an AI (Artificial Intelligence) assistant and is a well-known technique. The smart speakers 400, 400A to 400D have a microphone, a speaker, and a communication function. The voice information generation server 300 receives the user's voice collected by the smart speakers 400, 400A to 400D, and controls the smart speakers 400, 400A to 400D to speak by voice. The voice information generation server 300 has a function of performing natural language processing based on voice. The voice information generation server 300 may have a learning function using artificial intelligence technology including machine learning for natural language processing.

In the voice setting system 1 of the present embodiment, the user can set a job to any of the MFPs 100 and 100A to 100D by voice by using the service of the virtual assistant provided by the voice information generation server 300. .. A voice setting support server 200 is arranged between each of the controlled MFPs 100 and 100A to 100D and a voice information generation server 300 that provides a virtual assistant service. The voice setting support server 200 controls the MFPs 100, 100A to 100D.

Specifically, the smart speakers 400, 400A to 400D and the device to be controlled are registered in the voice information generation server 300. Specifically, the smart speaker 400 and the MFP 100 are registered, the smart speaker 400A and the MFP 100A are registered, the smart speaker 400B and the MFP 100B are registered, the smart speaker 400C and the MFP 100C are registered, and the smart speaker 400D and the MFP 100D are registered. And are registered. Therefore, in the voice setting system 1, the MFP 100 is controlled based on the voice input to the smart speaker 400, the MFP 100A is controlled based on the voice input to the smart speaker 400A, and the voice input to the smart speaker 400B. The MFP100B is controlled based on the above, the MFP100C is controlled based on the sound input to the smart speaker 400C, and the MFP100D is controlled based on the sound input to the smart speaker 400D. In the voice setting system 1, the processes for controlling the MFPs 100, 100A to 100D are the same. Therefore, unless otherwise specified, a case where the MFP 100 is controlled based on the voice input to the smart speaker 400 will be described here as an example.

The device to be controlled is the MFP 100, but since the voice setting support server 200 controls the MFP 100, the voice setting support server 200 is actually registered in the voice information generation server 300 instead of the MFP 100 as the device to be controlled. Will be done. The voice setting support server 200 is registered in the voice information generation server 300 in place of the MFPs 100, 100A, 100B, and 100D, respectively.

For example, in the voice setting system 1, an authentication server can be provided to associate the smart speaker 400 with the MFP 100. The voice setting support server 200 may have the function of the authentication server. Specifically, the authentication server issues a password in response to a request including an identification ID from the MFP 100. The administrator who manages the MFP 100 operates the MFP 100 and requests the authentication server to issue a password. The administrator operates a personal computer or the like to access the voice information generation server 300, associates the smart speaker 400 with the MFP 100, and registers the authentication server. The registration operation is an operation of associating the URL (Uniform Resource Identifier) of the smart speaker with the identification ID and password of the MFP 100.

When the smart speaker 400 and the MFP 100 are associated with each other, the voice information generation server 300 requests the authentication server to issue an authentication token. Specifically, when the voice information generation server 300 sends an issuance request including the identification ID and password of the MFP 100 to the authentication server, the authentication server issues an authentication token if the identification information and the password are registered, and voices. Reply to the information generation server 300. After receiving the authentication token for the MFP 100, the voice information generation server 300 transmits the voice information generated based on the sound collected by the smart speaker 400 to the voice setting support server 200 together with the authentication token of the MFP 100.

The voice setting support server 200 transmits an authentication token to the authentication server. Since the authentication server that receives the authentication token returns the identification ID of the MFP 100 corresponding to the authentication token, the voice setting support server 200 can specify the MFP 100 from the identification ID.

Further, a keyword prepared in advance as information for extracting information for controlling the MFP 100 from the voice is registered in the voice information generation server 300. The keyword is information about a parameter set for the controlled MFP 100 to execute a job. Specifically, the keywords include the type of job and the parameters used by the MFP 100 to execute the job. The parameter is a value set for each of a plurality of setting items defined for each type of job. The voice information generation server 300 extracts information for controlling the MFP 100 from the voice spoken by the user, generates voice information including the extracted information, and outputs the voice information to the voice setting support server 200. A parsing rule may be registered in the voice information generation server 300 in order to extract a keyword from the voice.

For example, the user speaks a word prepared in advance for specifying the MFP 100 to be controlled to the smart speaker 400, for example, a name assigned to the MFP 100. In this case, the voice information is generated by referring to the keyword registered corresponding to the MFP 100 in the voice information generation server 300. The voice information generation server 300 transmits the generated voice information and the device identification information for identifying the smart speaker 400 that has transmitted the voice data to the voice setting support server 200. Here, character information is used as the voice information. The voice information is not limited to the character information, and may be voice or code.

For example, a case where the name assigned to the MFP 100 is "Biz Hub" will be described as an example. When the user says "copy in color in 3 copies, 2 in 1 with Biz Hub", the voice information is transmitted to the voice information generation server 300. The voice information generation server 300 identifies the MFP 100 from the word "biz hub", refers to the keyword stored in advance for the MFP 100, and refers to the words "three copies", "two-in-one", "color", and "copy". To extract. Then, the voice information generation server 300 determines that the job type is copy from the word "copy" according to the parsing rule, determines that "three copies", "two-in-one", and "color" are parameters, and determines that they are parameters. Generate audio information including. Then, the voice information generation server 300 transmits the voice information to the voice setting support server 200.

FIG. 2 is a block diagram showing an example of an outline of the hardware configuration of the voice setting support server. With reference to FIG. 2, the voice setting support server 200 has a central processing unit (CPU) 201 for controlling the entire voice setting support server 200, and a ROM (Read Only) for storing a program for the CPU 201 to execute. Memory) 202, RAM (Random Access Memory) 203 used as a work area of CPU 201, a hard disk drive (HDD) 204 for storing data non-volatilely, a communication unit 205 for connecting CPU 201 to network 3, and information. A display unit 206 for displaying the above, an operation unit 207 for receiving an input of a user's operation, and an external storage device 210 are included.

The CPU 201 downloads a program from a computer connected to the Internet 5 and stores it in the HDD 204. Further, when the computer connected to the network 3 writes the program to the HDD 204, the program is stored in the HDD 204. The CPU 201 loads the program stored in the HDD 204 into the RAM 203 and executes it.

The external storage device 210 is equipped with a CD-ROM (Compact Disk Read Only Memory) 211. In the present embodiment, an example in which the CPU 201 executes a program stored in the ROM 202 or the HDD 204 will be described. However, the CPU 201 may control the external storage device 210 to read a program for the CPU 201 to execute from the CD-ROM 211, store the read program in the RAM 203, and execute the program.

The recording medium for storing the program to be executed by the CPU 201 is not limited to the CD-ROM211 but is not limited to a CD-ROM211. )), IC cards, optical cards, mask ROMs, semiconductor memory media such as EPROMs (Erasable Program ROMs), and the like. The program referred to here includes not only a program that can be directly executed by the CPU 201, but also a source program, a compressed program, an encrypted program, and the like.

Since the hardware configurations of the MFPs 100 and 100A to 100D are all the same, the MFP100 will be described here as an example. FIG. 3 is a block diagram showing an outline of the hardware configuration of the MFP. With reference to FIG. 3, the MFP 100 includes a main circuit 110, a document reading unit 130 for reading a document, an automatic document transfer device 120 for transporting a document to the document reading unit 130, and a document reading unit 130. The image forming unit 140 for forming an image on paper or the like based on the image data to be read and output, the feeding unit 150 for supplying the paper to the image forming unit 140, and the paper on which the image is formed are processed. The post-processing unit 155 and the operation panel 160 as a user interface are included.

The post-processing unit 155 executes a sort process for rearranging and ejecting one or more sheets on which an image is formed by the image forming unit 140, a punch process for punching holes, and a staple process for driving staples.

The main circuit 110 is equipped with a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a large-capacity storage device, a facsimile unit 116, and a CD-ROM 118. External storage device 117 and. The CPU 111 is connected to the automatic document transfer device 120, the document reading unit 130, the image forming unit 140, the paper feeding unit 150, the post-processing unit 155, and the operation panel 160, and controls the entire MFP 100.

The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. Further, the RAM 114 temporarily stores image data continuously sent from the document reading unit 130.

The communication I / F unit 112 is an interface for connecting the MFP 100 to the network 3. The CPU 111 communicates with the smart speaker 400 via the communication I / F unit 112, and transmits / receives data. Further, the communication I / F unit 112 can communicate with a computer connected to the Internet 5 via the network 3.

The facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to or receives facsimile data from PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115 or outputs the received facsimile data to the image forming unit 140. The image forming unit 140 prints the facsimile data received by the facsimile unit 116 on paper. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data and transmits the data to the facsimile apparatus connected to the PSTN.

The external storage device 117 is equipped with a CD-ROM 118. The CPU 111 can access the CD-ROM 118 via the external storage device 117. The CPU 111 loads the program recorded in the CD-ROM 118 mounted on the external storage device 117 into the RAM 114 and executes the program. The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM 118, but may be a semiconductor memory such as an optical disk, an IC card, an optical card, a mask ROM, or an EPROM.

Further, the program executed by the CPU 111 is not limited to the program recorded in the CD-ROM 118, and the program stored in the HDD 115 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network 3 may rewrite the program stored in the HDD 115 of the MFP 100, or may add and write a new program. Further, the MFP 100 may download a program from another computer connected to the network 3 and store the program in the HDD 115. The program referred to here includes not only a program that can be directly executed by the CPU 111, but also a source program, a compressed program, an encrypted program, and the like.

The operation panel 160 is provided on the upper surface of the MFP 100 and includes a display unit 161 and an operation unit 163. The display unit 161 is, for example, a liquid crystal display (LCD) or an organic LE (electroluminescence) display, and displays an instruction menu for the user, information on acquired image data, and the like. The operation unit 163 includes a touch panel 165 and a hard key unit 167. The touch panel 165 is provided on the upper surface or the lower surface of the display unit 161 so as to be superimposed on the display unit 161. The hard key unit 167 includes a plurality of hard keys. The hard key is, for example, a contact switch. The touch panel 165 detects a position designated by the user on the display surface of the display unit 161.

FIG. 4 is a first chart diagram showing an example of the flow of voice setting processing in the voice setting system. With reference to FIG. 4, the passage of time is shown vertically from top to bottom, and the processing of the smart speaker 400, the processing of the voice information generation server 300, the processing of the voice setting support server 200, and the processing of the MFP 100 are shown in order from the left side. Is shown.

In the MFP 100, the user who operates the MFP 100 is authenticated. When authenticating a user, the MFP 100 transmits user identification information for identifying the authenticated user to the voice setting support server 200. When the user inputs a user ID and a password to the operation panel 160, the MFP 100 authenticates the user by using the user ID and the password. Further, when the MFP100 has a short-range wireless communication function called RFID (Radio Frequency Identification), it is short-range wireless with a mobile information device or an IC card carried by a user such as a smartphone, a tablet terminal, or a PDA (Personal Digital Assistants). You may communicate and authenticate the user. For short-range wireless communication, communication according to the ISO / IEC 18092 standard can be used. Further, when the MFP 100 has a card reader that reads a magnetic card, the MFP 100 may authenticate the user by reading the magnetic card carried by the user. Further, when the user remotely controls the MFP 100 using the mobile information device, the user who remotely controls the MFP 100 from the mobile information device is authenticated in the MFP 100. The user authentication may be executed by the MFP 100 or an external authentication server.

The MFP 100 further transmits the prohibited group information to the voice setting support server 200. The prohibited group information includes at least one prohibited group. A prohibited set is a combination of multiple parameters that cannot be combined. The prohibited set includes, for example, a combination of a color, which is a parameter of the setting item color, with respect to a CompactPDF whose setting item is a parameter of the format. Since the data in the format of CompactPDF cannot include the data of color, the combination of CompactPDF whose setting item is the parameter of the format and the color which is the parameter of the setting item color is defined as a prohibited set. The voice setting support server 200 stores the received prohibited group information in the HDD 204 in association with the MFP 100.

When the user speaks, the voice is converted into an electric signal in the smart speaker 400, and the voice data indicating the electric signal is transmitted to the voice information generation server 300.

When the voice data is received, the voice information generation server 300 recognizes the voice and converts the voice data into character information. The voice information generation server 300 extracts information for controlling the MFP 100 from the character information corresponding to the voice spoken by the user by using the keyword stored in advance corresponding to the MFP 100, and the voice including the extracted information. Generate information. The voice information generation server 300 transmits the voice information and the device identification information for identifying the smart speaker that has transmitted the voice data to the voice setting support server 200. The voice information includes one or more of a plurality of parameters used by the MFP 100 to execute a job, and the volume at which each of the one or more parameters is uttered. A plurality of parameters may be extracted from one voice data. In this case, the voice information includes a plurality of parameters. The voice information generation server 300 generates voice information in which a plurality of parameters are arranged in the order in which the voice is uttered with respect to the parameters. Since the voice data indicates the voice in which the voice is uttered by the user, the arrangement order of the character information extracted from the voice data indicates the order in which the voice is uttered by the user. Therefore, when a plurality of parameters are extracted from the character information, the voice information generation server 300 generates character information in which a set of the plurality of parameters and the volume is arranged in the order in which the plurality of parameters are extracted.

The voice setting support server 200 that receives the voice information extracts a parameter from the voice information and determines the extracted parameter as a parameter for setting in the MFP 100. When extracting a parameter from the voice information, the voice setting support server 200 determines that the voice information includes a setting command instructing the setting of the parameter. The voice setting support server 200 determines the consistency of a plurality of parameters determined for the job executed by the MFP 100. The voice setting support server 200 reads the prohibited group information stored in the HDD 204 in association with the MFP 100, and identifies the prohibited group included in the prohibited group information. Then, the voice setting support server 200 determines that it does not match when a plurality of parameters defined by the prohibited group are included in the plurality of parameters determined for the job. When the voice setting support server 200 determines that the plurality of parameters determined for the job do not match, the voice setting support server 200 determines the priority parameter to be prioritized from the plurality of parameters determined for the job. Furthermore, parameters other than the priority parameter are changed among the plurality of parameters determined for the job. Specifically, the parameters other than the priority parameter are changed so as not to be a combination of the parameters defined by the prohibited set.

Then, the voice setting support server 200 transmits a setting instruction command for causing the MFP 100 to set a parameter, and generates voice output information for notifying the user of the setting content. The audio output information includes parameters determined to be set in the MFP 100. Here, the audio output information includes a priority parameter and a parameter modified so as not to be a combination of the priority parameter and the parameter defined by the prohibited set.

The MFP 100 that receives the setting instruction command sets the parameters according to the setting instruction command. The voice setting support server 200 transmits the generated voice output information to the voice information generation server 300. The voice information generation server 300 generates voice data obtained by voice synthesis of parameters included in the voice output information, and transmits the voice data to the smart speaker 400. The smart speaker 400 that receives the voice data converts the voice data into voice and reproduces the voice data. As a result, the user can confirm the parameters set in the MFP 100 by voice.

FIG. 5 is a second chart showing an example of the flow of voice setting processing in the voice setting system. With reference to FIG. 5, a case where the user confirms the parameters set in the MFP 100 and then reconfirms the parameters set in the MFP 100 and a case where the user instructs the MFP 100 to execute a job are shown as examples. .. When the user utters a voice such as "Tell me the set parameters", "What is the setting?", "Confirm the setting", the confirmation command to be reconfirmed is detected on the voice setting support server 200. .. Further, when the user utters a voice such as "execute", "print", or "job execution", the execution command is detected on the voice setting support server 200.

In the smart speaker 400, the voice uttered by the user is converted into an electric signal, and the voice data indicating the electric signal is transmitted to the voice information generation server 300. The voice information generation server 300 recognizes voice data by voice, generates voice information, and transmits the voice information to the voice setting support server 200.

When the voice setting support server 200 that receives the voice information extracts the confirmation command from the voice information, the voice setting support server 200 reads out the parameters set in the MFP 100. The voice setting support server 200 may read out the parameters stored in the voice setting support server 200, or may inquire of the MFP 100 and acquire the parameters transmitted from the MFP 100. The voice setting support server 200 generates voice output information for notifying the user of the setting contents. The audio output information includes parameters set in the MFP 100.

The voice setting support server 200 transmits the generated voice output information to the voice information generation server 300. The voice information generation server 300 generates voice data obtained by voice synthesis of parameters included in the voice output information, and transmits the voice data to the smart speaker 400. The smart speaker 400 that receives the voice data converts the voice data into voice and reproduces the voice data. This allows the user to reconfirm the parameters set in the MFP 100 by voice.

On the other hand, when the voice setting support server 200 that receives the voice information extracts the execution command from the voice information, the voice setting support server 200 sends an execution instruction command for instructing the MFP 100 to execute the job to the MFP 100. Upon receiving the execution instruction command, the MFP 100 executes the job according to the parameters set up to that point. As a result, the user can confirm that the MFP 100 is made to execute the job by voice.

FIG. 6 is a block diagram showing an example of the functions of the CPU included in the voice setting support server. The function shown in FIG. 6 may be realized by hardware, or may be realized by CPU 201 by causing CPU 201 included in the voice setting support server 200 to execute a program stored in ROM 202, HDD 204 or CD-ROM 211. May be good. Here, a case where the CPU 201 included in the voice setting support server 200 is made to execute the voice setting support program will be described as an example.

With reference to FIG. 6, the CPU 201 included in the voice setting support server 200 includes a voice information acquisition unit 251, a parameter determination unit 253, a consistency determination unit 255, a prohibited group acquisition unit 257, and a priority change unit 259. It includes an output control unit 261, an alternative device determination unit 263, a command extraction unit 265, an execution instruction unit 267, a confirmation output control unit 269, a restriction information acquisition unit 271, and a restriction determination unit 273.

The voice information acquisition unit 251 acquires the voice information and the device identification information received from the voice information generation server 300 by the communication unit 205. The voice information acquisition unit 251 outputs voice information to the parameter determination unit 253 and the command extraction unit 265. Audio information includes commands and parameters. The command includes a setting command, a confirmation command, and an execution command. The parameter indicates a value that can be set in the setting item. The setting item indicates the type of the parameter defined for the job executed by the MFP 100.

The MFP 100 can execute a plurality of types of jobs. In the present embodiment, a case where a plurality of types of jobs that can be executed by the MFP 100 are a copy job that executes a copy process and a scan job that executes a scan process will be described as an example. Further, the job type of the copy job is set to copy, and the job type of the scan job is set to scan. In this case, the keywords registered in the voice information generation server 300 include copy and scan.

The parameter determination unit 253 extracts the parameter from the voice information when the voice information acquired by the voice information acquisition unit 251 includes a setting command. When the voice information includes parameters, it may be determined that the voice information includes setting commands. The parameter determination unit 253 refers to the parameter table and extracts parameters from the voice information. For example, the parameter determination unit 253 extracts the same word as the word defined as a parameter in the parameter table from the voice information. Since the parameters are set corresponding to one or more setting items defined for the job type, the parameter determination unit 253 determines the parameters corresponding to each of the one or more setting items. When one voice information includes a plurality of parameters, the parameter determination unit 253 extracts the plurality of parameters. The parameter determination unit 253 outputs one or more determined parameters to the consistency determination unit 255 and the restriction determination unit 273.

FIG. 7 is a diagram showing an example of a parameter table. With reference to FIG. 7, the parameter table associates job types, setting items, and parameters. The parameter table contains multiple parameter records. The parameter record includes a job type item, a setting item item, and a parameter item. The job type is set in the job type item. The name of the setting item is set in the item of the setting item. Settable parameters are set in the parameter items.

The parameter record for which copy is set for the job type item includes seven parameter records whose setting item names are color, read, print, staple, number of copies, 2in1, and paper size.

The setting items whose names are colors correspond to the parameters that determine the number of colors that form the image. The parameter record in which the color is set as the name in the setting item includes three parameters of black and white, auto color, and full color in the parameter item. This indicates that one of black and white, auto color, and full color parameters can be set for the setting item whose name is color.

The setting items whose names are read correspond to the parameters that determine the reading surface of the document. The parameter record for which reading is set as the name in the setting item includes two parameters, double-sided and single-sided, in the parameter item. This indicates that either the double-sided reading or the single-sided reading parameter can be set for the setting item whose name is reading.

The setting items whose names are printed correspond to the parameters that determine the formation surface on which the image of the recording medium is formed. The parameter record for which printing is set as the name in the setting item includes two parameters, double-sided and single-sided, in the parameter item. This indicates that either the double-sided printing or single-sided printing parameter can be set for the setting item whose name is printing.

The setting items whose names are staples correspond to the parameters that determine the content of the process of driving staples into multiple sheets of paper. A parameter record in which staples are set as names in the setting items include three parameters of two points, corners, and none in the parameter items. This indicates that any of two points, corners, and none can be set as a parameter for the staple setting item.

The setting item whose name is the number of copies corresponds to a parameter that determines the number of sheets on which an image is formed. A parameter record in which the number of copies is set as a name in the setting item includes a numerical parameter in the parameter item. This indicates that any number can be set as a parameter for the setting item whose name is the number of copies.

The setting item whose name is 2in1 corresponds to a parameter that determines whether or not the process of forming two pages on one sheet is executed. A parameter record in which 2in1 is set as a name in the setting item includes two parameters, ON and OFF, in the parameter item. This indicates that either ON or OFF parameter can be set for the setting item whose name is 2in1.

The setting item whose name is the paper size corresponds to the parameter that determines the tail size of the recording medium that is the target of image formation. The parameter record in which the paper size is set as the name in the setting item includes four parameters A4, A3, Letter, and Legal in the parameter item. This indicates that any of the parameters A4, A3, Letter, and Legal can be set for the setting item whose name is the paper size.

The parameter record for which scan is set for the job type item includes six parameter records whose setting item names are resolution, destination, color, read size, read, and format.

The setting item whose name is resolution corresponds to the parameter that determines the resolution for reading the original. The parameter record in which the resolution is set as the name in the setting item includes four parameters of 200 dpi, 300 dpi, 400 dpi, and 600 dpi in the parameter item. This indicates that any parameter of 200 dpi, 300 dpi, 400 dpi, or 600 dpi can be set for the setting item whose name is color.

The setting item whose name is the destination corresponds to the parameter that determines the output destination of the data obtained by scanning the original. The parameter record for which the destination is set as the name in the setting item includes the parameter of the name of the output destination address in the parameter item. This indicates that the output destination address can be set as a parameter for the setting item whose name is the destination.

The setting item whose name is color corresponds to the parameter that determines the number of colors to read the original. A parameter record in which a color is set as a name in a setting item includes three parameters of black and white, auto color, and full color in the parameter item. This indicates that one of black and white, auto color, and full color parameters can be set for the setting item whose name is color.

The setting item whose name is the scanning size corresponds to the parameter that determines the size of the original. The parameter record in which the reading size is set as the name in the setting item includes four parameters A4, A3, Letter, and Legal in the parameter item. This indicates that any of A4, A3, Letter, and Legal parameters can be set for the setting item whose name is the reading size.

The setting item whose name is read corresponds to the parameter that determines the surface on which the document is read. The parameter record for which reading is set as the name in the setting item includes two parameters, double-sided and single-sided, in the parameter item. This indicates that either the double-sided or single-sided parameter can be set for the setting item whose name is the reading surface.

The setting item whose name is the format corresponds to the parameter that determines the format of the image data obtained by scanning the original. The parameter record whose format is set as the name in the setting item includes four parameters of CompactPDF, PDF, JPEG, and TIFF in the parameter item. This indicates that any parameter of CompactPDF, PDF, JPEG, or TIFF can be set for the setting item whose name is format.

Returning to FIG. 6, the prohibited group acquisition unit 257 acquires the prohibited group information from each of the MFPs 100, 100A to 100D, and determines the consistency determination unit 255 and the alternative device based on the prohibited group information acquired from each of the MFPs 100, 100A to 100D. Output to unit 263. Specifically, the prohibited group acquisition unit 257 controls the communication unit 205 to communicate with each of the MFPs 100 and 100A to 100D, and requests each of the MFPs 100 and 100A to 100D to transmit the prohibited group information. Since each of the MFPs 100 and 100A to 100D returns the prohibited group information, the prohibited group acquisition unit 257 acquires the prohibited group information received by the communication unit 205 from each of the MFPs 100 and 100A to 100D.

FIG. 8 is a diagram showing an example of prohibited group information. Here, the prohibited group information defined in the MFP 100 is shown. With reference to FIG. 8, the prohibited group information associates the parameter 1 set in the two setting items 1 that cannot be combined with the parameter 2 set in the setting item 2. Here, the prohibited group information cannot be combined with "CompactPDF" as the parameter 1 in which the setting item 1 is set to "format" and "color" as the parameter 2 in which the setting item 2 is set to "color". Associated as a parameter. Here, with reference to FIG. 7, both the "format" setting item 1 and the "color" setting item 2 are setting items whose job type determines the scan process of scanning. In the format whose format is CompactPDF, color data cannot be included. Therefore, in order to convert the data read in color into the data in the CompactPDF format, the data read in color is binarized or the like. Therefore, even though the user has instructed to save the data as color data, the monochrome data is saved. Therefore, "CompactPDF" is defined as the parameter 1 in which the setting item 1 is set to "format", and "color" is defined as the parameter 2 in which the setting item 2 is set to "color".

Returning to FIG. 6, the consistency determination unit 255 determines the consistency of one or more parameters input from the parameter determination unit 253. The consistency determination unit 255 stores a default job in which a plurality of parameters are set by default for a job to be executed by the MFP 100. Whenever one or more parameters are determined by the parameter determination unit 253, the consistency determination unit 255 inputs a part of a plurality of parameters defined for the default job from the parameter determination unit 253. Update with. Voice information may be input multiple times. In this case, one or more parameters are determined each time voice information is input by the parameter determination unit 253. The consistency determination unit 255 updates a part of a plurality of parameters defined for the default job with one or more parameters determined for the first input voice information. The consistency determination unit 255 updates a part of a plurality of parameters defined for the updated job with one or more parameters determined for the voice information input from the second time onward.

The consistency determination unit 255 determines whether or not a plurality of parameters defined for the updated job are matched by one or more parameters input from the parameter determination unit 253. Specifically, the consistency determination unit 255 specifies the prohibited group information received from the MFP 100 among the prohibited group information received from each of the MFPs 100, 100A to 100D by the prohibited group acquisition unit 257. Then, the consistency determination unit 255 determines that the plurality of parameters defined for the updated job do not match when the prohibited group included in the prohibited group information is included. When the prohibited group information includes a plurality of prohibited groups, the consistency determination unit 255 determines that the plurality of parameters defined for the updated job include at least one of the plurality of prohibited groups included in the prohibited group information. Judge that it does not match. Further, when a plurality of parameters are input from the parameter determination unit 253, the consistency determination unit 255 does not match when the plurality of parameters input from the parameter determination unit 253 include the prohibited set included in the prohibited set information. You may judge that.

When it is determined that the plurality of parameters defined for the updated job do not match, the consistency determination unit 255 outputs a mismatch signal to the output control unit 261. Further, the consistency determination unit 255 outputs to the priority change unit 259 a set of a plurality of parameters defined by the prohibited group included in the prohibited group information among the plurality of parameters defined for the updated job. Further, the consistency determination unit 255 outputs the updated job determined to be inconsistent to the alternative device determination unit 263.

The priority change unit 259 determines one priority parameter from a set of a plurality of parameters defined by the prohibited set included in the prohibited set information among the plurality of parameters defined for the updated job. The priority change unit 259 determines the priority parameter based on the evaluation value corresponding to each of the plurality of parameters.

Specifically, the priority change unit 259 determines one priority parameter from the plurality of parameters determined by the parameter determination unit 253. The evaluation value is the volume at which each of the one or more parameters determined by the parameter determination unit 253 is uttered. The priority change unit 259 determines a parameter having a high volume as a priority parameter.

The priority change unit 259 changes non-priority parameters other than the priority parameter among the plurality of parameters defined by the prohibited group included in the prohibited group information among the plurality of parameters defined for the updated job. Specifically, one of the plurality of parameters defined by the prohibited set is a priority parameter, and the other one or more is a non-priority parameter. The priority change unit 259 changes the non-priority parameter to a value different from the value defined by the prohibited set. For example, the priority change unit 259 changes the non-priority parameter to a value defined by default. Further, the priority change unit 259 may change the non-priority parameter to a value predetermined for the prohibited set. Hereinafter, the parameter after changing the non-priority parameter is referred to as a change parameter. The priority change unit 259 outputs the priority parameter and the change parameter to the output control unit 261.

The alternative device determination unit 263 is updated with one or more parameters determined by the parameter determination unit 253, and the job determined to be inconsistent by the consistency determination unit 255 is input to the alternative device determination unit 263. Determines an alternative device to replace the MFP100 from among the MFPs 100A to 100D. Even if the prohibited set for the MFP 100 is included, the prohibited set for other MFPs 100A to 100D may not be included. Therefore, the alternative device determination unit 263 matches a plurality of parameters defined by the job determined by the consistency determination unit 255 among the MFPs 100A to 100D based on the prohibited group information of the MFPs 100A to 100D. Determine the device to be used as an alternative device. When determining an alternative device for the MFP 100, the alternative device determination unit 263 outputs device identification information for identifying the alternative device to the output control unit 261. Here, a case where the MFP 100A is determined as an alternative device will be described as an example.

The output control unit 261 notifies the user that the parameter that the job cannot be executed is set in the MFP 100 in response to the mismatch signal input from the consistency determination unit 255. The output control unit 261 transmits, for example, voice output information including a message "a parameter that cannot be set has been specified" to the voice information generation server 300. As a result, since the message is reproduced by voice from the smart speaker 400, the user is notified that a plurality of parameters defined by the prohibited group are set.

The output control unit 261 includes a restriction notification unit 281, a parameter notification unit 283, a display control unit 285, and an alternative device notification unit 287. The parameter notification unit 283 notifies the user of the priority parameter and the change parameter in response to the input of the priority parameter and the change parameter from the priority change unit 259. Specifically, the parameter notification unit 283 transmits the voice output information including the priority parameter and the change parameter to the voice information generation server 300. As a result, the priority parameter and the change parameter are reproduced by voice from the smart speaker 400, so that the user is notified of the priority parameter and the change parameter set in the MFP 100. It is preferable that the parameter notification unit 283 transmits the voice output information after a predetermined time has elapsed from the voice information acquisition by the voice information acquisition unit 251. As a result, it is possible to prevent the sound from being reproduced from the smart speaker 400 while the user is speaking.

The display control unit 285 causes the MFP 100 to display the priority parameter and the change parameter in a changeable manner in response to the input of the priority parameter and the change parameter from the priority change unit 259. Further, the display control unit 285 causes the MFP 100 to display the priority parameter and the change parameter in association with the corresponding evaluation value, here, the volume. For example, in the setting screen that displays the priority parameter and the change parameter in a changeable manner, a numerical value indicating the volume corresponding to the priority parameter is placed in the vicinity of the priority parameter, and the volume corresponding to the change parameter is shown in the vicinity of the change parameter. A setting screen in which numerical values are arranged is generated, and the setting screen is displayed on the MFP 100. As a result, the user can confirm that the priority parameter and the change parameter are set in the MFP 100, and can change the priority parameter and the change parameter.

The alternative device notification unit 287 notifies the user of the alternative device when the device identification information of the alternative device is input from the alternative device determination unit 263. Specifically, the alternative device notification unit 287 transmits voice output information including the priority parameter, the non-priority parameter, and the name given to the substitute device to the voice information generation server 300. As a result, the priority parameter, the non-priority parameter, and the name of the alternative device are reproduced by voice from the smart speaker 400. Therefore, it is possible to notify the user that the job including the priority parameter and the non-priority parameter set by the user by voice can be executed by the alternative device. Therefore, the user can cause the alternative device to execute the job including the priority parameter and the non-priority parameter by switching the control target or the like.

The restriction information acquisition unit 271 acquires restriction information. The restriction information defines the parameters whose settings are restricted. The restriction information includes user restriction information and device restriction information. The restriction information acquisition unit 271 includes a user identification unit 291 and a device state acquisition unit 293. The user identification unit 291 acquires parameters whose settings are restricted for the user in the device to be controlled by the user, in this case, the MFP 100, as user restriction information. For example, in the MFP 100, color printing may be restricted to a specific user among color printing and monochrome printing. The user identification unit 291 acquires, as user restriction information, parameters that are restricted from being set in the MFP 100 for the user who operates the MFP 100 from the MFP 100. The user identification unit 291 outputs to the restriction determination unit 273 a parameter that is restricted to be set in the MFP 100 for the user who operates the MFP 100 as a restriction parameter.

The device state acquisition unit 293 acquires the state of the device to be controlled by the user, in this case, the MFP 100. Some parameters cannot be set depending on the state of the MFP100. For example, it is not possible to set a parameter for setting an image forming target for a type of paper that is not stored in the MFP 100. Further, when the consumables included in the MFP 100 have reached the number of times of use that reaches the end of their life, it is not possible to set a parameter for executing a process using the consumables. Specifically, it is not possible to set parameters for forming a full-color image in the absence of toner in the toner bottle containing any of the yellow, magenta, and cyan toners. The device state acquisition unit 293 determines a parameter that cannot be set based on the state acquired from the MFP 100 in the device restriction information, and outputs the parameter determined in the restriction information to the restriction determination unit 273 as a restriction parameter.

FIG. 9 is a diagram showing an example of user restriction information. The user restriction information defines a restriction function for each user. With reference to FIG. 9, the user restriction information includes a user restriction record, and the user restriction record includes an item of user identification information and an item of restriction function. In the item of user identification information, a user ID for identifying a user is set. In the item of the restriction function, the function identification information for identifying the restricted function is set. For example, the restriction function "color printing" is set for the user identification information "USER-1". Therefore, for the user restriction information in which "USER-1" is set in the user identification information item, the function of "color printing" is restricted for the user whose user identification information is "USER-1". show.

FIG. 10 is a diagram showing an example of device state information. The device status information indicates the status of each function for each device. With reference to FIG. 10, the device state information includes a device identification information item, a function item, and a state item. In the item of device identification information, device identification information for identifying a device is set. For the function item, function identification information indicating the function of the device is set. The status item is either TRUE, which indicates that the function is executable, or FALSE, which indicates that the function is not executable, as information indicating that the function specified by the function identification information set in the function item is executable. Is set. For example, for a device whose device identification information is "MFP-A", the function identification information can execute the function of "color blind", the function identification information can execute the function of "staple", and the function identification information can execute the function of "punch". It is shown that the function of "" cannot be executed, and the function identification information can execute the function of "double-sided printing". Regarding a device whose device identification information is "MFP-B", the function identification information cannot execute the "color print" function, the function identification information cannot execute the "staple" function, and the function identification information is "punch". It is shown that the function of "" cannot be executed, and the function identification information can execute the function of "double-sided printing".

Returning to FIG. 6, the restriction determination unit 273 inputs the restriction parameter from the restriction information acquisition unit 271. When the restriction parameter is included in one or more parameters input from the parameter determination unit 253, the restriction determination unit 273 outputs a restriction signal to the output control unit 261. The limiting signal includes limiting parameters included in one or more parameters input from the parameter determining unit 253.

The output control unit 261 notifies the user that the parameter for which the setting to the MFP 100 is restricted has been set in response to the input of the restriction signal from the restriction determination unit 273. The output control unit 261 transmits the voice output information including the restriction parameter and the message to the voice information generation server 300. The message is, for example, "A parameter that cannot be set has been specified." As a result, the limit parameter and the message are played back by voice from the smart speaker 400, so that the user is notified that the limit parameter cannot be set.

Further, the message includes a message indicating a procedure of the resolution method when the restriction parameter can be set when the state of the MFP 100 is resolved. For example, when there is no toner in the toner bottle containing the yellow, magenta, or cyan toner, the audio output information includes a message indicating the procedure for replacing the toner bottle. As a result, the smart speaker 400 outputs a voice message indicating a procedure for resolving the infeasible state of the MFP 100, so that the user can easily make the MFP 100 in a state in which the job can be executed.

The command extraction unit 265 inputs voice information from the voice information acquisition unit 251 and extracts commands included in the voice information. Voice information includes setting commands, confirmation commands, and execution commands. The command extraction unit 265 extracts a setting command when the voice information includes parameters. When the command extraction unit 265 extracts the confirmation command from the voice information, the command extraction unit 265 outputs the confirmation instruction to the confirmation output control unit 269. When the command extraction unit 265 extracts an execution command from the voice information, the command extraction unit 265 outputs an execution instruction to the execution instruction unit 267.

The confirmation output control unit 269 generates voice output information in response to the input of the confirmation instruction, and transmits the voice output information to the voice information generation server 300. Specifically, the confirmation output control unit 269 reads out the parameters set in the MFP 100. When the parameter set in the MFP 100 is stored in the HDD 204, the output control unit 269 at the time of confirmation may read the parameter, inquire the MFP 100, and acquire the parameter transmitted from the MFP 100. May be good. The confirmation output control unit 269 generates voice output information for notifying the user of the parameters set in the MFP 100. The confirmation output control unit 269 transmits the generated voice output information to the voice information generation server 300. The voice information generation server 300 generates voice data obtained by voice synthesis of parameters included in the voice output information, and transmits the voice data to the smart speaker 400. The smart speaker 400 that receives the voice data converts the voice data into voice and reproduces the voice data. This allows the user to reconfirm the parameters set in the MFP 100 by voice.

The confirmation output control unit 269 may generate voice output information that does not include the parameter so that the parameter not determined by the parameter determination unit 253 is not output by voice. In this case, since the parameters not spoken by the user are not output from the smart speaker 400, the user can confirm that only the parameters spoken by the user are correctly set.

The execution instruction unit 267 transmits to the MFP 100 a setting instruction command for setting parameters and an execution instruction command for instructing the execution of a job in response to the input of the execution instruction. The setting instruction command contains multiple parameters set for the job. Upon receiving the setting instruction command, the MFP 100 sets a plurality of parameters included in the setting instruction command. Further, when the MFP 100 receives the execution instruction command, the MFP 100 executes the job according to the parameters set up to that point. This allows the user to have the MFP 100 execute the job by voice.

FIG. 11 is a diagram showing an example of a setting instruction command. With reference to FIG. 11, the setting instruction command includes a job type and a plurality of parameters. The setting instruction command "create copy job" indicates that the job type is copy. The setting instruction command doublex: null indicates that no parameter is set in the setting item whose name is read. The setting instruction command "color": "color" indicates that the color parameter is set in the setting item whose name is color. The setting instruction command "number": "3" indicates that the color parameter is set in the setting item whose name is color. The setting instruction command "combine": "2in1" indicates that the ON parameter is set in the setting item whose name is 2in1.

FIG. 12 is a flowchart showing an example of the flow of voice setting support processing. The voice setting support process is a process executed by the CPU 201 when the CPU 201 included in the voice setting support server 200 executes a voice setting support program stored in the ROM 202, HDD 204, or CD-ROM 211.

With reference to FIG. 12, the CPU 201 included in the voice setting support server 200 determines whether or not the voice information has been acquired (step S01). When the voice information is received from the voice information generation server 300, the process proceeds to step S02, but if not, the process returns to step S01. In step S02, the user who operates the MFP 100 is specified, and the process proceeds to step S03. The user who logs in to the MFP 100 is authenticated by the MFP 100. When the user identification information of the authenticated user is received from the MFP 100, the user is identified.

In step S03, the device to be operated by the user is specified, and the process proceeds to step S04. Here, a case where the MFP 100 is specified will be described as an example. In step S04, the prohibited group information is acquired from each of the MFPs 100 and 100A to 100D, and the process proceeds to step S05.

In step S05, it is determined whether or not the voice information acquired in step S01 includes a setting command. If the voice information contains parameters, it is determined that the setting command is included. If the voice information includes a setting command, the process proceeds to step S06, otherwise the process proceeds to step S10. In step S06, the parameter setting process is executed, and the process proceeds to step S06. The details of the parameter setting process will be described later, but it is a process of setting one or more parameters included in the voice information in the MFP 100 which is an operation target device.

In step S07, it is determined whether or not the limiting parameter exists among the parameters set in the MFP 100 which is the operation target in step S06. The restriction parameters are parameters defined by the user restriction information and the device restriction information, respectively. If the restriction parameter exists, the process proceeds to step S08, but if it does not exist, the process returns to step S01.

In step S08, the user is notified that the restriction is restricted, and the process proceeds to step S09. For example, in order to notify the user that the job cannot be executed when the restriction parameter is set, the voice output information including the message including the restriction parameter is generated and transmitted to the voice information generation server 300. As a result, the message is played back from the smart speaker 400, so that the user can be notified that the job cannot be executed when the restriction parameter is set. In step S09, the resolution method is notified, and the process returns to step S01. The solution method is information indicating a procedure for changing the state of the MFP 100 so that the job can be executed even if the restriction parameter is set. For example, when the MFP 100 cannot execute the process of forming an image in color when the remaining amount of toner is insufficient, the solution method is a procedure of replacing the toner bottle having insufficient remaining amount.

In step S10, it is determined whether or not the voice information acquired in step S01 includes a confirmation command. If the voice information includes a confirmation command, the process proceeds to step S11, otherwise the process proceeds to step S14. In step S11, the parameters set in the MFP 100 are acquired from the MFP 100, and the process proceeds to step S12. In step S12, audio output information in which the parameters acquired from the MFP 100 are arranged in step S11 is generated, and the process proceeds to step S13. In step S13, the voice output information is transmitted to the voice information generation server 300, and the process returns to step S01.

In step S14, it is determined whether or not the voice information acquired in step S01 includes an execution command. If the voice information includes an execution command, the process proceeds to step S15, otherwise the process returns to step S01. In step S15, an execution instruction command instructing the MFP 100 to execute the job is transmitted, and the process returns to step S01. In the MFP 100 that receives the execution instruction command, the job is executed according to the parameters set up to that point.

FIG. 13 is a flowchart showing an example of the flow of the parameter setting process. The parameter setting process is a process executed in step S05 of the voice setting support process. With reference to FIG. 13, in step S21, the parameter is extracted from the voice information, and the process proceeds to step S22. In step S22, it is determined whether or not the job in which the extracted parameters are set includes the prohibited group. It is determined whether or not the plurality of parameters defined by the prohibited group are included in the plurality of parameters after updating the plurality of parameters set in the job with the parameters extracted from the voice information in step S21. If a plurality of parameters defined by the prohibited set are included, the process proceeds to step S23, but if not, the process proceeds to step S30. In step S23, it is notified that the prohibited group exists. For example, voice output information including the message "A parameter that cannot be set has been set." Is generated and transmitted to the voice information generation server 300.

In the next step S24, the priority parameter is determined, and the process proceeds to step S25. In step S21, the priority parameter is determined from the plurality of parameters extracted from the voice information. Of the plurality of parameters defined by the prohibited set, the parameter having the loudest corresponding voice volume is determined as the priority parameter. In step S25, the non-priority parameter is changed, and the process proceeds to step S26. The non-priority parameter is a parameter other than the priority parameter among a plurality of parameters defined by the prohibited set. The non-preferred parameter is changed to a value different from the value defined by the prohibited set. The parameter after the non-preferred parameter is changed is the changed parameter. Here, the case where the plurality of parameters extracted from the voice information in step S21 are a plurality of parameters defined by the prohibited set will be described. In this case, the parameter having the highest corresponding voice volume among the plurality of parameters extracted from the voice information is determined as the priority parameter.

In step S26, a setting instruction command for setting the priority parameter and the non-priority parameter to the MFP 100 is transmitted to the MFP 100, and the process proceeds to step S27. In step S27, the display instruction command is transmitted to the MFP 100, and the process proceeds to step S28. The display instruction command is a command instructing to display the volume of the voice corresponding to the priority parameter and the volume of the voice corresponding to the non-priority parameter as evaluation values. When the setting instruction command is received in the MFP 100, the priority parameter and the change parameter are displayed on the display unit 161 by the MFP 100. Then, when the display instruction command is received, the MFP 100 displays a value indicating the volume of the voice corresponding to the priority parameter in the vicinity of the priority parameter, and is non-priority before the change parameter is changed in the vicinity of the change parameter. A value indicating the volume of the audio corresponding to the parameter is displayed. As a result, the user can know that the priority parameter having a large volume indicating value is preferentially determined and the change parameter is a parameter changed from the non-priority parameter. The user can change the priority parameter and the change parameter by voice, or can change by operating the operation unit 163.

Then, in step S28, the audio output information is generated, and the process proceeds to step S29. The audio output information includes priority parameters and change parameters. In step S29, the voice output information is output to the voice information generation server 300, and the process returns to the voice setting support process. As a result, the priority parameter and the change parameter are output by voice from the smart speaker 400. Therefore, the user can confirm by voice that the priority parameter and the change parameter have been set.

In step S30, a setting instruction command for setting one or more parameters extracted from the voice information in step S21 to the MFP 100 is transmitted to the MFP 100, and the process proceeds to step S31. Then, in step S31, audio output information is generated, and the process proceeds to step S32. The audio output information includes one or more parameters extracted from the audio information in step S21. In step S32, the voice output information is output to the voice information generation server 300, and the process returns to the voice setting support process. As a result, one or more parameters extracted from the voice information in step S21 are output by voice from the smart speaker 400. Therefore, the user can confirm by voice that the parameter spoken by the user has been set.

<First modification>
FIG. 14 is a block diagram showing an example of the function of the CPU included in the voice setting support server in the first modification. With reference to FIG. 14, the functions different from those shown in FIG. 6 are that the priority change unit 259 is deleted and the output control unit 261 is changed to the output control unit 261A. Since the other functions are the same as the functions shown in FIG. 6, the description thereof will not be repeated here.

The output control unit 261A notifies the user that the parameter that the job cannot be executed is set in the MFP 100 in response to the mismatch signal input from the consistency determination unit 255. The output control unit 261A transmits, for example, voice output information including a message "a parameter that cannot be set has been specified" to the voice information generation server 300. As a result, since the message is reproduced by voice from the smart speaker 400, the user is notified that a plurality of parameters defined by the prohibited group are set.

The output control unit 261A includes a restriction notification unit 281, a parameter notification unit 283A, a display control unit 285A, and an alternative device notification unit 287. The parameter notification unit 283A notifies the user of one or more parameters determined by the parameter determination unit 253. Specifically, the parameter notification unit 283A transmits voice output information including one or more parameters determined by the parameter determination unit 253 to the voice information generation server 300. As a result, one or more parameters determined by the parameter determination unit 253 are reproduced by voice from the smart speaker 400, so that the parameter set in the MFP 100 is notified to the user.

The display control unit 285A causes the MFP 100 to display one or more parameters determined by the parameter determination unit 253 in a changeable manner. Further, the display control unit 285A causes the MFP 100 to display one or more parameters determined by the parameter determination unit 253 in association with the corresponding evaluation value, here, the volume. As a result, the user can confirm that one or more parameters determined by the parameter determination unit 253 are set in the MFP 100, and can change one or more parameters determined by the parameter determination unit 253.

FIG. 15 is a flowchart showing an example of the flow of the parameter setting process in the first modification. The difference from the parameter setting process shown in FIG. 13 is that steps S24 to S25 are deleted, and steps S26 and S27 are changed to steps S26A and S27A, respectively. Since the other processes are the same as those shown in FIG. 13, the description will not be repeated here.

When it is notified in step S23 that the prohibited group exists, the process proceeds to step S26A. In step S26A, a setting instruction command for setting one or more parameters extracted from the voice information in step S21 to the MFP 100 is transmitted to the MFP 100, and the process proceeds to step S27A. In step S27A, the display instruction command is transmitted to the MFP 100, and the process proceeds to step S28. The display instruction command is a command instructing to display the volume of the voice of each of the one or more parameters extracted from the voice information in step S21 as an evaluation value. When the setting instruction command is received, the MFP 100 displays one or more parameters extracted from the voice information in step S21 on the display unit 161 by the MFP 100. Then, when the display instruction command is received, the MFP 100 displays a value indicating the volume of the voice of each of the one or more parameters extracted from the voice information in step S21.

<Second modification>
In the first modification, the evaluation values are in the order in which each of the plurality of parameters determined by the parameter determination unit 253 is uttered. A plurality of parameters determined by the parameter determination unit 253 are included in one voice information. In this case, the priority change unit 259 determines the parameter whose utterance order is first as the priority parameter.

<Third modification example>
In the voice setting system 1 described above, the case where the job is generated by the MFP 100 has been described as an example, but the voice setting support server 200 may generate a job to be executed by the MFP 100. In this case, the load on the MFP 100 can be reduced.

<Fourth modification>
The voice setting system 1 in the fourth modification includes an intermediate server between the voice setting support server 200 and the MFPs 100, 100A to 100D, respectively. The intermediate server is connected to the network 3 and manages the MFPs 100, 100A to 100D. Further, the intermediate server has a part of the functions of the voice setting support server 200. For example, the intermediate server has some functions of the prohibited group acquisition unit 257 and the restriction information acquisition unit 271. Therefore, the load of the voice setting support server 200 can be reduced, and the load of the MFPs 100, 100A to 100D can be reduced.

As described above, in the voice setting system 1 of the present embodiment, the voice setting support server 200 functions as a voice setting support device, the MFP 100 functions as a job execution device, and the voice information generation server 300 functions as voice information. It functions as a generator, and the smart speaker 400 functions as a voice input device.

The voice setting support server 200 determines a plurality of parameters based on the voice information, acquires a prohibited set in which the combination of the plurality of parameters is prohibited by the MFP 100, and whether or not the determined plurality of parameters include the prohibited set. To judge. Therefore, for this reason, it can be determined that the plurality of parameters uttered by the user include the prohibited set. Therefore, since it is not necessary for the MFP 100 to determine the combination of a plurality of parameters, the load on the MFP 100 can be reduced.

Further, the voice setting support server 200 notifies by voice that the plurality of parameters include the prohibited set. Therefore, the user can know by voice that a plurality of parameters uttered by voice cannot be set for the setting.

Further, the voice setting support server 200 gives a voice notification after a predetermined time has elapsed from the acquisition of the voice information. This makes it possible to prevent the voice uttered by the user and the voice notification from overlapping.

Further, the voice setting support server 200 determines a priority parameter from a plurality of parameters based on the evaluation value for each of the plurality of parameters included in the prohibited set among the determined plurality of parameters, and non-priority other than the priority parameter. Change the parameters. Therefore, a plurality of parameters that can be combined can be automatically set.

Further, the voice setting support server 200 determines the priority parameter by using the volume at which each of the determined plurality of parameters is uttered as an evaluation value. Therefore, it is possible to correct the wrong setting by the user to the correct setting. In addition, it is possible to increase the probability that the modified setting will be the setting desired by the user.

Further, the voice setting support server 200 notifies the priority parameter and the change parameter. Therefore, the user can know a plurality of modified parameters that have been set.

Further, the voice setting support server 200 causes the MFP 100 to display the priority parameter and the change parameter in association with the corresponding evaluation values. Therefore, the user can know the reason why the parameter spoken by voice is changed.

Further, the voice setting support server 200 determines the MFP 100 to execute the job from the plurality of MFPs 100, 100A to 100D, and when the plurality of parameters extracted from the voice information include the prohibited set acquired from the MFP 100, the voice setting support server 200 determines. An alternative device capable of executing a job is determined from a plurality of MFPs 100, 100A to 100D. Therefore, the user can know that the job can be executed by a device other than the MFP 100 operated by the user.

Further, the voice setting support server 200 notifies when a plurality of parameters extracted from the voice information are included. Therefore, the user can know that a restriction parameter that cannot be set has been set.

Further, the voice setting support server 200 in the first modification causes the MFP 100 to display a plurality of parameters included in the prohibited set among the determined plurality of parameters in a changeable manner. Therefore, the user can check a plurality of set parameters and change a plurality of parameters.

Further, the voice setting support server 200 in the second modification determines the priority parameter by using the order in which the determined plurality of parameters are uttered as the evaluation value. Therefore, it is possible to correct the wrong setting by the user to the correct setting. In addition, it is possible to increase the probability that the modified setting will be the setting desired by the user.

In the present embodiment, the voice setting system 1 and the voice setting support server 200 included therein have been described, but as a voice setting support method for causing the voice setting support server 200 to execute the voice setting support process shown in FIG. Needless to say, the invention can be captured.

It should be considered that the embodiments disclosed this time are exemplary in all respects and not restrictive. The scope of the present invention is shown by the scope of claims rather than the above description, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

<Additional Notes>
(1) Preferably, the restriction information is set for each user.
(2) Preferably, the voice setting support device includes a state acquisition means for acquiring the state of the job execution device and a state acquisition means.
With the limiting parameter determining means for determining the parameter corresponding to the process that cannot be executed by the job executing device among the plurality of parameters determined by the parameter determining means based on the state of the job executing device as the limiting parameter. , Further prepare.
(3) Preferably, when the restriction parameter is determined, the job execution device changes the job from an unexecutable state to an executable state according to a plurality of the parameters determined by the parameter determination means. Further provided with a cancellation notification means for notifying the procedure.

1 voice setting system, 3 network, 5 internet, 7 gateway device, 100, 100A-100DMFP, 200 voice setting support server, 300 voice information generation server, 400, 400A-400D smart speaker, 110 main circuit, 201 CPU, 202 ROM , 203 RAM, 204 HDD, 205 communication unit, 206 display unit, 207 operation unit, 210 external storage device, 211 CD-ROM, 251 audio information acquisition unit, 253 parameter determination unit, 255 consistency judgment unit, 257 prohibited group acquisition Unit, 259 priority change unit, 261,261A output control unit, 263 alternative device determination unit, 265 command extraction unit, 267 execution instruction unit, 269 confirmation output control unit, 271 restriction information acquisition unit, 273 restriction determination unit, 281 restriction Notification unit, 283,283A parameter notification unit, 285,285A display control unit, 287 alternative device notification unit, 291 user identification unit, 293 device status acquisition unit.

Claims (15)

A job execution device that executes jobs according to multiple parameters, and
A voice setting system including a voice setting support device for supporting the generation of the job to be executed by the job execution device based on the voice information obtained from the voice.
The voice setting support device includes a parameter determination means for determining a plurality of the parameters based on the voice information, and a parameter determination means.
A prohibited set acquisition means for acquiring a prohibited set for which a combination of a plurality of the parameters is prohibited by the job execution device, and
A voice setting system including a consistency determining means for determining whether or not a plurality of the parameters determined by the parameter determining means include the prohibited set. The voice setting system according to claim 1, further comprising a notification means for notifying by voice that the plurality of parameters include the prohibited set. The voice setting system according to claim 2, wherein the notification means notifies by voice after a predetermined time has elapsed from the acquisition of the voice information. The priority parameter is determined from the plurality of parameters based on the evaluation values for each of the plurality of parameters included in the prohibited set among the plurality of parameters determined by the parameter determination means, and the above-mentioned other than the priority parameters. The voice setting system according to any one of claims 1 to 3, further comprising a priority changing means for changing a parameter. The voice setting system according to claim 4, wherein the priority changing means determines the priority parameter by using the volume at which each of the plurality of parameters determined by the parameter determining means is uttered as the evaluation value. The voice setting system according to claim 4, wherein the priority changing means determines the priority parameter using the order in which the plurality of parameters determined by the parameter determining means are uttered as the evaluation value. The voice setting system according to any one of claims 4 to 6, further comprising a parameter notification means for notifying the priority parameter and the changed parameter other than the priority parameter. Any of claims 4 to 7, further comprising display control means for associating the priority parameter and the changed parameter other than the priority parameter with the corresponding evaluation value and displaying the display on the job execution device. The audio setting system described in. Any of claims 1 to 3, further comprising display control means for displaying a plurality of the parameters included in the prohibited set among the plurality of parameters determined by the parameter determining means on the job execution device so as to be changeable. The audio setting system described in Crab. A claim that the display control means causes the job execution device to display a plurality of the parameters included in the prohibited set among the plurality of parameters determined by the parameter determination means in association with evaluation values corresponding to the respective parameters. The audio setting system according to 9. There are multiple job execution devices,
Execution device determination means for determining an execution device for executing the job from among a plurality of the job execution devices, and
When the plurality of parameters determined by the parameter determination means include the prohibited set acquired from the execution device, a plurality of other job execution devices determined by the parameter determination means. An alternative device determining means for determining an alternative device capable of executing the job according to the parameters,
The voice setting system according to any one of claims 1 to 10, further comprising an alternative device notification means for notifying the alternative device. The voice setting support device includes a restriction information acquisition means for acquiring restriction information that defines a restriction parameter whose setting is restricted among a plurality of the parameters.
The voice setting system according to any one of claims 1 to 11, further comprising a restriction notification means for notifying when the restriction parameter is included in the plurality of determined parameters. The voice setting support device according to any one of claims 1 to 12, further comprising an intermediate server provided between the voice setting support device and the job execution device. A voice setting support device that sets the parameters in a job execution device that executes a job in which a plurality of parameters are set according to the plurality of parameters.
A parameter determining means for determining a plurality of the above parameters based on voice information obtained from voice, and a parameter determining means.
A prohibited set acquisition means for acquiring a prohibited set for which a combination of a plurality of the parameters is prohibited by the job execution device, and
A voice setting support device including a consistency determining means for determining whether or not a plurality of the parameters determined by the parameter determining means include the prohibited set. A voice setting support method executed by a computer that controls a voice setting support device that sets the parameters in a job execution device that executes a job in which a plurality of parameters are set according to the plurality of parameters.
A parameter determination step that determines a plurality of the above parameters based on the voice information obtained from the voice, and
A prohibited set acquisition step for acquiring a prohibited set for which a combination of a plurality of the parameters is prohibited by the job execution device, and a step of acquiring the prohibited set.
A voice setting support program for causing the computer to execute a consistency determination step for determining whether or not a plurality of the parameters determined in the parameter determination step include the prohibited set.

Images