JP7205308B2 - Job generation device, image processing device, job generation method and job generation program - Google Patents

Description

The present invention relates to a job generation device, an image processing device, a job generation method, and a job generation program, and more particularly to a job generation device that generates a job from voice, an image processing device that includes the job generation device, and a job generation device that executes the job generation device. The present invention relates to a job control method and a job generation program that causes a computer that controls the job generation device to execute the job generation method.

2. Description of the Related Art Generally, a multifunction peripheral (hereinafter referred to as "MFP") is installed in an office. The user causes the MFP to execute processes such as printing image data, copying documents, reading documents, storing image data, and transmitting image data. It is common to set the contents of processing as a job as work for causing the MFP to execute processing. Conventionally, a user who requests processing directly sets a job using the operation panel of the MFP, etc. However, in recent years, with the development of voice recognition technology, it has been considered to set a job by voice operation. That is, the MFP analyzes the contents of the user's voice instruction, understands it, and sets it as a job.

Here, even between humans, there is a case where a client requests another acceptor, and in this case, the acceptor operates the MFP to perform the work. The acceptor must set operating conditions for the MFP in order to have the MFP execute the requested work. If the acceptor misunderstands the content of the work transmitted from the requester, or sets the operating conditions to be set in the MFP incorrectly, the work requested by the requester may not be executed by the MFP. be.

Japanese Patent Application Laid-Open No. 2008-085956 discloses a transmission unit that transmits data to a destination that is an external device, and a storage unit that stores at least a history of transmission destinations within a predetermined period in association with transmission request sources. , when a request for data transmission is made by a certain requester, the destination with the highest number of transmissions among the two or more destination histories within the predetermined period corresponding to the certain requester is selected as this and a destination setting unit for defaulting destinations in transmissions. The technique described in Japanese Patent Application Laid-Open No. 2008-085956 can reduce the probability of setting errors when setting the same address as one of the transmission histories with the same source, but if there is a homonym ( For example, "Tamura" and "Tamura" as destinations), the requester may request transmission to destinations different from those to which the requester has sent in the past.

The same thing can happen with voice manipulation. Such problems cannot be solved only by past history information as described in Japanese Patent Application Laid-Open No. 2008-085956.

JP 2008-085956 A

One of the objects of the present invention is to provide a job generating apparatus capable of accurately generating jobs.

Another object of the present invention is to provide an image processing apparatus capable of accurately generating jobs.

Another object of the present invention is to provide a job generation method capable of accurately generating a job.

Another object of the present invention is to provide a job generating program capable of accurately generating jobs.

According to one aspect of the present invention, a job generation device includes job generation means for generating a job that defines processing to be executed by an image processing device based on audio information obtained from audio, and information stored in advance in a storage unit. Determining means for determining whether or not the voice information includes ambiguous information that cannot specify a job, and confirming means for executing an inquiry to the user when the determining means determines that the voice information includes ambiguous information and determination means for determining processing to be executed by the image processing apparatus based on the audio information and information pre-stored in the storage unit, and setting information that defines conditions for executing the processing, wherein the determination means is based on the audio information. When a plurality of candidate information are determined as candidates for setting information based on the Related information related to each piece of candidate information is inquired, and when the setting information is information specifying data to be processed by the image processing apparatus, the related information includes data attributes .

According to this aspect, since the inquiry is made when the voice information obtained from the voice includes ambiguous information, the job can be accurately generated from the voice. As a result, it is possible to provide a job generating apparatus capable of accurately generating jobs.

Further , when a plurality of candidate information are determined as candidates for the setting information based on the voice information and the information stored in advance in the storage unit, it is determined that the voice information includes ambiguous information. It can be easily determined whether or not In addition, since the related information is inquired when the related information related to each of the plurality of candidate information is different from each other, one of the plurality of candidate information can be determined as the setting information. Also, when the setting information is information specifying data, since the attribute of the data is inquired, one of the plurality of candidate information can be determined as the setting information.

Preferably, the information pre-stored in the storage unit is a keyword associated with the setting information.

Preferably, the verification means queries alternative pronunciations or meanings of the ambiguous information.

According to this aspect, when the pronunciation is the same or similar between related information, another pronunciation or meaning is queried, so one of a plurality of candidate information can be determined as setting information.

According to still another aspect of the present invention, a job generating apparatus includes job generating means for generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from audio, and Judgment means for judging whether or not the voice information includes ambiguous information that cannot specify a job based on the information obtained, and executing an inquiry to the user when the judgment means judges that the voice information contains ambiguous information. and a user identification means for identifying a user who has made the utterance, wherein the job generation means generates voice information obtained from the voice identifying the first user by the user identification means and the first user by the user identification means. A requested job that the first user has requested the second user to execute is generated as a job based on the voice information obtained from the voice specified by the different second user.

According to this aspect, the requested job is generated based on the voice information obtained from the voices respectively specifying the first user and the second user. Therefore, since the requested job is generated from conversations of two or more users, the operation for generating the job can be simplified.

According to still another aspect of the present invention, a job generating apparatus includes job generating means for generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from audio, and Judgment means for judging whether or not the voice information includes ambiguous information that cannot specify a job based on the information obtained, and executing an inquiry to the user when the judgment means judges that the voice information contains ambiguous information. confirmation means; and voice information acquisition means for acquiring voice information and identification information for identifying the identified user from a voice collection device that collects voice and identifies the user who uttered the collected voice. The job generating means generates a requested job that the first user has requested the second user to execute, based on the voice information obtained from the voices respectively associated with the first user and the second user different from the first user. Generate as a job.

According to this aspect, the operation for creating a job can be simplified.

Preferably, the requested job is generated when voice information including the requested character string exists in the voice information.

According to another aspect of the present invention, an image processing device includes the job generation device described above.

According to this aspect, it is possible to provide an image processing apparatus that can easily generate a job.

According to still another aspect of the present invention, a job generation method is a job generation method executed by a job generation device, wherein processing to be executed by an image processing device is defined based on audio information obtained from audio. a determination step of determining whether or not the voice information includes ambiguous information that cannot specify the job based on information pre-stored in a storage unit; and a determination step in which the voice information is A confirmation step of executing an inquiry to the user when it is determined that ambiguous information is included, and a setting that defines processing and conditions for executing the processing to be executed by the image processing apparatus based on the voice information and information pre-stored in the storage unit. a determining step of determining the information, wherein the determining step includes determining that the voice information includes ambiguous information when a plurality of candidate information are determined as candidates for the setting information based on the voice information. , the confirming step includes a step of inquiring about the relevant information associated with each of the plurality of candidate information when the associated information associated with each of the plurality of candidate information is different from each other, and the setting information is subject to the processing executed by the image processing apparatus. In the case of information identifying data, related information includes attributes of the data .

According to this aspect, it is possible to provide a job generation method capable of easily generating a job.
According to still another aspect of the present invention, a job generation method is a job generation method executed by a job generation device, wherein the job generation method defines a process to be executed by the image processing device based on audio information obtained from audio. a determination step of determining whether or not the voice information includes ambiguous information that cannot identify the job based on information pre-stored in the storage unit; and a determination step in which the voice information is ambiguous information. and a user identification step of identifying the user who made the utterance. Based on the obtained speech information and the speech information obtained from the speech identifying the second user different from the first user in the user identification step, the requested job requested by the first user to be executed by the second user is regarded as a job. including the step of generating.

According to still another aspect of the present invention, a job generation method is a job generation method executed by a job generation device, wherein the job generation method defines a process to be executed by the image processing device based on audio information obtained from audio. a step of determining whether or not the voice information includes ambiguous information by which the job cannot be specified based on the information pre-stored in the storage unit; and a step of determining whether the voice information is ambiguous information a confirmation step of querying the user if it is determined that the and a voice information obtaining step of obtaining identification information, wherein the job generating step obtains the first user based on the voice information obtained from voices respectively associated with the first user and a second user different from the first user. It includes a step of generating as a job the requested job that the user has requested the second user to execute .

According to still another aspect of the present invention, the job generation program is a job generation program executed by a computer that controls the job generation device, and is executed by the image processing device based on audio information obtained from audio. a job generation step of generating a job defining a process to be performed, a judgment step of judging whether or not the voice information includes ambiguous information that cannot specify the job based on information pre-stored in a storage unit, and a judgment step a confirmation step of querying the user if it is determined that the voice information includes ambiguous information; and causing the computer to execute a determination step of determining setting information that defines a condition, wherein the determining step includes, when a plurality of candidate information are determined as candidates for the setting information based on the voice information, the voice information including ambiguous information. and the confirming step includes the step of inquiring about the relevant information associated with each of the plurality of candidate information, if the relevant information associated with each of the plurality of candidate information is different from each other, and the setting information is executed by the image processing apparatus In the case of information that specifies data to be processed, the relevant information includes attributes of the data .

According to this aspect, it is possible to provide a job generation program capable of easily generating a job.
According to still another aspect of the present invention, the job generation program is a job generation program that is executed by a computer that controls the job generation device, and causes the image processing device to execute the program based on audio information obtained from audio. a job generating step of generating a job that defines processing; a determining step of determining whether or not the voice information includes ambiguous information that cannot identify the job based on information pre-stored in a storage unit; causing the computer to execute a confirmation step of querying the user if the information is determined to include ambiguous information; and a user identification step of identifying the user who made the utterance. Based on the voice information obtained from the voice by which the user is specified and the voice information obtained from the voice by which the second user different from the first user is specified in the user specifying step, the first user instructs the second user to perform It includes a step of generating the requested job as a job.

According to still another aspect of the present invention, the job generation program is a job generation program that is executed by a computer that controls the job generation device, and causes the image processing device to execute the program based on audio information obtained from audio. a job generating step of generating a job that defines processing; a determining step of determining whether or not the voice information includes ambiguous information that cannot identify the job based on information pre-stored in a storage unit; a confirmation step of querying the user if the information is determined to contain ambiguous information; and a speech information acquisition step of acquiring identification information for identification, wherein the job generation step acquires speech obtained from speech respectively associated with the first user and a second user different from the first user. Based on the information, a step of generating as a job the requested job that the first user has requested the second user to execute is included.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows the whole information processing system outline|summary in one of the 1st Embodiment of this invention. 2 is a block diagram showing an example of an overview of the hardware configuration of a PC according to the first embodiment; FIG. 2 is a block diagram showing an overview of the hardware configuration of the MFP according to the first embodiment; FIG. 3 is a block diagram showing an example of functions of a CPU included in the PC according to the first embodiment; FIG. It is a figure which shows an example of a keyword table. 3 is a block diagram showing an example of functions of a CPU included in the MFP according to the first embodiment; FIG. It is a figure which shows an example of a login screen. 4 is a flow chart showing an example of the flow of job generation in the first embodiment; 9 is a flowchart showing an example of the flow of job generation sub-processing; It is a flowchart which shows an example of the flow of a confirmation process. 7 is a flowchart illustrating an example of the flow of job execution processing; 7 is a flowchart showing an example of the flow of execution instruction processing; It is a figure which shows the whole information processing system outline|summary in one of the 2nd Embodiment of this invention. FIG. 10 is a block diagram showing an example of functions of a CPU included in the MFP according to the second embodiment; FIG.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are given the same reference numerals. Their names and functions are also the same. A detailed description thereof will therefore not be repeated.

<First embodiment>
FIG. 1 is a diagram showing an overall overview of an information processing system according to one of the first embodiments of the present invention. Referring to FIG. 1 , information processing system 1 includes an MFP (Multi Function Peripheral) 100 and a personal computer (hereinafter referred to as “PC”) 200 .

MFP 100 is an example of an image processing apparatus. PC 200 is an example of a job generation device and is a general computer. MFP 100 and PC 200 are each connected to network 3 . Network 3 is, for example, a local area network (LAN). Therefore, MFP 100 and PC 200 can communicate with each other via network 3 . PC 200 generates a job defining a process to be executed by MFP 100 . A printer driver program for controlling MFP 100 is installed in PC 200, and by executing the printer driver program, PC 200 can control MFP 100 and cause MFP 100 to execute a job. In the network 3, the form of connection may be wired or wireless. Network 3 may also be a wide area network (WAN), a public switched telephone network (PSTN), the Internet, or the like.

FIG. 2 is a block diagram showing an example of an overview of the hardware configuration of the PC according to the first embodiment. Referring to FIG. 2, PC 200 includes a central processing unit (CPU) 201 for controlling the entire PC 200; A RAM (Random Access Memory) 203 used as a work area for the CPU 201, a hard disk drive (HDD) 204 for storing data in a nonvolatile manner, a communication unit 205 for connecting the CPU 201 to the network 3, and a display unit for displaying information. 206, an operation unit 207 that receives user operation input, a microphone 208, a speaker 209, and an external storage device 210.

CPU 201 downloads a program from a computer connected to the Internet and stores it in HDD 204 . Also, when a computer connected to the network writes a program to HDD 204 , the program is stored in HDD 204 . The CPU 201 loads a program stored in the HDD 204 into the RAM 203 and executes it.

As a software architecture of the CPU 201, an operating system (OS) layer is formed in the CPU 201, and an application layer is formed in the upper layer. Tasks in which the CPU 201 executes an operating system (OS) program belong to the OS layer. Tasks belonging to the OS layer execute processing for controlling hardware resources of the PC 200 . The hardware resources here include ROM 202, RAM 203, HDD 204, communication section 205, display section 206, operation section 207, microphone 208 and external storage device 210. FIG.

Microphone 208 collects sound and converts the collected sound into electrical signals. Microphone 208 outputs to CPU 201 audio data converted from audio into electrical signals.

A CD-ROM (Compact Disk Read Only Memory) 211 is attached to the external storage device 210 . In this embodiment, an example in which CPU 201 executes a program stored in ROM 202 or HDD 204 will be described. However, CPU 201 may control external storage device 210 to read a program for CPU 201 to execute from CD-ROM 211, store the read program in RAM 203, and execute it.

The recording medium for storing programs to be executed by the CPU 201 is not limited to the CD-ROM 211, but may be a flexible disk, a cassette tape, an optical disk (MO (Magnetic Optical Disc)/MD (Mini Disc)/DVD (Digital Versatile Disc). )), an IC card, an optical card, a mask ROM, a semiconductor memory such as an EPROM (Erasable Programmable ROM), or the like. The programs here include not only programs that can be directly executed by the CPU 201, but also source programs, compressed programs, encrypted programs, and the like.

FIG. 3 is a block diagram outlining the hardware configuration of the MFP according to the first embodiment. Referring to FIG. 3, MFP 100 includes main circuit 110, document reading unit 130 for reading a document, automatic document feeder 120 for conveying a document to document reading unit 130, and document reading unit 130. image forming unit 140 for forming an image on paper or the like based on image data read and output, a paper feeding unit 150 for supplying paper to the image forming unit 140, and processing the paper on which the image is formed. and an operation panel 160 as a user interface.

The post-processing unit 155 executes sorting processing for rearranging and discharging one or more sheets on which images have been formed by the image forming unit 140, punching processing for punching holes, and stapling processing for driving staples.

The main circuit 110 includes a CPU 111, a communication interface (I/F) section 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a mass storage device, a facsimile section 116, and a CD-ROM 118. and an external storage device 117 . CPU 111 is connected to automatic document feeder 120 , document reading portion 130 , image forming portion 140 , paper feeding portion 150 , post-processing portion 155 and operation panel 160 , and controls MFP 100 as a whole.

ROM 113 stores a program executed by CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes programs. Further, RAM 114 temporarily stores image data continuously sent from document reading unit 130 .

Communication I/F unit 112 is an interface for connecting MFP 100 to network 3 . CPU 111 communicates with PC 200 via communication I/F section 112 to transmit and receive data. Also, the communication I/F unit 112 can communicate with a computer connected to the Internet 5 via the network 3 .

Facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to or receives facsimile data from the PSTN. Facsimile unit 116 stores the received facsimile data in HDD 115 or outputs it to image forming unit 140 . Image forming unit 140 prints the facsimile data received by facsimile unit 116 on paper. Further, facsimile section 116 converts data stored in HDD 115 into facsimile data and transmits the facsimile data to a facsimile machine connected to the PSTN.

A CD-ROM 118 is attached to the external storage device 117 . CPU 111 can access CD-ROM 118 via external storage device 117 . CPU 111 loads a program recorded on CD-ROM 118 attached to external storage device 117 into RAM 114 and executes the program. The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM 118, and may be semiconductor memory such as an optical disk, an IC card, an optical card, a mask ROM, or an EPROM.

Further, the program executed by CPU 111 is not limited to the program recorded on CD-ROM 118, and a program stored in HDD 115 may be loaded into RAM 114 and executed. In this case, another computer connected to network 3 may rewrite the program stored in HDD 115 of MFP 100 or add and write a new program. Furthermore, MFP 100 may download a program from another computer connected to network 3 and store the program in HDD 115 . The programs here include not only programs directly executable by the CPU 111, but also source programs, compressed programs, encrypted programs, and the like.

Operation panel 160 is provided on the upper surface of MFP 100 and includes display portion 161 and operation portion 163 . The display unit 161 is, for example, a liquid crystal display (LCD) or an organic LE (electroluminescence) display, and displays an instruction menu for the user, information about acquired image data, and the like. Operation portion 163 includes a touch panel 165 and a hard key portion 167 . Touch panel 165 is provided on the upper surface or the lower surface of display unit 161 so as to overlap display unit 161 . Hard key portion 167 includes a plurality of hard keys. A hard key is, for example, a contact switch. Touch panel 165 detects a position designated by the user on the display surface of display unit 161 .

FIG. 4 is a block diagram showing an example of functions of the CPU 201 included in the PC 200 according to the first embodiment. The functions shown in FIG. 4 may be implemented by hardware, or may be implemented by CPU 201 of PC 200 by causing CPU 201 to execute a program stored in ROM 202, HDD 204, or CD-ROM 211. FIG. Here, a case where the CPU 201 provided in the PC 200 is caused to execute the job generation program will be described as an example.

Referring to FIG. 4 , CPU 201 of PC 200 includes voice accepting portion 251 , voice recognizing portion 253 , user identifying portion 255 , job generating portion 257 , and job transmitting portion 259 . Audio reception unit 251 receives audio data output from microphone 208 . Voice accepting portion 251 outputs voice data input from microphone 208 and time information indicating the time when the voice data was input to voice recognition portion 253 and user specifying portion 255 .

Voice data is input from the microphone 208 only while the user is speaking. When a plurality of users converse, voice data of voices uttered by one user and another user are input to voice reception unit 251 . When the period during which one user utters and the period during which another user utters are different, the voice data of the voice uttered by the one user and the voice data of the voice uttered by the other user is entered in Also, when one user intermittently utters, the voice data of the previous voice and the next voice data are input to the voice reception unit 251 in different periods.

Voice recognition unit 253 recognizes the voice specified by the voice data each time voice data and time information are input from voice reception unit 251 . Specifically, the voice recognition unit 253 converts voice data into voice information composed of characters. Techniques for recognizing speech are well known and will not be described again here. Voice recognition portion 253 outputs a set of voice information obtained by converting voice data and time information to job generating portion 257 . When the voice data includes voices of a plurality of users, the voice recognition unit 253 divides the voice data into voice data for each of the plurality of users, and performs voice recognition for each of the plurality of voice data. In this case, speech recognition section 253 outputs a set of speech information and time information to job generation section 257 for each of a plurality of pieces of speech data.

User specifying unit 255 specifies the user who has uttered the voice specified by the voice data each time voice data and time information are input from voice accepting unit 251 . Specifically, HDD 204 stores voiceprint information indicating the voiceprints of each of a plurality of users registered in advance. User identification unit 255 identifies a user by comparing the voice specified by the voice data input from voice reception unit 251 with each of the voiceprints of a plurality of users. Note that the technology for specifying the user who has uttered the voice is well known, so the description will not be repeated here. User identifying portion 255 outputs a set of user identification information for identifying the identified user and time information to job generating portion 257 .

Job generation portion 257 receives a set of voice information and time information from voice recognition portion 253 and receives a set of user identification information and time information from user identification portion 255 . Job generation unit 257 may receive a plurality of sets of voice information and time information and a plurality of sets of user identification information and time information. Job generator 257 uses time information to distinguish between multiple pieces of audio information.

Job generation unit 257 associates the user identification information and the voice information that are paired with the same time information. In other words, job generation unit 257 associates the voice with the user who uttered the voice. Specifically, the job generation unit 257 generates a voice record including voice information converted from voice, user identification information of the user who uttered the voice, and time information indicating the time when the voice was generated. and adds the voice record to the voice table stored in the HDD 204 .

Job generation portion 257 generates a job that defines a process to be executed by MFP 100 and conditions for executing the process based on the voice information input from voice recognition portion 253 . Job generation portion 257 includes determination portion 261 , normal job generation portion 263 , requested job generation portion 265 , and confirmation portion 267 .

The determination unit 261 determines setting information based on the audio information. The setting information is information indicating processing to be executed by MFP 100 and conditions for executing the processing. When the audio information includes a file name for identifying data, the determination unit 261 determines the data specified by the file name included in the audio information as the setting information indicating the data to be processed. Further, determination unit 261 determines setting information based on voice information using a keyword table stored in advance in HDD 204 . The keyword table associates configuration information with keywords associated with the configuration information. A keyword is one of related information related to setting information.

FIG. 5 is a diagram showing an example of a keyword table. The keyword table includes multiple keyword records that associate keywords with setting information. The setting information defines the process to be executed by MFP 100 or the conditions under which MFP 100 executes the process. The keyword record includes keyword items and setting information items. In the keyword record, a keyword is set in the keyword field, and a process name and/or conditions for executing the process are set in the setting information field. As an example of how the keyword table associates a keyword with a process to be executed by MFP 100, a keyword record including the keyword "scan" associates the keyword "scan" with a scan process that causes MFP 100 to read a document. The keyword table may associate one keyword with a process and conditions for executing the process. For example, for a keyword record containing the keyword "2in1", the number of images to be used as the basis for synthesis must be two as a condition for performing synthesis processing for synthesizing a plurality of images for the keyword "2in1". associate. The keyword table may associate multiple processes with one keyword. For example, a keyword record containing the keyword "copy" associates a copy action with the keyword "copy". Copy processing includes scan processing for causing MFP 100 to read a document and print processing for forming an image on paper.

As an example of how the keyword table associates a keyword with a condition for the MFP 100 to execute processing, the keyword "color" is associated with full color as a condition for print processing to be executed by the MFP 100 . As another example, for the keyword "Taro", the e-mail address "taro@aaa.com", which is the destination information assigned to the user as a condition for the MFP 100 to execute the transmission process of transmitting the data, is used. Associate. As the destination information, facsimile numbers and IP addresses are used in addition to e-mail addresses. Note that the keyword "Taro" indicates the name of a pre-registered user.

Returning to FIG. 4 , determination unit 261 includes determination unit 262 . The determination unit 262 determines whether or not the voice information includes ambiguous information that cannot determine the job, based on a plurality of keywords set in the keyword table. Determination unit 261 compares the voice information with a plurality of keywords set in the keyword table, and if there is a keyword that includes at least part of the voice information that is the same as or similar to the keyword, the keyword for which the keyword is set is found. Extract records. The determination unit 261 determines setting information set in the extracted keyword record. Determining portion 261 generates a job defining a process to be executed by MFP 100 based on the determined setting information. Specifically, determination unit 261 generates a job that causes MFP 100 to execute a process determined by the setting information under conditions determined by the setting information.

For example, when the audio information includes keywords “copy” and “full color”, the determination unit 261 determines setting information that defines scan processing and print processing associated with the keyword “copy” from the keyword table, , which determines the conditions for executing full-color scan processing and print processing associated with . In this case, the determination unit 262 determines that one set of setting information is determined from the voice information, and thus determines that the voice information does not include ambiguous information that cannot determine the job. A job that causes MFP 100 to execute a process and a print process of forming an image of full-color image data output by executing scan process on paper in full color is determined.

Further, when the voice information includes the keywords "send" and "Taro", the determining unit 261 specifies the scanning process and the data transmission process associated with the keyword "send" from the keyword table, and the keyword "Taro" from the keyword table. ” is identified that indicates the destination associated with the “. In this case, the determining unit 262 determines that one setting information is determined from the voice information, and thus determines that the voice information does not include ambiguous information that cannot determine the job. and a data transmission process of attaching the monochrome image data output by the scanning process to an e-mail addressed to the e-mail address registered for the user whose name is "Taro" and sending it. A job to be executed by MFP 100 is generated.

The determination unit 261 may determine a plurality of pieces of setting information from one piece of audio information, and may not be able to determine one piece of setting information. If a piece of setting information cannot be determined from the voice information, the determination unit 262 determines that the voice information includes ambiguous information that cannot determine the job. If determination unit 262 determines that the voice information includes ambiguous information, determination unit 261 outputs a confirmation instruction to confirmation unit 267 . The confirmation instruction includes a plurality of pieces of setting information determined from the voice information by determination unit 261 . Hereinafter, each of the plurality of setting information determined from the audio information by the determination unit 261 will be referred to as candidate information.

Although an example in which the determining unit 261 determines setting information from voice information using a keyword table has been described, deep learning technology using a neural network or the like is employed to learn the relationship between voice information and setting information. A model may be generated in advance, and the setting information may be determined from the voice information using the model. Even when this model is used, a plurality of pieces of setting information may be determined from one piece of audio information.

When the determination unit 261 determines a plurality of pieces of candidate information from voice information, the voice information may include setting information. For example, when two pieces of data with the same file name are stored in different storage areas, and the audio information includes the file name, the determination unit 261 selects two pieces of setting information respectively indicating the two pieces of data as candidates. Make an informed decision.

Moreover, when the determination unit 261 determines a plurality of candidate information from the voice information, there are cases where a plurality of keyword records are extracted from the voice information. For example, when noise is superimposed on part of the speech, and the accuracy of speech recognition is lowered, the speech information may include only part of the keyword. In this case, the determination unit 261 may extract multiple keyword records from at least part of the audio information. Specifically, this is the case where the voice information includes "in1" and the part before it is not included in the voice information. In this case, the determining unit 261 extracts a keyword record in which "2in1" is set in the keyword item and a keyword record in which "4in1" is set in the keyword item. The determination unit 261 determines the setting information included in the keyword record in which "2in1" is set and the setting information included in the keyword record in which "4in1" is set in the keyword item as candidate information.

Another example of determining a plurality of setting information from voice information is that voice recognition is normally executed, but there are multiple keyword records in which keywords that are the same as or similar to part of the voice information are set. is the case. More specifically, this is the case where a plurality of keyword records are registered in the keyword table, each of which is set with a plurality of keywords including character strings with the same pronunciation but different meanings. In this case, the multiple keywords include homonyms. Specifically, this is the case where the voice information includes "tamura". In this case, the determination unit 261 extracts keyword records in which “Tamura” is set in the keyword item and keyword records in which “Tamura” is set in the keyword item. The determining unit 261 determines the setting information included in the keyword record in which "Tamura" is set and the setting information included in the keyword record in which "Tamura" is set in the keyword item as candidate information. Also, it is a case where the voice information includes "houl". In this case, the determination unit 261 extracts keyword records in which “hole” is set in the keyword item and keyword records in which “whole” is set in the keyword item. The determination unit 261 determines the setting information included in the keyword record in which "hole" is set and the setting information included in the keyword record in which "whole" is set in the keyword item as candidate information.

Confirmation unit 267 inquires of the user in order to specify one of a plurality of pieces of candidate information included in the confirmation instruction. Confirmation portion 267 includes a related information inquiry portion 271 and a different meaning inquiry portion 273 . The related information inquiry unit 271 inquires the related information related to each of the plurality of candidate information when the related information related to each of the plurality of candidate information included in the confirmation instruction is different from each other. Specifically, related information inquiry unit 271 reproduces a message for inquiring related information from speaker 209 . Related information inquiry unit 271 reproduces a message inquiring about related information, then determines one related information based on the voice information input from voice recognition unit 253, and determines the related information determined from among a plurality of candidate information. Determines a piece of configuration information associated with .

When each of the plurality of pieces of candidate information is information specifying data to be processed by MFP 100, the related information is the attribute of the data. The data attributes include the name of the data storage area, the creation date when the data was created, the update date when the data was updated, or the contents of the data. The related information inquiry unit 271 reproduces a message to inquire about the attribute, which is related information. A user listening to a message asking for a keyword attribute responds by uttering affirmative words to the query if the attribute is correct. When related information inquiry unit 271 receives a positive response, it determines setting information indicating data of the inquired attribute. If the attribute indicated by the message inquiring about the attribute of the keyword is not correct, the user utters a negative word in response to the inquiry, so the related information inquiry unit 271 reproduces a message inquiring about another attribute.

For example, when data with the same file name "AA" are stored in two storage areas "folder A" and "folder B" of the HDD 204, the audio information includes the file name "AA". In this case, the two pieces of candidate information are the file name "AA" stored in "folder A" of HDD 204 and the file name "AA" stored in "folder B" of HDD 204 as data to be processed by MFP 100. AA”, respectively. In this case, the related information inquiry unit 271 inquires about the attributes when the file name "AA" stored in "folder A" and the file name "AA" stored in "folder B" have different attributes. Specifically, the related information inquiry unit 271 asks at least one of the file name "AA" stored in the "folder A" and the file name "AA" stored in the "folder B", the storage area name, the creation date, and so on. Or play a message with modified date. Specifically, the related information inquiry unit 271 asks, "Is the file saved in folder A?", "Is the file created on XX, XX, XX?" Is the file dated XX?" is played.

Further, when a plurality of keywords respectively corresponding to a plurality of pieces of candidate information are partially the same, the related information is the keyword. Related information inquiry unit 271 reproduces a message inquiring about the keyword itself, which is related information. A user who hears a message asking for the keyword itself responds by uttering affirmative words to the inquiry if the keyword is correct. When related information inquiry unit 271 receives a positive response, related information inquiry unit 271 determines setting information related to the inquired keyword. If the keyword indicated by the message inquiring about the keyword itself is not correct, the user utters negative words in response to the inquiry, so the related information inquiry unit 271 reproduces another message inquiring about the keyword itself.

For example, as in the above example, when a keyword record in which "2in1" is set in the keyword item and a keyword record in which "4in1" is set in the keyword item are extracted, the related information inquiry unit 271 , play a "two-in-one?" message, or play a "four-in-one?" message.

Related information is a keyword when some of the pronunciations are the same or similar among a plurality of keywords respectively corresponding to a plurality of pieces of candidate information. For at least one of the plurality of keywords, the different meaning inquiry unit 273 reproduces a message in which the keyword is pronounced in different readings. A user who listens to a message with alternate pronunciations of a keyword responds by uttering affirmative words to the query if the keyword is correct. Upon receiving a positive response, different meaning inquiry portion 273 determines setting information related to the inquired keyword. If the pronunciation indicated by the message is not correct, the user utters a negative word in response to the inquiry, so the different meaning inquiry section 273 inquires of another pronunciation for another keyword.

For example, the different meaning inquiry unit 273 inquires with the kun reading if at least one character that constitutes one of the two keywords is the on-reading, or with the on-reading if the kun reading. For example, if two keyword records are registered in the keyword table with the user names "Tamura" and "Tamura" set in the keyword field, and the voice information includes "Tamura", the keyword Two keyword records in which "Tamura" and "Tamura" are set in the keyword items are extracted. In this case, the different meaning inquiry unit 273 inquires about the two keywords "tamura" and "tamura" with different readings for "ta" and "ta", which are different parts. For example, the different meaning inquiry unit 273 reproduces the message "Is this Tamura reading Oi?" or "Is this Tamura reading Dento?".

In addition, the different meaning inquiry unit 273 inquires with a word in which at least one character constituting either one of the two keywords is combined with another character. For example, the different meaning inquiry unit 273 reproduces a message such as "Is it a little more?" or "Is it a field in the field?".

Also, the different meaning inquiry unit 273 inquires about the meaning of at least one character that constitutes one of the two keywords. For example, the different meaning inquiry unit 273 reproduces the message "Is Tamura showing a lot of meaning?"

Also, for example, when two keyword records are registered in the keyword table with the user names "hole" and "whole" set in the keyword field, if the voice information includes "houl", the keyword Two keyword records in which "hole" and "whole" are set in the keyword item are extracted. In this case, the related information inquiry unit 271 inquires about the two keywords "hole" and "whole" with different readings. Specifically, related information inquiry unit 271 reads out the spellings of the two keywords “hole” and “whole”.

Also, the different meaning inquiry section 273 makes an inquiry by combining at least one word that constitutes one of the two keywords with another word. For example, the different meaning inquiry unit 273 reproduces the message "dig a hole?" for the keyword "hole" or "the whole world?" for the keyword "whole".

Also, the different meaning inquiry unit 273 inquires about the meaning of at least one character that constitutes one of the two keywords. For example, the different meaning inquiry unit 273 reproduces the message "a hollow place in a solid body?" for the keyword "hole". Further, the different meaning inquiry section 273 reproduces the message "entire?" for the keyword "whole".

When generating a job, determination unit 261 determines one or more pieces of user identification information paired with one or more pieces of audio information used to generate the job. For example, if the job is generated based on one or more voice information paired with the user identification of the first user, then the user identification of the first user is determined. If the job is generated based on the one or more voice information paired with the user identification information of the first user and the one or more voice information paired with the user identification information of the second user, the user identification of the first user determining the information and the user identification of the second user; Determining portion 261 outputs a set of a job and one or more pieces of determined user identification information to requested job generating portion 265 and normal job generating portion 263 .

Requested job generation portion 265 receives a set of a job and one or more pieces of user identification information from determination portion 261 and generates a requested job. A requested job is a job that the second user causes MFP 100 to execute in order for the second user, who is the requester, to perform the work requested by the first user, who is the requester, to the second user who is the acceptor. In other words, the requested job is a job whose execution is instructed to MFP 100 by the second user. Therefore, the requested job is a job input from determination unit 261 in which an instruction by the second user is set as a start condition for MFP 100 to execute the process determined by the job.

Requested job generation unit 265 generates voice information including a requested character string among the one or more voice information input from voice recognition unit 253 when there is a plurality of pieces of user identification information included in each of the one or more voice information. Create a request job if exists. The request character string includes words used when requesting work to others. For example, the request character string includes "please", "please", "shiro", and the like. A request character string may be determined in advance. Alternatively, the CPU 201 may determine the request character string by having the CPU 201 learn conversations between a plurality of users using the MFP 100 .

However, requested job generation unit 265 does not generate a requested job if there is no voice information containing a permitted character string among the one or more pieces of voice information input from voice recognition unit 253 . The authorization character string includes words used when receiving a request from another person. The permission string includes "understood", "understood", "accept", and the like. The permission character string may be determined in advance. Also, the permission string may be determined by learning conversations between multiple users of MFP 100 .

When voice information including the requested character string exists, requested job generation unit 265 specifies user identification information paired with the voice information as user identification information of the first user. Further, when there is voice information including the permission character string, requested job generation unit 265 identifies the user identification information paired with the voice information as the user identification information of the second user. Requested job generating portion 265 sets, in the job input from determining portion 261, acceptance of an instruction from the second user as a start condition for MFP 100 to execute a process defined by the job. to generate Requested job generating portion 265 outputs a set of the user identification information of the first user and the requested job to job transmitting portion 259 .

When there is voice information including the permission character string, the requested job generation unit 265 determines voice information paired with the time information indicating a time earlier than the time indicated by the time information paired with the voice information. do. Then, requested job generating section 265 extracts voice information including the requested character string from the determined voice information. As a result, when there is voice information containing a permission character string, it is sufficient to generate a requested job, so there is no need to extract keywords from all of the voice information, and the load can be reduced as much as possible. In this case, it is preferable to start extracting keywords and generating jobs after confirming the presence of voice information containing the permitted character string.

When a job is input from determining portion 261 and the requested job is not to be generated, requested job generating portion 265 outputs a normal generation instruction to normal job generating portion 263 . Normal job generating portion 263 receives a set of a job and one or more pieces of user identification information from determining portion 261 . When a normal generation instruction is input from requested job generation portion 265, normal job generation portion 263 generates a normal job based on the job input from determination portion 261 and one or more pieces of user identification information. A normal job is a job other than a requested job.

Normal job generation portion 263 determines, as an instruction user, a user whose user identification information is associated by voice information including an instruction character string among the one or more pieces of user identification information input from determination portion 261 . The instruction string is a word that indicates the content of the process, such as "want to do", "do", and the like. Further, normal job generating portion 263 may determine, as the instructed user, the user identified by the user identification information having the largest number of keywords among the one or more pieces of user identification information input from determination portion 261 . In this case, using a plurality of pieces of voice information each containing a plurality of keywords used when the determining unit 261 generates a job, the keywords corresponding to each user identification information are aggregated, and the number of keywords corresponding to the user identification information is calculated. You can ask for it. Normal job generation portion 263 generates a normal job by setting, in the job input from determination portion 261, an instruction by the instruction user as a start condition for MFP 100 to execute a process determined by the job. Normal job generating portion 263 outputs the normal job to job transmitting portion 259 . As a result, job transmitting portion 259 transmits the normal job to MFP 100 . In MFP 100 , when a normal job is received from PC 200 , the normal job is stored in HDD 115 , and when the instructing user operates operation unit 163 , the normal job is set to an executable state.

Job transmission portion 259 transmits a job to MFP 100 . When a set of the requested job and the first user's user identification information is input from requested job generating portion 265 , job transmitting portion 259 transmits the set of the requested job and the first user's user identification information to MFP 100 . Further, when a normal job is input from normal job generating portion 263 , job transmitting portion 259 transmits the normal job to MFP 100 .

Job transmission portion 259 includes an operator notification portion 281 . When a set of the requested job and the user identification information of the first user is transmitted to MFP 100 , operator notification portion 281 notifies the second user that the requested job can be executed by MFP 100 . The second user is specified by the user identification information of the second user set as the start condition in the requested job. For example, operator notification unit 281 controls communication unit 205 to send an e-mail including a message indicating that MFP 100 has an executable requested job to the second user. The e-mail address of the second user is pre-stored. Note that the notification method is not limited to e-mail and may be message transmission. Thus, the second user can be notified that he or she should input an operation for causing MFP 100 to execute the requested job.

FIG. 6 is a block diagram showing an example of functions of CPU 111 of MFP 100 according to the first embodiment. The functions shown in FIG. 6 may be realized by hardware, or are functions realized by CPU 111 provided in MFP 100 by executing a job control program stored in ROM 113, HDD 115, and CD-ROM 118. be. The Job Control Program is part of the Job Generator Program. Referring to FIG. 6 , CPU 111 includes an operating user specifying portion 51 , a setting portion 53 , a job control portion 55 and a client notifying portion 57 .

Job control portion 55 includes a job reception portion 81 , an association portion 83 , and a job execution portion 85 . Job receiving portion 81 controls communication I/F portion 112 and receives a job transmitted from PC 200 . When receiving a set of a requested job and the user identification information of the first user from PC 200 , job receiving portion 81 stores the requested job in HDD 115 . When job receiving portion 81 receives a normal job from PC 200 , job receiving portion 81 stores the normal job in HDD 115 .

Association portion 83 associates the requested job with the first user when communication I/F portion 112 receives a set of the requested job and the first user's user identification information from PC 200 . Specifically, association unit 83 generates a user record including job identification information for identifying the requested job stored in HDD 115 and user identification information of the first user, and stores the user record in HDD 115 .

The job execution unit 85 executes jobs by controlling hardware resources. The hardware resources include communication I/F section 112 , HDD 115 , facsimile section 116 , automatic document feeder 120 , document reading section 130 , image forming section 140 , paper feeding section 150 , post-processing section 155 and operation panel 160 . Jobs include, for example, copy jobs, print jobs, scan jobs, facsimile transmission jobs, and data transmission jobs. Jobs that can be executed by job execution unit 85 are not limited to these, and may include other jobs. The copy job includes scan processing for causing document reading unit 130 to read the document, and print processing for causing image forming unit 140 to form an image of data output by document reading unit 130 reading the document. The print job includes print processing for causing image forming portion 140 to form an image of data stored in HDD 115 and print data externally received by communication I/F portion 112 on paper. The scan job includes scan processing for causing document reading unit 130 to read the document, and output processing for outputting image data output by document reading unit 130 reading the document. The output processing includes data storage processing for storing data in HDD 115 and data transmission processing for transmitting data to communication I/F portion 112 to the outside. The facsimile transmission job includes scanning processing for causing document reading unit 130 to read a document, and facsimile transmission processing for causing document reading unit 130 to read and output data from the document and transmit the data to facsimile unit 116 . The data transmission job includes a data transmission process of controlling communication I/F unit 112 to transmit data stored in HDD 115 or data read and output by document reading unit 130 to another computer.

Operating user identification unit 51 identifies an operating user who operates MFP 100 . For example, when a user operates operation panel 160 and the user inputs user identification information to operation unit 163, the user identified by the user identification information input to operation unit 163 is identified as the operating user. Further, when MFP 100 includes a card reader, operating user identification unit 51 allows the user to cause the card reader to read the user identification information stored in the card when the card reader reads the user identification information stored in the card. accept. The operating user identification unit 51 identifies the user identified by the user identification information read by the card reader as the operating user. The card reader may be a magnetic card reader, or may be a wireless communication device that communicates according to the NFC (Near field communication) standard. When specifying the operating user, operating user specifying portion 51 outputs the user identification information of the operating user to setting portion 53 .

When the user identification information of the operating user is input from operating user specifying portion 51 , setting portion 53 stores in HDD 115 a requested job or a normal job whose start condition is set to an instruction by the user of the user identification information. determine whether there is If such a requested job or normal job is stored in HDD 115, setting unit 53 sets the requested job or normal job to an executable state. In particular, when setting the requested job to an executable state, setting portion 53 displays a setting button for accepting an instruction from the second user on display portion 161 . A setting button is assigned a command for executing a requested job.

FIG. 7 is a diagram showing an example of a login screen. Login screen 500 shown in FIG. 7 is displayed on display portion 161 when the second user operates operation portion 163 and MFP 100 identifies the user. Referring to FIG. 7, login screen 500 includes a plurality of selection buttons 503 and a setting button 501 for selecting various processes. Setting button 501 is displayed when the second user operates operation unit 163 and MFP 100 identifies the second user. Accordingly, when no requested job is stored in HDD 115 , login screen 500 does not include setting button 501 . The setting button 501 includes a character string “work request” and a character string “(Mr. XX)”. The character string "(Mr. XX)" includes the first user name, which is the user identification information of the first user. Therefore, the second user who sees the setting button 501 can know that the setting button 501 is a button for enabling the requested job for performing the work requested by the first user. .

Returning to FIG. 6, instead of displaying setting button 501 on display portion 161, setting portion 53 displays job identification information for identifying one or more jobs stored in HDD 115 in a selectable manner. 161 may be displayed. In this case, when a requested job or a normal job is stored in HDD 115, display portion 161 displays job identification information of the requested job and the normal job in a selectable manner. When the user selects the job identification information of the requested job, the setting unit 53 sets the requested job or the normal job to an executable state in the same manner as when the set button is instructed.

Setting unit 53 changes the setting values of the job when accepting an operation to change the setting values of the job set to be executable. Thereby, the second user can change the setting values erroneously set in the requested job to correct values, and can add and set setting values that have not been set.

Also, a predetermined time may elapse after a requested job whose start condition is set to an instruction by the second user is stored in HDD 115 without being executed. In this case, setting unit 53 does not set the requested job to an executable state even when the user identification information of the second user is input from operating user specifying unit 51 . Specifically, setting portion 53 does not display on display portion 161 setting button 501 for accepting the user's instruction to execute the requested job. If the requested job has not been executed after a predetermined period of time has elapsed, there is a high probability that the requested job has become unnecessary. is. Storage resources can be effectively used by deleting unnecessary data.

Job execution portion 85 included in job control portion 55 executes the requested job when accepting the execution operation of the requested job input by the second user to operation portion 163 . In addition, job executing portion 85 executes a normal job when receiving a normal job execution operation input to operation portion 163 by the instructing user. The designated user is identified by the user identification information associated by the association unit 83 with the job identification information of the normal job.

The requester notification unit 57 notifies the first user that the requested job has been executed in response to the execution of the requested job. The first user is identified by the user identification information associated by the association unit 83 with the job identification information of the requested job. The requester notification unit 57 notifies the first user that the requested job has been executed by a method registered in advance. For example, the requester notification unit 57 sends an e-mail message indicating that the requested job has been executed by the second user to a destination registered in advance for the first user.

FIG. 8 is a flow chart showing an example of the flow of job generation according to the first embodiment. Job generation is a process executed by CPU 201 of PC 200 when CPU 201 executes a job control program stored in ROM 202 , HDD 204 or CD-ROM 211 . The Job Control Program is part of the Job Generator Program.

Referring to FIG. 8, CPU 201 provided in PC 200 determines whether or not voice has been received. Specifically, when the CPU 201 accepts audio data output from the microphone 208, it determines that the audio has been accepted. CPU 201 is in a standby state until voice data is received from microphone 208 (NO in step S01), and when voice data is received (YES in step S01), the process proceeds to step S02.

In step S02, CPU 201 recognizes the voice and advances the process to step S03. Specifically, CPU 201 recognizes the voice specified by the voice data accepted in step S01, and converts the voice into voice information composed of characters. In step S03, voice information converted from voice is determined, and the process proceeds to step S04.

In step S04, the user who uttered the voice specified by the voice data is specified, and the process proceeds to step S05. CPU 201 uses the voiceprint information stored in HDD 204 to identify a user by comparing the voice specified by the voice data with the voiceprints of each of a plurality of users. Voiceprint information is information indicating the voiceprints of each of a plurality of users registered in advance. In step S05, CPU 201 generates a voice record and advances the process to step S06. Specifically, CPU 201 generates a voice record including the voice information determined in step S03, the user identification information specified in step S04, and the date and time when the voice data was accepted. A voice record is information that associates voice information converted from voice, user identification information of the user who uttered the voice, and the date and time when the voice was generated. In step S06, the voice record is added to the voice table stored in HDD 115, and the process proceeds to step S07.

In step S07, it is determined whether or not the voice information contains a permitted character string. The permission character string is a predetermined character string including a word used when receiving a request from another person. If the audio information determined in step S03 contains the permitted character string, the process proceeds to step S08; otherwise, the process proceeds to step S13.

In step S08, the user identified in step S04 is determined as the second user, and the process proceeds to step S09. A second user is a user who accepts a work request from the first user.

In step S09, a job generation sub-process is executed, and the process proceeds to step S10. Although the details of the job generation sub-processing will be described later, it is a process of generating a job based on one or more voice records included in the voice table stored in the HDD 204 and determining the first user who requested the work from the second user. is. In step S10, a requested job is generated, and the process proceeds to step S11. A requested job is generated based on the job generated by executing the job generation sub-process and the second user determined in step S08. A requested job is a job for which acceptance of an operation by the second user is set as a condition for starting MFP 100 to execute processing defined by the requested job. Specifically, the requested job is generated by setting the job generated in step S09 to accept the operation by the second user determined in step S08 as a start condition. In the next step S11, CPU 201 controls communication unit 205 to transmit the requested job and the user identification information of the first user to MFP 100, and the process proceeds to step S12. In step S12, the existence of the requested job is notified to the second user, and the process ends. Specifically, an e-mail containing a message indicating that executable requested jobs are stored in MFP 100 and having the e-mail address of the second user set as the destination address is generated, and communication unit 205 generates the e-mail. is sent.

On the other hand, in step S13, it is determined whether or not the voice information contains the designated character string. If the voice information contains the designated character string, the process proceeds to step S14; otherwise, the process returns to step S01. In step S14, the user who uttered the instruction character string is determined as the instruction user, and the process proceeds to step S15. A user identified by the user identification information associated with the voice information by the voice record is determined as the designated user. In step S15, a job generation sub-process is executed, and the process proceeds to step S16.

In step S16, a normal job is generated, and the process proceeds to step S17. A normal job is a job for which acceptance of an operation by an instructing user is set as a condition for starting MFP 100 to execute processing defined by the normal job. Specifically, a normal job is generated by setting the job generated in step S15 as a start condition to accept an operation by the instruction user determined in step S14. In the next step S17, communication unit 205 is controlled to transmit the normal job to MFP 100, and the process proceeds to step S18. In step S18, the instruction user is notified of the existence of the normal job, and the process ends. Specifically, an e-mail containing a message indicating that executable normal jobs are stored in MFP 100 and having the e-mail address of the designated user set as the destination address is generated, and communication unit 205 generates the e-mail. is sent.

FIG. 9 is a flowchart showing an example of the flow of job generation sub-processing. The job generation sub-process is a process executed in steps S09 and S15 of FIG. In step S06 before the job generation sub-process is executed, HDD 115 stores a voice record including voice information including a permission character string and a voice record including voice information including an instruction character string in HDD 115. There are cases. Hereinafter, an audio record including audio information including a permission character string or an audio record including audio information including an instruction character string is referred to as a record to be processed.

Referring to FIG. 9, CPU 201 reads the voice record of the previous time (step S21). Specifically, the CPU 201 includes time information indicating the nearest time earlier than the time indicated by the time information included in the record to be processed among the plurality of voice records included in the voice table stored in the HDD 204. Read voice record. In the next step S22, audio information contained in the audio record is specified.

Then, it is determined whether or not the voice information includes the requested character string (step S23). The request character string includes words used when requesting work to others. A request character string may be determined in advance. If the voice information contains the requested character string, the process proceeds to step S24, otherwise step S24 proceeds to step S25. In step S24, the user who uttered the requested character string is determined as the first user, and the process proceeds to step S25. The user identified by the user identification information included in the voice record read in step S21 is determined as the first user.

In step S25, it is determined whether or not the setting information has been determined from the voice information. When the audio information includes the file name of data to be processed, setting information specifying the data to be processed is determined. If the setting information is determined from the audio information, the process proceeds to step S26; otherwise, the process proceeds to step S28. In step S26, it is determined whether or not a plurality of pieces of setting information have been determined. If a plurality of pieces of setting information have been determined, the process proceeds to step S30; otherwise, the process proceeds to step S34. For example, when a plurality of data with the same file name are stored in different folders, a plurality of pieces of setting information respectively indicating the plurality of data are determined.

In step S28, the voice information is compared with the keyword, and the process proceeds to step S29. Specifically, the pronunciation of at least part of the voice information is compared with the pronunciation of at least part of the keywords registered in the keyword table stored in HDD 204 . In the next step S29, as a result of the comparison, it is determined whether or not there are a plurality of keywords including character strings having the same or similar pronunciation as at least part of the voice information. If multiple keywords exist, the process proceeds to step S27. As a result of the comparison, if there are a plurality of keywords including character strings that are pronounced the same as or similar to at least a part of the voice information, the process proceeds to step S30, and if there is only one, the process proceeds to step S31. In step S31, as a result of the comparison, it is determined whether or not the keyword exists. If the keyword exists, the process proceeds to step S33; otherwise, the process proceeds to step S34.

In step S30, confirmation processing is performed, and the processing proceeds to step S28. Details of the confirmation process will be described later, but this is a process of confirming with the user which one of the plurality of setting information is, and one of the plurality of setting information is determined. In step S31, it is determined whether or not the result of the confirmation process is an error indicating that the setting information has not been determined. If the result of the confirmation process is an error, the process proceeds to step S34, but if not, the process proceeds to step S33. In step S33, setting information is determined, and the process proceeds to step S34. When step S30 is executed, the setting information determined in the confirmation process is determined, and when the process proceeds from step S31, setting information associated with the keyword is set.

In step S34, it is determined whether or not the process is determined based on the setting information determined in step S33. If the process is determined, the process proceeds to step S35; otherwise, the process returns to step S21.

In step S35, a job is generated for causing MFP 100 to execute the process determined by the setting information determined in step S33 under the conditions determined by the setting information determined in step S33, and the process proceeds to step S36. In step S36, it is determined whether the job has been completed. A job may define multiple processes, and a job is considered complete when all of the multiple processes have been defined. If the job is completed, the process returns to the job generation process; otherwise, the process returns to step S21.

FIG. 10 is a flowchart showing an example of the flow of confirmation processing. The confirmation process is a process executed in step S30 of the job generation sub-process. A plurality of pieces of setting information are determined before the confirmation process is executed. Referring to FIG. 10, it is determined whether or not a plurality of setting information define data (step S41). If the plurality of setting information define data to be processed, the process proceeds to step S42; otherwise, the process proceeds to step S46.

In step S42, setting information to be processed is selected, and the process proceeds to step S43. In step S43, the attribute of the data specified by the setting information is inquired, and the process proceeds to step S44. Data attributes include storage area name, creation date or update date. Then, it is determined whether or not an affirmative response has been received (step S44). It is determined whether the voice information corresponding to the voice uttered by the user after the inquiry contains a character string indicating a positive response. A positive response string is, for example, "yes", "correct", and the like. If an affirmative response is received, the process proceeds to step S45; otherwise, the process returns to step S42. In step S45, the setting information selected to be processed in step S42 is determined, and the process returns to the job generation sub-process.

In step S46, it is determined whether or not some of the multiple keywords associated with the multiple setting information are the same. If some of the keywords are the same, the process proceeds to step S47; otherwise, the process proceeds to step S50.

In step S47, a keyword to be processed is selected from a plurality of keywords, and the process proceeds to step S48. In step S48, a keyword is queried, and the process proceeds to step S49. A message asking for the keyword itself is played. Then, it is determined whether or not an affirmative response has been received (step S49). It is determined whether or not the voice information corresponding to the voice uttered by the user after the inquiry includes a character string indicating a positive response (step S49). If an affirmative response is received, the process proceeds to step S45; otherwise, the process returns to step S47. In step S45, the setting information associated with the keyword selected as the processing target in step S47 is determined, and the process returns to the job generation sub-process.

In step S50, it is determined whether or not some of the multiple keywords associated with the multiple setting information are homonyms. If some of the keywords are homonyms, the process proceeds to step S51; otherwise, the process proceeds to step S54. In step S54, an error indicating that the setting information could not be confirmed is set, and the process returns to the job generation sub-process.

In step S51, a keyword to be processed is selected from a plurality of keywords, and the process proceeds to step S52. In step S52, the keyword is queried with a different pronunciation and processing proceeds to step S53. The correctness of the keyword is queried by playing back a message that pronounces the keyword in different readings. It may also be queried whether the keyword is correct by playing back a word that combines the keyword with another letter. Further, an inquiry may be made as to whether or not the keyword is correct by reproducing a message indicating the meaning of the characters indicating the keyword.

Then, it is determined whether or not a positive response has been received (step S53). It is determined whether the voice information corresponding to the voice uttered by the user after the inquiry includes a character string indicating a positive response. If an affirmative response is received, the process proceeds to step S45; otherwise, the process returns to step S51. In step S45, the setting information associated with the keyword selected as the processing target in step S51 is determined, and the process returns to the job generation sub-process.

FIG. 11 is a flowchart illustrating an example of the flow of job execution processing. The job execution process is a function realized by CPU 111 of MFP 100 by executing a job execution program stored in ROM 113 , HDD 115 and CD-ROM 118 . The job executor is part of the job generator. Referring to FIG. 11, CPU 111 of MFP 100 determines whether or not a requested job has been received (step S61). CPU 111 controls communication I/F portion 112 to determine whether or not the requested job and the user identification information of the first user have been received from PC 200 . If the requested job has been received, the process proceeds to step S62; otherwise, the process proceeds to step S63. In step S62, the requested job and the user identification information of the first user received together with the requested job are stored in HDD 115, and the process proceeds to step S63.

In step S63, it is determined whether or not a normal job has been received. CPU 111 controls communication I/F unit 112 to determine whether or not a normal job has been received from PC 200 . If the normal job is received, the process proceeds to step S64; otherwise, the process proceeds to step S65. In step S64, the normal job is stored in HDD 115, and the process proceeds to step S65.

In step S65, it is determined whether operation unit 163 has received an operation input by the user. If the operation has been accepted, the process proceeds to step S66; otherwise, the process returns to step S61. In step S66, the user who operates operation unit 163 is specified, and the process proceeds to step S67. When the user inputs user identification information to operation unit 163, the user identified by the user identification information input to operation unit 163 is identified as the operating user. Further, an operation by the user to cause the card reader to read the user identification information stored in the card is accepted, and the user identified by the user identification information read by the card reader is specified as the operating user.

In step S67, it is determined whether or not there is a requested job corresponding to the specified user. It is determined whether or not a requested job whose start condition is set to the specified user's instruction is stored in HDD 115 . If the requested job exists, the process proceeds to step S68; otherwise, the process proceeds to step S71.

In step S68, it is determined whether or not the elapsed time since the requested job was received is within a predetermined time. If it is within the predetermined time, the process proceeds to step S69, but if the predetermined time has passed, the process ends. If a predetermined time has passed since the requested job was received, there is a high probability that the requested job is no longer needed. Therefore, it is possible to prevent unnecessary requested jobs from being executed.

In step S69, an execution instruction process is executed, and the process proceeds to step S70. Details of the execution instruction process will be described later. In step S70, the first user is notified that the requested job has been executed, and the process ends. The first user is identified using the user identification information stored in HDD 115 in step S62 together with the requested job identified in step S67. For example, an e-mail containing a message indicating that the requested job has been executed by the second user and including the e-mail address of the first user as the destination is generated, and the e-mail is transmitted via communication I/F unit 112. be.

In step S71, it is determined whether or not there is a normal job corresponding to the user identified in step S66. It is determined whether or not a normal job for which the specified user's instruction is set as a start condition is stored in HDD 115 . If the normal job exists, the process proceeds to step S72; otherwise, the process ends. In step S72, it is determined whether or not the elapsed time since the normal job was received is within a predetermined time. If it is within the predetermined time, the process proceeds to step S73; otherwise, the process ends. If a predetermined time has passed since the normal job was received, there is a high probability that the normal job is no longer needed. Therefore, unnecessary normal jobs can be prevented from being executed. In step S73, an execution instruction process is executed, and the process ends. When the execution instruction process is executed, the normal job is targeted for processing, and the normal job is executed.

FIG. 12 is a flowchart illustrating an example of the flow of execution instruction processing. The execution instruction process is a process executed in step S69 or step S73 of FIG. The requested job is determined before the execution instruction process is executed. Referring to FIG. 12, CPU 111 determines whether or not there is a requested job. It is determined whether or not there is a requested job corresponding to the user identified as the user operating MFP 100 (step S81). It is determined whether HDD 115 stores a requested job whose start condition is an instruction from the user who operates MFP 100 . If the requested job exists, the process proceeds to step S83; otherwise, the process proceeds to step S84.

In step S82, a setting button is displayed on display unit 161, and the process proceeds to step S83. The setting button is a button for accepting an operation for setting the requested job to an executable state, and is associated with a command for setting the requested job to an executable state. In step S83, it is determined whether or not the setting button has been instructed. A standby state is established until the setting button is instructed (NO at step S83), and if the setting button is instructed (YES at step S83), the process proceeds to step S85. Note that if the setting button is not instructed even after a predetermined time has elapsed since the setting button was displayed, the process may be terminated.

On the other hand, in step S84, it is determined whether or not the normal job has been selected. With the job selection screen displaying a list of jobs associated with the user operating MFP 100 displayed, it is determined whether or not a normal job has been selected. The process waits until the normal job is selected, and if the normal job is selected, the process proceeds to step S85. Note that the process may proceed to step S85 when a job different from the normal job is selected. Further, the process may be terminated when the normal job is not selected even after a predetermined time has elapsed since the job selection screen was displayed.

In step S85, a setting screen for setting setting values is displayed, and the process proceeds to step S86. In step S86, the process branches depending on the operation input by the user. If the operation input by the user is the execution operation, the process proceeds to step S87, and if the operation is the setting operation, the process proceeds to step S88. An execution operation is an operation for instructing execution of a job. The setting operation is an operation for setting job setting values. In step S88, the setting value is set according to the setting operation, and the process returns to step S86. In step S87, the requested job or normal job is executed, and the process returns to the job execution process.

<First modification>
The requested job generating unit 265 converts the voice information paired with the time information indicating the time earlier than the time indicated by the time information paired with the voice information including the permission character string to the voice used to generate the requested job. Make an informed decision. In this case, the requested job generation unit 265 sets the voice information including the name of the second user to the voice information having the earliest time indicated by the time information among the voice information used for generating the requested job. good too. It suffices to register the nickname of each user in advance. When a first user requests a work from a second user, the work is often requested after uttering the name of the second user. Therefore, the audio information used for generating the requested job can be narrowed down based on the time information. Therefore, the number of pieces of audio information to be processed can be minimized, and the load on the CPU 201 can be reduced.

Note that the requested job generation unit 265 performs the processing based only on a plurality of pieces of voice information corresponding to times between the time corresponding to the voice information including the name of the second user and the time corresponding to the voice information including the permission character string. It may not be possible to create a requested job. In this case, the requested job generation unit 265 uses the voice information paired with the time information indicating the time before the time indicated by the time information paired with the voice information including the nickname of the second user. Generate a job.

As described above, in information processing system 1 according to the first embodiment, PC 200 functions as a job generation device, and generates a job defining processing to be executed by MFP 100 based on voice information obtained from voice. , if the voice information contains ambiguous information that cannot determine the job. Therefore, it is possible to provide a job generating apparatus that can easily generate a job.

PC 200 determines that the voice information includes ambiguous information when determining a plurality of candidate information as setting information candidates for determining the processing to be executed by MFP 100 and the conditions for executing the processing based on the voice information. Therefore, it can be easily determined whether or not the voice information is ambiguous information.

In addition, when the related information related to each of the plurality of candidate information is different from each other, the PC 200 inquires the related information related to each of the plurality of candidate information. can be done.

When the setting information specifies data to be processed by MFP 100, PC 200 stores the name of the storage area in which the data is stored, the creation date when the data is created, the update date when the data is updated, or the data Query the contents of as related information. Therefore, one of the plurality of candidate information can be determined as the setting information.

In addition, when the pronunciation is the same or similar between a plurality of keywords that are related information related to a plurality of candidate information, the PC 200 inquires about different pronunciations or meanings of each of the plurality of keywords. Therefore, one of the plurality of candidate information can be determined as the setting information.

Also, PC 200 generates a requested job based on voice information obtained from voices specifying the first user and the second user. Therefore, since the requested job is generated from conversations of two or more users, the operation for generating the requested job can be simplified.

<Second Embodiment>
FIG. 13 is a diagram showing an overall outline of an information processing system in one of the second embodiments of the present invention. Referring to FIG. 13 , information processing system 1 in the second embodiment includes MFP 100 , PC 200 and smart speaker 250 . MFP 100 in the second embodiment functions as an image processing apparatus as well as a job generation apparatus as does MFP 100 in the first embodiment.

Smart speaker 250 includes a microphone, a speaker, and a wireless LAN interface. The smart speaker 250 functions as an output device that generates sound from the speaker, and also functions as an input device that receives sound collected by a microphone. An access point (AP) 9 is a relay device having a wireless communication function and is connected to the network 3 . Smart speaker 250 is connected to network 3 by communicating with AP9. Therefore, smart speaker 250 can communicate with MFP 100 and PC 200 .

A gateway (G/W) device 7 is connected to the network 3 and the Internet 5 . Gateway device 7 relays network 3 and Internet 5 . A cloud server 300 is connected to the Internet 5 . Therefore, each of MFP 100 , PC 200 and smart speaker 250 can communicate with cloud server 300 via gateway device 7 .

Cloud server 300 functions as an AI (Artificial Intelligence) assistant for smart speaker 250 . An AI assistant provided in the cloud server 300 is registered in the smart speaker 250 in advance. The smart speaker 250 converts sound collected by the microphone into sound data, which is electronic data, and transmits the sound data to the cloud server 300 . In addition, the smart speaker 250 converts electronic data transmitted from the cloud server 300 into voice and outputs the voice from the speaker.

The cloud server 300 uses the smart speaker 250 as a user interface, recognizes the user's voice collected by the smart speaker 250, and converts it into voice information.

The cloud server 300 also has a user identification function. The cloud server 300 is associated with the smart speaker 250 and registered in advance with the voiceprint of the user who operates the smart speaker 250 . The cloud server 300 compares the voice collected by the smart speaker 250 with the voiceprint of the registered user to identify the user from the voice. Thus, cloud server 300 identifies the user who uttered the sound based on the sound collected by smart speaker 250 .

Furthermore, cloud server 300 is installed with an application program that controls MFP 100 , and transmits to MFP 100 voice information obtained by converting the user's voice and user identification information of the user who uttered the voice.

It should be noted that the AI assistant possessed by cloud server 300 and the operations of application programs registered in cloud server 300 are not limited to the operations described above, and other operations may be performed.

FIG. 14 is a block diagram showing an example of functions of a CPU included in the MFP according to the second embodiment. The functions shown in FIG. 14 are realized by CPU 111 of MFP 100 by executing a job generation program stored in ROM 113 , HDD 115 and CD-ROM 118 . Referring to FIG. 14, the functions different from those shown in FIG. 6 are that voice information acquiring portion 71, job generating portion 73 and operator notifying portion 59 are added, and job receiving portion 81 is replaced with job receiving portion 81A. This is the point that has been changed. Since other functions are the same as those shown in FIG. 6, the description will not be repeated here.

Voice information acquisition unit 71 acquires voice information and user identification information from cloud server 300 . Specifically, voice information acquisition portion 71 controls communication I/F portion 112 to acquire voice information and user identification information that communication I/F portion 112 receives from cloud server 300 . Voice information acquiring portion 71 outputs a set of voice information and user identification information to job generating portion 73 .

Job generator 73 has the same function as job generator 257 of CPU 201 of PC 200 in the first embodiment. That is, job generating portion 73 generates the requested job and determines the first user based on the voice information and user identification information received from cloud server 300 . Job generation portion 73 outputs the requested job and the user identification information of the first user to job control portion 55 . Job generation portion 73 also generates a normal job based on the voice information and user identification information received from cloud server 300 and outputs the normal job to job control portion 55 . Job accepting portion 81A of job control portion 55 accepts the requested job and the user identification information of the first user when job creating portion 73 creates the requested job, and accepts the normal job when job creating portion 73 creates the normal job. accept jobs.

Operator notification unit 59 has the same function as operator notification unit 281 of CPU 201 of PC 200 in the first embodiment. That is, when job generating portion 73 generates a requested job, operator notifying portion 59 notifies second user that the requested job can be executed by MFP 100 .

In information processing system 1 according to the second embodiment, cloud server 300 has part of the functions of PC 200 of information processing system 1 according to the first embodiment, and MFP 100 has the other part of the functions of PC 200 . has. Therefore, the system can be simplified because the PC 200 does not need to be used.

Note that the smart speaker 250 may have the functions of the cloud server 300 . That is, if smart speaker 250 has voice recognition and voice authentication functions, MFP 100 can acquire voice information and user identification information from smart speaker 250 . In this case, the cloud server 300 is unnecessary, so the system configuration can be simplified.

<Second modification>
MFP 100 in the second embodiment may be provided with a microphone. In this case, CPU 111 included in MFP 100 has voice reception unit 251, voice recognition unit 253, and user identification unit 255 among the functions of CPU 201 included in PC 200 in the first embodiment shown in FIG. This eliminates the need for the smart speaker 250 and the cloud server 300, thereby simplifying the system configuration.

<Third Modification>
In the second embodiment, cloud server 300 transmits to MFP 100 voice information obtained by converting the user's voice and user identification information of the user who uttered the voice. In the third modification, voice data representing the user's voice is directly transmitted from smart speaker 250 to MFP 100 . Audio data may be transmitted from smart speaker 250 to MFP 100 via cloud server 300 . In this case, CPU 111 included in MFP 100 has voice reception unit 251, voice recognition unit 253, and user identification unit 255 among the functions of CPU 201 included in PC 200 in the first embodiment shown in FIG.

As described above, in the information processing system 1 according to the second embodiment, the MFP 100 functions as a job generation device and as an image processing device. Also, the MFP 100 generates a job defining a process to be executed by the MFP 100 based on the voice information obtained from the voice, and inquires when the voice information includes ambiguous information that cannot determine the job. Therefore, jobs can be easily generated. The MFP 100 according to the second embodiment can achieve the same effects as the PC 200 according to the first embodiment.

In addition, since MFP 100 receives voice information obtained by converting the user's voice and user identification information of the user who uttered the voice from cloud server 300, the system configuration can be simplified and the load on MFP 100 can be reduced. can be done.

It should be considered that the embodiments disclosed this time are illustrative in all respects and not restrictive. The scope of the present invention is indicated by the scope of the claims rather than the above description, and is intended to include all modifications within the meaning and range of equivalents of the scope of the claims.

<Appendix>
(1) Preferably, the attributes of the data include a storage area name in which the data is stored, a creation date when the data is created, an update date when the data is updated, or contents of the data.
(2) Preferably, the setting information includes destination information indicating a data transmission destination when the processing to be executed by the image processing apparatus is data transmission processing for transmitting data.
(3) Preferably, the setting information includes image processing conditions when the processing to be executed by the image processing apparatus is image processing.

1 information processing system, 3 network, 5 Internet, 7 gateway device, 300 cloud server, 100 MFP, 200 PC, 250 smart speaker, 51 operating user identification unit, 53 setting unit, 55 job control unit, 57 requester notification unit, 59 operator notification unit, 71 voice information acquisition unit, 73 job generation unit, 81 job reception unit, 81A job reception unit, 83 association unit, 85 job execution unit, 110 main circuit, 111 CPU, 112 communication I/F unit , 113 ROM, 114 RAM, 115 HDD, 116 facsimile section, 117 external storage device, 120 automatic document feeder, 130 document reading section, 140 image forming section, 150 paper feeding section, 155 post-processing section, 160 operation panel, 161 display unit, 163 operation unit, 165 touch panel, 167 hard key unit, 201 CPU, 202 ROM, 203 RAM, 204 HDD, 205 communication unit, 206 display unit, 207 operation unit, 208 microphone, 209 speaker, 210 external storage device, 251 voice reception unit, 253 voice recognition unit, 255 user identification unit, 257 job generation unit, 259 job transmission unit, 261 determination unit, 262 determination unit, 263 normal job generation unit, 265 requested job generation unit, 267 confirmation unit, 269 Confirmation unit 271 Related information inquiry unit 273 Difference inquiry unit 281 Operator notification unit 500 Login screen.

Claims (13)

a job generating means for generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from audio;
determination means for determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
confirmation means for executing an inquiry to a user when the determination means determines that the voice information includes the ambiguous information;
determining means for determining the processing to be executed by the image processing device and setting information that defines conditions for executing the processing based on the audio information and the information stored in advance in the storage unit;
the determining means determines that the voice information includes the ambiguous information when a plurality of candidate information are determined as candidates for the setting information based on the voice information;
said confirmation means inquires about said related information related to each of said plurality of candidate information when related information related to each of said plurality of candidate information is different from each other;
When the setting information is information specifying data to be processed by the image processing apparatus, the related information includes an attribute of the data . 2. The job generating apparatus according to claim 1 , wherein said information pre-stored in said storage unit is a keyword associated with said setting information. 3. The job generation apparatus according to claim 1, wherein said confirmation means inquires for alternative pronunciations or meanings of said ambiguous information. a job generating means for generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from audio;
determination means for determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
confirmation means for executing an inquiry to a user when the determination means determines that the voice information includes the ambiguous information;
and user identification means for identifying the user who made the utterance,
The job generating means obtains the voice information obtained from the voice specifying the first user by the user specifying means and the voice specifying the second user different from the first user by the user specifying means. A job generating device that generates, as the job, a requested job that the first user has requested the second user to execute based on the voice information. a job generating means for generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from audio;
determination means for determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
confirmation means for executing an inquiry to a user when the determination means determines that the voice information includes the ambiguous information;
voice information acquisition means for acquiring the voice information and identification information for identifying the specified user from a voice collection device that collects voice and identifies the user who uttered the collected voice,
The job generating means, based on the voice information obtained from voices respectively associated with a first user and a second user different from the first user, the first user requests the second user to execute A job generation device that generates a requested job as the job. 6. The job generating apparatus according to claim 4 , wherein said requested job is generated when said voice information including a requested character string exists in said voice information. An image processing apparatus comprising the job generation apparatus according to any one of claims 1 to 6 . A job generation method executed by a job generation device,
a job generating step of generating a job defining a process to be executed by the image processing apparatus based on the audio information obtained from the audio;
a determination step of determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
a confirmation step of querying a user if the audio information is determined to include the ambiguous information in the determination step;
a determination step of determining the processing to be executed by the image processing device based on the audio information and the information stored in advance in the storage unit and setting information that defines conditions for executing the processing;
the determining step includes determining that the voice information includes the ambiguous information when a plurality of candidate information are determined as candidates for the setting information based on the voice information;
The confirming step includes inquiring the related information related to each of the plurality of candidate information when the related information related to each of the plurality of candidate information is different from each other;
When the setting information is information specifying data to be processed by the image processing apparatus, the related information includes an attribute of the data . A job generation method executed by a job generation device,
a job generation step of generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from the audio;
a determination step of determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
a confirmation step of querying a user if the audio information is determined to include the ambiguous information in the determination step;
a user identification step of identifying the user who made the utterance;
The job generating step includes the voice information obtained from the voice that identifies the first user in the user identifying step and the voice that identifies the second user different from the first user in the user identifying step. A job generating method, comprising: generating, as the job, a requested job requested by the first user to be executed by the second user based on the voice information. A job generation method executed by a job generation device,
a job generation step of generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from the audio;
a determination step of determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
a confirmation step of querying a user if the determination step determines that the voice information includes the ambiguous information;
a voice information acquisition step of acquiring the voice information and identification information for identifying the identified user from a voice collection device that collects voice and identifies the user who uttered the collected voice;
The job generating step is requested by the first user to be executed by the second user based on the voice information obtained from voices respectively associated with a first user and a second user different from the first user. A job generation method, comprising the step of generating a requested job as the job . A job generation program executed by a computer that controls a job generation device,
a job generating step of generating a job defining a process to be executed by the image processing apparatus based on the audio information obtained from the audio;
a determination step of determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
a confirmation step of querying a user if the audio information is determined to include the ambiguous information in the determination step;
and a determination step of determining the processing to be executed by the image processing device based on the audio information and the information stored in advance in the storage unit, and setting information that defines conditions for executing the processing. ,
the determining step includes determining that the voice information includes the ambiguous information when a plurality of candidate information are determined as candidates for the setting information based on the voice information;
The confirming step includes inquiring the related information related to each of the plurality of candidate information when the related information related to each of the plurality of candidate information is different from each other;
When the setting information is information specifying data to be processed by the image processing apparatus, the related information is a job generating program including attributes of the data . A job generation program executed by a computer that controls a job generation device,
a job generation step of generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from the audio;
a determination step of determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
a confirmation step of querying a user if the determination step determines that the voice information includes the ambiguous information;
causing the computer to perform a user identification step of identifying the user who made the utterance;
The job generating step includes the voice information obtained from the voice that identifies the first user in the user identifying step and the voice that identifies the second user different from the first user in the user identifying step. A job generation program comprising the step of generating, as the job, a requested job that the first user requested the second user to execute based on the voice information. A job generation program executed by a computer that controls a job generation device,
a job generation step of generating a job that defines processing to be executed by the image processing apparatus based on audio information obtained from the audio;
a determination step of determining whether or not the voice information includes ambiguous information that cannot specify the job, based on information stored in advance in a storage unit;
a confirmation step of querying a user if the determination step determines that the voice information includes the ambiguous information;
a voice information acquisition step of acquiring voice information and identification information for identifying the identified user from a voice collection device that collects voice and identifies a user who uttered the collected voice; let
The job generating step is requested by the first user to be executed by the second user based on the voice information obtained from voices respectively associated with a first user and a second user different from the first user. A job generation program comprising a step of generating a requested job as the job.

Images