JP2021163074A - Information processing apparatus and program - Google Patents

Abstract

To provide a technique that can collect a user's wide variety of preferences and demands as logs.SOLUTION: A CPU 410 executes voice detail recognition processing of recognizing the details of a voice input by a user of a printer 200 uttering a voice, from a smart speaker 300 that is connected through a network IF 480 and inputs and outputs a voice, acquisition processing of, when a term related to the setting of the printer 200 is included in the recognized details of the voice, acquiring the print setting of the printer 200 from the printer 200, and log information storage processing of associating the recognized details of the voice with the acquired print setting of the printer 200 and storing them in a storage unit 420 as log information related to the setting of the printer 200.SELECTED DRAWING: Figure 4

Description

The present application relates to a technique for controlling an image forming apparatus by voice.

Patent Document 1 describes a configuration in which an operation history of a user with respect to an operation screen is recorded, and the operation screen is changed by using the operation history.

Japanese Unexamined Patent Publication No. 2020-21354

However, in the configuration described in Patent Document 1, since only the user's operation information for the operation screen is collected as a log, the user's preference and request beyond the operation screen cannot be collected as a log.

An object of the present application is to provide a technique capable of collecting a wide range of user preferences and requests as a log.

In order to achieve the above object, the information processing device of the present application includes a communication interface, a storage device, and a control device, and the control device is a smart speaker that inputs and outputs voice connected via the communication interface. Therefore, when the voice content recognition process for recognizing the content of the voice input by the user of the image forming apparatus and the recognized voice content include terms related to the setting of the image forming apparatus. , The acquisition process of acquiring the setting information of the image forming apparatus from the image forming apparatus, the content of the recognized sound, and the acquired setting information of the image forming apparatus are associated with each other, and stored as log information regarding the setting of the image forming apparatus. Executes log information storage processing stored in the device.

The techniques disclosed in the present specification can be realized in various forms, for example, an information processing method, a control method of an image forming apparatus, a function of the apparatus, or a computer program for realizing the above method. , A recording medium on which the computer program is recorded, and the like.

According to the present application, it is possible to collect a wide range of user preferences and requests as a log.

It is a block diagram which shows the structure of the image formation system which concerns on one Embodiment of this application. It is a sequence diagram of the print control process executed by the image formation system of FIG. It is a continuation sequence diagram of the sequence diagram of FIG. It is a figure which shows an example of the data which is stored as log information.

Hereinafter, embodiments of the present application will be described in detail with reference to the drawings.

FIG. 1 shows the configuration of the image forming system 1000 according to the embodiment of the present application. The image forming system 1000 is mainly composed of a repeater 100, a printer 200, a smart speaker 300, and an application server 400. In the image forming system 1000 of the present embodiment, the repeater 100, the printer 200, and the smart speaker 300 are used by the same user.

The access point 50 used in the image forming system 1000 realizes a function as a wireless LAN access point by using, for example, a communication method according to the standard of IEEE802.11a / b / g / n. The access point 50 is connected to the LAN 70. The LAN 70 is, for example, a wired network constructed in accordance with the Ethernet (registered trademark) standard. The LAN 70 is connected to the Internet 80. The application server 400 is connected to the Internet 80.

The repeater 100 is a device that relays data transmitted and received between the application server 400 and the printer 200. The repeater 100 communicates with the CPU 110 for controlling the entire repeater 100, the memory 120 such as ROM, RAM, and NVM, the Bluetooth (registered trademark) IF160 for P2P communication with the printer 200, and the application server 400. It mainly has a wireless LAN IF180 for the purpose. The repeater 100 is composed of, for example, a mobile terminal such as a smartphone. NVM is an abbreviation for non-volatile memory, P2P is an abbreviation for Peer to Peer, and IF is an abbreviation for Interface.

The memory 120 includes a data storage area 122 and a control program area 124. The data storage area 122 is an area for storing data or the like required when the CPU 110 executes a control program or the like. The control program area 124 is an area for storing the OS, control program, firmware, and the like.

The Bluetooth IF160 includes an antenna and is an interface for performing short-range wireless communication conforming to the Bluetooth method. The repeater 100 is communicably connected to the printer 200 via Bluetooth IF160. The wireless LAN IF180 includes an antenna and performs wireless communication using, for example, a communication method according to the standard of IEEE802.11a / b / g / n. As a result, the repeater 100 is connected to the LAN 70 and the Internet 80 via the access point 50, and is communicably connected to the application server 400. When the printer 200 is provided with a wireless LAN IF, the repeater 100 may be configured to be communicably connected to the printer 200 via the wireless LAN IF 180.

The printer 200 includes, for example, a control unit 210 including a CPU and a memory, a printing mechanism 250 that prints under the control of the control unit 210, and a Bluetooth IF 260. The printing mechanism 250 is a mechanism for printing an image on a sheet, and is a printing mechanism such as an electrophotographic method, an inkjet method, or a thermal method. The Bluetooth IF260 includes an antenna and is an interface for performing short-range wireless communication conforming to the Bluetooth method, and is used for communication with the repeater 100 as described above. The printer 200 may be provided with a wireless LAN IF instead of the Bluetooth IF 260 and may be configured to be communicably connected to the repeater 100.

When the printer 200 is not provided with the wireless LAN IF, the printer 200 is communicably connected to the repeater 100, but cannot directly communicate with the application server 400.

The smart speaker 300 is a device that executes a specific process according to the voice spoken by the user. The specific process includes, for example, a process of generating voice data and transmitting it to the application server 400. The smart speaker 300 includes a control unit 310 including a CPU and a memory, an audio input / output unit 350, a Bluetooth IF 360, and a wireless LAN IF 380.

The audio input / output unit 350 includes a speaker and a microphone, and executes processing related to audio input and audio output. For example, the voice input / output unit 350 detects the voice spoken by the user according to the control of the control unit 310, and generates voice data indicating the voice. Further, the voice input / output unit 350 generates a voice corresponding to the received voice data from the speaker.

The wireless LAN IF380 includes an antenna and performs wireless communication using, for example, a communication method according to the standard of IEEE802.11a / b / g / n. As a result, the smart speaker 300 is connected to the LAN 70 and the Internet 80 via the access point 50, and is communicably connected to the application server 400.

The application server 400 is, for example, a server operated by a business operator that provides a so-called cloud service. The application server 400 includes a CPU 410 that controls the entire application server 400, and a storage unit 420 that includes a ROM, a RAM, an HDD, an SSD, an optical disk drive, and the like. The application server 400 further includes a network IF480 for connecting to the Internet 80. Although the application server 400 is conceptually shown as one server in FIG. 1, it is actually a so-called cloud server including a plurality of servers connected to each other so as to be able to communicate with each other.

The storage unit 420 includes a data storage area 422 and a program storage area 424. The data storage area 422 functions as a storage area for storing data and the like required when the CPU 410 performs processing, and as a buffer area for temporarily storing various intermediate data generated when the CPU 410 performs processing. do. The program storage area 424 is an area for storing an OS, an information processing program, various other applications, firmware, and the like. The information processing program includes a voice analysis program 424a and a print-related program 424b. The voice analysis program 424a is provided, for example, by being uploaded to the application server 400 by the operator of the application server 400. The print-related program 424b is provided by being uploaded to the application server 400 by, for example, a business operator that provides a print service using the resources of the application server 400, for example, a business operator that manufactures the printer 200. Note that all or part of the voice analysis program 424a may be provided by a business operator that manufactures the printer 200. Alternatively, all or part of the print-related program 424b may be provided by the operator operating the application server 400.

The application server 400, particularly the CPU 410, functions as a voice analysis processing unit 424a'(see FIG. 2) by executing the voice analysis program 424a. The voice analysis processing unit 424a'executes voice recognition processing and morphological analysis processing. The voice recognition process is a process of analyzing voice data and generating text data indicating the content of an utterance indicated by the voice data. The morphological analysis process analyzes the text data, extracts constituent units (called morphemes) such as words included in the content of the utterance, and specifies the type of the extracted morpheme (for example, the type of part of speech). It is a process.

Further, the application server 400, particularly the CPU 410, functions as a print-related processing unit 424b'(see FIG. 2) by executing the print-related program 424b. The print-related processing unit 424b'executes a process of generating a command for instructing the printer 200 to operate using the text data obtained by analyzing the voice data.

2 and 3 show a sequence of print control processes performed by the image forming system 1000. The print control process is a process in which the smart speaker 300 and the application server 400 cooperate with each other to cause the printer 200 to perform printing.

The print control process of FIGS. 2 and 3 shows the process after the predetermined preprocess is executed. The preprocessing is that the user first accesses the smart speaker 300 using a terminal device not included in the image forming system 1000, for example, a smartphone or a PC, and a user ID and a voiceprint are stored in the memory included in the control unit 310. To register. Next, the user sets the repeater 100, the printer 200, and the smart speaker 300 so that data can be correctly transmitted and received between the application server 400 and the printer 200. Further, the user instructs the printer 200 to print using the printing application installed in the terminal device. By executing such preprocessing, the user receives the print result from the printer 200 and is in a state of being dissatisfied or having a request for the print result.

In FIG. 2, the user first speaks in S2. Since the user felt that the print result was a little lighter than his intended density, he asked the smart speaker 300, for example, "Is it a little darker?" The print control process starts when the smart speaker 300 detects the spoken voice.

In S4, the smart speaker 300 generates voice data indicating the voice spoken by the user. That is, when the voice "Is it a little darker?" Is input to the smart speaker 300, the smart speaker 300 generates voice data indicating the voice.

Next, in S6, the smart speaker 300 transmits the voice data and the registered user ID to the voice analysis processing unit 424a'of the application server 400. A known protocol, such as HTTP, is used to transmit the voice data.

When the application server 400 receives the voice data and the user ID, in S8, the voice analysis processing unit 424a'of the application server 400 analyzes the received voice data. Specifically, the voice analysis processing unit 424a'executes voice recognition processing on the voice data and generates text data indicating the voice indicated by the voice data. For example, when the voice data indicating the voice "is it a little darker?" Is received, the voice analysis processing unit 424a'generates text data indicating the content of the voice. The speech analysis processing unit 424a' further executes morphological analysis processing on the text data. As a result, words such as "a little more", "darker", and "become?" Are extracted from the generated text data, and the part of speech types (for example, nouns and verbs) of these words are specified. .. The voice analysis processing unit 424a'generates a list in which the extracted words are associated with the part of speech type as the morphological analysis result.

Next, in S10, the voice analysis processing unit 424a'passes the generated text data, the morphological analysis result, and the user ID received from the smart speaker 300 to the print-related processing unit 424b'. Specifically, the voice analysis processing unit 424a'stores the text data, the morphological analysis result, and the user ID in a predetermined area in the data storage area 422, and calls the print-related program 424b.

Upon receiving the text data, the morphological analysis result, and the user ID from the voice analysis processing unit 424a', the print-related processing unit 424b' uses the text data and the morphological analysis result in S12 to perform the next content. Execute the process to determine. Specifically, in the print-related processing unit 424b', the change from "a little more" is small, and from "dark", the setting parameter item is the density parameter, and the direction of further change is Recognize that it is an increasing direction and that it is inquiring whether it is possible from "become?". Then, from this recognition result, the print-related processing unit 424b'recognizes that the content of the user's utterance is "to increase the value of the density parameter in a direction slightly darker than the current value", and for that purpose, first, the printer 200 is asked. It is determined that the current setting value of the concentration parameter is to be queried. Then, the print-related processing unit 424b'generates a command (hereinafter referred to as "current setting request command") for inquiring the current setting value of the density parameter.

Next, in S14, the print-related processing unit 424b'transmits the current setting request command to the repeater 100. The repeater 100 transmits the received current setting request command as it is to the printer 200 in S16.

When the printer 200 receives the current setting request command, in S18, the printer 200 transmits a response including the current setting value of the density parameter and the model name of the printer 200 (hereinafter referred to as “current setting response”) to the repeater 100.

The repeater 100 transmits the received current setting response as it is to the application server 400 in S20. The print-related processing unit 424b'of the application server 400 executes processing based on the received current setting response in S22. Specifically, for example, it is assumed that the current setting response includes "5" as the current setting value of the concentration parameter. The application server 400 stores, for example, information on all setting parameters for each of the various image forming devices including the printer 200 in the data storage area 422. The print-related processing unit 424b'acquires the maximum value that can be set as the density parameter from the information of all the setting parameters of the image forming apparatus that matches the model name included in the current setting response, that is, the printer 200. Assuming that the maximum value is, for example, "10", the print-related processing unit 424b'knows that the value of the density parameter can be further increased by "5" steps from the current value "5". Therefore, the print-related processing unit 424b'generates text data that is the basis of the voice data for notifying the fact. For example, the print-related processing unit 424b'selects "5" and "can be darkened" and "2" for a small degree, and "can be darkened by 5 more steps. Should I make it darker by 2 steps and reprint?" Generate text data for. Then, the print-related processing unit 424b'passes the generated text data to the voice analysis processing unit 424a' in S24.

Next, in S26, the voice analysis processing unit 424a'creates voice data based on the text data. Then, the voice analysis processing unit 424a'transmits the created voice data to the smart speaker 300 in S28 of FIG.

Next, in S30, the smart speaker 300 generates the received voice data as voice. The user who hears this voice utters, for example, "OK" in S32. Alternatively, for example, the utterance may be "make it darker by one step". In response to this, the smart speaker 300 and the voice analysis processing unit 424a'execute the same processing as the processing of the above S4 to S10 in S32, generate text data, and pass it to the printing-related processing unit 424b'. ..

In S36, the print-related processing unit 424b'creates a command based on the text data. Specifically, the print-related processing unit 424b'sets the density parameter value to the current set value +2, that is, 7 in the case of two steps, and generates a command instructing reprinting. Then, the application server 400 transmits the generated command to the repeater 100 in S38. The repeater 100 transmits the received reprint command as it is to the printer 200 in S40. In S42, the printer 200 controls the printing mechanism 250 with the set value of the density parameter according to the received reprint command, and executes reprinting based on the print data stored in the control unit 210 for the previous printing. do.

In S38 above, the print-related processing unit 424b'generates text data that is the basis of voice data for notifying the printer 200 that the printer 200 has been instructed to reprint when transmitting a print command to the repeater 100, and the voice is generated. It may be passed to the analysis processing unit 424a'. As a result, the smart speaker 300 generates a voice informing the printer 200 that the printer 200 has been instructed to reprint, so that the user can know in advance that the reprint result will be output from the printer 200.

If the user is dissatisfied with the reprint result, the user again speaks the dissatisfied content to the smart speaker 300. In response to this, the processes S4 to S42 are repeated, and the print result is output again from the printer 200.

The printer 200 is configured so that the set value of the density parameter can be changed, but there is a model in which the set value of the density parameter cannot be changed in other printers. In that case, the print-related processing unit 424b'may generate text data that is the basis of the voice data for notifying that the setting cannot be changed, and pass it to the voice analysis processing unit 424a'.

Further, in the present embodiment, the user asks "Is it a little darker?" In S2 above, so in S30 above, the user asks "You can make it darker by 5 steps. Let's make it darker by 2 steps and reprint." Is replying to. Instead of this, the processing of S22 to S34 is omitted, the processing is advanced from S20 to S36 without replying to the user, and the current value of the concentration parameter determined from "dark" is slightly changed from "a little more". A command may be generated instructing reprinting by adding only the values determined in the increasing direction.

In this embodiment, the content spoken by the user and the content of the voice generated from the smart speaker 300 are only examples. Further, the determined setting parameter items are not limited to the concentration parameter, and various setting parameter items are determined according to the content of the user's utterance. Further, the parameter value is not limited to the change in the increasing direction, but may be changed in the decreasing direction. It is also possible that it will not be changed.

As described above, in the image forming system 1000 of the present embodiment, the user who is dissatisfied or has a request for the print result from the printer 200 simply speaks the dissatisfaction or the content of the request to the smart speaker 300, and the dissatisfaction is expressed. The items of the setting parameters and their values are automatically determined so that the print result to be resolved or the print result meets the request, and the print control for the printer 200 is performed, so that the image is formed as intended by the user. Can be done. In particular, it is useful for a user who does not fully understand the relationship between the value of the setting parameter to be changed and the print result, because the user does not have to directly instruct the item and the parameter value of the setting parameter.

Further, the user can intuitively change the print setting because the print setting is changed and the print result as intended can be obtained only by speaking an intuitive impression on the print result. As a result, the user does not have to search the print application for print settings that can obtain the print result as intended by the user. In addition, it may be possible to change to a new print setting that is not in the print setting registered in advance in the print application.

In the image forming system 1000 of the present embodiment, since the application server 400 performs from the analysis of the utterance content of the user to the generation of the command to be transmitted to the printer 200, various smart speakers 300 may be adopted. That is, there is no model dependence. Further, since the repeater 100 only relays the data transmitted and received between the application server 400 and the printer 200 as it is, it is sufficient as long as the data can be relayed, and there is no model dependence.

FIG. 4 shows an example of the format of the log information stored in the storage unit 420 by the print-related processing unit 424b'of the application server 400. When the user speaks to the smart speaker 300, the print-related processing unit 424b'acquires log information each time the user speaks and stores the log information in the storage unit 420. As shown in FIG. 4, the log information is 1. Utterance data and 2. Stores in association with printer information.

1. 1. As the utterance data, 1-1: date and time, 1-2: region, 1-3: raw data and 1-4: extracted data are acquired. The "date and time" is the date and time when the user utters. The "region" is the region in which the user is speaking. The area may be any unit such as a national unit, a prefecture unit, a municipal unit, or a finer unit. For example, the smart speaker 300 may be equipped with GPS, and the "region" may be determined based on the position information obtained from the GPS. The "raw data" is the voice data itself input from the smart speaker 300. The "extracted data" is the text data generated as described above from the "raw data" and the morphological analysis result generated by subjecting the text data to morphological analysis processing.

2. As the printer information, 2-1: print application information, 2-2: print setting, and 2-3: model information are acquired. The "print application information" is the information of the print application used in the pre-processing of the print control processing of FIGS. 2 and 3 above. For the information of the print application, inquire the terminal device in which the print application is installed, or when the printer 200 stores the information of the print application used for printing, the current setting request is made in S14 above. When you send the command, you should also ask for the information of the print application. The "print setting" is a print setting that is being set when the printer 200 speaks. In S14, only the information of the setting parameters related to the utterance content uttered in S2 is requested, but the setting information of all the setting parameters may be requested. "Model information" is a model name of the printer 200. In S18, the printer 200 generates the current setting response including the model name, so this model name may be used. The "print settings" may be all of the print settings set in the printer 200, or may be a part of them. The part may be one. In this case, one print setting that is closely related to the utterance content may be selected.

Further, the log information is classified into log information in which terms related to printer 200 settings are included in the utterance data and log information in which terms related to printer 200 settings are not included, and is stored for each type. .. If you store it in this way, you can use the log information for each type, which is convenient. Whether or not the term related to the setting of the printer 200 is included can be immediately determined based on 1-4: extracted data.

The log information acquired in this way is used to know a wide range of user preferences and requests for the printer 200 and to utilize it in future product development. Conventionally, user operations on the UI screen of a print application have been stored as an operation log, but the range in which the user can grasp what he / she wants to do (Want) has been limited. For example, when the set value of the density parameter is set to the maximum, it is difficult for the user to judge from the operation log whether the set value should be used or whether the set value should be made darker. On the other hand, if the user's utterance is "want to be darker" or "still thin" and this is collected as log information, it can be seen that the user's Want is a Want that exceeds the settable range of the device. .. As described above, from the log information of the present embodiment, a wide range of user preferences and requests can be known.

It is conceivable to store information that is just a text version of voice data as log information, but then it is difficult to understand later what the user used to speak. Therefore, in the present embodiment, information such as printer settings and utterance information are associated with each other and stored as log information. As a result, the accuracy of grasping the Want of the user is greatly improved, and the usefulness as log information is also greatly improved.

Further, as a method of knowing the user's preference and request, for example, there is a method of providing a user's request column on a printer support site or the like and having the user write freely. The user preferences and desires obtained by this method may be biased. In other words, only the tastes and requests from users who are willing to write positively can be obtained. On the other hand, from the log information obtained as in the present embodiment, it is possible to obtain preferences and requests from a wide range of users without bias. Therefore, it can be utilized for business expansion such as provision of services corresponding to Want of a wide range of users and development of the next product.

As described above, the application server 400 of the present embodiment includes a network IF 480, a storage unit 420, and a CPU 410. Then, the CPU 410 recognizes the content of the voice input by the user of the printer 200 from the smart speaker 300 that inputs and outputs the voice connected via the network IF480. When the term "setting of the printer 200" is included in the content of the sound, the acquisition process of acquiring the print setting of the printer 200 from the printer 200, the content of the recognized sound, and the acquired printer 200 The log information storage process of storing the log information in the storage unit 420 as the log information related to the setting of the printer 200 is executed in association with the print setting of.

As described above, the application server 400 of the present embodiment can collect a wide range of user preferences and requests as a log.

Incidentally, in the present embodiment, the application server 400 is an example of an "information processing device". The network IF480 is an example of a "communication interface". The storage unit 420 is an example of a “storage device”. The CPU 410 is an example of a "control device". The printer 200 is an example of an "image forming apparatus". The print setting is an example of "setting information".

Further, in the log information storage process, in addition to the print settings of the printer 200, the print application information instructing the printer 200 to print is also stored as log information related to the settings of the printer 200. This makes it possible to collect a wide range of user preferences and requests regarding the print application as a log. By the way, printing is an example of "image formation". The print application information is an example of "application information".

Further, in the log information storage process, in addition to the print settings of the printer 200, the model information of the printer 200 is also stored as log information related to the settings of the printer 200. As a result, a wide range of user preferences and requests can be collected as a log for each model of the printer 200. By the way, the model information is an example of "device information".

Further, in the log information storage process, when the recognized voice content does not include a term related to the setting of the printer 200, the recognized voice content corresponds to the acquired setting information of the printer 200. Attached, it is stored in the storage unit 420 as log information not related to the setting of the printer 200. As a result, a wide range of user preferences and requests including audio content not related to the settings of the printer 200 can be collected as a log.

Further, the print setting of the printer 200 includes the setting of a plurality of setting items, and in the log information storage process, one related to the recognized voice content and the sound content recognized from the setting of the plurality of setting items. Are associated with each other and stored in the storage unit 420 as log information related to the setting of the printer 200. This makes it possible to collect a wide range of user preferences and requests as a log while narrowing down the setting items.

Further, in the log information storage process, when the content of the recognized voice includes a term indicating the degree, the term indicating the degree is also stored in the storage unit 420 as log information regarding the setting of the printer 200. This makes it possible to collect a wide range of user preferences and requests, including degree, as a log. By the way, "I want to make it darker" and "I'm still thin" are examples of "degree".

The present invention is not limited to the above embodiment, and various modifications can be made without departing from the spirit of the present invention.

(1) In the above embodiment, the process of analyzing the voice data is executed by the voice analysis processing unit 424a'of the application server 400. Instead, the smart speaker 300 may perform part or all of the process of analyzing the voice data. In addition, the print-related processing unit 424b'may execute a part or all of the processing for analyzing the voice data. For example, the voice analysis processing unit 424a'may perform only the processing of performing the voice recognition processing to generate text data, and the morphological analysis processing of extracting words may be executed by the printing-related processing unit 424b'.

(2) In the above embodiment, the printer 200 is adopted as the image forming apparatus, but the present invention is not limited to this, and a multifunction device in which a scanning function and a fax function are added to the printing function may be adopted. In this case, for example, the multifunction device can be made to print according to the voice input to the smart speaker 300.

(3) Although the application server 400 is a cloud server, it may be a local server connected to the LAN 70 and not connected to the Internet 80. In this case, the smart speaker 300 may not transmit the identification information such as the user ID to the application server 400, but may transmit only the voice data.

(4) The interface for connecting the repeater 100 and the printer 200 is not limited to the Bluetooth IF160, and may be, for example, a wired interface such as USB, or another wireless interface such as NFC (abbreviation of Near field communication). It may be.

(5) In the above embodiment, the repeater 100 relays the data transmitted and received between the application server 400 and the printer 200, but further relays the data to and from the application server 400 via the smart speaker 300. You may. In this case, communication using the Bluetooth IF160 of the smart speaker 300 or the wireless LAN IF180 is performed with the repeater 100. Further, when the printer 200 is provided with a wireless LAN IF, the application server 400 may directly communicate with the printer 200 without going through the repeater 100, or the application server 400 may communicate directly with the printer 200 via the smart speaker 300. It may communicate with the printer 200.

(6) In the above embodiment, a part of the configuration realized by the hardware may be replaced with software, and conversely, a part of the configuration realized by the software may be replaced with the hardware. May be good.

50 ... Access point, 70 ... LAN, 80 ... Internet, 100 ... Repeater, 110 ... CPU, 120 ... Memory, 160, 260, 360 ... Bluetooth IF, 180, 380 ... Wireless LAN IF, 200 ... Printer, 210 ... Control unit , 250 ... printing mechanism, 300 ... smart speaker, 310 ... control unit, 350 ... audio input / output unit, 400 ... application server, 410 ... CPU, 420 ... storage unit, 424a ... voice analysis program, 424b ... printing related program, 424b ′… Printing-related processing unit 424a ′… Voice analysis processing unit 480… Network IF, 1000… Image forming system.

Claims (7)

Communication interface and
Storage device and
Control device and
With
The control device is
A voice content recognition process that recognizes the content of the input voice by the user of the image forming apparatus speaking from a smart speaker that inputs and outputs voice connected via the communication interface.
When the recognized audio content includes terms related to the setting of the image forming apparatus,
The acquisition process of acquiring the setting information of the image forming apparatus from the image forming apparatus, and
A log information storage process in which the recognized voice content is associated with the acquired setting information of the image forming apparatus and stored in the storage device as log information relating to the setting of the image forming apparatus.
To execute,
Information processing device. In the log information storage process, in addition to the setting information of the image forming apparatus, the information of the application instructing the image forming apparatus to form an image is also stored as the log information regarding the setting of the image forming apparatus.
The information processing device according to claim 1. In the log information storage process, in addition to the setting information of the image forming apparatus, the device information of the image forming apparatus is also stored as the log information regarding the setting of the image forming apparatus.
The information processing device according to claim 1 or 2. In the log information storage process,
When the recognized audio content does not include terms related to the setting of the image forming apparatus.
The recognized content of the sound is associated with the acquired setting information of the image forming apparatus, and stored in the storage device as log information not related to the setting of the image forming apparatus.
The information processing device according to any one of claims 1 to 3. The setting information of the image forming apparatus includes the setting of a plurality of setting items.
In the log information storage process, the recognized voice content is associated with one related to the recognized voice content from the settings of the plurality of setting items, and the log information related to the setting of the image forming apparatus is used. Store in the storage device,
The information processing device according to any one of claims 1 to 4. In the log information storage process, when the content of the recognized voice includes a term indicating a degree, the term indicating the degree is also stored in the storage device as log information regarding the setting of the image forming apparatus.
The information processing device according to any one of claims 1 to 5. A program that can be executed by a computer of an information processing device equipped with a communication interface and a storage device.
On the computer
A voice content recognition process that recognizes the content of the input voice by the user of the image forming apparatus speaking from a smart speaker that inputs and outputs voice connected via the communication interface.
When the content of the voice recognized by the voice content recognition process includes terms related to the setting of the image forming apparatus.
The acquisition process of acquiring the setting information of the image forming apparatus from the image forming apparatus, and
A log information storage process in which the recognized voice content is associated with the acquired setting information of the image forming apparatus and stored in the storage device as log information relating to the setting of the image forming apparatus.
A program that executes.

Images