KR20190142210A - Server system, printing apparatus, control method, and communication system - Google Patents

Abstract

Provided are a server system, a printing device, a control method and a communication system. The server system comprises a transmission part configured to transmit first notification information for notifying a first message about the printing device by voice to a user through a voice control device, and second notification information for notifying a second message related to the printing device but not included in the first message to the user through a terminal device placed outside the voice control device and the printing device based on the reception of predetermined information. Therefore, the usability in notification of messages related to the printing device is improved.

Description

Server system, printing apparatus, control method, and communication system {SERVER SYSTEM, PRINTING APPARATUS, CONTROL METHOD, AND COMMUNICATION SYSTEM}

The present invention relates to a server system, a printing apparatus, a control method, and a communication system.

A notification system for notifying a user of a message related to a printing apparatus is known.

Japanese Unexamined Patent Application Publication No. 2016-170631 discloses a toast for notifying the display unit of the information processing apparatus of the status when an error occurs in the printer during printing based on a print job sent from the information processing apparatus. The displayed technology is disclosed.

As the use of the notification system for notifying a user of a message related to a printing apparatus increases, a higher usability notification method is desired.

An object of the present invention is to improve the usability in notification of a message related to a printing apparatus.

A communication system including a printing apparatus for executing print processing by adding a recording agent to a recording medium by a printing unit, and a server system for communicating with the printing apparatus, transmits information to the printing apparatus to execute the print processing. And a predetermined information based on a predetermined voice instruction given to the voice control device, and a printing unit configured to execute the print processing, based on the first transmitter configured to execute the print process. A receiving unit configured to receive, a second transmitting unit configured to transmit, based on the reception of the predetermined information, first notification information for notifying the user of the voice control device by voice to the voice control device; And a second message including a message related to the printing apparatus and not included in the first message. A third notification information configured to transmit the second notification information for notifying the user via the notification screen to a terminal device that is outside the voice control device and outside of the printing apparatus, based on the reception of the predetermined information. A transmitter is provided. When the first notification information is transmitted, the first message is notified to the user by voice by the voice control device. When the second notification information is transmitted, the second message is notified by the terminal device to the user through the notification screen.

Further features of the present invention will become apparent from the following detailed description of the embodiments given with reference to the accompanying drawings.

1 is a diagram illustrating an example of a configuration of a communication system.
2 is a block diagram showing a hardware configuration of the voice control device.
3 is a block diagram showing the hardware configuration of the management server and the relay server.
4 is a block diagram showing a hardware configuration of a printing apparatus.
5 is a block diagram illustrating an outline of a hardware configuration of a terminal device.
Fig. 6 is a sequence diagram showing registration processing performed by a management server to associate and manage each device.
7 is a sequence diagram showing print service execution processing.
8 is a sequence diagram showing print processing using the voice control device.
Fig. 9 is a sequence diagram showing status confirmation processing for confirming status information of a printing apparatus associated with a voice control device.
10 is a flowchart showing processing executed by the relay server in the status confirmation processing.
11 is an example of the priority table in which the priority of an error state is defined.
12 is an example of the priority table in which the priority of the ink state is defined.
13A, 13B, and 13C are examples of notification screens displayed on the display unit.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. At this time, the following embodiments do not limit the present invention related to the claims, and all combinations of the features described in the present embodiment are not necessarily essential to the solution of the present invention. Each of the embodiments of the invention described below may be used alone or in a plurality of embodiments or of these embodiments, as desired or when a combination of components or features from separate embodiments is advantageous in a single embodiment. It can be implemented with a combination of features.

<System configuration>

An example of the block diagram of the communication system which concerns on this embodiment is shown in FIG. The system of the present embodiment includes, for example, the voice control device 101, the voice control device management server (hereinafter referred to as the management server) 102, the relay server 103, the printing apparatus 104, and the terminal device 105. And an access point (AP) 106. The voice control device 101 is, for example, a smart speaker. The terminal device 105 is, for example, any terminal device such as a smartphone, a personal computer (PC), a tablet terminal, a mobile phone, a personal digital assistant (PDA), or the like. In the following description, the terminal device 105 is a smart phone. The printing apparatus 104 is a communication apparatus in this embodiment, and is a printer which forms (prints) an image on a recording medium by adding a recording agent such as ink to a recording medium such as paper. The printing device 104 may be a multifunction device having a plurality of functions including a copy function, a FAX function, and a print function. In the present embodiment, the printing apparatus 104 is assumed to be an apparatus for printing by the inkjet method, but the present invention is not limited to this embodiment. The printing device 104 may be, for example, an apparatus for printing by an electrophotographic method or a thermal sublimation method. As the communication apparatus, the printing apparatus 104 is used in this embodiment, but the present invention is not limited to this. For example, a device capable of providing services other than printing, such as a copy machine, a facsimile device, a smart phone, a cellular phone, a tablet terminal, a PDA, a digital camera, a music playback device, a storage, a projector, a PC, and the like, is applicable. The access point (AP) 106 is, for example, a wireless local area network (LAN) router. The device connected to the AP 106 can use the Internet via the AP 106. In this embodiment, the voice control device 101, the printing apparatus 104, and the terminal apparatus 105 are APs according to a wireless communication method of a wireless LAN conforming to the Institute of Electrical and Electronics Engineers (IEEE) 802.11 standard series. Wireless connection to 106.

The voice control device 101 and the terminal device 105 can communicate with the management server 102 via the AP 106 and the Internet. The printing apparatus 104 can communicate with the relay server 103 via the AP 106 and the Internet. The voice control device 101 and the terminal device 105 can be connected to each other (communication possible) via the AP 106. In the communication system shown in FIG. 1, the voice control device 101, the printing device 104, and the terminal device 105 can connect to the same AP and use the Internet, but the present invention is not limited to this embodiment. For example, the voice control device 101, the printing apparatus 104, and the terminal apparatus 105 may connect to different APs and use the Internet. In addition, the voice control device 101, the printing apparatus 104, and the terminal apparatus 105 do not use an AP, for example, by a mobile communication network such as Long Term Evolution (LTE) and 4th Generation (4G), The Internet may be available.

2 is a block diagram illustrating an outline of a hardware configuration of the voice control device 101. The voice control device 101 includes a speaker 201, a central processing unit (CPU) 202, a read only memory (ROM) 203, a microphone 204, a random access memory (RAM) 205, and external storage. Apparatus 206, communication unit 207, and near field communication unit 208. At this time, the blocks shown in FIGS. 2 to 4 are connected to each other using, for example, an internal bus. These configurations are examples, and each device may also include hardware other than those shown. The plurality of blocks shown in Figs. 2 to 4 may be combined into one block, or any one block may be divided into two or more blocks. That is, each apparatus can take arbitrary structures in the range which can perform the process mentioned later.

The speaker 201 generates sound by the processing (to be described later). The CPU 202 is a system control unit and is a processor that controls the entire voice control device 101. The ROM 203 stores a control program executed by the CPU 202 and fixed data such as a data table and an embedded operating system (OS) program. According to the present embodiment, each control program stored in the ROM 203 is used to perform scheduling, task switch, interrupt processing, and other software execution control under management of the embedded OS stored in the ROM 203. do. The microphone 204 receives the voice around the voice control device. For example, the microphone 204 receives a voice generated by the user. The RAM 205 is configured of, for example, a static RAM (SRAM) that requires a backup power supply. Since the data in the RAM 205 is held by a primary battery (not shown) for data backup, the RAM 205 can be stored without volatilizing program control variables and data. The RAM 25 includes a memory area for storing setting information and management data of the voice control device 101. The RAM 205 is also used as a main memory and a work memory of the CPU 202. The external storage device 206 stores application software.

The communication unit 207 includes a circuit and an antenna for performing communication in accordance with a predetermined wireless communication method. For example, the communication unit 207 may wirelessly connect to the access point. In addition, the communication unit 207 operates as an access point temporarily used. The wireless communication according to the present embodiment may operate according to a wireless communication method (Wi-Fi) of a wireless LAN compliant with the IEEE 802.11 standard series, or may operate according to another wireless communication method.

The short range wireless communication unit 208 executes short range wireless communication from the voice control device 101 with another apparatus existing within a predetermined short range. The short range wireless communication unit 208 performs communication based on a wireless communication method different from the method used by the communication unit 207. According to the present embodiment, the near field communication unit 208 operates according to the Bluetooth (registered trademark) standard, but other methods may be used.

5 is a block diagram illustrating an outline of a hardware configuration of the terminal device 105. The terminal device 105 is, for example, an input interface 501, a CPU 502, a ROM 503, a display unit 504, a RAM 505, an external storage device 506, a communication unit 507, a near field wireless device. It has a communication unit 508. These blocks are connected to each other via an internal bus, for example.

The CPU 502 is a system control unit that controls the entire apparatus. The RAM 505 is configured of a dynamic RAM (DRAM) that requires a backup power supply, similar to the RAM 205. The RAM 505 is also used as the main memory and the work memory of the CPU 502. The ROM 503 stores a control program executed by the CPU 502 and fixed data such as a data table and an OS program. This embodiment assumes that the terminal device 105 installs an application program (hereinafter, referred to as a voice control application) for the voice control device 101 and stores it in the ROM 503.

The display unit 504 is composed of a light emitting diode (LED) or a liquid crystal display (LCD) and displays a screen based on various data. The display unit 504 may be configured as a touch display, and may have a function of accepting various inputs from a user. That is, the display unit 504 is an interface for receiving data input and operation instructions from the user. The display unit 504 may be an operation panel composed of a physical keyboard, a button, and a touch panel. The communication unit 507 has a similar function to the communication unit 207 described above, and can wirelessly connect with other devices via the AP 106. The short range wireless communication unit 508 is a device capable of performing short range wireless communication with the short range wireless communication unit 208 using the same wireless communication method as that used in the short range wireless communication unit 208.

3 is a block diagram showing an outline of the hardware configuration of the management server 102 and the relay server 103. According to the present embodiment, the management server 102 and the relay server 103 are composed of one server, but the server system corresponding to the management server 102 and the relay server 103 by operating a plurality of servers in cooperation. This may be in the form of being constructed.

The CPU 301 is a processor for controlling the following units. The disk device 302 stores an application program 312, a database 313, an OS, and various files that are read by the CPU 301. The external storage media reading device 303 is a device for reading information such as a file stored in an external storage medium such as a secure digital (SD) card. The memory 304 is comprised of RAM, and the CPU 301 temporarily stores and buffers data as necessary. The display unit 305 is composed of LEDs and LCDs and displays a screen based on various data. The operation unit 306 is composed of a keyboard, a mouse, and the like for the user to perform various input operations. The network communication unit 307 is connected to a network such as the Internet via the network connection unit 308 to perform various types of communication. The network communication unit 307 communicates by wired LAN or wireless LAN. When the network communication unit 307 is wired LAN compatible, the network connection unit 308 is a connector for connecting a cable of a wired LAN. When the network communication unit 307 is wireless LAN compatible, the network connection unit 308 becomes an antenna. The network connection part 308 may correspond to both a wired LAN and a wireless LAN. The Universal Serial Bus (USB) communication unit 310 is connected via various peripheral devices and the USB connection unit 311 and performs various types of communication according to the USB standard. Each of the above sections is connected to each other via a bus 309. The processing of the management server 102 and the relay server 103 (to be described later) is realized by the CPU 301 reading out and executing a program necessary for the processing.

4 is a block diagram showing an outline of a hardware configuration of the printing apparatus 104.

In the printing apparatus 104, the printing function is realized by the printer unit 401, the scanner function is realized by the scanner unit 402, and the storage function is stored in the memory card mounting unit 403 and the memory card 404. Is realized.

The printer unit 401 executes printing based on the image data received from the outside and the image data stored in the memory card 404. The printer unit 401 also manages ink information such as ink remaining amount and paper information such as paper remaining amount.

The scanner unit 402 optically reads an original set on a document glass (not shown), converts the read data into electronic data, converts the electronic data into image data having a specified file format, and converts the image data into a network. Via transmission to an external device or storing image data in a storage area (not shown) such as a hard disk drive (HDD). In the copy function, the scanner unit 402 reads an original placed on a document glass, generates image data, and transmits the generated image data to the printer unit 401, and the printer unit prints an image based on the image data on printing paper. It is realized by printing.

The memory card 404 attached to the memory card mounting unit 403 stores various file data. This file data may be read and edited from an external device via a network. Furthermore, file data can be stored in the memory card 404 from an external device.

The printing device 104 includes a CPU 405, a program memory 406, a work memory 407, a display unit 408, an operation unit 409, a network communication unit 410, a network connection unit 411, and a flash memory 412. ). The CPU 405 is a processor for controlling each unit in the printing apparatus 104. The program memory 406 is composed of a ROM, and stores various program codes and an application 415 for communicating with the relay server 103. The application 415 accesses the printer unit 401 to obtain ink information and paper information. The work memory 407 is comprised of RAM, and temporarily stores and buffers image data at the time of execution of each service. The display unit 408 is configured of an LED or an LCD and displays a screen based on various data. The operation unit 409 consists of a switch for the user to perform various input operations. The network communication unit 410 is connected to a network such as the Internet via the network connection unit 411 and performs various types of communication. The network communication unit 410 communicates by wired LAN or wireless LAN. When the network communication unit 410 is wired LAN compatible, the network connection unit 411 is a connector for connecting a cable of a wired LAN. When the network communication unit 410 is wireless LAN compatible, the network connection unit 411 becomes an antenna. The network connection part 411 may correspond to both a wired LAN and a wireless LAN. According to the present embodiment, the network communication unit 410 corresponds to a wireless LAN and connects with the AP 106 in accordance with a wireless communication method of a wireless LAN conforming to the IEEE 802.11 standard series.

The flash memory 412 is a nonvolatile memory for storing image data received by the network communication unit 410. Each unit described above is connected to each other by a bus 413. The processing of the printing apparatus 104 (to be described later) is realized by the CPU 405 reading out and executing a program necessary for the processing.

<Print Processing Using Voice Control Device 101>

In the system shown in Fig. 1, print processing using the voice control device 101 is executed. In order to execute print processing using the voice control device 101, it is necessary to execute registration processing for allowing the management server 102 to manage each device in association. The registration process will be described using the sequence diagram of FIG. In this sequence, the processing executed by each device is realized by the CPU of each device executing a program stored in the ROM of each device. The program executed by the terminal device 105 is a voice control application.

The following describes the registration processing for allowing the management server 102 to manage each device in association.

Before the registration process is executed, the user adds the voice control application of the terminal apparatus 105 to a user account (hereinafter referred to as a first account) for the voice control device 101 managed by the management server 102. To log in. As a result, the management server 102 manages the terminal device 105 in association with the first account. As a result, the management server 102 recognizes the information about the voice control application of the terminal device 105 related to the first account. The terminal device 105 recognizes information about the first account including the account name, identifier (ID) and password.

In step S601, the voice control device 101 receives a predetermined operation from the user and shifts to a mode for executing a registration process. Specifically, the voice control device 101 validates its own access point.

In step S602, the terminal device 105 receives an instruction to execute registration processing from the user as an input to a screen displayed by the voice control application.

In step S603, the terminal device 105 connects to the access point of the voice control device 101 via Wi-Fi.

In step S604, the terminal device 105 specifies an external access point to be connected to the voice control device 101. Specifically, the terminal device 105 searches for surrounding external access points and displays a list of found external access points. The terminal device 105 then specifies an external access point selected by the user in the list. The specific method of the external access point is not limited to this form. For example, the terminal device 105 receives a list of external access points found in the search executed by the voice control device 101 from the voice control device 101 via a Wi-Fi connection. Thereafter, the terminal device 105 may specify an external access point selected by the user from the list. Alternatively, for example, the terminal device 105 may specify an external access point to which the terminal device 105 has connected when receiving a command to execute registration processing from a user.

In step S605, the terminal device 105 transmits the information about the external access point specified in step S604 and the information about the first account described above to the voice control device 101 via the Wi-Fi connection. After transmitting the information in step S605, the terminal device 105 may disconnect the Wi-Fi connection with the voice control device 101 and establish a Wi-Fi connection with the specific external access point in step S604. .

In the above description, the voice control device 101 has received information necessary for the first registration process via Wi-Fi, but the present invention is not limited to this embodiment. For example, in the mode of executing the first registration process, the voice control device 101 validates the Bluetooth function and receives information necessary for the first registration process via the Bluetooth connection with the terminal apparatus 105. You may also

In step S606, the voice control device 101 invalidates the access point it has and disconnects the Wi-Fi connection with the terminal device 105. FIG. The voice control device 101 then connects to the external access point via Wi-Fi based on the information about the external access point received from the terminal apparatus 105. When the Wi-Fi connection with the external access point is successful, the voice control device 101 may notify the user by voice of the connection.

In step S607, the voice control device 101 accesses the management server 102 via an external access point, and informs the management server 102 of the first account received from the terminal apparatus 105 and the self. Transmits identification information.

In step S608, the management server 102 manages in association with the voice control device 101 and the first account based on the received information. At this time, the management server 102 has already managed the terminal device 105 in association with the first account. For this reason, in step S608, the voice control device 101, the terminal device 105, and the first account are managed in association.

In step S609, the terminal device 105 registers the service (skill) to be used by using the voice control device 101. According to this embodiment, since the print service using the voice control device 101 is used, the print service applicable to the printing apparatus 104 is registered. Therefore, the terminal device 105 transmits to the management server 102 information indicating that the print service applicable to the printing device 104 has been selected by the user.

In step S610, the management server 102 manages the print service applicable to the printing apparatus 104 in association with the first account based on the received information. That is, the print service applicable to the printing apparatus 104 is registered.

In step S611, the terminal device 105 displays a login screen for allowing the user to log in to a user account (hereinafter referred to as second account) managed by the relay server 103 associated with the print service. The terminal device 105 obtains information for displaying a login screen by accessing, for example, the relay server 103 associated with a print service. When the user logs in to the second account via the PC controlling the printing apparatus 104, it is assumed that the relay server 103 manages the second account in association with the printing apparatus 104 in advance.

In step S612, the terminal device 105 relays the login information (including the ID and password), the information about the first account, and the information about the management server 102 inputted to the login screen to the relay server 103. To send).

In step S613, the relay server 103 determines whether the received login information is correct. When the received login information is correct and the login to the second account succeeds, the relay server 103 accesses the management server 102 based on the received information about the management server 102. The relay server 103 then transmits to the management server 102 an information about the access token and the second account for allowing access by the first account.

In step S614, the management server 102 manages the first and second accounts in association with the received information.

As a result, the management server 102 can manage each device in association with each account, and can recognize which information should be sent to which device in the notification process according to the present embodiment. Will be.

The above-described process executed by the terminal apparatus 105 may be executed via, for example, a web browser on the terminal apparatus 105 without passing through the voice control application.

The print service execution process for using the print service via the voice control device 101 will be described. 7 is a sequence diagram showing a print service execution process. The processing executed by each device in this sequence is realized by the CPU of each device executing a program stored in the ROM of each device or the like. It is assumed that the processing executed by each device in this sequence is executed while the registration processing described with reference to FIG. 6 is completed.

First, the user generates a first wake word corresponding to the voice control device 101 as voice in the vicinity of the voice control device 101. As a result, the voice control device 101 shifts to a mode for receiving a voice command from the user. Thereafter, the user generates a second wake word as a voice as a print service execution instruction for executing a registered print service.

In step S701, the voice control device 101 receives a voice of a user by the microphone 204 to receive a print service execution instruction (second wake word).

In step S702, the voice control device 101 transmits voice data based on the voice received in step S701 to the management server 102 via the Internet. When transmitting the voice data, the voice control device 101 transmits the voice of the user received by the microphone 204 as voice data as it is, or converts the voice of the user into text data and converts the text data into voice data. You may transmit.

In step S703, the management server 102 analyzes the received voice data. Specifically, the management server 102 analyzes the voice data corresponding to the second wake word, registers the registered print service, the relay server 103 associated with the print service, and the print service. It identifies the second account that has been set.

In step S704, the management server 102 notifies the relay server 103 associated with the print service of receipt of the print service execution instruction. The information transmitted at this time includes information indicating the second account associated with the registered print service.

In step S705, the relay server 103 specifies the execution request of the print service. The relay server 103 specifies the second account associated with the registered print service, and specifies which printing device 104 is used to execute the print service.

In step S706, the relay server 103 transmits notification information for notifying the management server 102 of the function executable by the printing apparatus 104 in the print service, to the management server 102. According to the present embodiment, since the notification is performed by both the voice control device 101 and the terminal apparatus 105, the relay server 103 is the notification information and the terminal apparatus 105 for the voice control device 101. Send notification information for According to the present embodiment, the content of the message notified to the user by voice by the voice control device 101 is determined by the notification information for the voice control device 101. That is, the relay server 103 controls the content of the message notified to the user by voice by the voice control device 101. Similarly, the contents of the messages and graphics notified to the user via the screen by the terminal device 105 are determined by the notification information for the terminal device 105. That is, the relay server 103 controls the contents of the message and the graphic notified to the user through the screen by the terminal apparatus 105.

In step S707, the management server 102, based on the received notification information, provides voice notification information for notifying the user by voice of a function executable by the printing apparatus 104 in the print service. Transmit to (101).

In step S708, the voice control device 101 notifies the user by voice through the speaker 201 of a function that can be executed using the printing apparatus 104 in the print service, based on the received voice notification information. . According to the present embodiment, the functions that can be executed by using the printing apparatus 104 in the print service include a printing function for causing the printing apparatus 104 to execute printing, and a state checking function for confirming the state of the printing apparatus 104. It includes. Therefore, the voice control device 101 notifies the user by voice that the printing function and the status checking function are available.

In step S709, the management server 102, based on the received notification information, provides screen notification information for notifying a user via a screen display of a function executable by the printing apparatus 104 in a print service. It transmits to the terminal device 105 related to one account. Step S709 may be executed before step S707.

In step S710, the terminal apparatus 105, based on the received screen notification information, the display unit 504, on the display unit 504, a notification screen for notifying the user of a function that can be executed using the printing apparatus 104 in the print service. Display. Specifically, the terminal device 105 displays a notification screen 1300 as shown in FIG. 13A. According to the present embodiment, the terminal apparatus 105 notifies the user of the details through the notification screen more than the contents of the voice control device 101 notifying the user by voice. The notification screen 1300 includes an area 1301 for notifying a user of a function executable by the printing apparatus 104 in a print service, and an area 1302 for notifying a user of printable content by a printing function. . According to the present embodiment, the message included in the area 1301 is also notified to the user by voice in step S708. However, the message contained in the area 1302 is not notified to the user by the voice in step S708, but is notified to the user only through the screen notification in step S710. The notification screen 1300 notifies the user of the information about the printing apparatus 104 as well as a message for notifying the user of the information about the printing apparatus 104, such as the messages displayed in the regions 1301 and 1302. May include graphics for

Thereby, the user can grasp the function which can be performed using the printing apparatus 104 in a print service, and can start using a print service.

Hereinafter, print processing using the voice control device 101 will be described. 8 is a sequence diagram showing print processing using the voice control device 101. The processing executed by each device in this sequence is realized by the CPU of each device executing a program stored in the ROM of each device. The processing executed by each apparatus in this sequence is executed while the print service execution processing described with reference to FIG. 7 is completed and the user grasps a function that can be executed using the printing apparatus 104 in the print service. Assume that

In order to use the printing function among the functions executable by using the printing apparatus 104 in the printing service, the user generates a third wake word corresponding to the printing function by voice as a print instruction.

In step S801, the voice control device 101 receives a user's voice by the microphone 204 to receive a print instruction (third wake word).

In step S802, the voice control device 101 transmits voice data based on the voice received in step S801 to the management server 102 via the Internet. As in step S702, the voice control device may convert the user's voice into text data and transmit the text data as voice data.

In step S803, the management server 102 transmits the information based on the received voice data to the relay server 103.

In step S804, the relay server 103 analyzes the information received in step S803 to specify the execution request of the print function.

In step S805, the relay server 103 transmits the notification information for the voice control device 101 to notify the user by voice of the type of the content that can be printed by the print function, to the management server 102. In the present embodiment, the type of content printable by the printing function is notified to the user only by voice by the voice control device 101, but the type of content is notified to the user through the screen notification by the terminal device 105. You may be. That is, the relay server 103 may further transmit the notification information for the terminal device 105 for notifying the user of the kind of the printable content by the printing function through the screen display.

In step S806, the management server 102 transmits, to the voice control device 101, voice notification information for notifying the user of the type of the printable content by voice based on the received notification information. .

In step S807, the voice control device 101 notifies the user of the type of the printable content by voice via the speaker 201 based on the received voice notification information.

When the user grasps the type of the printable content by the print function, the user selects the content to be printed by the print function by generating the name of the target content by voice. At this time, the user may generate print settings (number of copies, color settings for printing, etc.) for printing of the content by voice.

Then, in step S808, the voice control device 101 receives the user's voice by the microphone 204 to receive the selected content to be printed and the print setting by the print function.

In step S809, the voice control device 101 transmits voice data based on the voice instruction received in step S808 to the management server 102 via the Internet.

In step S810, the management server 102 transmits the information based on the received voice data to the relay server 103.

In step S811, the relay server 103 analyzes the information received in step S810 and specifies the content to be printed by the print function.

In step S812, the relay server 103 prints the print data in binary format for printing the content of the print object, and prints for instructing the print device 104 associated with the second account to print the content of the print object. Create a job. The generated print data is stored in a predetermined storage area of the relay server 103. The generated print job contains information such as a Uniform Resource Locator (URL) for acquiring print data stored in a predetermined storage area of the relay server 103.

In step S813, the relay server 103 transmits the generated print job to the printing apparatus 104 associated with the second account via the Internet.

In step S814, the printing apparatus 104 transmits a request to the relay server 103 for obtaining the print data stored in the predetermined storage area of the relay server 103 based on the received print job.

In step S815, the relay server 103 transmits the print data generated in step S812 to the printing apparatus 104 in response to the request received in step S814. Instead of transmitting the print job and the print data to the printing apparatus 104 separately, the relay server 103 may transmit the print job including the print data in step S813.

In step S816, the printing apparatus 104 starts printing based on the received print job and print data. When an error occurs during printing, the printing apparatus 104 transmits status information indicating that the printing apparatus 104 is in an error state to the relay server 103.

Next, in step S817, the relay server 103 informs the user that the selected content is currently being printed by the printing apparatus 104 when the printing apparatus 104 starts printing in step S816. Is transmitted to the management server 102. According to the present embodiment, since the notification is performed by both the voice control device 101 and the terminal apparatus 105, the relay server 103 uses the notification information for the voice control device 101 and the terminal apparatus 105. FIG. Send notification information for

In step S818, the management server 102, based on the received notification information, provides voice notification information for notifying the user by voice that the selected content is currently being printed by the printing apparatus 104. 101).

In step S819, the voice control device 101 notifies the user by voice via the speaker 201 that the selected content is currently being printed by the printing apparatus 104, based on the received voice notification information.

In step S820, on the basis of the received notification information, the management server 102 provides the screen notification information for notifying the user via screen display that the selected content is currently being printed by the printing apparatus 104. It transmits to the terminal device 105 related to the account. Step S820 may be executed before step S818.

In step S821, the terminal apparatus 105 displays on the display unit 504 a notification screen for notifying the user that the selected content is currently being printed by the printing apparatus 104, based on the received screen notification information. do. Specifically, the terminal device 105 displays a notification screen 1303 as shown in FIG. 13B. According to the present embodiment, the terminal apparatus 105 notifies the user of the contents, which are more detailed than the contents notified by the voice control device 101, via the notification screen. The notification screen 1303 notifies the user of an area 1304 for notifying the user that the selected content is currently being printed by the printing apparatus 104 and a wake word different from the third wake word for executing a print instruction. Region 1305 for the purpose of communication. According to the present embodiment, the message included in the area 1304 is notified to the user by the voice in step S819. However, the message contained in the area 1305 is not notified to the user by the voice in step S819, but is notified to the user only by the screen notification in step S821.

When printing based on a print job is completed, in step S822, the printing apparatus 104 transmits print completion status information indicating completion of printing to the relay server 103.

In this way, the printing apparatus 104 can start printing by triggering the issuance of the print instruction of the voice to the voice control device 101.

After step S822, the relay server 103 may transmit the notification information for notifying the user that the printing is completed, to the voice control device 101 and the terminal device 105, based on the print completion status information. .

Hereinafter, the state confirmation processing for confirming the state information of the printing apparatus 104 associated with the voice control device 101 will be described. 9 is a sequence diagram showing a state confirmation process. The processing executed by each device in this sequence is realized by the CPU of each device executing a program stored in the ROM of each device. The program executed by the terminal device 105 is a voice control application. The processing executed by each apparatus in this sequence is executed while the print service execution processing described with reference to FIG. 7 is completed and the user grasps a function that can be executed using the printing apparatus 104 in the print service. Assume that

A user confirms the status of the printing apparatus 104 (instruction for acquiring the status information of the printing apparatus 104) in order to use a status checking function among functions that can be executed using the printing apparatus 104 in a print service. As a result, a fourth wake word corresponding to the status confirmation function is generated by voice.

After that, in step S901, the voice control device 101 receives the user's voice through the microphone 204 to receive a confirmation instruction (fourth wake word) of the state of the printing apparatus 104.

In step S902, the voice control device 101 transmits voice data based on the voice received in step S901 to the management server 102 via the Internet. As in step S702, the voice control device may convert the user's voice into text data and transmit the text data as voice data.

In step S903, the management server 102 transmits the information based on the received voice data to the relay server 103.

In step S904, the relay server 103 analyzes the information received in step S803 to specify the execution request of the status checking function.

According to this embodiment, whenever the state of the printing apparatus 104 and the state of the ink which the printing apparatus 104 has changed, the printing apparatus 104 informs the relay server 103 about this state. Send (status information). According to the present embodiment, the state information includes error information indicating that the printing apparatus 104 is in an error state and ink information (recording information) indicating the state of ink included in the printing apparatus 104.

For example, in the printing apparatus 104, whenever the state of the printing apparatus 104 changes from the normal state (the error does not occur) to the error state, the relay server 103, the printing apparatus 104 is connected to. Send status information indicating an error condition. For example, whenever the state of the printing apparatus 104 changes from an error state to a normal state, the printing apparatus 104 informs the relay server 103 of the status information indicating that the printing apparatus 104 is in a normal state. Send.

For example, the printing apparatus 104 is used when the state of the ink included in the printing apparatus 104 is changed from a normal state (a state in which the remaining amount of ink is sufficient) to a small ink amount state (a state in which the remaining amount of ink is low). Each time, the relay server 103 transmits status information indicating the state of the ink included in the printing apparatus 104.

Each time the relay server 103 receives the status information, the relay server 103 updates the currently held status information and updates the latest status of the printing apparatus 104 associated with the second account. It is specified.

In step S905, the relay server 103 generates notification information based on the state information currently held. According to the present embodiment, since the notification is performed by both the voice control device 101 and the terminal apparatus 105, the relay server 103 is the notification information for the voice control device 101 and the terminal apparatus 105. Generates notification information for the dragon.

As the relay server 103 receives the request for the status information, the relay server 103 may request the latest status information from the printing apparatus 104 and acquire new status information. In this case, notification information is generated based on the new state information.

According to the present embodiment, when the relay server 103 specifies that a plurality of errors have occurred in the printing apparatus 104 based on the status information, the notification information generated differs depending on the priority set for each error. The specific generation method of notification information is mentioned later.

In step S906, the relay server 103 transmits the generated notification information to the management server 102.

In step S907, the management server 102 transmits to the voice control device 101 voice notification information for notifying the user by voice of the state of the printing apparatus 104 based on the received notification information.

In step S908, the voice control device 101 notifies the user of the state of the printing apparatus 104 by voice via the speaker 201 based on the received voice notification information. A specific notification method will be described later.

In step S909, the management server 102, based on the received notification information, the terminal apparatus associated with the first account for screen notification information for notifying the user of the state of the printing apparatus 104 by screen display. To 105. Step S909 may be executed before step S907.

In step S910, the terminal apparatus 105 displays the notification screen for notifying the user of the state of the printing apparatus 104 on the display unit 504 based on the received screen notification information. A specific notification method will be described later.

In this way, the user can confirm the state of the printing apparatus 104 by issuing a voice instruction to the voice control device 101.

10 is a flowchart showing processing executed by the relay server 103 in the state confirmation processing. The process shown in this flowchart is realized by the CPU 301 of the relay server 103 executing a program stored in the disk device 302 of the relay server 103.

In step S1001, the CPU 301 receives from the management server 102 the information transmitted based on the status confirmation instruction by the voice to the voice control device 101.

In step S1002, the CPU 301 analyzes the state information of the printing device 104 currently held, and specifies the state of the printing device 104. The state of the printing apparatus 104 includes an error state (error occurrence), a normal state (error does not occur), and a state in which printing is currently performed based on a print job. According to the present embodiment, the error state is a state in which the printing apparatus 104 cannot execute printing. Error states include a cover open state, a paper jam state, an out of paper state, a busy state, and an offline state. The cover open state is a state in which a cover (not shown) is opened when the ink cartridge is attached to the print head included in the printing apparatus 104. The paper jam state is a state where a paper (recording medium) is caught in a conveyance path. In the paperless state, there is no paper held by the printing apparatus 104. The busy state is a state in which the printing apparatus 104 is executing a process other than printing (for example, a scan process of reading an original to generate image data). The offline state is a state in which no power is supplied to the printer unit 401 (or the supply of power is limited). The error condition is a small ink amount state in which the printing device 104 holds a small amount of remaining ink (recording agent), an ink-free state in which no ink is held in the printing device 104, and a small amount of ink in the printing device 104. A small amount of paper holding state may be included. When a plurality of errors occur in the printing apparatus 104, a plurality of errors are specified in step S1004.

In step S1003, the CPU 301 determines whether or not the state of the printing apparatus 104 specified in step S1002 is an error state. When the CPU 301 determines that the state of the printing apparatus 104 is in an error state (YES in step S1003), the processing proceeds to step S1004. On the other hand, when the CPU 301 determines that the state of the printing apparatus 104 is not an error state (NO in step S1003), the processing proceeds to step S1008.

In step S1004, the CPU 301 determines whether a plurality of errors have occurred in the printing apparatus 104 (if a plurality of error states are specified in step S1002). If the CPU 301 determines that a plurality of errors have occurred in the printing apparatus 104 (YES in step S1004), the processing proceeds to step S1005. On the other hand, when the CPU 301 determines that a plurality of errors have not occurred in the printing apparatus 104 (NO in step S1004), the processing proceeds to step S1007.

In step S1005, the CPU 301 specifies the priority of the plurality of error states specified in step S1002. Specifically, first, the CPU 301 refers to the priority table as shown in FIG. 11. The priority table is stored in the database 313. The priority table defines the priority of the error state. The CPU 301 specifies the priority of the plurality of error states specified in step S1002 based on the priority defined in the priority table. According to the present embodiment, the priority order of decreasing in this order is assigned to the cover open state, the paper jam state, the paper empty state, the busy state and the offline state. For example, when the plurality of error states include a cover open state, a paperless state, and an offline state, the cover open state has the highest priority, the ink free state has the second highest priority, and the offline state has priority. Degrees are lowest. The contents of the priority and the error state defined in the priority table are not limited to the above forms but may be arbitrarily defined.

Next, in step S1006, the CPU 301 determines the error state of the printing apparatus 104 based on the state of the printing apparatus 104 specified in step S1002 and the priority of each error state specified in step S1005. Create notification information about Specifically, the CPU 301 generates notification information so that the error state to which the priority is assigned is notified to the user by the voice control device 101 and the terminal device 105 more preferentially. More specifically, the CPU 301 notifies the user only of the error state to which the highest priority is assigned among the plurality of error states specified in step S1002, and an error state other than the error state to which the highest priority is assigned is displayed. Notification information is generated so that a user is not notified. As described above, according to the present embodiment, notification is performed by both the voice control device 101 and the terminal apparatus 105 based on the notification information. Therefore, the CPU 301 informs the user of the notification information for the voice control device 101 for notifying the user of the state of the printing apparatus 104 by voice and the state of the printing apparatus 104 to the user by screen display. Notification information for the terminal device 105 for notification is generated. As shown in the table of Fig. 11, a message for notifying the user of the error state is defined for the notified error state. The notification information for the voice control device 101 is notification information used for generating the message by voice by the voice control device 101. The notification information for the terminal device 105 is notification information used for displaying the notification screen including the message by the printing apparatus 104. The message may include not only a message for notifying the user of an error state of the printing apparatus 104 but also a message for canceling the error state of the printing apparatus 104. For example, the message generated by the voice control device 101 as voice may be different from the message displayed by the terminal device 105, and in particular, the message displayed by the terminal device 105 may be the voice control device 10. May include a message for resolving an error state of the printing apparatus 104 which is not included in the message generated by the voice. Next, the CPU 301 advances the process to step S1008.

The present invention is not limited to this configuration. When the error state assigned the priority is notified to the user more preferentially by the voice control device 101 and the terminal apparatus 105, all the error states specified in step S1002 may be notified to the user. Specifically, for example, an error state assigned a higher priority may be voiced to the user before an error state assigned a lower priority, or a screen indicating an error state assigned a higher priority may be lower. The notification information may be generated so that the priority is displayed before the screen indicating the assigned error state.

When the CPU 301 determines that a plurality of errors have not occurred in the printing apparatus 104 (NO in step S1004), in step S1007, the CPU 301 determines that the printing apparatus 104 has been identified in step S1002. Based on the state, notification information about an error state of the printing apparatus 104 is generated. Since only one error has occurred in the printing apparatus 104, the notification information for the voice control device 101 and the notification information for the terminal apparatus 105 so that the user is notified of an error state relating to the one error. Is generated. Next, the process proceeds to step S1009.

In step S1008 executed when the CPU 301 determines that the state of the printing apparatus 104 is not an error state (NO in step S1003), the CPU 301 states the state of the printing apparatus 104 specified in step S1002. Based on this, notification information about an error state of the printing apparatus 104 is generated. Since no error has occurred in the printing apparatus 104, the notification information for the voice control device 101 and the terminal so that the user is notified that the printing apparatus 104 is not in an error state (the normal state). Notification information for the device 105 is generated. Next, the process proceeds to step S1009.

According to the present embodiment, when the printing apparatus 104 is in an error state, first, an error state of the printing apparatus 104 is notified to the user by voice, and then information about ink included in the printing apparatus 104 is voiced. The user is notified. According to the present embodiment, it is assumed that the printing apparatus 104 includes four colors of ink of black, cyan, magenta, and yellow. Therefore, the information about the ink which the printing apparatus 104 has is notified to a user for every color.

In step S1009, the CPU 301 specifies the state (ink state) of the ink of each color included in the printing apparatus 104. The ink states include an ink no state, a low ink amount state 1, a low ink amount state 2, and a normal state. The ink free state is a state in which the ink amount is less than the first amount. The small ink amount state 1 is a state in which the ink amount is larger than the first amount and smaller than the second amount. The small ink amount state 2 is a state in which the ink amount is larger than the second amount and smaller than the third amount. The steady state is a state in which the ink amount is larger than the third amount. Therefore, the steady state, low ink amount state 2, low ink amount state 1, and no ink state indicate the amount of ink included in the printing apparatus 104 which decreases in this order. The no ink state, the low ink amount state 1, and the low ink amount state 2 can also be regarded as an error state of the printing apparatus 104 regarding ink.

In step S1010, the CPU 301 specifies the priority of the ink of each color. Specifically, first, the CPU 301 refers to the priority table as shown in FIG. 12. The priority table is stored in the database 313. In the priority table, the priority of the ink state is defined. The CPU 301 specifies the priority of the ink of each color based on the priority defined in the priority table. According to this embodiment, higher priority is assigned in this order to the no ink state, the low ink amount state 1, the low ink amount state 2, and the normal state. For example, when the black ink is in the no ink state, cyan and magenta low ink amount state 1, and the yellow ink is in the normal state, the highest priority is assigned to the black ink, and the cyan and magenta The second high priority is assigned to the ink, and the lowest priority is assigned to the ink of yellow. The priority and the error state defined in the priority table are not limited to the above-described forms, and may be arbitrarily defined. When inks of colors other than black, cyan, magenta, and yellow are held by the printing apparatus 104, priority is also specified for inks of colors other than black, cyan, magenta, and yellow.

In step S1011, the CPU 301 generates notification information about the ink of each color included in the printing apparatus 104, based on the ink state relating to the ink of each color and the priority specified in step S1007. Specifically, the CPU 301 generates the notification information so that the ink state of the ink color assigned to the higher priority is notified more preferentially by the voice control device 101 and the terminal apparatus 105. More specifically, the CPU 301 generates notification information so that the ink state of the ink color assigned to the higher priority is notified by voice before the ink state of the ink color assigned the lower priority. The CPU 301 generates notification information so that the ink state of the ink color assigned to the higher priority is displayed at a higher position on the notification screen than the ink state of the ink color assigned the lower priority. The CPU 301 notifies the user only of the ink state of the ink color assigned to the highest priority and notifies the user so that the ink state of ink colors other than the ink color assigned to the highest priority is not notified to the user. You may create it. When there are a plurality of inks of the color to which the highest priority is assigned, the CPU 301 determines an ink color other than the ink color to which the ink state of the ink color to which the highest priority is assigned is the highest. Notification information is generated so as to notify the user in preference to the ink state of the. Regarding the notification information regarding the ink of each color, both the notification information for the voice control device 101 and the notification information for the terminal apparatus 105 are generated. As shown in the table of Fig. 11, for each ink state notified, a message for notifying the user of the ink state is defined. The notification information for the voice control device 101 is notification information for generating the color of the message and ink as voice by the voice control device 101. The notification information for the terminal device 105 is notification information used by displaying the notification screen including the message and the color of the ink by the printing apparatus 104. The message may include not only a message for notifying the user of the ink state of the printing apparatus 104 but also a message for notifying the user of identification information such as a part number of ink. For example, the message generated by the voice control device 101 by voice and the message displayed by the terminal device 105 may be different. According to this embodiment, the message generated by the voice control device 101 by voice does not include a message for notifying the part number of the ink, but is included in the message displayed by the terminal device 105. This is because the information of the part number of the ink often includes a sequence of alphabets and numbers, and it is difficult for the user to accurately grasp the part number of the ink notified by voice.

The present invention is not limited to this form. The notification information may be generated such that only the ink state of the ink color to which the higher priority is assigned is notified to the user and the ink state of the ink color to which the lower priority is assigned is not notified to the user.

According to this embodiment, the CPU 301 generates notification information indicating that the ink states of all the ink colors are in a normal state when the ink states of all the ink colors are in a normal state. The CPU 301 generates notification information so that the ink state of the ink color in the normal state is not notified to the user when the ink state of the ink of any one color is not normal. However, the present invention is not limited to this form. The CPU 301 may generate the notification information so that the user is notified of the ink state of the ink color in the normal state even when the ink state of the ink of any one color is not normal.

In step S1012, the CPU 301 transmits the notification information about the error state of the generated printing apparatus 104 and the notification information about the ink of each color to the management server 102.

Upon receiving the notification information, the management server 102 transmits the notification information for the voice control device 101 to the voice control device 101 associated with the first account. Then, the voice control device 101 notifies the user of the status information by voice based on the received notification information. Specifically, after the voice control device 101 notifies the user by voice of the status information based on the notification information about the error status of the printing apparatus 104, the voice control device 101 is based on the notification information about the ink of each color. The user is notified of the status information by voice. For example, when the notification information includes notification information for notifying that the printing apparatus 104 is in the cover open state and notification information for notifying the user of ink states of yellow and magenta, the voice control device 101 For example, the message "The printer's cover is open. Close the cover. The following ink is completely gone. Magenta. The next ink level is low." Yellow is generated. For example, when the notification information includes notification information for notifying the user that the printing apparatus 104 is in a normal state and notification information for notifying the user that the ink state of all the ink colors is in a normal state, voice control is performed. The device 101 generates a voice message, for example, "The printer is in a normal state. The ink amount is sufficient for all the ink colors".

Upon receiving the notification information, the management server 102 transmits the notification information for the terminal device 105 to the terminal device 105 associated with the first account. The terminal device 105 then displays on the display unit 504 a notification screen based on the received notification information. According to the present embodiment, the terminal device 105 notifies the user of the details of the contents notified by the voice control device 101 via voice via the notification screen. FIG. 13C shows the display unit 504 when the notification information includes notification information for notifying the user that the printing apparatus 104 is in the cover open state and notification information for notifying the user of ink states of yellow and magenta inks. This is an example of a notification screen displayed on the screen. The notification screen 1306 includes an area 1307 for notifying the user of an error state of the printing apparatus 104 and an area 1308 for notifying the user of the ink status of the ink included in the printing apparatus 104. According to the present embodiment, the message included in the area 1307 is notified to the user by voice also by the voice control device 101. Area 1307 contains a lower priority error that is not notified to the user by voice by the voice control device 101. In this case, the area 1307 includes a message that is not notified to the user by voice by the voice control device 101 but is notified to the user only by screen notification by the terminal apparatus 105. The notification screen may include not only a message for notifying the user of the information about the printing apparatus 104 but also a graphic for notifying the user of the information about the printing apparatus 104.

According to this embodiment, according to the voice instruction from the user to the voice control device 101, the user can be notified of the message concerning the printing apparatus 104. FIG.

According to this embodiment, the voice control device 101 notifies a user of a message about the printing apparatus 104 by voice, and at the same time, the terminal apparatus 105 displays a notification screen on the message about the printing apparatus 104. Notify the user via By the notification being made by voice, the user can grasp the message concerning the printing apparatus 104, for example, while the user performs another job. By being notified by the notification screen, the user can confirm the state of the printing apparatus 104 not only by voice notification but also by screen notification. That is, for example, a message concerning the printing apparatus 104 can be notified to both the user near the voice control device 101 and the user away from the voice control device 101. For example, a notification screen is displayed to both a user who has not heard a voice message generated by the voice control device 101 and a user who wants to confirm the notification again after the voice message is generated by the voice control device 101. When confirming, the message regarding the printing apparatus 104 can be notified.

In general, a user needs to be informed of as much detailed information as possible. However, if the amount of information notified to the user by voice is large, the user may not hear the voice message and may not be able to correctly recognize the information to be notified. However, even if there are many contents notified to the user by the screen display, the user can accurately recognize the information. Therefore, according to the present embodiment, the notification screen notifies a message which is not notified by voice while notifying the user of the message about the printing apparatus 104 by voice. By the control of this embodiment, the amount of information notified by voice can be suppressed, and the user can recognize the information accurately. Moreover, the user can thereby confirm detailed information by the notification screen. That is, the user can be notified of the detailed information through the notification screen while the user correctly recognizes the information notified by voice under such a control.

According to the present embodiment, when a plurality of errors occur in the printing apparatus 104, not all of the plurality of errors are notified to the user by voice by the voice notification information, but only an error to which a high priority is assigned. The user is notified. As a result, only important information can be notified to the user by voice, and the user can accurately recognize the contents notified to the user by voice.

(Other Embodiments)

In the above-described embodiment, both the error state of the printing apparatus 104 and the ink state of the ink color of the printing apparatus 104 are notified in accordance with the state confirmation instruction issued by the user. It is not limited to form. For example, the user may be notified of only one of an error state of the printing apparatus 104 and an ink state of the ink color of the printing apparatus 104. For example, when the word for confirming the error state of the printing apparatus 104 and the word for confirming the ink state of the ink color of the printing apparatus 104 are respectively distinguished, the error of the printing apparatus 104 is different. The user may be notified of the state and the state corresponding to the word generated in the state confirmation instruction by the user among the ink states of the ink colors included in the printing apparatus 104.

In the above description, the information not included in the information notified to the user by voice by the voice control device 101 but included in the information notified to the user by the notification screen displayed by the terminal apparatus 105 (hereinafter referred to as specific information). A message indicating the identification information of the ink whose ink status is notified is illustrated. However, the specific information is not limited to this, and may be, for example, information (link to the corresponding screen) for displaying a screen prompting the user to purchase the ink whose ink state is notified to the user. For example, the specific information may be a message detailing the remaining amount of ink for which the ink state is notified. For example, the specific information may be not only information about ink but also information about an error state of the printing apparatus 104. Specifically, the specific information may be a message and a graphic indicating a method for releasing an error state of the printing apparatus 104. In the above example, the user is not informed of the error state and the ink state to which the low priority is assigned, but the present invention is not limited to this embodiment. For example, information about an error state and ink state to which a low priority is assigned is not notified to the user by voice, but is notified to the user via a notification screen, so that information about an error state and ink state to which a low priority is assigned is specified. It may be treated as information.

In the above example, the printing apparatus 104 has a plurality of inks, but the present invention is not limited to this embodiment. For example, when the printing apparatus 104 is a monochrome printer, the printing apparatus 104 may have only one type of ink (black ink). In that case, the information about the ink to be notified is information about only black ink. For example, when the printing apparatus 104 is an electrophotographic printer, the user may be notified of the information about the toner instead of the information about the ink.

In the above example, the voice control device 101 does not have a display portion, but the present invention is not limited to this embodiment. The voice control device 101 has a low performance display unit and a small display unit instead of a high performance display unit or a large display unit for presenting simple information that is the content of the notification transmitted from the printing apparatus 104 to the user. You may be. In the case where the voice control device 101 has a high performance display unit or a large display unit, the voice control device 101 includes a screen related to a notification transmitted from the printing apparatus 104. You may display on a display part.

In the above example, the relay server 103 determines the notification information for determining the contents notified to the user by voice by the voice control device 101 and the contents notified to the user through the screen by the terminal device 105. Although notification information is generated, the present invention is not limited to this embodiment. For example, the notification information may be generated from the printing apparatus 104 and the management server 102 and then transmitted from the printing apparatus 104 and the management server 102.

The above embodiment is also realized by executing the following processing. That is, the software (program) for realizing the functions of the above-described embodiments is supplied to the system or apparatus via a network or various storage media, and the computer (CPU, micro processing unit (MPU), processor) of the system or apparatus is provided. The process of reading and executing a program. The program may be executed on one computer or may be executed in conjunction with a plurality of computers. It is not necessary to implement all of the above processes in software. Some or all of the processing may be implemented by hardware such as an Application Specific Integrated Circuit (ASIC). It is not necessary to perform all the processing in one CPU, that is, a plurality of CPUs may be linked to each other to perform the processing appropriately.

An embodiment of the present invention is a computer-implemented program recorded on a storage medium (may be referred to in more detail as a 'non-transitory computer readable storage medium') to perform one or more functions of the above-described embodiment (s) of the present invention. One or more circuits (eg, application specific semiconductor circuits (ASICs) that read and execute possible instructions (eg, one or more programs) and / or perform one or more functions of the foregoing embodiment (s). By a computer of a system or apparatus comprising, or by reading and executing, for example, computer executable instructions from a storage medium to perform one or more functions of the above-described embodiment (s). A computer may comprise one or more central processing units (CPUs), microprocessors (MPUs), or other circuitry, and a network of separate computers. Computer-executable instructions may be given, for example, to a computer from a network of storage media, for example, the recording medium may include one or more hard disks, random access memory ( RAM), read-only memory (ROM), storage in distributed computing systems, optical disks (such as compact disks (CD), digital versatile disks (DVD), or Blu-ray disks (BD) ^TM ), flash memory devices, memory cards, etc. You may be provided.

The present invention provides a program for realizing one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and at least one processor reads and executes the program in a computer of the system or apparatus. It can also be executed in the processing. It can also be executed by a circuit (for example, ASIC) that realizes one or more functions.

Although the present invention has been described with reference to exemplary embodiments, it is obvious that the present invention is not limited to this embodiment. The scope of protection of the following claims is to be accorded the broadest interpretation so as to encompass all modifications, equivalent structures and functions.

Claims (20)

A communication system comprising a printing apparatus which executes print processing by adding a recording agent to a recording medium by a printing unit, and a server system which communicates with the printing apparatus.
A first transmitter configured to transmit information for executing the print process to the printer;
A printing section configured to execute the print processing based on information for causing the print processing to execute to the printing apparatus;
A receiver configured to receive predetermined information based on a predetermined voice instruction given to the voice control device,
A second transmitter configured to transmit first notification information for notifying the voice control device to the user by voice of the first message about the printing apparatus, based on the reception of the predetermined information;
Notifying the user through a notification screen to a terminal device that is external to the voice control device and that is external to the printing device, the second message including a message related to the printing device and not included in the first message. A third transmitting unit, configured to transmit second notification information for receiving based on the reception of the predetermined information,
When the first notification information is transmitted, the first message is notified to the user by voice by the voice control device,
And when the second notification information is transmitted, the second message is notified by the user through the notification screen by the terminal apparatus.
The method of claim 1,
The first and second messages include messages regarding functions available using the printing apparatus,
The functions available using the printing apparatus include at least a function of causing the printing apparatus to execute the print process.
The method of claim 2,
And a message not included in the first message but included in the second message is a message indicating the printable content by a function of causing the printing apparatus to execute the print process.
The method of claim 2,
An information transmitter configured to transmit information for executing the print process to the printer based on an audio print instruction for executing the print process to the printer given to the voice control device,
The first message including a message about functions available using the printing apparatus is sent to the voice control device based on the first notification information before the voice print instruction is given to the voice control device. Is notified to the user by voice,
And the print processing is executed by the printing apparatus when the information for executing the print processing is transmitted to the printing apparatus.
The method of claim 1,
And the first and second messages include a message indicating execution of the print processing by the printing apparatus.
The method of claim 5,
And a message not included in the first message but included in the second message is a message indicating a method of providing a voice print instruction to the voice control device.
The method of claim 1,
And an acquisition unit configured to acquire error information about an error occurring in the printing apparatus,
And the first message and the second message include a message relating to an error occurring in the printing apparatus based on the acquired error information.
The method of claim 7, wherein
And a message relating to an error occurring in the printing apparatus includes a message indicating an error occurring in a recording medium held by the printing apparatus.
The method of claim 8,
And a message not included in the first message but included in the second message is a message held by the printing apparatus and indicating identification information of a recording agent in which an error has occurred.
The method of claim 7, wherein
And a message not included in the first message but included in the second message is a message indicating a method for resolving an error occurring in the printing apparatus.
The method of claim 7, wherein
When a plurality of errors occur in the printing apparatus, a message regarding a first error among the plurality of errors takes precedence over a message regarding a second error among the plurality of errors as the first message. And the user is notified by voice by the voice control device based on the notification information.
The method of claim 11,
And when the plurality of errors occur in the printing apparatus, the first message includes a message relating to the first error and does not include a message relating to the second error.
The method of claim 12,
And a message not included in the first message but included in the second message is a message relating to the second error.
The method of claim 11,
A specifying unit configured to specify a priority of the plurality of errors,
A message about an error to which a higher priority is assigned is notified to the user more preferentially as a message about the printing apparatus,
The priority of the first error is higher than the priority of the second error.
The method of claim 11,
The plurality of errors include an error in which the cover of the printing apparatus is open, an error in which the printing medium is not provided by the printing apparatus, an error in which the recording medium included in the printing apparatus is blocked in a conveying path, And at least one of errors in which power is not supplied to the printing unit.
The method of claim 11,
The plurality of errors include an error in which the amount of the first recording agent is smaller than the first amount among the plurality of recording agents included in the printing apparatus, and the amount of the second recording agent in the plurality of recording agents is smaller than the first amount. At least one of a greater number of errors than the second amount.
The method of claim 1,
An information transmitter configured to transmit information for executing the print process to the printer, based on an audio print instruction for causing the print apparatus to execute the print process, given to the voice control device,
And the print processing is executed by the printing apparatus when the information for executing the print processing is transmitted to the printing apparatus.
The method of claim 1,
The server system is a communication system including one or a plurality of servers.
A control method of a communication system including a printing apparatus for executing print processing by adding a recording agent to a recording medium by a printing unit, and a server system communicating with the printing apparatus,
Transmitting information for executing the print process to the printing apparatus;
Executing the print process based on information for causing the print apparatus to execute the print process;
Receiving predetermined information based on a predetermined voice instruction given to the voice control device,
Transmitting first notification information for notifying the voice control device to the user by voice of the first message about the printing apparatus, based on the reception of the predetermined information;
Notifying the user through a notification screen to a terminal device that is external to the voice control device and that is external to the printing device, the second message including a message related to the printing device and not included in the first message. Transmitting second notification information for receiving based on the reception of the predetermined information,
When the first notification information is transmitted, the first message is notified to the user by voice by the voice control device,
And when the second notification information is transmitted, the second message is notified by the user through the notification screen by the terminal apparatus.
A server system for communicating with a printing apparatus that executes print processing by adding a recording agent to a recording medium by a printing portion,
A receiver configured to receive predetermined information based on a predetermined voice instruction given to the voice control device,
A first transmitter configured to transmit first notification information for notifying the voice control device to the user by voice of the first message about the printing apparatus, based on the reception of the predetermined information;
Notifying the user through a notification screen to a terminal device that is external to the voice control device and that is external to the printing device, the second message including a message related to the printing device and not included in the first message. A second transmitter configured to transmit second notification information for the user based on the reception of the predetermined information,
When the first notification information is transmitted, the first message is notified to the user by voice by the voice control device,
And when the second notification information is transmitted, the second message is notified by the user through the notification screen by the terminal apparatus.

Images