JP2003058360A - Voice guidance method in printing system and information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To vary a method for synthesizing voice according to a status of a printer in notifying the status of the printer by voice. SOLUTION: This information processor executes a reception step (1701) to receive state information that indicates the state of the printer, voice synthesis steps (1702 to 1711) to synthesize voice waveform data based on text data corresponding to a state to be included in the state information in the reception step and an output step (1712) to reproduce and output the voice from the voice waveform data synthesized in the voice synthesis step.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a voice guidance method and an information processing device in a printing system, and more specifically, in a printing system including the information processing device and the printer device, the status of the printer device is notified. The present invention relates to a voice guidance method and an information processing device.

[0002]

2. Description of the Related Art Various methods for notifying the status of a printer device are known. The simplest example is a method of sounding a buzzer of the printer to notify when a failure occurs in the printer. In this method, the number of times the buzzer sounds and the time at which the buzzer sounds are changed according to the type of failure or the notified status. This method is still used today.

In a printing system including an information processing device and a printer device, the printer device is connected to an external connection port called a printer port of the information processing device. The printer port of the information processing device is I
In most cases, it conforms to the EEE1284 standard. Therefore, bidirectional communication can be performed between the information processing device and the printer device. Further, in recent years, a method of connecting an information processing device and a printer device with a USB (Universal Serial Bus) is also known. Since the USB is a bus capable of bidirectional communication, it can receive data from the printer device in the same manner as IEEE1284.

Attempts have been made to notify more detailed status information by using the two-way communication function instead of the status notification method using a buzzer. Specifically, a command corresponding to the status of the printer is arranged in advance, and when the corresponding status occurs, the corresponding command is sent to the information processing apparatus via the port connected to the printer. The information processing device determines these commands and executes an application capable of displaying the information. This application reads the command from the port and displays the message corresponding to the command.

FIG. 1 is a diagram showing a state in which a warning message of a conventional printer device is displayed on an information processing device.
6 is a screen on which an application displays a warning message indicating a status of printing paper out in the printer device. In this way, compared to the method using the buzzer,
The amount of information that can be provided will increase dramatically, and the GUI
(Graphical User Interface) enables intuitive visual judgment. As a result, it has become possible to improve the usability for the user.

On the other hand, when printing a specific document, the user sets various parameters related to printing, such as print mode setting, print sheet setting, and printer cartridge setting, in order to control printing. It is necessary to make settings. To set these parameters, use the GU described above.
I is used. The user reads the graphic and text messages on the screen displayed by the printer driver, which is one of the applications of the information processing device, confirms the selected item, and selects the specific item using the input device such as the keyboard and the mouse. .

[0007]

However, in the status notification method, the user who gives the print instruction to the printer must face the screen of the information processing apparatus. In addition, in the information processing apparatus, the multi-window format is generally used, and there is a problem in that the screen shown in FIG. 1 is displayed in front of the application in which the work is being performed, and the work must be interrupted.

As a method that does not hinder the user's work as much as possible, voice notification is performed. Even if the user is not facing the screen being operated, the information can be acquired, and the voice notification can be made more intuitively than the visual notification if the array is simple. However, there are several statuses to notify,
Despite the difference in importance and urgency, since the voice notification has the same tone, it is necessary to concentrate on the voice from the information processing device and listen to it. There was also the problem of missing out.

On the other hand, in the parameter setting method,
According to the graphic displayed on the screen, you can set specific parameters using the keyboard and mouse.
The user needs to learn a series of operating procedures. Therefore, there is a problem that operability is poor for a beginner user who has never used a keyboard and a mouse.

Further, the user has to operate the keyboard and the mouse by hand while looking at the screen with his eyes, and there is a problem that the visually impaired and the physically disabled cannot use the user.

The present invention has been made in view of the above problems, and an object of the present invention is to synthesize voices according to the printer status when the printer status is notified by voice in a printing system. An object is to provide a voice guidance method and an information processing device that change the method.

Another object of the present invention is to provide a voice guidance method and an information processing apparatus which can set various parameters by voice and specific sound.

Further, another object of the present invention is to provide a voice guidance method and an information processing apparatus which can surely recognize information by changing a voice reproduction speed according to a voice message.

[0014]

SUMMARY OF THE INVENTION In order to achieve such an object, the present invention provides a printer according to a first aspect of the invention, wherein the printer device in a printing system comprises an information processing device and a printer device. In a voice guidance method of notifying a state by voice, the information processing device,
A receiving step of receiving status information indicating the status of the printer device, and voice waveform data are synthesized based on the text data corresponding to the status included in the status information received in the receiving step, and a voice to be reproduced is reproduced. It is characterized by executing a voice synthesizing step of adding a feature and an output step of reproducing and outputting a voice from the voice waveform data synthesized in the voice synthesizing step.

According to a second aspect of the present invention, in the voice synthesizing step according to the first aspect, a text data main body portion in which a message is described, which corresponds to the state included in the state information, and an urgency level or A first acquisition step of acquiring a parameter indicating importance with reference to a database, and a second acquisition step of acquiring an attribute part corresponding to the parameter acquired in the first acquisition step with reference to the database. And combining the text data body part and the attribute part to form the text data and synthesizing a voice.

According to a third aspect of the present invention, the attribute part according to the second aspect includes any one of information for adding features relating to the volume, sex, pitch and speed of the reproduced voice. Characterize.

According to a fourth aspect of the present invention, in the second aspect, the information processing apparatus executes a display step of displaying the message described in the text data body section on a display section. .

According to a fifth aspect of the present invention, in the second aspect, the information processing apparatus includes a changing step of changing the text data main body portion and the attribute portion stored in the database according to a user's instruction. It is characterized by executing.

According to a sixth aspect of the present invention, in an information processing apparatus for notifying a voice of the status of the printer apparatus in a printing system including the information processing apparatus and the printer apparatus, status information indicating the status of the printer apparatus is provided. Receiving means for receiving the voice, and voice synthesizing means for synthesizing voice waveform data based on the text data corresponding to the state included in the state information received by the receiving means and adding a feature to the reproduced voice. Output means for reproducing and outputting a voice from the voice waveform data synthesized by the voice synthesizing means.

According to a seventh aspect of the present invention, the voice synthesizing means according to the sixth aspect includes a text data main body portion in which a message is described, which corresponds to the state included in the state information, and an urgency level or With the parameter that represents the importance,
The text data body includes: a first acquisition unit that refers to a database; and a second acquisition unit that refers to the database to obtain an attribute part corresponding to the parameter obtained by the first acquisition unit. It is characterized in that a part and the attribute part are combined into the text data to synthesize a voice.

According to an eighth aspect of the present invention, the attribute part according to the seventh aspect includes any one of information for adding features relating to volume, sex, pitch, and speed of reproduced voice. Characterize.

According to a ninth aspect of the present invention, in the seventh aspect, a display means for displaying the message described in the text data main body portion is provided.

According to a tenth aspect of the present invention, in the seventh aspect, the text data main body section and the attribute section stored in the database are changed according to a user's instruction. To do.

According to an eleventh aspect of the present invention, a computer of the information processing apparatus for notifying a voice of the state of the printer apparatus in a printing system including the information processing apparatus and the printer apparatus is informed of the state of the printer apparatus. A receiving step of receiving the state information shown and a voice synthesizing step of synthesizing voice waveform data based on the text data corresponding to the state included in the state information received in the receiving step and adding a feature to the reproduced voice. It is a computer-readable recording medium in which a program for executing a step and an output step of reproducing and outputting a voice from the voice waveform data synthesized in the voice synthesizing step is recorded.

According to a twelfth aspect of the present invention, the status of the printer device is notified to a computer of the information processing device that notifies the status of the printer device by voice in a printing system including the information processing device and the printer device. A receiving step of receiving the state information shown and a voice synthesizing step of synthesizing voice waveform data based on the text data corresponding to the state included in the state information received in the receiving step and adding a feature to the reproduced voice. It is a program for executing a step and an output step of reproducing and outputting a voice from the voice waveform data synthesized in the voice synthesizing step.

[0026]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described in detail below with reference to the drawings. FIG. 2 is a diagram showing a printing system according to an embodiment of the present invention. This is an information processing system in which a host computer (information processing device) 101 and a printer device 102 are connected. The respective devices constituting the system are connected by a USB cable. The connection form may use an IEEE1284 interface or the like, and is not limited to USB.
Detailed description of the USB standard and the IEEE1284 standard will be omitted.

FIG. 3 is a block diagram showing the internal configuration of the host computer according to the embodiment of the present invention.
The host computer 101 uses an AC adapter (rated voltage 20 [V], 54 [W]) 201 and a nickel-hydrogen secondary battery (rated voltage 12 [V], 2700) as drive sources.
[MA / h]) 202, and by the power supply unit 203 and the power supply control IC 204, the host computer 10
Power is supplied to 1.

The host computer 101 has a CPU 20.
5, a BIOS 206, a video controller (VGAC) 208 connected to the LCD 207, a video memory (VRAM) 209, and a hard disk controller (HDC) 211 connected to a hard disk drive (HDD) 210. , DMA controller (D
MAC) 212, port (PORT) 213, floating point processor (FPU) 214, real time clock (RTC) 215, keyboard controller (KBC) 216 connected to keyboard 217, system main memory 218, floppy disk (Registered trademark)
Floppy disk controller (FD) connected to disk drive (FDD) 220
C) 219 and interrupt controller (IRQC) 22
1 and a serial interface (SIO) 222, which are connected to each other by an internal bus.

The USB interface is provided through the USB port included in the port 213. A sound source board (SB) 223 is connected to the internal bus of the host computer 101, and a speaker 224 and a microphone 225 are connected to the SB 223.

It goes without saying that the present invention is achieved by the CPU 205 reading out and executing the program code from the storage medium storing the program code of the software for realizing the voice guidance method. A floppy (registered trademark) disk drive (FDD) is used as a storage medium for supplying the program code.
A floppy (registered trademark) disk to be inserted in 220,
In addition to the hard disk drive (HDD) 210,
Magneto-optical disk, optical disk, CD-ROM, CD-
R, a magnetic tape, a non-volatile memory card, a ROM, or the like can be used.

FIG. 4 is a block diagram showing the internal configuration of the printer device according to the embodiment of the present invention. The printer device 102 includes a power supply unit, a printer control unit, an operation unit, an interface unit, and a motor control unit.

The operation section includes a power switch 301, a cartridge exchange switch 302, and a reset switch 303.
It has and. In addition, L that lights up in green when the power is turned on
ED304 and L that lights up in orange when an error occurs
The ED 305 is provided, and these LEDs can light up in two colors of green and orange by themselves. The operation of the power switch 301 is transmitted to the MPU 317 as the interrupt signal 310 via the interrupt signal line 313.
It is preferentially processed in the MPU 317.

The printer control unit includes a printer control gate array 314, an MPU 317, and a ROM 31 in which a program describing the operation and processing of the MPU 317 is recorded.
6 and are connected by an address bus 311 and a data bus 312. The MPU 317 controls a carriage motor 319 that moves a carriage that is a support body of an ink cartridge and a feed motor 320 that feeds print paper by a signal line 318.

The printer control gate array 314 is connected to an ink cartridge 322 having a structure in which ink itself and a head for ejecting the ink are integrated with a control line 321, and controls the head of the ink cartridge 322.
The ID indicating the type of the ink cartridge itself is read. Further, the printer control gate array 314 has a control function such as a switch, an LED, an interface, and a memory, and also manages the microphone 339 and the speaker 340.
Further, the printer control gate array 314 has an MPU.
Is connected to a DRAM 315 that provides a storage area for temporarily storing data and the like.

The power supply unit is an AC adapter 307 for converting a commercial power supply 306 provided to a general household into a DC 5 volt 308 and a DC 24 V 309. DC 5
The bolt 308 is used to operate an electronic component such as the MPU 317, and the DC 24 volt 309 is a motor such as the carriage motor 319 or the ink cartridge 32.
2 used to drive the head.

The printer control unit and the interface unit are
The interface control signal 323 and the data bus 324 are connected. The interface control signal 323 is the interface controller 3
27 is used to connect the printer control gate array 314 and the printer control gate array 314 detects the operation mode of the interface section. Data bus 32
4 sends the data received from the PC by the interface controller 327 to the printer control gate array 314.

The interface controller 327 and the Centronics connector 329 are connected by a data signal line 328 and a signal line 326. The interface controller 327 has a Centronics connector 32.
The analog switch 325 switches between the data from the CPU 9 and the data from the USB MPU 338. The interface controller 327 is always a USB MP
It is designed to prioritize data from U338. That is, when print data is sent to both the Centronics interface 329 and the USB B type connector 335, the USB side is always prioritized and the data from the Centronics side is not received. This switching is performed by the signal line 326 from the Centronics connector 329.
And signal line 330 from USB B type connector 335
It is performed using the status of and.

The flash memory 331 stores a program of the USB MPU 338 for controlling the USB interface. The USB interface has A type and B type connectors, and the USB B type connector 335 is connected to a PC or an upstream device. Further, it is connected to a downstream device from a USB A type 334 connector. The signal line 336 is a USB MP
The U338 is connected to the USB A type connector 334, and the signal line 337 is connected to the USB MPU338 and the USB.
It is connected to the B type connector 335.

Next, the above-mentioned host computer 101
A print control method using voice in a printing system in which the printer and the printer device 102 are connected will be described.

FIG. 5 is a block diagram showing the software configuration of the printing system according to the embodiment of the present invention. The application program 400 instructs the printer driver 4 to create a print document and start print processing.
01 is notified, and the image data of the print original is transferred to the printer driver 401. The printer driver 401 is device driver software for controlling a specific printer device and printing image data generated by specific application software.

The USB port monitor 402 provides an application programming interface (hereinafter referred to as API) used by the printer driver 401 to control the printer device. As an API,
USB port control commands such as a specific USB port open command, a specific USB port close command, a specific USB port data write command, and a specific USB port data read command are prepared. When the printer driver 401 calls the API, the USB port monitor 402 interprets the called API command, converts the API command, and passes it to the USB port driver 403 described later.

The USB port driver 403 interprets the control command received from the USB port monitor 402, further modulates the command, and passes it to the USB common driver 404 described later. USB common driver 404 is US
The USB port of the host computer 101 is directly controlled according to the control command received from the B port driver 403, and data is transmitted / received to / from the USB printer 405.

The voice recognition program 406 analyzes the voice data received from the sound source control program 410 using the voice recognition database 408. The voice recognition database 408 is a database in which information necessary for voice information processing is registered. A plurality of this database can be prepared, and the user can add or change the registered content later. For example, the voice recognition program 406 extracts the character string data corresponding to the received voice data from the voice recognition database 408 and transfers the character string data to the printer driver 401.

The voice synthesis program 407 is used by the speaker 4
The voice data to be output to 13 is created using the voice synthesis database 409. Speech synthesis database 409
Is a database in which information about printing or information about the printer body is registered as voice data. A plurality of this database can be prepared, and the user can add or change the registered content later.

The sound source control program 410 controls the sound source board 411 to take in the voice data input from the microphone 412, convert it into appropriate input digital data, and then deliver it to the voice recognition program 406. Further, the sound source control program 410 converts the sound data generated by the sound synthesis program 407 into appropriate sound data, and then controls the sound source board 411 to output it to the speaker 413.

The sound source board 411 records the sound data input from the microphone 412, and stores the sound source control program 41.
Deliver to 0. Further, the sound source board 411 uses the sound data received from the sound source control program 410 as the speaker 4
It outputs to 13.

The above-mentioned software programs are stored in the system main memory 218 of the host computer 101.
And is executed by the CPU 205.

Next, the above-mentioned host computer 101
A method of displaying the printer status (hereinafter referred to as printer status) in the printing system in which the printer device 102 and the printer device 102 are connected will be described.

The printer device 102 stores a code assigned to each event occurring in the printer device. When a corresponding event occurs, the printer device 102 sends the assigned code to the host computer 101 via the interface. The timing of sending out is when the situation of the printer device 102 changes. Table 1 shows a list of commands sent from the printer device 102 to the host computer 101.

[0050]

[Table 1]

The application for displaying the status, which is executed on the host computer 101, uses the table 1 from the interface to which the printer device 102 is connected.
The code shown in is read and the display and voice corresponding to this code are synthesized.

FIG. 6 is a diagram showing an initial screen of an application for displaying a status in the printing system according to the embodiment of the present invention. The screen 4601 is an initial screen displayed by an application that displays status on the host computer 101.

FIG. 7 is a view showing a screen showing the printing paper run-out of the printer device in the printing system according to the embodiment of the present invention. When the printer device 102 detects the printing paper exhaustion, it sends the printing paper exhaustion command “PEMPTY” shown in Table 1 to the host computer. When the application on the host computer 101 detects the command "PEMPTY", the screen 4 corresponding to this code is displayed.
501 is displayed. In addition, the application is screen 4
In addition to displaying 501, an agent character 4502 which is a 3D graphic animation that operates in synchronization with a voice message, and a balloon 4 for displaying a voice message text accompanying the agent character.
And 503 are displayed. The host computer 101 reproduces the same voice as the content displayed in 4703 by using the voice synthesizing means.

Next, the above-mentioned host computer 101
A method of voice recognition in a printing system in which the printer and the printer device 102 are connected will be described.

FIG. 8 is a flowchart showing a voice recognition method in the printing system according to the embodiment of the present invention. If the particular software requires the input of voice commands and data, in step 501,
The sound source control program controls the sound source board to enable the microphone. The sound source control program captures the words spoken by the user into the microphone as voice data. In step 502, the captured voice data is transferred to the voice recognition program.

In step 503, the voice recognition program analyzes the voice data using the voice model and the recognition grammar, and in step 504, the voice database and the language knowledge database are referred to search for a language suitable for the voice data. . In step 505, the voice recognition program notifies the software requesting the voice recognition of the result of the voice recognition.

Next, the above-mentioned host computer 101
A method of voice synthesis in a printing system in which the printer device 102 and the printer device 102 are connected will be described.

FIG. 9 is a flowchart showing a voice synthesizing method in the printing system according to the embodiment of the present invention. If the particular software requires speech synthesis, then in step 601, the software transfers the text data to the speech synthesis program. Step 6
In 02, the speech synthesis program analyzes the transferred text data using the language analysis dictionary, and performs language processing for adding language information such as phrase relation, reading, and accent to the text data.

In step 603, the speech synthesis program generates speech waveform data corresponding to the transferred text data by using the speech segment dictionary and the process parameter, and in step 604, the generated speech waveform data is subjected to sound source control. Transfer to the program. Step 60
In 5, the sound source control program controls the sound source board to enable the speaker, transfers the transferred voice waveform data to the speaker, and outputs a synthetic sound.

Next, the above-mentioned host computer 101
A method for printing a document in a printing system in which the printer device 102 and the printer device 102 are connected will be described.

FIG. 10 is a diagram showing a screen for selecting print data in the printing system according to the embodiment of the present invention. It is a screen displayed by the printer driver on the display device of the host computer 101. The agent character 701 is realized by a 3D graphic animation that operates in synchronization with a voice message. Balloon 702 displays the voice message text associated with the agent character. In the present embodiment, the voice message that is the print data selection request is displayed in text format. A dialog box 703 displays selectable print data. In the present embodiment, the print data that can be selected is 1. Photo, 2. Chart, 3. Co
mposite, and 4. Four types of Text are prepared.

In FIG. 10, notification of selectable print data is performed by voice and graphic, and print data can be selected by voice, click operation with mouse, and key input with keyboard.

FIG. 11 is a diagram showing a screen for selecting a printing sheet in the printing system according to the embodiment of the present invention. It is a screen displayed by the printer driver on the display device of the host computer 101. The agent character 801 is realized by a 3D graphic animation that operates in synchronization with a voice message. Balloon 802 displays the voice message text associated with the agent character. In the present embodiment, a voice message requesting paper selection is displayed in text. The dialog box 803 is
Displays the types of print paper that can be selected. In the present embodiment, the print sheets that can be selected are 1. Glossy P
photo Paper, 2. High Resolut
Ion Paper, and 3. Three types of Other are prepared.

In FIG. 11, the notification of the selectable printing papers is performed by voice and graphic, and the selection of the printing papers can be performed by voice, click operation by mouse, and key input by keyboard. .

FIG. 12 is a view showing a screen for selecting a printer cartridge in the printing system according to the embodiment of the present invention. It is a screen displayed by the printer driver on the display device of the host computer 101. The agent character 901 is realized by a 3D graphic animation that operates in synchronization with a voice message. Balloon 902 displays the voice message text associated with the agent character. In this embodiment, a voice message requesting selection of a printer cartridge is displayed in text. Dialog box 903 displays selectable printer cartridges. In this embodiment, the printer cartridges that can be selected are 1. Photo / Col
or (BC-32 / BC-31), and 2. Bla
Two types of ck / Color (BC-30 / BC-31) are prepared.

In FIG. 12, the notification of the selectable printer cartridge is performed by voice and graphic, and the selection of the printer cartridge can be performed by voice, click operation by mouse, and key input by keyboard. .

FIG. 13 is a diagram showing a screen for confirming print parameters in the printing system according to the embodiment of the present invention. It is a screen displayed by the printer driver on the display device of the host computer 101. The agent character 1001 is realized by a 3D graphic animation that operates in synchronization with a voice message. Balloon 1002 displays a voice message text associated with the agent character. In the present embodiment, the voice message for the print parameter confirmation request is displayed in text. Dialog box 1003 displays the selected print parameters for the confirmation request. In this embodiment, the print parameters requested to be confirmed are 1. Type of print data, 2. Type of printing paper, and 3. Three types of printer cartridge types are prepared.

In FIG. 13, the notification of the confirmation request item is
The notification is made by voice and graphic, and the confirmation notification can be made by voice, click operation by mouse, and key input by keyboard.

FIG. 14 is a diagram showing a screen for notifying a printing error in the printing system according to the embodiment of the present invention. It is a screen displayed by the printer driver on the display device of the host computer 101. The agent character 1101 is realized by a 3D graphic animation that operates in synchronization with a voice message. Balloon 1102 displays voice message text associated with the agent character. In this embodiment, a voice message notifying a paper jam error is displayed in text. The dialog box 1103 notifies the content of the print error.

In FIG. 14, the print error notification is given by voice and graphic, and the error recovery instruction can be given by voice, a click operation with a mouse, and a key input with a keyboard.

Next, the above-mentioned host computer 101
A method for a user to print a document using a specific application in a printing system in which the printer device 102 and the printer device 102 are connected will be described.

FIG. 15 is a flowchart showing print data selection in the printing method according to the embodiment of the present invention. In step 1201, the user
Select the "Print" command from the command menu of the specific application. In step 1202,
The printer driver is activated and the screen for selecting print data shown in FIG. 10 is displayed on the display device. In step 1203, the printer driver refers to an arbitrary voice notification message database and reads the message information of the print data selection request. In step 1204, the read message information of the print data selection request is transferred to the voice synthesis program, and the voice message which is the print data selection request is voice synthesized. In step 1205, the voice synthesis program outputs the synthesized voice message from the speaker.

The user refers to the voice message output from the speaker and the graphic information and text information on the screen for selecting the print data displayed on the display, and determines the type of print data to be selected. In step 1206, the user speaks a select print data voice command into the microphone. In step 1207, the voice recognition program voice-recognizes the voice command input from the microphone, notifies the printer driver that the voice command has been input, and transfers information related to the input voice command.

In step 1208, the printer driver refers to the voice recognition command database, and in step 1209 determines whether the voice command input in step 1206 is a valid voice command for the print data selection request.

If the voice command is an invalid command, step 1210 follows and the printer driver transfers the voice message information, which is a command error notification, to the voice synthesis program, and the voice message, which is a command error notification, is voiced. To synthesize. And step 12
Returning to 05, the voice synthesis program outputs the synthesized voice message from the speaker, and then waits for the next voice command to be input from the microphone.

On the other hand, if the voice command is a valid command in step 1209, step 12
11, the print data selection process is executed in accordance with the voice command input in step 1206, and then,
The print data selection process ends.

FIG. 16 is a flow chart showing selection of printing paper in the printing method according to the embodiment of the present invention. When the print data selection process ends, the print paper selection process starts next. Step 1301
At, the printer driver displays a screen for selecting the printing paper shown in FIG. 11 on the display device. In step 1302, the printer driver
The message information for the print paper selection request is read by referring to an arbitrary voice notification message database. In step 1303, the read message information for requesting the print sheet selection is transferred to the voice synthesis program, and the voice message requesting the print sheet selection is voice-synthesized. In step 1304, the voice synthesis program outputs the synthesized voice message from the speaker.

The user refers to the voice message output from the speaker and the graphics information and the text information on the screen for selecting the print paper displayed on the display, and determines the type of print paper to be selected. .

In step 1305, the user speaks a print paper selection voice command into the microphone. In step 1306, the voice recognition program voice-recognizes the voice command input from the microphone and notifies the printer driver that the voice command has been input.
Transfers information related to the entered voice command. In step 1307, the printer driver refers to the voice recognition command database and determines in step 1308 whether the voice command input in step 1305 is a valid voice command for the print paper selection request.

If the voice command is an invalid command, the process advances to step 1309, the printer driver transfers the voice message information, which is a command error notification, to the voice synthesis program, and the voice message, which is a command error notification, is voiced. To synthesize. And step 13
Returning to 04, the voice synthesis program outputs the synthesized voice message from the speaker, and then waits for the next voice command to be input from the microphone.

On the other hand, if the voice command is a valid command in step 1308, step 13
In step 10, the print paper selection process is executed in accordance with the voice command input in step 1305, and then the print paper selection process ends.

FIG. 17 is a flowchart showing the selection of the printer cartridge in the printing method according to the embodiment of the present invention. When the print paper selection process ends,
Next, the printer cartridge selection process is started. In Step 1401, the printer driver
The screen for selecting the printer cartridge shown in 1 is displayed on the display device. In step 1402, the printer driver refers to an arbitrary voice notification message database and reads the message information of the printer cartridge selection request. In step 1403,
The read message information of the printer cartridge selection request is transferred to the voice synthesis program, and the voice message requesting the printer cartridge selection is voice-synthesized. In step 1404, the voice synthesis program outputs the synthesized voice message from the speaker.

The user refers to the voice message output from the speaker and the graphics information and the text information on the screen for selecting the printer cartridge displayed on the display, and determines the type of the printer cartridge to be selected. .

In step 1405, the user speaks a printer cartridge select voice command into the microphone. In step 1406, the voice recognition program voice-recognizes the voice command input from the microphone, notifies the printer driver that the voice command has been input, and transfers information related to the input voice command. In step 1407, the printer driver refers to the voice recognition command database, and in step 1408, determines whether the voice command input in step 1405 is a valid voice command for the printer cartridge selection request.

If the voice command is an invalid command, the process advances to step 1409, and the printer driver transfers the command error notification voice message information to the voice synthesizing program and voice-synthesizes the voice message which is the command error notification. . Then, returning to step 1404, the voice synthesis program outputs the synthesized voice message from the speaker, and then waits for the next voice command to be input from the microphone.

On the other hand, if the voice command is a valid command in step 1408, step 14
In step 10, the printer cartridge selection process is executed in accordance with the voice command input in step 1405, and then the printer cartridge selection process is ended.

FIG. 18 is a flowchart showing confirmation of print parameters in the printing method according to the embodiment of the present invention. When the printer cartridge selection process is completed, the print parameter confirmation process is started next. In step 1501, the printer driver displays a screen for confirming the printer parameters shown in FIG. 13 on the display device. Step 150
In 2, the printer driver refers to an arbitrary voice notification message database and reads the message information of the print parameter confirmation request. Step 1503
Then, the read message information of the print parameter confirmation request is transferred to the voice synthesis program, and the voice message requesting the confirmation of the print parameters is voice synthesized. In step 1504, the voice synthesis program outputs the synthesized voice message from the speaker.

The user confirms the print parameter by referring to the voice message output from the speaker and the graphics information and the text information on the screen for confirming the printer parameter displayed on the display.

In step 1505, the user speaks a print parameter confirmation command into the microphone. In step 1506, the voice recognition program voice-recognizes the voice command input from the microphone, notifies the printer driver that the voice command has been input, and transfers information related to the input voice command. In step 1507, the printer driver refers to the voice recognition command database, and in step 1508 determines whether the voice command input in step 1505 is a valid command for the print parameter confirmation request.

If the voice command is an invalid command, the process advances to step 1509, the printer driver transfers the command error notification voice message information to the voice synthesis program, and voice synthesizes the command error notification voice message. Then, returning to step 1504,
The voice synthesis program outputs the synthesized voice message from the speaker and then waits for the next voice command to be input from the microphone.

On the other hand, if the voice command is a valid command in step 1508, step 15
In step 10, the print parameter confirmation processing is executed according to the voice command input in step 1505. When the print parameter confirmation processing ends, step 15
At 11, the printer driver starts the printing process. That is, the image data of the document is rendered to generate print data, and then the generated print data is sent to the printer device.

FIG. 19 is a flow chart showing notification of a print error in the printing method according to the embodiment of the present invention. Prior to sending the print data to the printer device, the printer driver monitors the status of the printer device in step 1601 to check whether a print error has occurred.

If a print error occurs in step 1601, the process advances to step 1602, the printer driver displays the screen for notifying the print error shown in FIG. 14, and an arbitrary voice is output in step 1603. The print error notification message information is read by referring to the notification message database. In step 1604, the read print error notification message information is transferred to the voice synthesis program, and the voice print error notification message is voice synthesized. In step 1605, the voice synthesis program outputs the synthesized voice message from the speaker.

The user refers to the voice message output from the speaker and the graphic information and text information of the screen for notifying the print error displayed on the display, and executes error recovery of the printer device.

In step 1606, the user speaks a print error recovery voice command to the printer driver into the microphone. In step 1607, the voice recognition program voice-recognizes the voice command input from the microphone, notifies the printer driver that the voice command has been input, and transfers information related to the input voice command. In step 1608, the printer driver refers to the voice recognition command database, and in step 1609, step 16
It is determined whether the voice command input in 06 is a voice command valid for the error recovery process.

If the voice command is an invalid command, the process advances to step 1610, the printer driver transfers the command error notification voice message information to the voice synthesis program, and voice synthesizes the command error notification voice message. Then, returning to step 1605,
The voice synthesis program outputs the synthesized voice message from the speaker and then waits for the next voice command to be input from the microphone.

On the other hand, if the voice command is a valid command in step 1609, step 16
In step 11, the printing process is restarted according to the voice command input in step 1606. And step 1
At 611, the printer driver sends the print data to the printer device.

If no print error has occurred in step 1601, the process advances to step 1611, and the printer driver sends the print data to the printer device.

Next, in step 1612, the printer driver determines that the print data to be sent to the printer device is
Check to see if it's still there. Here, if the print data remains, the process returns to step 1601,
The above process is repeated until all print data is sent to the printer. On the other hand, if no print data remains in step 1612, all print processing ends.

Next, a voice synthesis method corresponding to the type of message to be notified will be described. As described with reference to FIG. 9, when performing voice synthesis, the text data that is the source of the voice to be synthesized is transferred to the voice synthesis program. This text data is composed of a language part that expresses words that are synthesized as sounds and an attribute part that gives them a change. Parameters for changing four types of volume, sex, pitch, and speed are described in the attribute section that gives a change. There are 3 levels of volume,
Gender can be adjusted by gender, pitch can be adjusted in 3 steps, and speed can be adjusted in 3 steps. When the attribute part does not exist in the text data, the voice is synthesized by the usual method.

Table 2 shows an example 1 of the description method of text data.
Indicates. Here, an example in the case of running out of printing paper is shown. Text data and attribute part shown in Table 2 (Print: Paper: There is: No; Medium; Female; Medium; Medium;)
Is sent to the voice synthesizing program, the volume is a normal female voice, the pitch is a medium voice and the speed is a medium voice, and a message notifying that the printing paper is out is reproduced from the host computer.

[0102]

[Table 2]

Similarly, the print error notification shown in FIG. 14 will be described. Table 3 shows a description method of the text data in the notification of the printing error.

[0104]

[Table 3]

According to the description method of Example 2, the most important part of the message synthesized in FIG. 14, “Paper jam occurred”, is synthesized at the normal height of a woman with a loud volume, and slowly. The voice is played back at the speaking style (slow speed)
Call attention to what is happening. The next part "Remove the jammed paper from the printer and press the reset button on the printer" says "Because it is less urgent and important than paper jam, it is synthesized with a normal female voice and the normal speed is used. If you want to play in the normal way, you can only specify “female” as the attribute part. If the standard playback sound is female, the entire attribute part is omitted. It is possible.
In this way, what kind of voice and speed of which each status shown in Table 1 is notified are determined by its importance and urgency.

The voice reproduction speed information is designated in advance according to the importance and urgency of a specific voice message. That is, it is specified that the reproduction speed becomes slower for the voice messages having higher importance and urgency. It may also be specified according to the length of a specific voice message. That is, the longer the voice message, the faster the reproduction speed may be specified.

Table 4 shows the voice messages synthesized with the statuses of Table 1 and their urgency. Table 5 shows the relationship between the urgency and the attributes. In the present invention, the information in Tables 4 and 5 is stored in the host computer as a database used in speech synthesis. With such a configuration, even when the status in Table 1 increases, it becomes possible to add the status relatively easily.

[0108]

[Table 4]

[0109]

[Table 5]

FIG. 20 is a flowchart showing a voice synthesizing method in the printing method according to the embodiment of the present invention. A method of changing the voice synthesis method according to the contents of the state to be notified will be described. FIG. 20 shows steps 1603 and 1604 in the print error notification shown in FIG.
Will be described in more detail.

First, in step 1701, the type of print error data is determined. This data is data indicating the printer status shown in Table 1. In step 1702, the text data body part to be synthesized as voice and the parameters of urgency / importance are acquired by referring to the database in Table 4. In step 1703, the data of the attribute part is acquired by referring to the database of Table 5 for the acquired parameters of urgency and importance. In step 1704, text data for voice synthesis is synthesized from the text body and the attribute. In step 1705, the text data that is the source of the speech synthesis is transferred to the speech synthesis program.

Next, in step 1706, the speech synthesis program analyzes the text data for speech synthesis. In step 1707, the text data body part and the attribute part are separated. In step 1708,
The existence of the attribute part is checked, and if it exists, the data of the attribute part, for example, the pitch and the reproduction speed are set in the voice synthesis program in step 1709. In step 1710, language processing for adding language information such as phrase relation, reading, accent, etc. is performed on the text data body. In step 1711, the voice synthesis program generates voice waveform data corresponding to the transferred text data using the voice segment dictionary, the data of the process parameter and the attribute part, and in step 1712, generates the voice waveform data as a sound source. Transfer to control program.

In the above-described voice synthesizing method, the attribute part for instructing the voice synthesizing method has been determined in advance, but in the following description, a means for the user to change the contents of the attribute part will be described.

FIG. 21 is a diagram showing a screen for changing the contents of the attribute part in the voice synthesizing method. A dialog 1801 displays a list of voice data synthesized and output as voice and the value of the attribute part set in them. List box 1802
Displays a list of messages to be voice-synthesized. The message displayed here is the text data body sent to the speech synthesis program. The user selects a message for which the attribute section is to be changed, using the instruction means on the screen. The selected message is highlighted. In order to change the data included in the attribute part, it has a volume selection part 1803, a gender selection part 1804, and a pitch selection part 1805 that selects the pitch of the sound.

The apply button 1806 is used to apply the selected volume, gender, and pitch to the highlighted message. The end button 1807 is a button for ending this voice synthesis method setting application.

FIG. 22 is a flowchart showing the change of the attribute part in the voice synthesizing method. In step 1900, a list of messages registered for voice synthesis is displayed in list box 1802. In step 1901, it is checked whether the apply button 1806 has been pressed. If not pressed, it is checked in step 1903 whether the end button 1807 has been pressed. If not pressed, the process returns to step 1901. When the end button 1807 is pressed, this application ends.

When the apply button 1806 is pressed,
In step 1902, a volume selection section 180
The selection information regarding the volume of 3 is acquired. Step 190
In 4, the selection information regarding the sex of the portion 1804 for selecting the sex is acquired. In step 1905, the selection information regarding the pitch of the pitch selecting portion 1805 is acquired.
By acquiring the three types of information in steps 1902, 1904, and 1905, all the data set in the attribute part is acquired. Finally, the message selected in the list box 1802 is acquired.

In step 1907, the data acquired for setting the attribute part is compared with the data corresponding to the original attribute part of the selected message. If they are the same by comparison, it is not necessary to reset them, and therefore the processing returns to step 1901. If they are not the same, new data of the attribute part is created in step 1908, and it is saved and recorded in step 1909.

The method of speech synthesis in the information processing apparatus of this embodiment has been described above. However, if speech recognition processing and speech synthesis processing are used in the process of printing processing, this embodiment and printing processing will be performed. It does not matter if the procedure is different.

[0120]

As described above, according to the present invention,
Speech waveform data is synthesized based on a receiving step of receiving status information indicating the status of the printer device and text data corresponding to the status included in the status information received in the receiving step, and features are added to the reproduced sound. Since it has a voice synthesizing step and an output step of reproducing and outputting voice from the voice waveform data synthesized in the voice synthesizing step, it is not only possible to recognize the printer state even when the user is not gazing at the screen. It becomes possible to recognize them more intuitively.

Further, according to the present invention, since the changing step of changing the text data main body portion and the attribute portion stored in the database according to the user's instruction is provided, it is possible to synthesize the voice more matched to the user's taste. It will be possible.

[Brief description of drawings]

FIG. 1 is a diagram showing a state in which a warning message of a conventional printer device is displayed on an information processing device.

FIG. 2 is a diagram showing a printing system according to an embodiment of the present invention.

FIG. 3 is a block diagram showing an internal configuration of a host computer according to an embodiment of the present invention.

FIG. 4 is a block diagram showing an internal configuration of a printer device according to an embodiment of the present invention.

FIG. 5 is a block diagram showing a software configuration of a printing system according to an embodiment of the present invention.

FIG. 6 is a diagram showing an initial screen of an application for displaying a status in the printing system according to the embodiment of the present invention.

FIG. 7 is a diagram showing a screen showing a print sheet run-out of the printer device in the printing system according to the embodiment of the present invention.

FIG. 8 is a flowchart showing a voice recognition method in the printing system according to the embodiment of the present invention.

FIG. 9 is a flowchart showing a voice synthesizing method in the printing system according to the embodiment of the present invention.

FIG. 10 is a diagram showing a screen for selecting print data in the printing system according to the embodiment of the present invention.

FIG. 11 is a diagram showing a screen for selecting a printing sheet in the printing system according to the embodiment of the present invention.

FIG. 12 is a diagram showing a screen for selecting a printer cartridge in the printing system according to the embodiment of the present invention.

FIG. 13 is a diagram showing a screen for confirming print parameters in the printing system according to the embodiment of the present invention.

FIG. 14 is a diagram showing a screen for notifying a printing error in the printing system according to the embodiment of the present invention.

FIG. 15 is a flowchart showing selection of print data in the printing method according to the embodiment of the present invention.

FIG. 16 is a flowchart showing selection of printing paper in the printing method according to the embodiment of the present invention.

FIG. 17 is a flowchart showing selection of a printer cartridge in the printing method according to the embodiment of the present invention.

FIG. 18 is a flowchart showing confirmation of print parameters in the printing method according to the embodiment of the present invention.

FIG. 19 is a flowchart showing a print error notification in the printing method according to the embodiment of the present invention.

FIG. 20 is a flowchart showing a voice synthesis method in the printing method according to the embodiment of the present invention.

FIG. 21 is a diagram showing a screen for changing the contents of the attribute part in the voice synthesis method.

FIG. 22 is a flowchart showing a change of the attribute part in the voice synthesis method.

[Explanation of symbols]

101 Host Computer 102 Printer Device 201 AC Adapter 202 NiMH Secondary Battery 203 Power Supply Unit 204 Power Supply Control IC 205 CPU 206 BIOS 207 LCD 208 Video Controller (VGAC) 209 Video Memory (VRAM) 210 Hard Disk Drive (HDD) 211 Hard Disk Controller (HDC) 212 DMA Controller (DMAC) 213 Port (PORT) 214 Floating Point Processor (FPU) 215 Real Time Clock (RTC) 216 Keyboard Controller (KBC) 217 Keyboard 218 System Main Memory 219 Floppy®・ Disk Controller (FDC) 220 Floppy (registered trademark) ・ Disk Drive (FD) ) 221 Interrupt controller (IRQC) 222 Serial interface (SIO) 223 Sound source board (SB) 224, 340, 413 Speaker 225, 339, 412 Microphone 301 Power switch 302 Cartridge replacement switch 303 Reset switch 304, 305 LED 306 Commercial power supply 307 AC Adapter 308 DC 5V 309 DC 24V 310 Interrupt signal 311 Address bus 312, 324 Data bus 313 Interrupt signal line 314 Printer control gate array 315 DRAM 316 ROM 317 MPU 318, 326, 330, 336, 337 Signal line 319 Carriage motor 320 Feed motor 321 Control line 322 Ink cartridge 323 Interface control signal 325 Analog Switch 327 Interface controller 328 Data signal line 329 Centronics connector 331 Flash memory 334 USB A type connector 335 USB B type connector 338 USB MPU 400 Application program 401 Printer driver 402 USB port monitor 403 USB port driver 404 USB common driver 405 USB printer 406 Voice Recognition program 407 Speech synthesis program 408 Speech recognition database 409 Speech synthesis database 410 Sound source control program 411 Sound source board

Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G10L 13/08 G10L 5/04 F 21/06 3/00 S // B41J 29/42 Q (72) Inventor Takahiro Onsen 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. (72) Inventor Masaru Mata 3-30-2 Shimomaruko, Ota-ku, Tokyo Canon Inc. F-term (reference) 2C061 AQ05 AS02 CQ32 CQ34 5B021 AA01 QQ07 5D045 AA07 AA08 AB16 5E501 AA06 BA05 BA13 CA04 CB02 CB09 CB15 EA21 FA32 FA43

Claims (12)

[Claims] 1. A voice guidance method for audibly notifying the state of the printer device in a printing system including an information processing device and a printer device,
The information processing apparatus synthesizes voice waveform data based on a receiving step of receiving status information indicating a status of the printer apparatus, and text data corresponding to the status included in the status information received in the receiving step. A voice in a printing system, which executes a voice synthesizing step of adding a feature to a voice to be reproduced, and an output step of reproducing and outputting a voice from the voice waveform data synthesized in the voice synthesizing step. Guidance method. 2. The voice synthesizing step refers to a database for text data main body part in which a message is described, which corresponds to the state included in the state information, and a parameter indicating urgency or importance. A first acquisition step of acquiring, and a second acquisition step of acquiring an attribute part corresponding to the parameter acquired in the first acquisition step by referring to the database, the text data main body part and the attribute part 2. The voice guidance method in the printing system according to claim 1, wherein the voice data is synthesized by combining and to form the text data. 3. The voice in the printing system according to claim 2, wherein the attribute portion includes any one of information for adding a feature relating to volume, sex, pitch and speed of reproduced voice. Guidance method. 4. The voice guidance method in a printing system according to claim 2, wherein the information processing device executes a display step of displaying the message described in the text data body on a display. . 5. The information processing apparatus executes a changing step of changing the text data body section and the attribute section stored in the database according to a user's instruction. Guidance method for printing system in Japan. 6. An information processing apparatus for notifying a voice of a status of the printer apparatus in a printing system configured by the information processing apparatus and the printer apparatus, and receiving means for receiving status information indicating a status of the printer apparatus. A voice synthesizing unit for synthesizing voice waveform data based on the text data corresponding to the state included in the state information received by the receiving unit and adding a feature to the reproduced voice, and the voice synthesizing unit for synthesizing the voice waveform data. An information processing apparatus in a printing system, comprising: an output unit that reproduces and outputs voice from the voice waveform data. 7. The voice synthesizing means refers to a database for a text data body part in which a message is described, which corresponds to the state included in the state information, and a parameter indicating urgency or importance. The text data body part and the attribute part, including first acquisition means for acquiring, and second acquisition means for acquiring the attribute part corresponding to the parameter acquired by the first acquisition part by referring to the database. 7. The information processing apparatus in the printing system according to claim 6, wherein the text data is synthesized by combining and to synthesize a voice. 8. The information in the printing system according to claim 7, wherein the attribute portion includes any one of information for adding a feature relating to volume, sex, pitch and speed of reproduced voice. Processing equipment. 9. The information processing apparatus in a printing system according to claim 7, further comprising display means for displaying the message described in the text data body. 10. The information processing in the printing system according to claim 7, further comprising a changing unit that changes the text data main body portion and the attribute portion stored in the database according to a user's instruction. apparatus. 11. A receiving device for receiving status information indicating the status of the printer device to a computer of the information processing device, which notifies by voice the status of the printer device in a printing system including the information processing device and the printer device. A voice synthesizing step of synthesizing voice waveform data based on the text data corresponding to the state included in the state information received in the receiving step and adding a feature to a reproduced voice; and the voice synthesizing step. And a computer-readable recording medium recording a program for executing an output step of reproducing and outputting a voice from the voice waveform data synthesized in the above. 12. A reception system for receiving a status information indicating the status of the printer device to a computer of the information processing device, which notifies the status of the printer device by voice in a printing system including the information processing device and the printer device. A voice synthesizing step of synthesizing voice waveform data based on the text data corresponding to the state included in the state information received in the receiving step and adding a feature to a reproduced voice; and the voice synthesizing step. A program for executing an output step of reproducing and outputting a voice from the voice waveform data synthesized in.