JP2003051887A - Control system and control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a control system and method that can accurately control a plurality of connected devices being control objects by means of voice so as to eliminate the need for mounting a voice recognition software program on each device. SOLUTION: A mobile terminal 200 receives identification information used to identify a device 300a from the device 300a. The mobile terminal 200 transmits voice data acquired on the basis of an entered voice to a server 100. The server 100 identifies the device 300a on a network 600 on the basis of the received identification information. Further, the server 100 converts the received voice data into a control instruction given to the identified device 300a. Then the server 100 transmits the control instruction obtained by the conversion to the identified device 300a. The identified device 300a receives the control instruction from the server 100 and executes a job on the basis of the control instruction.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a control system and a control method for controlling a device by voice, and a portable terminal, a device, a data processing device, a control program, and a control program used in this control system. Computer-readable recording medium.

[0002]

2. Description of the Related Art A technique for selecting a desired procedure from a plurality of procedures by recognizing a voice input by a user is widely used for a tele-operating service using a telephone. In the tele-operating service, the user can select a desired operation procedure by indicating a number by voice.

There is also known a technique for automatically controlling a device by recognizing a voice input by a user. For example, an interactive user support system using artificial intelligence is disclosed in Japanese Patent Laid-Open No. 7-72767.

In the support system described in this publication, a microphone is built in the device itself to be controlled. The user inputs voice into this microphone. The device to be controlled performs voice recognition processing on the input voice and executes a job in accordance with the control command obtained by the voice recognition processing. Here, a job is
It means one work unit such as printing, copying, or scanning.

However, when a plurality of devices are arranged adjacent to each other, depending on the directivity and sensitivity of the microphone, not only the voice is input to the device desired by the user, but also other devices not desired by the user. Audio may be input to the device. Therefore, in this case, incorrect control may be performed.

Further, when a plurality of devices are configured to be controllable by voice, it is necessary to provide each device with voice recognition software and dedicated hardware. Therefore, the manufacturing cost of the device may increase. Furthermore, even in the actual use phase, the appearance of the user who inputs voice to the device such as the printer and the copying machine is different from that of the handset such as the mobile phone. It is hard to say that it is more sophisticated than the input method.

[0007]

SUMMARY OF THE INVENTION The present invention has been made to solve the above conventional problems. An object of the present invention is to provide a novel control system and control method capable of controlling a device by voice without inputting voice to a microphone provided in the device itself to be controlled.

Another object of the present invention is that, when a plurality of devices are arranged adjacent to each other, erroneous control is performed as a result of erroneous input of voice to a device not desired by the user. It is to provide a control system and a control method capable of preventing the above.

Still another object of the present invention is to eliminate the need to provide voice recognition software and dedicated hardware for each device even when a plurality of devices are controllable by voice, It is an object of the present invention to provide a control system and a control method capable of reducing the manufacturing cost of the.

Still another object of the present invention is to provide a portable terminal, a device, a data processing device, a control program, and a computer-readable recording medium used in each of the above control systems.

[0011]

Means for achieving the above object is configured as follows.

(1) The control system of the present invention has a device to be controlled, a data processing device connected to the device through a network, and a portable terminal capable of communicating with the device and the data processing device. A control system for controlling the device, wherein the mobile terminal has voice input means for inputting voice, and voice for transmitting voice data obtained based on the input voice to the data processing device. And a data transmission unit, wherein the data processing device comprises:
A voice data receiving unit that receives the voice data from the portable terminal, a converting unit that converts the received voice data into a control command to the device, and the control command obtained by the converting unit to the device to the network. And a control command receiving unit that receives a control command from the data processing device, and executes a job according to the control command.

(2) The device of (1) above is provided with an identification information transmitting means for transmitting identification information used for identifying the device itself to the portable terminal, and the portable terminal is provided with the identification information from the device. A portable identification information receiving means for receiving information; and a portable identification information transmitting means for transmitting the identification information received from the device to the data processing device,
The data processing device further includes a specifying unit that specifies the device on the network based on identification information received from the mobile terminal, and the converting unit specifies the received voice data by the specifying unit. And converting the control command to the device, and the control command transmitting unit transmits the control command to the device specified by the specifying unit.

(3) The mobile terminal of the present invention converts the received voice data into a control command for specifying the device on the network based on the received identification information, and the received voice data to the device specified by the specifying device. A data processing device comprising conversion means and control command transmission means for transmitting the control command obtained by the conversion means to the device specified by the specifying means through a network; and the control command received from the data processing device. A portable terminal used in a control system having the device for executing a job in response to the identification information used for identifying the device from the device itself; Portable identification information transmitting means for transmitting the identification information to the data processing device, and for inputting voice Characterized in that it has a voice input unit, and audio data transmission means for transmitting the audio data obtained based on the sound to the data processing apparatus is input, the.

(4) The device of the present invention includes a mobile terminal equipped with voice data transmitting means for transmitting voice data obtained based on input voice to a data processing device, and identification information received from the mobile terminal. Specifying means for specifying a device on the network based on the network, converting means for converting voice data received from the portable terminal into a control command for the device specified by the specifying means, and the control command obtained by the converting means In a device used for a control system having a data processing device including a control command transmitting means for transmitting a control command transmitting means to a device specified by the specifying means through a network, the identification information used for specifying the device itself. The identification information transmitting means for transmitting to the mobile terminal, and the control command obtained by converting the voice data, A control command receiving means for receiving from the data processing device, and is characterized by executing a job in response to the control command.

(5) The data processing device of the present invention comprises a portable terminal equipped with a voice input means for inputting voice, and an identification information transmitting means for transmitting the identification information used for identifying the device to the portable terminal. And a control command receiving unit that receives a control command, and a device that executes a job in response to the control command, in a data processing apparatus used in a control system, the identification including receiving the identification information from the mobile terminal. Information receiving means, and specifying means for specifying the device on the network based on the identification information,
Voice data receiving means for receiving voice data obtained based on the inputted voice from the portable terminal; conversion means for converting the received voice data into a control command to the device specified by the specifying means; Control command transmitting means for transmitting the control command obtained by the converting means to the device specified by the specifying means through a network.

(6) A control method according to the present invention is a method for controlling a device, wherein a step in which a portable terminal receives identification information used to identify the device from the device itself, and a network in the device. A step in which the mobile terminal transmits the identification information to a data processing device connected through, a step in which the mobile terminal transmits voice data acquired based on voice input to the mobile terminal to the data processing device, A step in which the data processing device specifies the device on the network based on the received identification information; and a control instruction to the device specified by the data processing device, based on the identification information, on the received voice data. And a step of converting the control instruction obtained by the conversion to a device specified based on the identification information. A step of signal, the device receives a control command from said data processing apparatus characterized by having the steps of: executing a job in response to the control command.

(7) The control program of the present invention converts the received voice data into a control command for specifying the device on the network based on the received identification information, and the received voice data to the device specified by the specifying device. A data processing device comprising conversion means, and control command transmission means for transmitting the control command obtained by the conversion means to a device specified by the specifying means through a network;
A control program in a mobile terminal used in a control system, comprising: the device that executes a job according to the control command received from the data processing device;
The process of receiving the identification information used to identify the device from the device itself, the process of transmitting the received identification information to the data processing device, the process of inputting voice, and the input The computer is caused to execute a process of transmitting voice data obtained based on voice to the data processing device.

(8) The control program of the present invention comprises a portable terminal equipped with voice data transmitting means for transmitting voice data obtained based on the input voice to the data processing device,
Specifying means for specifying a device on a network based on identification information received from the mobile terminal; conversion means for converting voice data received from the mobile terminal into a control command for the device specified by the specifying means; and A control program in a device used in a control system, comprising: a data processing device including a control command transmitting unit that transmits the control command obtained by the converting unit to the device identified by the identifying unit via a network, A process of transmitting the identification information used to identify the device itself to the mobile terminal, a process of receiving a control command obtained by converting the voice data from the data processing device, and a process of receiving the control command according to the control command. And causing the computer to execute processing for performing operation settings related to job execution.

(9) The control program of the present invention comprises a mobile terminal equipped with voice input means for inputting voice, and identification information transmission means for transmitting identification information used for identifying a device to the mobile terminal. And a control command receiving unit that receives a control command, and a device that executes a job in response to the control command. A process of receiving from the mobile terminal, a process of identifying the device on the network based on the identification information, a process of receiving voice data obtained from the input voice from the mobile terminal, and a received voice A process of converting data into a control command for the device specified based on the identification information; and the control command obtained by the conversion means, To execute a process of transmitting over the network to the specified device based on another information, to the computer.

(10) A computer-readable recording medium of the present invention records the control program described in any one of (7) to (9) above.

[0022]

BEST MODE FOR CARRYING OUT THE INVENTION Next, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing an example of a control system according to an embodiment of the present invention. This control system includes a plurality of control target devices 300a and 300b.
And these devices 300a and 300b and the network 6
A server 100 (data processing device) connected through 00, and a portable terminal 200 capable of communicating with the devices 300a and 300b and the server 100. Here, the network 600 is a LAN (local area network: local area communication network), WAN (wide area network: wide area communication network), or the Internet.

In the present embodiment, the devices 300a and 300b to be controlled are digital copying machines. However, the types and the number of devices to be controlled are not limited to those shown in FIG. Different from the present embodiment, various OA (office automation) devices such as printers, facsimiles, and scanners can be used as the devices to be controlled. As a device to be controlled, a multi-function peripheral device (mult) that has a multi-function such as a facsimile function or an e-mail transmission function in addition to a function of reading a document to obtain image data
i-function peripheral) can also be used.

The mobile terminal 200 is a device 3 to be controlled.
It is possible to perform near field communication with 00a and 300b. For example, as the near field communication, IrDA (infrared data association), which is an example of infrared communication, may be adopted, or Bluetooth (R) using a frequency hopping type spread spectrum system may be adopted. On the other hand, the mobile terminal 200 can communicate with the server 100 through the public line network 700. Mobile terminal 2
00 directly wirelessly communicates with the base station 500. As a result, the mobile terminal 200 connects to the public line network 700. Further, the server 100 is connected to the public line network 700 using a peripheral device such as a modem 400 or a terminal adapter (TA) not shown. As a result,
A communication connection is established between the mobile terminal 200 and the server 100. The public line network 700 may include a mobile phone network.

Next, the configurations of the mobile terminal 200, the server 100, and the devices 300a and 300b shown in FIG. 1 will be described.

FIG. 2 is a block diagram showing the configuration of the mobile terminal 200. In the present embodiment, the mobile terminal 200 is
It is a mobile phone.

The CPU 201 performs control and calculation, and gives instructions to the control unit 202 and other blocks. The control unit 202 acquires the state of each block and performs various input / output management. The ROM 203 stores a control program. The RAM 204 temporarily stores data and information as a working area.

The operation unit 205 makes various inputs. The operation unit 205 is used, for example, when setting a communication connection destination. The operation unit 205 is specifically a mechanical key. The display panel 206 displays various information.
For example, the display panel 206 displays various information such as names and icons corresponding to the devices 300a and 300b or the server 100 with which the mobile terminal 200 is trying to make a communication connection.

The voice input unit 207 is a microphone for inputting voice. The voice input unit 207 is used not only in the case of a telephone call like an ordinary mobile phone, but also the contents of various settings (hereinafter, referred to as “operation settings”) such as print conditions and copy conditions in the device 300a or 300b. Is also used by the user to indicate by voice.

The AD converter 208 digitizes analog format audio data corresponding to the input audio,
Convert to audio data in digital format. On the other hand, the DA converter 209 converts digital audio data received from another mobile terminal (not shown) into analog audio data. The voice output unit 210 is a speaker for outputting voice.

The encoding / encoding unit 211 encrypts and encodes the audio data digitized by the AD converter 208. Therefore, the AD converter 208
According to the processing by the encoding / encoding unit 211, digitization, encoding,
Encrypted and encoded audio data is acquired.

The antenna 212 transmits the above voice data acquired based on the input voice to the server 100 through the base station 500 and the public line network 700. The antenna 212 is also used to transmit various information from the mobile terminal 200 to the server 100.

The portable short-range communication section 213 is used for the device 300.
This is an interface for short-range communication with a or 300b. The portable short-range communication unit 213 is, for example, IrDA or Bluetooth as described above.
It corresponds to (R).

Unlike the present embodiment, a PDA (personal digital assistants) or a portable computer having a voice input function and a voice data transmission function is used as a portable terminal instead of a portable telephone. You can also In this case, it is not necessary to provide the DA converter 209 and the audio output unit 210.

FIG. 3 is a block diagram showing the configuration of the server 100. The server 100 is a computer that provides various services on the network 600, and functions as a data processing device.

CPU 101, control unit 102, ROM 10
Since the function of 3 is the same as that shown in FIG. 2, the description thereof will be omitted. The storage unit 104 includes a hard disk and a RAM, and stores various data and information.

The operation unit 105 is for inputting various inputs, and is, for example, a pointing device such as a keyboard and a mouse. The display 106 displays various information such as the state of the server 100 and the setting contents.

Speech recognition section 107 and command conversion section 1
The fact that 08 is provided in the server 100 is one of the characteristic configurations of the present invention. The voice recognition unit 107 performs voice recognition processing on the voice data received from the mobile terminal 200. More specifically, the voice recognition unit 107
Extraction processing of predetermined words and phrases included in the received voice data and analysis, conversion, and replacement of the extracted words and phrases are executed.

The command conversion unit 108 includes a voice recognition unit 10
Based on the data obtained by
Convert to a control command to 0a or 300b. here,
The control command is information for controlling each device such as a digital copying machine and a printer. More specifically, the control command is a print condition in a job executed by the device,
It is a command for instructing various settings such as copy conditions or scan conditions, that is, the above-mentioned operation settings. In this way, the voice recognition unit 107 and the command conversion unit 108 function as a conversion unit that converts the voice data received from the mobile terminal 200 into a control command for a predetermined device.

The job management unit 109 manages each job. Job management includes job registration, execution cancellation, addition, deletion, update, and execution order change. A queue is used to manage jobs.

The interface 110 has two interface functions. One function is the network 60
0 is an interface function for the network 600 for communicating with the devices 300a and 300b to be controlled through 0. Another function is an interface function for the public line network 700 for communicating with the mobile terminal 200 by connecting to the public line network 700 through a peripheral device such as the modem 400.

The server 100 is the network 60.
The identification information (ID) of a predetermined device connected to 0, for example, the device 300a, is input from the mobile terminal 200 to the interface 1
Receive through 10. Here, the identification information is information for identifying a predetermined device from a plurality of devices. Details of the identification information will be described later. In addition, the control unit 102
The network 600 based on the received identification information.
A predetermined device 30 out of a plurality of devices connected to the
In charge of processing for identifying 0a.

FIG. 4 is a block diagram showing the configuration of the device 300a. The device 300b has the same configuration as the device 300a. CPU 301, control unit 302, RO
The function of M303 is similar to that shown in FIG.
The function of the storage unit 304 is similar to that shown in FIG. Therefore, detailed description is omitted.

The operation panel 305 performs various inputs and displays, and is specifically a touch panel and mechanical keys other than the touch panel.

The document reading unit 306 is a scanner engine and obtains image data by reading a document.
The printing unit 307 is a printer engine and prints out on paper based on image data obtained by reading a document.

The short-range communication unit 308 is an interface for short-range communication with the portable terminal 200. The short-range communication unit 308 uses, for example, IrDA as described above.
Alternatively, it corresponds to Bluetooth (R). The interface 309 is an interface for communicating with the server 100 and other devices via the network 600.

In the device 300a shown in FIG. 4, similar to a normal digital copying machine, the operation panel 305 can be used to instruct various settings such as printing conditions in a job executed by the device, that is, operation settings. In addition to being able to do so, it is possible to instruct the operation setting by the voice input to the mobile terminal 200 by the user.

The control system of the present embodiment configured as described above operates as follows.

FIG. 5 is a sequence chart showing the operation of the control system in this embodiment. Figure 5 above
The operation of the control system will be described with reference to FIG.

In step S1, the mobile terminal 200 transmits a connection request to the device desired by the user. In the present embodiment, a case where mobile terminal 200 transmits a connection request to device 300a will be described as an example.

In step S2, the device 300a transmits, to the portable terminal 200, identification information (ID) used to identify the device 300a itself from the plurality of devices. The mobile terminal 200 receives the identification information from the device 300a.

In step S3, the mobile terminal 200 transmits the identification information received from the device 300a to the server 100. More specifically, the identification information is transmitted to the server 100 via the base station 500 and the public line network 700.

In step S4, the server 100 selects the device 300 from the plurality of devices on the network 600 based on the identification information received from the portable terminal 200.
a is specified. Then, the server 100 establishes a communication connection with the specified device 300a.

In step S5, the fact that the communication connection has been established (hereinafter referred to as "connection completion notification") is transmitted from the device 300a to the server 100. In addition, if necessary, the device 3
Information regarding the status of 00 (hereinafter, referred to as “status information”) may be transmitted to the server 100. In step S6, the connection completion notification received in step S5 is transmitted from the server 100 to the mobile terminal 200.

In step S7, voice is input using the voice input unit 207 of the mobile terminal 200. Step S
In 8, the mobile terminal 200 transmits the voice data acquired based on the input voice to the server 100. The server 100 receives voice data from the mobile terminal 200.

In step S9, the server 100 executes voice recognition processing of the received voice data. In step S10, the server 100 converts the received voice data into a control command for the device 300a specified in step S4. Specifically, the conversion process is executed using the command conversion unit 108.

In step S11, the server 100 sends the control command obtained by the command conversion unit 108 to the device 3
Send to 00a. That is, the server 100 transmits the control command to the device 300a identified in step S4.
The control command is transmitted through the network 600.

In step S12, the fact that the control command converted based on the voice data is received by the device 300a (hereinafter referred to as "control command reception completion notification") is transmitted from the device 300a to the server 100. Further, in step S13, the notification of the completion of receiving the control command is sent to the server 10.
It is transmitted from 0 to the mobile terminal 200.

In step S14, the instruction to start the execution of the job (hereinafter referred to as "job start instruction") is issued by the portable terminal 2
00 to the server 100. In step S15, the job management unit 104 of the server 100 manages jobs.

In step S16, the server 100 sends a job start instruction to the device 300a. Step S1
In step 7, the device 300a that has received the job start instruction executes the job according to the operation setting according to the control command.

In step S18, the device 3 indicates that the job execution is completed (hereinafter referred to as "job execution completion notification").
00a is transmitted to the server 100. Further, in step 19, the job execution completion notification is transmitted from the server 100 to the mobile terminal 200.

In step S20, a request to release the communication connection (hereinafter referred to as "connection release request") is transmitted from the portable terminal 200 to the server 100. As a result, the communication connection between the mobile terminal 200 and the server 100 is released. Furthermore, in S21, the server 100 transmits a connection release request to the device 300a. As a result, the communication connection between the server 100 and the device 300a is released.

As described above, the device 300 to be controlled
When controlling a or 300b based on voice, the user inputs voice to the voice input unit 207, which is a microphone provided in the mobile terminal 200. Voice data acquired based on the input voice is transmitted from the mobile terminal 200 to the server 100. Then, the server 100
Receives the received voice data from the predetermined device 300a or 3
It is converted into a control command to 00b, and the control command is transmitted to a predetermined device. Therefore, the voice recognition process and the control command conversion process can be collectively executed in the server 100. Further, the voice input unit 207 provided in the mobile terminal 200 can be diverted as a voice input microphone for controlling the device.

Further, the identification information used for identifying the device to be controlled from the plurality of devices is transmitted from the portable terminal 200 to the server 100. Server 100
Identifies the device to be controlled on the network 600 based on this identification information. Therefore, even when a plurality of devices are provided adjacent to each other, it is possible to prevent a device that is not desired by the user from being erroneously controlled.

Next, the portable terminal 20 according to the present embodiment
0, the server 100, and each device 300a to be controlled will be described.

6 and 7 are flow charts showing the processing contents of the mobile terminal 200 in the present embodiment. The algorithms shown in the flowcharts of FIGS. 6 and 7 are stored in the ROM 203 as a control program, and the control program is executed by the CPU 201.

In step S100 of FIG. 6, the portable terminal 2
00 transmits a connection request to the device 300a desired by the user. The conventional Bluetooth is used for the connection request transmission process.
Various technologies adopted in communication standards such as oth (R) can be used. For example, the device 300 is within a distance (hereinafter referred to as “communication distance”) in which a predetermined radio wave can be received.
It is determined whether or not a device such as a, 300b exists. Here, the communication distance is preferably within 100 m, more preferably within 10 m. Searching and authentication of all devices existing within this communication distance are executed.
As a result, the name or icon corresponding to the device existing within the communication distance is displayed on the display panel 206. The user uses the operation unit 205 to specify the name or icon corresponding to the desired device 300a. As a result, the connection request is transmitted to the device 300a corresponding to the designated name or icon.

However, unlike the present embodiment, it is possible to adopt a configuration in which the connection request is transmitted to the device closest to the portable terminal 200. In this case, the user brings the mobile terminal 200 close to the desired device and gives a connection request instruction. As a result, a desired device can be automatically selected. Therefore, even a user who is not accustomed to operating the mobile terminal 200 can use the present invention.

Then, wait until the communication connection with the desired device 300a is established (step S101: YE
S), steps S102 and S103 are executed.

In step S102, step S101
The above identification information is received from the device 300a with which the communication connection is established. The identification information is received, for example, using near field communication. The received identification information is stored in the RAM 2
It is temporarily stored in 04. For example, as identification information, the MAC address (media access control a
ddress) can be used. Here, the MAC address means the interface 3 of each device 300a, 300b.
ID unique to the Ethernet (R) card included in 09
It is a number. However, the identification information only needs to be unique information that can distinguish the device 300a from other devices on the network 600, and the identification information is not limited to the MAC address.

In step S103, the status information of the device 300a is received. Note that in a simple system, the process of step S103 may be omitted. Waiting for the reception of the identification information and the status information to be completed (step S104: YES), the process of step S105 is executed. In step S105, the device 300a
The communication connection with is released.

In step S106, a connection request to the server 100 is transmitted. In order to connect to the server 100 through the public line network 700, a calling process is executed.

In step S107, the communication connection between the mobile terminal 200 and the server 100 is established. Specifically, the mobile terminal 200 is communicatively connected to the server 100 through the base station 500 and the public line network 700. Wait for the communication connection between the mobile terminal 200 and the server 100 to be established (step S107: YES), and then step S108.
The process of is executed.

In step S108, step S102
The identification information of the device 300a acquired in
From the server 100 to the server 100. As a result, the server 10
0 receives the identification information of the device 300a desired by the user. The server 100 identifies the device 300a on the network 600 based on the identification information. As a result, the communication connection between the server 100 and the device 300a is established.

In step S109 of FIG. 7, the portable terminal 2
00 receives the connection completion notification between the server 100 and the device 300a. Wait for the reception of the connection completion notification between the server 100 and the device 300a (step S10).
9: YES), and the process of step S110 is executed.

In step S110, the user inputs a voice. The input voice includes instruction information regarding the operation setting of the device. The voice is input using the voice input unit 207, which is a microphone. For example, instructions regarding operation settings such as "Please set the resolution to 400 dpi" and "3 copies, please copy" are input using voice.

In step S111, the voice data acquired based on the input voice is transmitted from the portable terminal 200 to the server 100. Specifically, step S1
The voice input at 10 is initially acquired as voice data in analog format by the voice input unit 207, which is a microphone. This analog audio data is A
It is digitized by the D converter 208. Further, the digitized voice data is encrypted and encoded by the encoding / encoding unit 211. Through the above processing, voice data based on the input voice is acquired. Next, the acquired voice data is transmitted from the mobile terminal 200 to the server 100.

As a result, the server 100 receives the voice data. The server 100 converts the voice data into a control command for the device 300a by performing voice recognition processing on the received voice data. The obtained control command is transmitted to the device 300a specified from the plurality of devices by the identification information.

In step S112, the server 10 sends a notification that the voice recognition processing is impossible or the prohibition has occurred.
It is determined whether or not it is received from 0. When speech recognition processing is impossible in the server 100, and the server 100
Alternatively, when a prohibition described later occurs in the device 300a, a notification that the state in which the voice recognition processing is impossible has occurred or the prohibition has occurred is received. Here, the prohibition refers to a case where correct operation setting cannot be performed as a result of a plurality of setting items interfering with each other. When the notification that the voice recognition processing is impossible or the prohibition has occurred is received (step S112: YES), step S11.
It returns to 0 and the voice is input again.

In step S113, the server 100 receives the notification that the control command has been received, that is, that the control command converted based on the voice data is received by the device 300a. After waiting for the reception of the control command reception completion notification (step S113: YES), the process of step S114 is executed.

In step S114, step S113
The content of the operation setting recognized by the server 100 is displayed on the display panel 206 based on the notification of the completion of reception of the control command received in (1). Therefore, depending on the result of the voice recognition processing in the server 100, the content of the operation setting instructed by the user by voice may not match the content of the operation setting recognized in the server 100.

In step S115, it is determined whether or not a job execution start instruction has been given to the device 300a. For example, when the user confirms that his / her instruction is correctly recognized by the server 100 as a result of confirming the content of the operation setting displayed on the display panel 206 in step S113, the user presses a predetermined button of the operation unit 205. Push. As a result, the start of job execution is instructed.

When the execution of the job is not instructed (step S115: NO), it is determined in step S116 whether the cancel button or the redo setting button provided on the operation unit 205 has been pressed.
When the cancel button or the redo setting button is pressed, the fact that the processing has been canceled is transmitted to the server 100. On the other hand, when the execution start of the job is instructed (step S115: YES), the process of step S117 is executed.

In step S117, the portable terminal 200
Sends a job start instruction using the antenna 212 to the server 1
Send to 00. As a result, the device 300a becomes the server 1
A job execution start instruction is received via 00.

Next, wait for the notification that the job execution is completed in the device 300a, that is, the job execution completion notification is received from the server 100 (step S1).
18: YES), the communication connection with the server 100 is released (step S119).

The processing of the mobile terminal according to the present embodiment has been described above, but the mobile terminal 200 of the present invention is
It may have a function of receiving identification information from a predetermined device and transmitting it to the server 100, a function of inputting voice, and a function of transmitting voice data obtained based on the input voice to the server 100. Good. Therefore, the processing procedure shown in FIGS. 6 and 7 can be appropriately changed and omitted.

Next, the operation of the server 200 will be described.

FIG. 8, FIG. 9 and FIG. 10 are flowcharts showing the processing contents of the server 100 in this embodiment. The algorithm shown in the flowcharts of FIGS. 8, 9 and 10 is the ROM 1 as the control program.
03 is stored in the control program
Executed by 101.

In step S200, a connection request is received from the mobile terminal 200. The connection request is made through the public line network 700.
Be received through. In step S201, a connection process is executed with the mobile terminal 200. As a result, a communication connection is established.

In step S202, the identification information of the device 300a described above is received from the mobile terminal 200. Here, the identification information is the information received by the mobile terminal 200 from the device 300a and temporarily stored in the RAM 204 in the mobile terminal 200. The identification information temporarily stored in the RAM 204 is transmitted by the mobile terminal 200 and received by the server 100.

In step S203, a desired device 300a is searched (searched) from a plurality of devices connected to the network 600 based on the received identification information. As a result, the device 300a is identified based on the identification information.
Wait until the is specified (step S204: YE
S), the process of step S205 is executed.

In step S205, step S204
The connection process is executed with the device 300a specified in step. Then, wait until the communication connection is established between the server 100 and the device 300a (step S206: YE
S), in step S207, the connection completion notification is transmitted from the server 100 to the mobile terminal 200.

In step S208, the status information of the device 300a is further transmitted through the network 600.
And specifications of the device 300a (functions that the device can execute)
Information is received from device 300a.

In step S209 of FIG. 9, the portable terminal 2
00 to receive voice data. As described above, this audio data is data acquired based on the audio input using the audio input unit 207 of the mobile terminal 200.

Next, a voice recognition process is executed on the received voice data. Various techniques proposed in the fields of conventional voice recognition and natural language analysis can be applied to the voice recognition processing in the present embodiment.

At step S210, the voice data is analyzed, and an important word (hereinafter referred to as "keyword") included in the voice data is extracted.

The keyword extracting process is a process of extracting an important phrase for controlling the device from the voice data. Furthermore, when multiple words are extracted,
You may perform the process which links | relates each term. As a result of the keyword extraction processing, it is possible to remove the influence of the difference in the expression method by the user.

More specifically, when instructing to set the resolution to 400 dpi, "resolution is set to 400 dpi
While it can be expressed in detail as "Please set to i", it can also be expressed simply as "resolution is 400 dpi". Also, "resolution 400 dpi"
Instead of the expression
The expression "0 dpi resolution" can also be used.

According to the keyword extraction process, the operation can be set by voice without making the user aware of such expression redundancy and the order of words.

In the above example, "resolution" and "40"
The phrase "0 dpi" is extracted as a keyword. Of course, the words and phrases extracted as keywords are not limited to those related to resolution. Keywords related to various setting items can be extracted.

The types of words that can serve as keywords can be stored in the storage unit 104 in advance as a keyword table (not shown). The keyword can be extracted by comparing the result of analyzing the received voice data with the content of the keyword table. For example,
"Print", "Copy", "Print", "Copies",
It is possible to store the term “part”, terms relating to various units such as “dpi”, and voice data corresponding to various numbers in the keyword table.

In step S211, it is determined whether the keyword can be extracted. If it is difficult to extract the keyword (step S211: NO), step S
The processing of 212 is executed. In step S212, the server 100 transmits, to the mobile terminal 200, a message that the voice recognition process is impossible.

In step S213, it is determined whether the replacement process is necessary. When the replacement process is necessary (step S213: YES), the replacement process shown in step S214 is executed. On the other hand, if the replacement process is unnecessary (step S213: NO), the replacement process of step S214 is not executed. Here, the replacement process is a process of replacing one word with another word. The contents of this replacement process can be stored in advance in a replacement table (not shown), for example.

For example, the phrase “resolution 400” is replaced with the phrase “resolution 400 dpi”.
As a result, even when the unit "dpi" is not voice-input by the user, the unit can be automatically supplemented. As described above, according to the replacement process, it is possible to complement a predetermined word or phrase.

When the word "resolution 400 dots / cm" is recognized by voice, the value when the unit "dot / cm" is changed to "dpi" is calculated, and the calculated value is used. To perform replacement processing. In this way, the replacement process can be executed by using the calculation formula.

Further, when there are two or more words indicating one setting or processing, the substitution processing can be performed to unify the two or more words into one word.

In step S215, it is determined whether or not the order of words and phrases needs to be changed.
If the replacement process is necessary (step S21)
5: YES), the exchange process shown in step S216 is executed. On the other hand, when the replacement process is unnecessary (step S215: NO), the process of step S216 is skipped.

Based on the above processing and other natural language processing, the operation setting instructed by the voice input is recognized. The operation settings are double-sided printing / single-sided printing, color /
Monochrome, number of copies, resolution, paper size, N in 1
It includes various setting items such as (N-up), paper feed port designation, zoom designation, sort / non-sort, staple, and punch.

In step S217, it is determined whether or not a prohibition (prohibition combination) has occurred in the processing in the server 100. Here, the prohibition (prohibited combination) refers to a case where the operation setting cannot be correctly performed as a result of a plurality of setting items interfering with each other as described above.

Specifically, in the copy operation, the designation of non-sort and the designation of stapling interfere with each other and cannot be set at the same time. Further, there is a case where the designation of the predetermined resolution and the designation of the zoom interfere with each other and cannot be set at the same time. Further, the paper feed port designation and the paper size designation may interfere with each other.

When the prohibition occurs (step S21)
7: YES), and the process of step S218 is executed.
On the other hand, if the prohibition does not occur (step S217:
NO), the process of step S218 is skipped.

In step S218, processing for solving the prohibition (hereinafter referred to as "prohibition processing") is executed. Prohibition processing is to prevent multiple setting items from interfering with each other.
This is the process of adjusting the operation settings. For example, a user can give priority to a setting item that is input by voice first and change a setting item that is input by voice later. On the contrary, the setting contents instructed later may be prioritized.

When the prohibition occurs, the portable terminal 200
To the effect that the prohibition has occurred, so that the prohibition is not
The user can be made to input the voice again.

In step S219, the management table is updated. The management table is a table that manages each setting item of operation settings related to a job. The management table is provided in the storage unit 104. Step S210
The content of this management table is updated based on the result obtained by performing the process of step S218. As a result, the management table is updated for each setting item such as paper size and resolution based on the instruction included in the audio data received from the mobile terminal 200.

However, the contents of all the setting items are not always instructed in the received voice data. Therefore, the content of the management table is updated only for the instructed setting item. On the other hand, setting items that have not been instructed are maintained as default settings (initial settings).

In step S220, step S219
A control command to the device 300a specified as the control target is created based on the management table updated in. For example, when the device 300a specified in step S204 is a digital copying machine, a control command similar to the case where a setting item is instructed using the operation panel 305 is created. Note that, unlike the present embodiment, when the specified device 300a is a printer, the control command can be created as a page description language.

As described above, based on the processing of steps S210 to S220, the received voice data is
It is converted into a control command for the specified device 300a. However, unlike the present embodiment, another method may be used to execute the conversion of the voice data into the control command.

In step S221, step S220.
The control command obtained in step S204 is transmitted to the device 300a specified based on the identification information in step S204. The control command is transmitted through the network 600.

At step 222, it is judged whether or not a control command reception completion notice is received from the device 300a to which the control command is transmitted. When the reception completion notification of the control command has not been received (step S222: NO), the process of step S223 is executed. On the other hand, when the reception completion notification of the control command is received (step S222: YE
S), the process of step S225 is executed.

In step S223, it is further determined whether or not the notification that the prohibition has occurred is received in the device 300a to which the control command is transmitted. As will be described later, the server 100 cannot know the existence of the prohibition,
There is a prohibition that the existence of the device 300a becomes clear when the device 300a receives the control command. The process of step S223 is
This is to cope with the occurrence of prohibition in the device 300a.

When the notification that the prohibition has occurred is received from the device 300a (step S223: YES), the server 100 transmits the fact that the prohibition has occurred to the portable terminal 200 in step S224. On the other hand, when the notification that the prohibition has occurred is not received (step S2
23: NO), and the process returns to step S222.

In step S225, as the processing when the reception completion notification of the control command is received from the device 300a,
The reception completion notification of the control command is transmitted to the mobile terminal 200.
Here, the server 100 and the device 3 are preferably included in the reception completion notification transmitted from the server 100 to the device 300a.
The contents of the operation setting recognized in 00a are included.

In step S226, it is determined whether a job start instruction has been received from portable terminal 200. If the job start instruction has not been received (step S22)
6: NO), and the process of step S227 is executed. On the other hand, when the job start instruction is received (step S2
26: YES), and the process of step S228 is executed.

[0125] In step S227, it is determined whether or not the fact that the processing has been canceled is received from portable terminal 200. If the fact that the processing has been canceled has not been received (step S227: NO), step S22.
Return to the processing of 6. On the other hand, if the fact that the processing has been canceled is received, the processing ends.

In step S228, jobs are managed using a queue as a process when a job start instruction is received from the portable terminal 200. Specifically, when a job start instruction is received and another job is being executed, the job for which execution is instructed (more accurately, the job request) is registered in the queue. It As a method of waiting in the queue, for example, a FIFO method in which data is first output from the queue can be adopted. With such a job management function, in the present embodiment, one server 100 is used to operate a plurality of devices 30.
Jobs 0a and 300b can be centrally managed. Therefore, when a malfunction occurs in the identified device 300a, and when it takes more than a predetermined time to execute the job being processed, another device 300b may be configured to execute the job. .

In step S229, after waiting for the job to become executable, the specified device 300a
An instruction to start job execution is output.

In step S230, the job execution completion notification is received from the device, and the received job execution completion notification is transmitted to the portable terminal 200.

As described above, according to the server 100 of the present invention shown in FIG. 8, FIG. 9 and FIG.
The processing of converting the voice data received from 0 into a control command to the predetermined device 300a can be collectively executed in the server 100. Therefore, it is not necessary to install expensive voice recognition software or hardware in each device itself.

As described above, the processing of the server functioning as the data processing apparatus in this embodiment has been described.
The data processing device of the present invention has a function of receiving voice data from a portable terminal, a function of converting the received voice data into a control command for a predetermined device, and a function of transmitting a control command to the predetermined device. Good. Therefore, FIGS.
The processing procedure shown in can be changed and omitted as appropriate.

Next, the operation of the device 300a to be controlled will be described.

11, 12, and 13 are flowcharts showing the processing contents of the device 300a in the embodiment of the present invention.

At step S300, a connection request is received from the mobile terminal 200. After waiting for the connection request to be received (step S300: YES), the connection process with the mobile terminal 200 is executed (step S301). Specifically, as described above, it is desirable to use short-range wireless communication as communication between the device 300a and the mobile terminal 300.

At step S302, the device 300a
The identification information is issued, and the issued identification information is used as the portable terminal 200.
Send to. Further, in step S303, the status information of the device 300a is sent to the mobile terminal 200 as necessary.
Send to.

Waiting until the transmission of the identification information and the status information is completed (step S304: YES), the connection between the device 300a and the portable terminal 200 is released (step S305). The processing of steps S300 to S305 above is performed by the device 300a and the mobile terminal 200.
It is a process between and.

Next, the processing between the server 100 and the portable terminal 200 will be described.

At step S306, a connection request is received from the server 100. Waiting for a connection request to be received (step S306: YES), connection processing with the mobile terminal 200 and transmission of status information to the server 100 are executed (steps S307 and S30).
8).

In step S309 of FIG. 12, the server 1
00 to receive a control command. Wait for receiving a control command from the server 100 (step S309: YE
S), the process of step S310 is executed. In step S310, in response to the received control command, the device 300
a Perform internal operation settings.

In step S311, it is determined whether the device 300a receives a control command to generate a prohibition whose existence becomes clear. When the prohibition occurs (step S311: YES), the processes of steps S312 and S313 are executed. When the prohibition does not occur (step S311: NO), the processes of steps S312 and S313 are skipped.

In step S312, prohibition processing is executed. Further, in step S313, the fact that the prohibition has occurred is displayed on the operation panel 305, and the server 1
Send to 00.

In step S314, it is determined whether an error other than prohibition has occurred. Where the error is
Examples include lack of consumables such as out of paper and out of toner, and paper jam (paper jam). If an error occurs (step S314: YES),
The process of step S315 is executed. On the other hand, if no error has occurred (step S314: NO),
The processes of steps S315 and S316 are skipped.

In step S315, the fact that an error has occurred is displayed on the operation panel 305 and transmitted to the server 100. Then, wait until supply of consumables and paper jam are resolved (step S316: YES),
The process of step S317 is executed.

In step S317, the server 100
Send a control command reception completion notification. Further, in step S318, the content of the operation setting according to the control command is displayed on the operation panel 305.

In step S319, a job start instruction is received from the server 100. Wait for receiving the job start instruction (step S319: YES), and then step S
The process of 320 is executed. Note that, unlike the present embodiment, the user can use the operation panel 305 to instruct the start of job execution regardless of the processing of the mobile terminal 200 and the server 100. In this case, the user
Only complicated operation settings are instructed by voice input to the mobile terminal 200, while relatively simple contents such as a job start instruction are instructed using the operation panel 305 as in a normal digital copying machine. You can

In step S320, the job is executed according to the control command. Then, wait until the execution of the job is completed (step S321: YES), and then step S3.
22 processing is performed.

In step S322, a job completion notification is transmitted to the server 100, and in step S323, the communication connection with the server 100 is released.

As described above, according to the control system of this embodiment, a voice is input using a mobile terminal such as a mobile phone, and voice recognition processing and control instruction conversion processing are integrated in the server 100. It is possible to provide a new network solution that can control each device by executing it.

As described above, the control system according to the present embodiment, the portable terminal used in the control system,
Although the server functioning as a data processing device and the device to be controlled have been described, the present invention is not limited to this case, and various modifications can be made without departing from the spirit of the present invention.
It can be omitted or added.

In the above description, as the data processing device,
Although the case where the dedicated server 100 is used is shown, as shown in FIGS. 8, 9, and 10, voice data is received from the mobile terminal 200, and the received voice data is converted into a control command for a predetermined device. However, the data processing device is not limited to a dedicated server as long as the data processing device has a function of transmitting the control command obtained by the conversion to a predetermined device. Therefore, for example, a printer or a facsimile machine having these functions may be used as a server for other equipment.

In the above description, the portable terminal 200 is directly connected to the server 100 through the public line network 700, but the present invention is not limited to this case.
For example, similarly to the communication connection between the mobile terminal 200 and the device 300a, the connection between the mobile terminal 200 and the server 100 is also
It is also possible to make communication connection using short-range wireless communication.

The mobile terminal 200 is temporarily connected to a center (gateway server) dedicated to the mobile terminal through a packet communication network or a circuit switching network, and then to a server 100 connected to the center via a dedicated line or the Internet. It can also be configured to communicate. In this case, URL (uniform resource locator)
The server 100 is specified by using. Such technology is the same as that provided by various carriers as various mobile Internet technologies, and thus detailed description thereof will be omitted.

From the viewpoint of convenience of the mobile terminal 200, it is desirable to use short-distance wireless communication as communication between the mobile terminal 200 and a device to be controlled. Wired communication can also be used as communication with other devices.

The control system according to the present invention, the portable terminal, the data communication device, and each means for performing processing in the device,
And the control method can be realized by either a programmed computer or a dedicated hardware circuit.

When the present invention is implemented by a programmed computer, the program for operating the computer may be provided by a computer-readable recording medium (for example, a flexible disk or a CD-ROM), or the recording medium. However, it may be provided via the network. This program is usually transferred to and stored in the hard disk. Further, this program may be provided as application software alone, or may be incorporated into the software of the computer device as one function of the computer device.

[0155]

According to the present invention described above, the device can be controlled by voice without inputting voice to the microphone provided in the device itself to be controlled. Further, even when a plurality of devices are arranged adjacent to each other, it is possible to prevent erroneous input of voice to a device that the user does not desire and erroneous control.

Further, according to the present invention, even when a plurality of devices are configured to be controllable by voice, it is not necessary to provide voice recognition software and dedicated hardware for each device, and each device is manufactured. The cost can be reduced.

[Brief description of drawings]

FIG. 1 is a block diagram showing an example of a control system corresponding to an embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of a mobile terminal used in the control system of FIG.

3 is a block diagram showing a configuration of a server used in the control system of FIG.

4 is a block diagram showing a configuration of a device used in the control system of FIG.

5 is a sequence chart showing an operation of the control system shown in FIG.

FIG. 6 is a flowchart showing processing contents of the mobile terminal shown in FIG.

FIG. 7 is a flowchart showing the processing contents of the mobile terminal following FIG.

FIG. 8 is a flowchart showing the processing contents of the server shown in FIG.

FIG. 9 is a flowchart showing the processing contents of the server following FIG.

FIG. 10 is a flowchart showing the processing contents of the server following FIG.

FIG. 11 is a flowchart showing processing contents of the device shown in FIG.

FIG. 12 is a flowchart showing the processing contents of the device following FIG. 11.

FIG. 13 is a flowchart showing the processing contents of the device following FIG.

[Explanation of symbols]

100 ... server, 200 ... mobile terminal, 300a, 300b ... Equipment, 400 ... Modem, 500 ... base station, 600 ... network, 700 ... Public network.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04Q 9/00 331 G10L 3/00 551F F term (reference) 5D015 AA05 KK01 KK02 5K048 BA00 DA03 DC01 DC03 EB02 EB14 5K101 KK11 LL12 MM07 NN07 NN21 PP03 TT06 UU19 UU20

Claims (10)

[Claims] 1. A control for controlling the device, the device including a device to be controlled, a data processing device connected to the device through a network, and a portable terminal capable of communicating with the device and the data processing device. In the system, the portable terminal includes a voice input unit for inputting voice, and a voice data transmitting unit for transmitting voice data obtained based on the input voice to the data processing device, The data processing device includes a voice data receiving unit that receives the voice data from the portable terminal, a converting unit that converts the received voice data into a control command for the device, and the control command obtained by the converting unit. A control command transmitting unit that transmits the control command to the device via the network, the device controlling the device to receive a control command from the data processing device. A control system comprising a command receiving means, and executing a job according to the control command. 2. The device comprises identification information transmitting means for transmitting identification information used for identifying the device itself to the mobile terminal, the mobile terminal receiving the identification information from the device. Identification information receiving means, and portable identification information transmitting means for transmitting the identification information received from the device to the data processing device, wherein the data processing device is further based on the identification information received from the mobile terminal. And a specifying unit that specifies the device on the network, the converting unit converts the received voice data into a control command for the device specified by the specifying unit, and the control command transmitting unit includes the control unit. The control system according to claim 1, wherein the control command is transmitted to the device specified by the specifying unit. 3. A specifying unit for specifying a device on the network based on the received identification information, a converting unit for converting the received voice data into a control command to the device specified by the specifying unit, and the converting unit. A data processing device including a control command transmitting unit that transmits the obtained control command to the device specified by the specifying unit through a network, and the device that executes a job according to the control command received from the data processing device. A portable terminal used in a control system including: a portable identification information receiving unit that receives the identification information used to identify the device from the device itself; and the received identification information, the data processing device. Portable identification information transmitting means for transmitting to the user, voice input means for inputting voice, Mobile terminal to a voice data transmitting means for transmitting audio data to said data processing apparatus based on the obtained voice, characterized by having a. 4. A mobile terminal having voice data transmitting means for transmitting voice data obtained based on input voice to a data processing device, and a device on a network based on identification information received from the mobile terminal. Specifying means for specifying, converting means for converting the voice data received from the portable terminal into a control command for the device specified by the specifying means, and the control command obtained by the converting means is specified by the specifying means. In a device used in a control system having a data processing device having a control command transmitting means for transmitting the device to a portable device through a network, the identification information used to identify the device itself is transmitted to the portable terminal. Transmitting means, receiving a control command obtained by converting the voice data from the data processing device That the control command includes a receiving unit, a device and executes the job according to the control command. 5. A mobile terminal having voice input means for inputting voice, an identification information transmitting means for transmitting identification information used for identifying a device to the mobile terminal, and a control instruction for receiving a control instruction. In a data processing device used in a control system having a receiving unit and a device that executes a job in response to the control command, an identification information receiving unit that receives the identification information from the mobile terminal; Based on the network, the specifying means for specifying the device, the voice data receiving means for receiving the voice data obtained based on the input voice from the portable terminal, and the received voice data are specified by the specifying means. Means for converting into a control instruction to the device, and the control instruction obtained by the converting means is specified by the specifying means. The data processing apparatus characterized by and a control command transmitting means for transmitting over the network to the device which. 6. A method of controlling a device, the method comprising: receiving identification information used to identify the device from a mobile terminal itself; and a data processing device connected to the device via a network. The step of transmitting the identification information by the mobile terminal, the step of transmitting audio data obtained based on the voice input to the mobile terminal to the data processing device, and the data processing device received Specifying the device on a network based on identification information; converting the received voice data into a control command to the device specified on the basis of the identification information; The processing device transmits the control command obtained by the conversion to the device identified based on the identification information, Control method whose serial device receives the control command from said data processing apparatus characterized by having the steps of: executing a job in response to the control command. 7. A specifying unit for specifying a device on a network based on the received identification information, a converting unit for converting the received voice data into a control command for the device specified by the specifying unit, and the converting unit. A data processing device including a control command transmitting unit that transmits the obtained control command to the device specified by the specifying unit through a network, and the device that executes a job according to the control command received from the data processing device. And a control program in a mobile terminal used in a control system including: a process of receiving the identification information used to identify the device from the device itself; and the received identification information of the data processing device. To the input, the process for inputting the voice, and the input based on the input voice. Control program to be executed process and, to a computer to send voice data to said data processing apparatus. 8. A mobile terminal having a voice data transmitting means for transmitting voice data obtained based on an input voice to a data processing device, and a device on a network based on identification information received from the mobile terminal. Specifying means for specifying, converting means for converting the voice data received from the portable terminal into a control command for the device specified by the specifying means, and the control command obtained by the converting means is specified by the specifying means. A data processing device having control command transmitting means for transmitting the device to a device through a network, and a control program in a device used in a control system, wherein the identification information used to identify the device itself is the mobile terminal. And a control command obtained by converting the voice data, to the data processing device. A process of receiving from the control program for executing a process of performing an operation setting related to the execution of the job in response to the control command to the computer. 9. A mobile terminal having voice input means for inputting voice, an identification information transmitting means for transmitting identification information used for identifying a device to the mobile terminal, and a control instruction for receiving a control instruction. A control program in a data processing device used in a control system having a receiving unit and executing a job in accordance with the control command, the process including receiving the identification information from the mobile terminal, A process of identifying the device on the network based on the identification information, a process of receiving voice data obtained based on the input voice from the mobile terminal, and the received voice data based on the identification information. The process of converting the control command to the specified device, and the control command obtained by the conversion means are specified based on the identification information. Control program to be executed and processing of transmitting over the network to the vessel, to the computer. 10. A computer-readable recording medium in which the control program according to claim 7 is recorded.