JP2003202944A - Operation instructing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To allow a user who operates electronic equipment to re-execute an operation procedure corresponding to the condition of an equipment to be operated without confirming the condition of the equipment to be operated by recording the complicate operation procedure of the electronic equipment whose operating method is made complicate. <P>SOLUTION: This device is provided with an operation information acquiring means for acquiring operation information regarding the operation of electronic equipment, a status information acquiring means for acquiring status information indicating the current condition of the equipment, an operation data recording means for recording not only the operation information of the equipment but also the change of the status information of the equipment to be operated as operation data, and an operation data reproducing means for reproducing the operation data by checking the status information of the equipment to be operated. Thus, it re-executes the operation procedure corresponding to the condition of the equipment to be operated. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an operation instructing device, and more particularly to an operation instructing device for controlling an electronic device to execute a predetermined operation.

[0002]

2. Description of the Related Art In recent years, electronic devices have dramatically improved in performance and have become more sophisticated, so that their operation methods have become complicated. The user has to memorize complicated operation procedures or operate while reading the instruction manual in order to use the intended function. In order to improve such problems, the following techniques have been proposed.

For example, by registering a series of key operation procedures, the key operation procedures are automatically executed by a simple operation. That is, there is an “operation procedure batch registration device” that can replace a complicated key operation procedure with a simple operation (for example, see Patent Document 1).

Further, by storing the procedure of key operation performed once and displaying the procedure of a series of key operations for the next and subsequent same operations, not only the same series of key operations are automatically repeated. By operating a series of key operations in sequence according to the user's selection, it is possible to perform key operations different from the past. That is, the user can re-execute a series of operations according to the state of the device by confirming the state of the operation target device and selecting and instructing the key operation while looking at the sequence of key operations. Operating device, device operating method, and recording medium recording device operating program "
Exists (for example, see Patent Document 2).

[0005]

[Patent Document 1] Japanese Patent Publication No. 6-66048

[Patent Document 2] Japanese Patent Laid-Open No. 2000-231402

[0006]

However, in the technique disclosed in the above-mentioned Patent Document 1, regardless of the state of the operation target device, only a series of registered key operations are executed in order, and the operation target device is executed. You cannot operate according to the state of.

Further, in the technique disclosed in Patent Document 2,
The user himself / herself who operates the device needs to accurately grasp the state of the device to be operated, judge the appropriate procedure while observing a series of key operation procedures, and perform an instruction to select. The target operation may fail due to incorrect selection. Further, when the user cannot confirm the state of the operation target device, it is impossible to select an appropriate key operation, and it is impossible to execute an appropriate operation.

The present invention has been made to solve the above-mentioned problems, and a user who operates a device does not have to confirm the state of the device to be operated, but has a complicated structure according to the state of the device to be operated. It is an object of the present invention to provide an operation instruction device that can re-execute a series of operation procedures.

[0009]

The first aspect of the present invention is an apparatus for controlling an electronic device to execute a predetermined operation, which is required when the electronic device executes a predetermined operation. An operation instruction storage unit that stores a series of operation instructions, a status information storage unit that stores, as status information, a state that the electronic device should take when each operation instruction included in the series of operation instructions is performed, and a predetermined electronic device. When executing the operation, a series of operation instructions are read from the operation instruction storage means and given to the electronic device in order, and
And a control unit that controls the operation of the electronic device while monitoring the state of the electronic device when each operation instruction is issued based on the status information read from the status information storage unit.

According to the first aspect of the invention, the operation of the electronic device is controlled based on the operation instruction and the status information, so that the electronic device can be operated in an appropriate state.

A second invention is an invention subordinate to the first invention, and is characterized in that it is embedded as a part of an electronic device.

A third invention is an invention subordinate to the second invention, further comprising detection means for detecting a state of the electronic device when a series of operation instructions are inputted, and the operation instruction storage means. Is stored with a series of operation instructions input by the user to the electronic device, and the status information storage means stores the state of the electronic device detected by the detection means as status information.

According to the third aspect, the operation input by the user is stored as the operation instruction, so that the operation performed by the user can be reproduced.

A fourth aspect of the present invention is an aspect according to the third aspect of the present invention, wherein the time elapsed from the start of the operation instruction input by the user to the input of each operation instruction is used as time information. Further, the control means controls the operation of the electronic device according to the time included in the time information stored in the time information storage means.

According to the fourth aspect of the invention, the operation of the electronic device is controlled according to the time information, so that more detailed operation control of the electronic device is realized.

A fifth invention is an invention according to the second invention, further comprising detection means for detecting the state of the electronic equipment, wherein the control means detects the status information read from the status information storage means and the detection. When the current state of the electronic device detected by the means does not match, the operation of the electronic device is interrupted.

According to the fifth aspect of the invention, when the status information read from the status information storage means does not match the state of the electronic device in each operation instruction, the operation of the electronic device is interrupted. The malfunction of the electronic device is prevented.

A sixth aspect of the invention is an invention according to the second aspect of the invention, wherein the control means is provided when the status information read from the status information storage means does not match the state of the electronic device in each operation instruction. Is characterized by forcibly changing the state of the electronic device to the state of the electronic device of the status information.

According to the sixth aspect, when the status information read from the status information storage means and the state of the electronic device in each operation instruction do not match, the state of the electronic device is set to the state of the electronic device of the status information. Therefore, even in such a case, the electronic device can continue to operate.

A seventh invention is an invention according to the sixth invention, wherein the control means gives an operation instruction to the electronic device until the state of the electronic device is forcibly changed. It is characterized by waiting.

According to the seventh aspect of the invention, the control means waits for the operation instruction to be given to the electronic device until the state of the electronic device is forcibly changed. The electronic device is prevented from malfunctioning due to being exposed to the noise.

An eighth invention is an invention according to the first invention, characterized in that it is embedded as a part of a portable terminal for remotely controlling an electronic device.

A ninth invention is according to the eighth invention, wherein the control means further comprises requesting means for requesting the electronic device to notify the current state of the electronic device. If the current state of the electronic device notified in response to the request does not match the state of the electronic device of the status information read from the status information storage means, a series of operations stored in the operation information storage means is performed. The feature is that the giving of the operation instruction is interrupted.

According to the ninth aspect, when the current state of the electronic device notified in response to the request of the requesting unit does not match the state of the electronic device of the status information read from the status information storing unit, Since the operation of the electronic device is interrupted, the malfunction of the electronic device is prevented.

A tenth invention is an invention according to the eighth invention, wherein the control means further comprises requesting means for requesting the electronic device to notify the current state of the electronic device, and the requesting means. If the current state of the electronic device notified in response to the request does not match the state of the electronic device of the status information read from the status information storage means, the state of the electronic device The electronic device is instructed to match the state.

According to the tenth aspect of the invention, when the current state of the electronic device notified in response to the request of the requesting device does not match the state of the electronic device of the status information read from the status information storing device, Causes the state of the electronic device to be forcibly changed to the state of the electronic device indicated by the status information. Therefore, even in such a case, the electronic device can continue to operate.

An eleventh aspect of the present invention is an operation instructing device that causes an electronic device to execute a predetermined operation intended by a user in response to a remote operation from the mobile terminal, and executes a predetermined operation transmitted from the mobile terminal. Receiving means for receiving a part of the operation instructions out of a series of operation instructions required to be executed by the electronic device and control for controlling the operation of the electronic device by reading out the part of the operation instruction received by the receiving means. Means and the control means perform some operation instructions to the electronic device, and before the next operation instruction of some operation instructions is transmitted, the current state of the electronic device is displayed on the mobile phone. Notifying means for notifying.

According to the eleventh aspect, since the operation instruction and the status information are transmitted from the portable terminal to the electronic device, the electronic device can be remotely operated based on these.

A twelfth aspect of the present invention is a portable terminal for remotely controlling an electronic device to perform a predetermined operation, the operation storing a series of operation instructions required when the electronic device performs the predetermined operation. Instruction storage means, status information storage means for storing, as status information, a state that the electronic device should take when each operation instruction included in the series of operation instructions is given, and a series of operation instructions stored in the operation instruction storage means. And a transmission means for transmitting the status information stored in the status information storage means to the electronic device.

According to the twelfth aspect, since the operation instruction and the status information are transmitted from the portable terminal to the electronic device, the remote operation of the electronic device can be performed based on these.

A thirteenth aspect of the present invention is a method for controlling the operation of an electronic device so as to execute a predetermined operation, and acquires a series of operation instructions required when the electronic device executes a predetermined operation. And a step of, when giving each operation instruction included in the series of operation instructions to the electronic device, acquiring the state that the electronic device should take as status information, and the obtained series of operation instructions to the electronic device in order. And controlling the operation of the electronic device while monitoring the state of the electronic device when each operation instruction is issued based on the acquired status information.

According to the thirteenth aspect, the operation of the electronic device is controlled based on the operation instruction and the status information, so that the electronic device can be operated while being kept in an appropriate state.

A fourteenth invention is a program for controlling an operation of an electronic device so as to execute a predetermined operation,
Program steps for acquiring a series of operation instructions required when the electronic device executes a predetermined operation, and states to be taken by the electronic device when each operation instruction included in the series of operation instructions is given to the electronic device While giving a sequence of operation instructions to the electronic device, which are obtained as status information, while monitoring the state of the electronic device when each operation instruction is issued based on the obtained status information. Program steps for controlling the operation of the electronic device.

According to the fourteenth aspect, the operation of the electronic device is controlled based on the operation instruction and the status information, so that the electronic device can be operated in an appropriate state.

A fifteenth aspect of the present invention is an apparatus for recording and reproducing an operation procedure of a device, which is operation information acquisition means for acquiring operation information for operating the device, and a status indicating a current state of the device. Status information acquisition means for acquiring information, operation information acquired by the operation information acquisition means, and operation data recording means for recording the status information acquired by the status information acquisition means in the order of operation as operation data, and operation data recording The operation data storage means for storing the operation data recorded by the means, the normal operation state, the operation data recording state, and the operation data reproducing state, the recording / reproducing state control means and the status information acquiring means. While acquiring the status information of, the operation data recorded by the operation data recording means according to the acquired status information. Characterized in that it comprises an operation data reproducing means for reproducing the data in order.

A sixteenth aspect of the present invention is a transmission / reception unit for transmitting / receiving operation data to / from another device, a status information acquisition unit for acquiring status information indicating the current state of the device, and an operation acquired by the transmission / reception unit. Acquired status information while acquiring the current status information by the operation data storage means for storing information, switching between the normal operation state and the operation data reproduction state, and the recording / reproduction state control means and the status information acquisition means. The operation data reproducing means for reproducing the operation data stored in the operation data storage means in order.

[0037]

BEST MODE FOR CARRYING OUT THE INVENTION (First Embodiment) A first embodiment of the present invention will be described in detail below with reference to the drawings.

In the following, as the equipment to be operated,
TV, VCR, radio-cassette player, CD player, M
Audio equipment such as D player and DVD player, personal computer, word processor, printer, scanner, digital camera, information equipment such as PDA, telephone, mobile phone, F
This applies to communication equipment such as AX and white goods such as air conditioners.

FIG. 1 is a block diagram showing the configuration of the operation instruction device according to the first embodiment of the present invention. The operation instruction device shown in FIG. 1 is a part of a TV, a VCR, etc., and instructs a series of operations to the TV, VCR, etc. according to operation data including operation information, status information and time information. It is a thing.

The operation instruction device shown in FIG. 1 includes an operation information acquisition unit 101, a status information acquisition unit 102, and
Recording / playback state control unit 103 and operation data recording unit 104
An operation data reproducing unit 105, a normal operation unit 106,
An operation data storage unit 107, an operation time acquisition unit 108,
The transceiver unit 109 is included.

The operation information acquisition unit 101 acquires the operation information of the user's operation on the operation target device and notifies the recording / reproduction state control unit 103 of the operation information. The operation information is information that is input from an input device such as a keyboard, a button, a mouse, a pen, a joystick, a camera, and a microphone, and key information that the user has instructed to input, a key pressing duration, an input character string, and data / It includes audio information.

The status information acquisition unit 102 acquires status information indicating the current status of the operation target device and notifies the recording / reproduction status control unit 103 of the status information. Status information includes not only the internal state of the device itself, such as power on / off, rewinding status of tapes and disks, display screen status, receiving channel, set temperature, etc., but also communication status with external devices and peripheral devices. It also includes equipment search status and room temperature.

The operation time acquisition unit 108 acquires time information when the user operates the operation target device and notifies the recording / reproduction state control unit 103 of the time information. The time information is information indicating the time elapsed from the start of time measurement to the moment when the user operates. It should be noted that, in the operation instruction device according to the present embodiment, the time measurement starts when the operation of the recording operation and the operation of the reproduction operation (these will be described later) are started.

The recording / reproducing state control unit 103 controls switching between a normal operating state, an operating data recording state, and an operating data reproducing state. Also, the notified operation information, status information, and time information are sorted and notified to the operation data recording unit 104, the operation data reproducing unit 105, or the normal operation unit 106.

Here, the operation data recording state indicates a state when the operation instructing device according to the present embodiment stores operation data. The operation data reproduction state indicates a state when the operation data recorded in the operation data recording state is reproduced by the operation instruction device according to the present embodiment. The normal operation state indicates a state other than the above two states, and more specifically, a state in which the user can normally operate the VCR or the like.

The operation data recording unit 104 sequentially records the operation information, the status information and the time information notified from the recording / playback state control unit 103 as operation data in the operation data storage unit 107, and the recording / playback state control unit 103 By performing the device operation according to the notified operation information and status information, the device operation according to the operation information performed by the user on the operation target device is performed.

The operation data reproducing unit 105 makes a series of operations while referring to the operation data recorded in the operation data storage unit 107 in accordance with the current status information and the current time information notified from the recording / reproducing state control unit 103. Play the operations in sequence.

The normal operation unit 106 operates the device in accordance with the operation information and the status information notified from the recording / reproducing state control unit 103, so that the normal device corresponding to the operation information performed by the user on the operation target device. Do the operation.

The operation data storage unit 107 stores the operation data recorded by the operation data recording unit 104.
Further, the operation data storage unit 107 records the operation data received by the transmission / reception unit 109. Here, FIG. 2 is a diagram showing an example of operation data recorded in the operation data storage unit 107. The operation data shown in FIG. 2A includes status information and operation information, but does not include time information. The operation data shown in FIG. 2A is turned on by a key operation (key code A), the display screen is changed to “screen 1” which is an initial screen after the power is turned on, and the next key operation is performed. By (key code B), the display screen is switched to "screen 2" displaying the searched peripheral device list, and a series of operations for transitioning to the status of detecting peripheral device A is shown.

FIG. 2B is a diagram showing an example of operation data including status information, operation information, and time information. That is, the time information may or may not be included in the operation data. In the embodiments described below, it is assumed that operation data including time information is used.

Here, the operation data storage unit 107 can store a plurality of operation data shown in FIGS. 2A and 2B, and further, the operation data recording unit 104.
Alternatively, the operable device determination information of the device itself in which the operation data is recorded and the operation data may be paired and stored. Operable device determination information is information used to determine whether or not an operation can be performed with the same operation data, and more specifically, device attributes, manufacturer, product number, device settings by the user, etc. is there.

The transmission / reception unit 109 includes the operation data recording unit 10
4 transmits / receives the operation data recorded in the operation data storage unit 107 to / from another device. In the operation data transmission process, specific operation data to be transmitted, which is recorded in the operation data storage unit 107, is read out in accordance with an instruction to transmit the operation data from the user, and other operation instruction devices are included. This is a process in which operation data is transmitted to a device. The operation data may be notified to the receiving device by attaching the operation data to an e-mail or registering and saving the operation data in a memory card. Also, IrDA
Alternatively, a communication method such as Bluetooth, Bluetooth (R), or PHS may be used to directly transmit / receive the operation data between the devices. Further, the operation data reception processing is, when the received data is operation data, the operation data storage unit 107 stores the operation data and notifies the recording / reproduction state control unit 103 that the operation data has been received. It is a process to do.

Further, at the time of transmission, not only the operation data but also the operable device determination information of the device itself in which the operation data is recorded may be notified at the same time.

The operation of the operation instruction device according to this embodiment having the above-described structure will be described below with reference to the drawings. Each process shown in this embodiment can be realized by software or by using a dedicated hardware circuit for performing each process.

First, in the operation of the recording operation according to this embodiment, the operation performed by the operation instruction device will be described. FIG. 3 is a flowchart showing the operation of the recording operation of the operation instruction device according to the present embodiment. Here, the operation of the recording operation indicates an operation in which the operation procedure recording device stores the operation performed by the user on the device during the operation as operation data in time series.

First, the operation of the recording operation according to the present embodiment is started by the user for transmitting the recording start to the recording / reproducing state control unit 103, such as pressing the recording start button (step S21). At this time, the operation time acquisition unit 108 starts time measurement.

When the operation of the recording operation is started, the recording / reproducing state control section 103 determines whether or not the current state of the device is the normal state (step S22). This is because the operation instruction device cannot store the operation data when the device is in the operation data reproducing state or the operation data recording state. Here, in the case of the normal state, the process proceeds to step S23. On the other hand, if it is not in the normal state, this process ends. In this case, the operation data is not recorded.

In the normal state, the recording / reproducing state control unit 103 switches the recording / reproducing state of the device to the operation data recording state, and the operation data recording unit 104 starts recording the operation data (step S23).

Next, the recording / reproducing state control unit 103 notifies the operation information acquisition unit 101 that the operation to the device has been input.
It is determined whether the process has been performed from step S24 (step S24). If the notification is given, the process proceeds to step S25. On the other hand, if no notification has been given, the process proceeds to step S
Return to 24. In this case, step S2 until notification is given.
4 will be repeated.

When notified, the recording / playback state control unit 1
03 determines whether or not a recording end operation such as pressing the recording end button or turning off the power is notified. (Step S
25). When the recording end operation is notified, the recording / reproduction state control unit 103 switches the recording / reproduction state of the device to the normal state and ends the recording of the operation data. On the other hand, if the recording end notification has not been issued, the process proceeds to step S26.

When the recording end notification is not given, the recording / reproducing state control unit 103 determines that the user has performed an operation to be stored as operation data on the device. Therefore, the operation time acquisition unit 108 uses the time elapsed from the start of the time measurement to reach step S26 as time information via the recording / reproduction state control unit 103 and the operation data recording unit 10
Output to 4. In response, the operation data recording unit 104 records the acquired time information in the operation data storage unit 107 as a part of the operation data (step S26).

Next, the status information acquisition unit 102 outputs the status of the device when step S26 is performed to the operation data recording unit 104 as status information. Accordingly, the operation data recording unit 104 uses the acquired status information as a part of the operation data, and the recording / reproducing state control unit 1
It records in the operation data storage part 107 via 03 (step S27).

Next, the operation information acquisition unit 101 outputs the operation performed by the user on the device in step S24 as operation information to the operation data recording unit 104 via the recording / playback state control unit 103. In response, the operation data recording unit 104 records the acquired operation information in the operation data storage unit 107 via the recording / playback state control unit 103 as a part of the operation data (step S28).

Finally, the operation data recording unit 104 executes the device operation according to the acquired operation information (step S
28). After that, the process returns to S23. The operations of steps S24 to S29 are repeated until the recording end operation is performed. Through the above operation, the operation data is stored in the operation instruction device. This is the end of the description of the operation of the recording operation. By the operation of the recording operation,
The operation data of FIG. 2B in which the user's operation is recorded in time series from top to bottom is created.

Next, in the operation of the reproduction operation according to this embodiment, the operation performed by the operation instruction device will be described. FIG. 4 is a flowchart showing the operation of the reproduction operation of the operation instruction device according to the present embodiment. Here, the operation of the reproduction operation refers to an operation for reproducing the operation data stored in the operation instruction device by the recording operation and operating the device.

First, this processing is started by the user selecting an operation desired to be reproduced from the operation data list recorded in the operation data storage unit 107 (step S31). At this time, the operation time acquisition unit 108 starts time measurement.

When the operation of the reproducing operation is started, the recording / reproducing state control section 103 determines whether or not the selected operation data to be reproduced is recorded in the operation data storage section 107 (step S32). . If the operation data is recorded, the process proceeds to step S33. On the other hand, if the operation data is not recorded, the operation instructing device cannot reproduce the operation data, and thus this process ends.

When the operation data is recorded, the recording / reproducing state control unit 103 switches the recording / reproducing state of the device to the reproducing state (step S33). Next, the operation data reproducing unit 105 starts reproduction of the operation data (step S34).

Next, the operation data reproducing section 105 determines whether or not reproduction of all operation data has been completed (step S35). Here, when the reproduction of all the operation data has been completed, the recording / reproducing state of the device is switched to the normal state, and the present processing ends. On the other hand, if the reproduction of all the operation data has not been completed, this process is step S3.
Go to 6.

When the reproduction of all the operation data has not been completed, the operation data reproducing unit 105 determines whether or not the reproduction ending operation such as pressing the reproduction ending button or turning off the power is performed (step S36). When the reproduction end operation is performed, the reproduction state is switched to the normal state, and this processing ends. On the other hand, if the reproduction end operation has not been performed, the process proceeds to step S37.

When the reproduction end operation is not performed, the operation time acquisition unit 108 acquires the time elapsed from the start of the time measurement to the step S37 as the time information, and the recording / reproduction state control unit. The data is output to the operation data reproducing unit 105 via 103 (step S37).

Next, the operation data reproducing unit 105 compares the acquired time information with the time information included in the reproduction data, and determines whether or not they are different (step S3).
8). If the two match, the process proceeds to step S3.
Proceed to 9. On the other hand, if the two are different, the process returns to step S36. Note that the operation data reproducing unit 105 may determine that the two match each other, even if the two do not completely match, such as when the time when the current time information is recorded has already passed.

Here, the reason why the operation of step S38 is performed will be described. The operation data includes, for example, a series of operations such as first turning on the switch on the mobile phone, turning on the light 5 seconds after the switch is turned on, and turning off the light 10 seconds later. There is. In such a case, the operation instruction device needs to measure the time from the start of the operation and perform the operation corresponding to the time when the predetermined time is reached.
Therefore, in step S38, this is a process performed because the timing of each operation is set.

When the both match at step S38, the status information acquisition unit 102 checks the current status of the device and, as status information, the operation data reproduction unit 105 via the recording / reproduction state control unit 103.
(Step S39).

Next, the operation data reproducing unit 105 compares the acquired status information with the status information recorded in the operation data to be reproduced, and determines whether they are different (step S40). If they are different,
The process proceeds to step S42. On the other hand, if the two match, the process proceeds to step 41.

Here, the reason why the process of step S40 is performed will be described. When the operation data is recorded, the status when the user inputs an operation is recorded in the operation data as status information. This is because the operation instructing device stores an accurate state of the device when the operation is performed. In other words, if the status information included in the operation data does not match, the device may not operate exactly according to the operation information. Therefore, in order to prevent such malfunctions,
The operation instruction device performs the operation of step S40.

If they are different, the operation data reproducing unit 10
5 determines whether the status of the device can be changed (step S42). If the status can be changed, the process proceeds to step S43. On the other hand, when the status cannot be changed, the recording / reproducing state of the device is switched to the normal state, and this processing ends. For example, in FIG.
When the second key operation (key code B) is reproduced while the operation data of (a) is reproduced but the peripheral device A cannot be searched, it is determined that the status cannot be changed and the reproduction operation is performed. Ends.

If the status can be changed,
The operation data reproducing unit 105 changes the status of the device so as to match the status information recorded in the operation data to be reproduced (step S43). After this, the process proceeds to step S41.

In step S41, the operation data reproducing section 105 instructs the device to execute an operation corresponding to the operation information recorded in the operation data (step S41). After this, the process returns to S33. After this, steps S35 to S43 are repeated.

Here, the operation performed by the operation instructing device according to the present embodiment when it is determined in step S42 that the status can be changed will be described with a specific example. For example, in the operation data, when the operation is started from the status that the screen of the device is screen 1, the status information of the current device indicates that the screen of the device is another screen. The transition operation to 1 is executed, the status of the device is matched with the status information recorded in the operation data, and the reproducing operation is performed. The status information may be compared before the time information is compared, and the time information may be compared only when the status information is different, and the operation time interval may be waited. This is the end of the description of the reproducing operation according to the present embodiment.

Next, when there are a device A and a device B equipped with the operation instruction device according to the present embodiment, and the operation data is transmitted from the device A to the device B, the operation instruction device of the device B. The operation performed by will be described with reference to the drawings. FIG. 5 is a flowchart showing an operation performed by the operation instruction device according to the present embodiment at this time.

First, on the premise that the operation shown in FIG. 5 is performed, the device A and the device B equipped with the operation procedure recording device are installed.
And exist. It is assumed that the device A has previously stored the operation data stored by operating the device A by the user. The operation data stored in the device A may be received from another device and stored by exchanging the operation data. Now, a detailed description will be given below.

First, the device A is the operation data storage unit 107.
The operation data recorded in the
Send to device B. In the operation data, operable device determination information indicating that the operation data is recorded by the device A is recorded or added.

The device B uses the transmitting / receiving unit 109 to send the device A
The operation data transmitted from is received (step S5
1).

Next, the transmission / reception unit 109 stores the received operation data in the operation data storage unit 107 (step S
52).

Then, using the operable device determination information recorded or added to the received operation data, it is determined whether or not the received operation data is operable in device B (step S53). If it is operable, the process proceeds to step S54. On the other hand, if the operation cannot be performed, the operation data received by the operation instruction device of the device B cannot be reproduced, and this process ends.

The device B is of the same type as the device A,
When it is determined that the operation is possible, the received operation data can be applied to the device B, and thus the operation instruction device of the device B performs a reproduction operation of the acquired operation data (step S).
54). As a result, the device B can reproduce the same operation as the operation performed at the time of recording the operation data in the device A. The subroutine in step S54 is similar to the flowchart shown in FIG. As described above, the operation performed by the operation instruction device of the device B when the device A and the device B equipped with the operation instruction device according to the present embodiment exist and the operation data is transmitted from the device A to the device B The description of is ended.

By the operation instructing device performing the operation as shown in FIG. 5, for example, the mobile phone records data of an operation such as home page reference, and is used for a friend who has a mobile phone of the same model. Then, the data can be transmitted as operation data by a method such as an electronic mail, a memory card, IrDA or Bluetooth (R), and the same operation as referring to a home page can be reproduced on a friend's mobile phone.

In FIG. 5, the operation instructing device immediately and automatically reproduces the operation data at the time when the operation data is received. However, the operation data may be saved only and not immediately executed. Further, the automatic reproduction may be performed only when the recording / reproducing state is the normal state, and the automatic reproduction may not be performed when the recording / reproducing state is not the normal state.

Next, when the device A and the device B equipped with the operation instruction device according to the present embodiment exist and the device A remotely controls the device B, the operation instruction devices of the device A and the device B perform the operation. The operation will be described with reference to the drawings. Figure 6
3 is a flowchart showing the operation performed by the operation instruction devices of the device A and the device B at this time.

First, on the premise that the operation shown in FIG. 6 is performed, the device A and the device B equipped with the operation procedure recording device are installed.
And exist. It is assumed that the device A has previously stored the operation data stored by operating the device A by the user. The operation data stored in the device A may be received from another device and stored by exchanging the operation data. Now, a detailed description will be given below.

First, in order to start the remote operation, the user of the device A selects the operation data desired to be remotely operated from the operation data list recorded in the operation data storage unit 107 of the device A. The remote operation start operation according to the embodiment is started (step S61).

Next, the device A designates the selected operation data of the remote operation target, and the transmitting / receiving unit 109
A remote operation request is transmitted to the device B (step S62). Accordingly, the transmitting / receiving unit 109 of the device B is
Receives the remote operation request sent from (step S
63), the remote operation request is output to the operation data reproducing unit 105 via the operation data storage unit 107. It should be noted that the remote operation request includes operation data, and operable device determination information corresponding to the operation data is added.

Next, the operation data reproducing section 105 of the device B
Determines whether the received operation data is operation data that can be reproduced by the device B (step S64).
If it is operable, the process proceeds to step S65. On the other hand, if the operation is not possible, the present processing is performed in step S66 without performing the operation data reproducing operation.
Proceed to.

If the operation data can be operated, the operation data reproducing section 105 performs the operation data reproducing operation (step S).
65). The reproducing operation is the same as the reproducing operation shown in FIG. When the reproduction operation ends, the process proceeds to step S66.

In step S66, the transmitter / receiver 109 of the device B notifies the device A of the reproduction result (step S66). More specifically, the transmission / reception unit 109 of the device B notifies that the operation data is reproduced when the operation data is reproduced, and transmits the operation data when the operation data is not reproduced. Notify that it was not played.

On the other hand, the transmitting / receiving unit 109 of the device A is
It stands by while determining whether or not the reproduction result from is received (step S67). When the reproduction result is received, the process proceeds to step S68. On the other hand, if the reproduction result has not been received, the process proceeds to step S67.
Return to. In this case, the transmission / reception unit 109 repeats step S67 until the reproduction result is received.

When the reception result is received, the device A notifies the user of the received reproduction result by using screen display, sound or light (step S68).

If the reproduction of the operation data is successful, the remote operation is terminated, and if the operation data is unsuccessful, the operation data can be transmitted again. If the remote operation fails, the device B sends not only the notification of the reproduction result but also other appropriate operation data to the operation data storage unit 107.
May be acquired and reproduced, or appropriate operation data may be acquired and reproduced from an external device such as the device A that has transmitted the operation data. Furthermore, the device B may perform the automatic reproduction only when the recording / reproducing state is the normal state, and may not perform the automatic reproduction when the recording / reproducing state is not the normal state. As described above, when the device A and the device B equipped with the operation instruction device according to the present embodiment exist, and the device A remotely controls the device B, the device A
The description of the operation performed by the operation instruction device of the device B is ended.

As described above, not only the operation information of the device but also the change of the status information of the operation target device is recorded as the operation data, and the status information of the operation target device is checked while reproducing the recorded operation data. If the status is unintentional by playing,
Operate the device by stopping the playback of operation data, performing an operation to change the status to the intended status, shifting to the playback of other appropriate operation data, or acquiring the required operation data from the outside. The user can reproduce the operation data according to the state of the operation target device without checking the state of the operation target device.

Further, by recording the time information as the operation data, it becomes possible to more appropriately grasp the next status judgment timing, for example, when a certain time is required for the transition to the next status. Further, by transmitting the recorded operation data to another device, it is possible to reproduce the operation of another device that can be used by another user and can perform the same operation, or to perform a remote operation.

In this embodiment, step S in FIG.
If the status information in 40 is different, the status of the device is changed, but the operation is not limited to this. More specifically, when the status information is different, the status of the device may not be changed, and the process of FIG. 4 may be ended.

(Other Operation Example in First Embodiment) Here, in the operation instruction apparatus of the present embodiment, in the flowchart of FIG. 6, the operation information from the device A to the device B is collectively in the form of operation data. Has been sent.
However, the operation information does not need to be collectively sent from the device A to the device B. More specifically, device A
May sequentially obtain status information from the device B, refer to the status information, and then transmit only one piece of operation information. Now, another operation example of the first embodiment will be described with reference to the drawings. In addition,
The configurations of the device A and the device B are the same as those described in the first embodiment, and thus the description thereof will be omitted.

FIG. 7 is a flow chart showing the operations of the device A and the device B in this operation example. Well then
Below, there are a device A and a device B equipped with the operation instruction device according to the present embodiment, and other operations performed by the operation instruction devices of the device A and the device B when the device A remotely controls the device B. An example will be described.

First, in order to start the remote operation, the user of the device A selects the operation data desired to be remotely operated from the operation data list recorded in the operation data storage unit 107 of the device A. The remote operation start operation according to the embodiment is started (step S10).
0).

Next, the operation data reproducing unit 105 reads out the operation data selected by the user, and reads out only one operation information included in the operation data in order (step S105). Next, the transmitting / receiving unit 109
Notifies the device B that the operation information has been read out via the transmission / reception unit 109 (step S110). In response, the transmission / reception unit 109 of the device B receives the notification (step S115).

Next, the status information acquisition unit 102 detects the state of the device B and sets the detected state of the device B as status information via the recording / reproduction state control unit 103.
The data is output to the transmitting / receiving unit 109 (step S120). The transmission / reception unit 109 transmits the acquired status information to the device A (step S125). In response, the transmitter / receiver 109 of the device A receives the status information (step S130).

Next, the operation data reproducing unit 105 determines that the device B
Status information transmitted from the device and step S10
It is determined whether the status information included in the operation data read in step 5 is the same (step S13).
5). Here, if they are the same, the process proceeds to step S140. On the other hand, if they are not the same, this process ends.

If they are the same, the operation data reproducing unit 1
05 outputs the operation information read in step S105 to the transmission / reception unit 109. Accordingly, the transmitting / receiving unit 109
Transmits the operation information to the device B (step S
140). In response, the transmission / reception unit 109 of the device B acquires the operation information and outputs it to the operation data reproduction unit 105.

Next, the operation data reproducing section 105 of the device B
Instructs the device B to operate based on the acquired operation data (step S145). Depending on the device B
Operates according to the operation data. After that, the operation data reproducing unit 105 notifies the device A via the transmitting / receiving unit 109 that the reproduction of the operation data is completed (step S150). Accordingly, the transmitting / receiving unit 10 of the device A
9 receives the notification and outputs it to the operation data reproducing unit 105.

The operation data reproducing unit 105 which has received the reproduction end notification determines whether or not the reproduction of the operation data is to be ended (step S155). More specifically, the operation data reproducing unit 105 refers to the operation data and determines whether all the operation information in the operation data has been reproduced by the device B. When all the data have been reproduced, this process ends. On the other hand, if not all have been reproduced, the process returns to step S105. After that, the processing from step S105 to step S155 is performed on the operation information next to the operation information read in the previous step S105. As described above, other operations performed by the operation instruction devices of the device A and the device B when the device A and the device B equipped with the operation instruction device according to the present embodiment exist and the device A remotely operates the device B. The description of the example ends.

In this operation example, if the two status information do not match in step S135,
Although it is assumed that this processing ends, the operation in this case is not limited to this. For example, the device A may force the device B to change the state to be the same as the status information held by the device B, and then continue the process.

(Second Embodiment) Next, a remote operation system using an operation procedure device according to a second embodiment of the present invention will be described. In the remote operation system according to the second embodiment of the present invention, there are a mobile phone and a video device equipped with the operation instruction device of FIG. 1, and an operation data creation server for creating operation data. And the operation data creation server are used to remotely operate the recording reservation of the television program.

FIG. 7 is a block diagram showing the configuration of the remote control system according to this embodiment. The remote control system includes a home server 200, a mobile phone 205, and a video device 210.

The home server comprises a server storage unit 215, a server control unit 220 and a server transmission / reception unit 225,
Operation data is created in cooperation with the mobile phone 205. The server storage unit 215 manages, as device information, device information existing in the user's home. The device information is
For example, in order to make a recording reservation for a video device, it is information indicating what operation is performed on the video device and what status the video device must be in at the time of the operation. The server control unit 220 creates a screen to be presented to the mobile phone 205 in response to a request from the mobile phone 205, and is realized by, for example, a CPU. The server transmitting / receiving unit 225 exchanges information with the mobile phone 205 via the Internet.

The mobile phone 205 is connected to the mobile phone transmitter / receiver 23.
0 and the operation instruction device 235, the home server 200
The operation data is created in conjunction with, and the video device 210 is remotely operated based on the operation data to schedule the recording of the television program. The mobile phone transceiver 230 exchanges information with the home server 200 via the Internet.
The operation instruction device 235 is similar to that shown in FIG. 1 of the first embodiment.

The video equipment 210 is a general video equipment equipped with the operation instructing device 240, and the recording reservation of a television program is made on the basis of the operation data transmitted from the portable telephone 205. The operation instruction device 2
40 is the same as that shown in FIG. 1 of the first embodiment.

The operation of the remote operation system according to this embodiment having the above-described configuration will be described below with reference to the drawings. FIG. 9 shows the mobile phone 205, the home server 200, and the video device 21 at this time.
6 is a flowchart showing an operation performed by 0. Note that the screens D1 to D5 described in the left column of FIG.
It is an example of a screen displayed in 05.

First, this process is started when the mobile phone 205 and the home server 200 are connected via the Internet or the like. Mobile phone 205 and home server 2
When 00 is connected, the server control unit 215 creates a screen D1 of recordable television program information, and transmits the data of the screen D1 to the mobile phone via the server transmission / reception unit 225 ( Step S71). In response, the mobile phone transmitting / receiving unit 230 receives the data on the screen D1. After that, the screen D1 is displayed on the display unit (not shown in the figure) of the mobile phone 205. The user of the mobile phone 205 uses the screen D1 displayed on the mobile phone 205 to select the TV program to be recorded from the presented TV programs (step S72), and the mobile phone transceiver 230 sends the selection result to the home screen. It is transmitted to the server 200. As a result, the home server 200 identifies the TV program to be recorded.

Next, the server control unit 220 creates the image D2 including the manufacturer of the video device capable of creating the operation data, and the data of the screen D2 is transmitted via the server transmission / reception unit 225 to the mobile phone 205. (Step S73). The mobile phone transceiver 230 displays the screen D
The data of 2 is received. After that, the screen D2 is displayed on the display unit of the mobile phone 205. The user of the mobile phone 205 selects, on the screen D2, the manufacturer of the video device of the operation data to be created. After that, the selection result is transmitted from the mobile phone transmitting / receiving unit 230 to the home server 200. As a result, the home server 200 acquires a part of the status information.

Next, the server control unit 220 creates a screen D3 or a screen D4 including information on selectable operations, and transfers the data of the screen D3 or the screen D4 to the mobile phone 205 via the server transmission / reception unit 225. To (step S7
5). In response, the mobile phone 230 receives the data on the screens D3 and D4. Thereafter, the screen D3 or D4 is displayed on the display unit (not shown in the figure) of the mobile phone 205. The user of the mobile phone 205 is the mobile phone 20.
The status of the video device at the time of recording such as the recording mode and the recording start position is input using the screen D3 or D4 displayed on the screen 5 (step S76). After that, the information about the entered status is sent to the mobile phone transceiver unit 2
It is transmitted from 30 to the home server 200. The status input in step S77 is
The status is other than the status stored in the server storage unit 215. More specifically, the server storage unit 21
In FIG. 5, a status that should be present when the video is recorded and that does not require the user's judgment (for example, the power source must be ON) is stored. On the other hand, the status input in step S77 needs to be judged by the user, such as being recorded in the triple mode.

The server transmission / reception unit 225 receives the transmitted information on the status, and the server control unit 220
Output to. The server control unit 220 creates operation data based on the information regarding the status and the device information stored in the server storage unit 215 (step S).
77). As a result, status information for performing the recording reservation operation is created and included in the operation data.
For example, as the status information, after the information that the recording start position of the video tape is one hour later in the triple mode is recorded, the operation data in which the operation information that the record button is pressed is recorded and the operation is performed. When playing back data, if the status is checked and if it is determined that the status can be changed, the remote operation such that the recording start position of the video tape is changed according to the status information and then the recording reservation is started. Can be realized.

Next, the user of the mobile phone 205 downloads the created operation data to the mobile phone 205 (step S78).

When the download is completed, the mobile phone 20
5 uses the transmission / reception unit 109 of the operation instruction device 235,
The operation data is transmitted to the video device 210 that is the remote operation target (step S78). In response, the transmission / reception unit 109 of the video device 210 receives the operation data.

The operation instructing device 235 of the video equipment 210 which has received the operation data makes an operation availability judgment on the operation data as described as the operation of the equipment B in FIG.
Furthermore, the recording reservation operation according to the status is executed by reproducing the operation data (step S7).
9).

As described above, by applying the operation instructing device according to the present embodiment to remote control using a mobile phone, it is possible to confirm the recording mode of the video equipment and the status of the video tape. Instead, a remote operation according to the status such as a recording reservation operation according to the user's selection can be realized.

Further, in addition to the remote operation of FIG. 9, in addition to the application operating on the mobile phone,
By downloading the operation data of the application, it is possible to realize automatic execution of the application according to the status of the mobile phone terminal.

Here, in the remote control system shown in FIG. 8 of the present embodiment, the device information of the home electronic device of the user is downloaded from the home server 200. The device information may be downloaded from the server of the company that sells each electronic device. In this case, the remote control system is as shown in FIG.

The remote control system shown in FIG.
Company server 300, Company B server 305, Company C server 31
0, an index server 315, a mobile phone 320 and a video device 325. The company A server 300, the company B server 305, and the company C server 310 manage the device information of their own products. The index server 315 is
The mobile phone 320 that has been accessed is led to the index home page. The index home page includes the name of the electronic device for which the device information exists. When the user uses the mobile phone 320 to select the electronic device name of the device information to be acquired, the mobile phone 320 is connected to the server of the seller of the electronic device (here, the company A server). After that, the mobile phone 320 is connected to the A company server 30.
Acquire operation data while exchanging information with 0. Note that the exchange between the mobile phone 320 and the company A server at this time is the same as in FIG.

[0130] In the present embodiment, the description has been made on the case of performing the reserved recording of the video device by the remote operation using the mobile phone, but the operation to be performed is not limited to the reserved recording and the device used Is not limited to mobile phones and video equipment. For example, a PDA instead of a mobile phone
May be used, or a karaoke device may be used instead of the video device.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of an operation instruction device according to a first embodiment of the present invention.

FIG. 2 is a diagram showing an example of operation data stored in an operation data storage unit according to the first embodiment of the present invention.

FIG. 3 is a flowchart showing an example of a specific operation procedure of a recording operation according to the first embodiment of the present invention.

FIG. 4 is a flowchart showing an example of a specific operation procedure of a reproduction operation according to the first embodiment of the present invention.

FIG. 5 is a flowchart showing an example of a specific operation procedure when exchanging operation data according to the first embodiment of the present invention.

FIG. 6 is a flowchart showing an example of a specific operation procedure when a remote operation is performed in the first embodiment of the present invention.

FIG. 7 is a flowchart showing another operation example according to the first embodiment of the present invention.

FIG. 8 is a block diagram showing a configuration of a remote control system according to a second exemplary embodiment of the present invention.

FIG. 9 is a flowchart showing an example of a specific operation procedure when performing a remote operation using a mobile phone according to the second embodiment of the present invention.

FIG. 10 is a block diagram showing another example of the configuration of the remote control system according to the second embodiment of the present invention.

[Explanation of symbols]

101 Operation information acquisition unit 102 Status information acquisition unit 103 Recording / playback state control unit 104 Operation data recording unit 105 Operation data playback unit 106 Normal operation part 107 Operation data storage unit 108 Operation time acquisition unit 109 transmitter / receiver 200 Home Server 205,320 mobile phones 210,325 Video equipment 215 Server storage unit 220 Server control unit 225 server transceiver 230 Cellular phone transceiver 235, 240 operation instruction device 300 Company A server 305 Company B server 310 C company server

Continued front page    F term (reference) 5B020 AA15 CC12 DD02 GG23                 5E501 AA04 BA05 CA03 CB02 DA17                       EA02

Claims (16)

[Claims] 1. An apparatus for controlling an electronic device to execute a predetermined operation, comprising an operation instruction storage means for storing a series of operation instructions required when the electronic device executes the predetermined operation. A status information storage unit that stores, as status information, a state to be taken by the electronic device when each operation instruction included in the series of operation instructions is performed; and when the electronic device is caused to execute the predetermined operation, the operation The series of operation instructions are read from the instruction storage means and given to the electronic device in order, and the state of the electronic equipment when each operation instruction is issued is monitored based on the status information read from the status information storage means. An operation instructing device, comprising: a control unit that controls the operation of the electronic device. 2. The operation instruction device according to claim 1, wherein the operation instruction device is embedded as a part of the electronic device. 3. A detection unit that detects a state of the electronic device when each of the series of operation instructions is input, wherein the operation instruction storage unit includes a series of data input by the user to the electronic device. 3. The operation instruction device according to claim 2, wherein the operation information is stored, and the status information storage unit stores the state of the electronic device detected by the detection unit as status information. 4. A time information storage unit for acquiring and storing, as time information, a time elapsed between the start of the operation instruction input by the user and the input of each operation instruction, The operation instruction device according to claim 3, wherein the control unit controls the operation of the electronic device according to the time included in the time information stored in the time information storage unit. 5. A detection means for detecting a state of the electronic device is further provided, wherein the control means reads status information read from the status information storage means, and a current state of the electronic device detected by the detection means. The operation instruction device according to claim 2, wherein the operation of the electronic device is interrupted when the values do not match. 6. The control means, when the status information read from the status information storage means does not match the status of the electronic device in each operation instruction, sets the status of the electronic device to the electronic status information. The operation instruction device according to claim 2, wherein the operation instruction device is forcibly changed to a device state. 7. The control unit waits until an operation instruction is given to the electronic device until the state of the electronic device is forcibly changed. Operation instruction device. 8. The operation instruction device according to claim 1, wherein the operation instruction device is embedded as a part of a mobile terminal that remotely controls the electronic device. 9. The control means further comprises requesting means for requesting the electronic device to notify the current state of the electronic device, and the electronic device is notified in response to the request from the requesting means. When the current state and the state of the electronic device of the status information read from the status information storage means do not match, the assignment of the series of operation instructions stored in the operation information storage means is interrupted. 9. The operation instruction device according to claim 8, wherein: 10. The control means further comprises requesting means for requesting the electronic device to notify the current state of the electronic device, and the electronic device is notified in response to the request from the requesting means. If the current state and the state of the electronic device of the status information read from the status information storage means do not match, to match the state of the electronic device with the state of the electronic device of the status information, The operation instruction device according to claim 8, wherein the operation instruction device instructs the electronic device. 11. An operation instruction device for causing an electronic device to execute a predetermined operation intended by a user in response to a remote operation from the mobile terminal, wherein the predetermined operation transmitted from the mobile terminal is performed by the electronic device. Receiving means for receiving a part of the operation instructions out of a series of operation instructions required to be executed by the device, and controlling the operation of the electronic device by reading out the part of the operation instructions received by the receiving means. And a control means for controlling the mobile phone after the control means gives the operation instruction to the electronic device and before the operation instruction next to the operation instruction is transmitted. An operation instruction device, comprising: a notification unit that notifies the current state of the electronic device. 12. A mobile terminal that is remotely operated so that an electronic device executes a predetermined operation, and an operation instruction storage that stores a series of operation instructions required when the electronic device executes the predetermined operation. Means, status information storage means for storing, as status information, a state to be taken by the electronic device when each operation instruction included in the series of operation instructions is given, and the series of the operation instructions stored in the operation instruction storage means. A mobile terminal, comprising: a transmission unit that transmits an operation instruction and status information stored in the status information storage unit to the electronic device. 13. A method of controlling an operation of an electronic device so as to perform a predetermined operation, the method comprising: acquiring a series of operation instructions required when the electronic device performs the predetermined operation. A step of acquiring, as status information, a state that the electronic device should take when each operation instruction included in the series of operation instructions is given to the electronic device; and the acquired series of operation instructions to the electronic device. And a step of controlling the operation of the electronic device while monitoring the state of the electronic device when each operation instruction is issued based on the acquired status information. 14. A program for controlling an operation of an electronic device so as to execute a predetermined operation, the program acquiring a series of operation instructions required when the electronic device executes the predetermined operation. A step, a program step of acquiring, as status information, a state that the electronic device should take when each operation instruction included in the series of operation instructions is given to the electronic device; And a program step of controlling the operation of the electronic device while monitoring the state of the electronic device when each operation instruction is issued based on the acquired status information, while giving the device in order. 15. An apparatus for recording and reproducing an operation procedure of a device, and acquiring operation information acquisition means for acquiring operation information of operation of the device, and status information indicating a current state of the device. Operation information recording means for recording status information acquisition means, operation information acquired by the operation information acquisition means, and status information acquired by the status information acquisition means in the order of operation as operation data, and the operation data recording means The operation data storage means for storing the operation data recorded by the operation data storage means, the normal operation state, the operation data recording state, and the operation data reproduction state, the recording / reproduction state control means, and the status information acquisition means. While acquiring the status information of, the operation data recording means records the status information according to the acquired status information. An operation data reproducing means for sequentially reproducing the generated operation data. 16. A transmission / reception unit for transmitting / receiving the operation data to / from another device, a status information acquisition unit for acquiring status information indicating a current state of the device, and operation information acquired by the transmission / reception unit. The operation data storage means for storing, switching between the normal operation state and the operation data reproduction state, the recording / reproduction state control means, and the status information acquisition means while acquiring the current status information, Accordingly, the operation instructing device is provided with an operation data reproducing unit that sequentially reproduces the operation data stored in the operation data storing unit.