JP4210907B2 - Control apparatus and method, recording medium, program, and remote control system - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a control device and method, a recording medium, and a program , And a control apparatus and method, a recording medium, and a program for estimating a user's operation intention and controlling or operating the remote control system , And a remote control system.
[0002]
[Prior art]
Remote controllers attached to home appliances such as television receivers (hereinafter also referred to as remote controls) have tended to increase the number of items that can be controlled from the remote control as the corresponding home appliances become more multifunctional. . In order to increase the number of items that can be controlled from the remote control, the simplest method is to increase the number of operation buttons, but there is a problem that it is not convenient for the user.
[0003]
Therefore, as a method of not reducing the usability of the remote controller, it has been proposed to provide a numeric input button and a function button on the remote controller (see, for example, Patent Document 1).
[0004]
[Patent Document 1]
Japanese Patent Laid-Open No. 7-30972
[0005]
[Problems to be solved by the invention]
However, even with the above-described method, complicated operations and an increase in operation buttons are unavoidable. Therefore, there is an appearance of a remote controller that is easy to operate and has few operation buttons without restricting the items of controllable functions. There was a challenge that was desired.
[0006]
In addition, the conventional remote control has a uniform repulsive force with respect to the user's pressing operation on the operation buttons and the like, and has a poor operational feeling. It was.
[0007]
The present invention has been made in view of such a situation, and an object of the present invention is to realize a remote controller that is easy to operate and has few operation buttons, without limiting items of controllable functions.
[0008]
[Means for Solving the Problems]
The control device of the present invention refers to detection means for detecting a user operation on the user interface, storage means for storing the detection result of the detection means as operation history information, and operation history information stored by the storage means, A determination unit that determines whether or not to shift from the normal mode to the operation estimation mode, and a user mode detected by the detection unit as a normal mode process when the determination unit determines that the transition to the operation estimation mode is not performed. When a corresponding command signal is transmitted and it is determined by the determining means to shift to the operation estimation mode, a command signal that is different from the command signal corresponding to the user operation detected by the detecting means is transmitted as processing in the operation estimation mode. And transmitting means.
[0009]
The storage unit stores at least one of operation date / time, operation content, operation pressure, operation direction, operation inclination angle, or operation duration of the user's operation detected by the detection unit as operation history information. can do.
[0010]
The determination unit refers to the operation date and time included in the operation history information stored by the storage unit, and determines that the normal mode is changed to the operation estimation mode when the operation frequency for the same user interface is high. it can.
[0011]
The determination means refers to the operation date and time included in the operation history information stored by the storage means, and can determine that the normal mode is changed to the operation estimation mode when the operation frequency for different user interfaces is high. .
[0012]
The control device of the present invention may further include a receiving unit that receives a signal indicating the state of the electronic device transmitted from the electronic device to be controlled.
[0013]
The control method of the present invention includes a detection step for detecting a user operation on the user interface, a storage step for storing a detection result in the processing of the detection step as operation history information, and an operation history information stored by the processing of the storage step. With reference to the determination step for determining whether or not to transition from the normal mode to the operation estimation mode, and when the determination step determines that the transition to the operation estimation mode is not to be performed, When the command signal corresponding to the user operation detected in the process is transmitted and it is determined in the determination step process to shift to the operation estimation mode, as the operation estimation mode process, the user's operation detected in the detection step process A transmission step of transmitting a command signal different from the command signal corresponding to the operation. And wherein the Mukoto.
[0014]
The recording medium program of the present invention includes a detection step for detecting a user operation on the user interface, a storage step for storing a detection result in the detection step processing as operation history information, and an operation stored by the processing of the storage step. Referring to the history information, a determination step that determines whether or not to transition from the normal mode to the operation estimation mode, and if it is determined by the processing of the determination step that the transition to the operation estimation mode does not occur, detection is performed as the normal mode processing. When a command signal corresponding to the user operation detected in the step processing is transmitted and it is determined in the determination step processing to shift to the operation estimation mode, it is detected by the detection step processing as the operation estimation mode processing. Transmission that transmits a command signal different from the command signal corresponding to the user's operation Characterized in that it comprises a step.
[0015]
The program of the present invention includes a detection step for detecting a user operation on the user interface, a storage step for storing the detection result in the processing of the detection step as operation history information, and the operation history information stored by the processing of the storage step. Referring to the determination step for determining whether or not to transition from the normal mode to the operation estimation mode, and the processing of the detection step as the normal mode processing when it is determined by the determination step processing that the transition to the operation estimation mode is not performed. When the command signal corresponding to the user operation detected in step S1 is transmitted and it is determined in the determination step process to shift to the operation estimation mode, the user operation detected by the detection step process is performed as the operation estimation mode process. A transmission step of transmitting a command signal different from the command signal corresponding to And characterized by causing a computer to execute.
[0017]
In the first remote control system of the present invention, the control device stores a detection unit that detects a user operation on the user interface, a storage unit that stores a detection result of the detection unit as operation history information, and a storage unit. With reference to the operation history information, a determination unit that determines whether or not to transition from the normal mode to the operation estimation mode, and a detection unit that determines whether or not to transition to the operation estimation mode by the determination unit A command signal corresponding to the user operation detected by the detection means is transmitted as a process of the operation estimation mode when the command means corresponding to the user operation detected by the detection means is determined to be transferred to the operation estimation mode by the determination means. Transmission means for transmitting a command signal different from the signal.
[0019]
In the control device, method, and program of the present invention, a user operation on the user interface is detected, and the detection result is stored as operation history information. Further, with reference to the stored operation history information, it is determined whether or not a transition is made from the normal mode to the operation estimation mode. When it is determined that the operation estimation mode is not changed, a command signal corresponding to the detected user operation is transmitted as the normal mode process. On the other hand, when it is determined to shift to the operation estimation mode, a command signal different from the command signal corresponding to the detected user operation is transmitted as processing in the operation estimation mode.
[0021]
In the first remote control system of the present invention, the control device detects a user operation on the user interface and stores the detection result as operation history information. Further, with reference to the stored operation history information, it is determined whether or not a transition is made from the normal mode to the operation estimation mode. When it is determined that the operation estimation mode is not changed, a command signal corresponding to the detected user operation is transmitted as the normal mode process. On the other hand, when it is determined to shift to the operation estimation mode, a command signal different from the command signal corresponding to the detected user operation is transmitted as processing in the operation estimation mode.
[0023]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 shows the appearance of a remote controller according to an embodiment of the present invention. The remote controller 1 (hereinafter referred to as the remote controller 1) corresponds to user operations on various operation buttons including the power button 3, and provides commands corresponding to the television receiver that is the object of remote control. This is a signal to be sent and adjusted according to the operation history of the user, such as adjusting the operation feeling of the operation buttons or the like (to be described later as an operation feeling adjustment process), or by depressing the user's operation intention. A command signal different from the command signal corresponding to the operation button is transmitted (described later as processing in the operation estimation mode).
[0024]
Various operation buttons including a touch panel type LCD (Liquid Crystal Display) 2 and a power button 3 are provided on the outer surface of the remote controller 1.
[0025]
The touch panel LCD 2 displays the status of the television receiver that is the control target, the type of the transmitted command, and the like. The touch panel LCD 2 displays a pseudo operation button and detects a user operation on the pseudo operation button.
[0026]
The power button 3 is pressed when turning on / off the power of the television receiver to be controlled. The input switching button 4 is a source signal (TV broadcast signal, AV (Audio Video) signal from a VCR (Video Cassette Recorder), AV from a DVD (Digital Versatile Disc) player) displayed by a television receiver to be controlled. Pressed when switching signal). The audio switching button 5 is operated when switching the type of audio output (stereo, monaural, main / sub audio, etc.) of the television receiver to be controlled. The mute button 6 is operated to mute the audio output of the television receiver that is the control target. The channel (CH) button 7 is pressed when causing the television receiver to be controlled to select a designated channel. Hereinafter, the channel button 7-1 for the channel button of 1 channel, the channel button 7-2 for the channel button of channel 1, and the other channels will be described in the same manner.
[0027]
The program information button 8 is pressed when displaying program information (for example, EPG (Electronic Program Guide) included in a broadcast signal) of a program being selected on a television receiver to be controlled. The split display button 9 is pressed when the television receiver, which is the control target, splits the screen into a plurality of parts and displays videos of different channels.
[0028]
The channel shift button 10 is pressed when the television receiver to be controlled shifts the channel selection in the forward direction or the reverse direction. The volume button 11 is operated when increasing or decreasing the sound output level of the television receiver that is the control target. The channel shift button 10 and the volume button 11 change the channel selection shift speed or the volume increase / decrease speed in accordance with the pressed depth.
[0029]
For example, the joystick 12 is tilted in an arbitrary direction when a cursor displayed on the screen of a television receiver that is a control target is moved. The joystick 12 is pressed to determine the position of the cursor displayed on the screen.
[0030]
The brightness adjustment button 13 is pressed when transitioning to a brightness adjustment mode for adjusting the brightness of the screen of the television receiver to be controlled. The resolution adjustment button 14 is used to adjust the screen resolution of the television receiver to be controlled in the brightness adjustment mode. In Pressed down. That is, the resolution adjustment by the resolution adjustment button 14 can be performed only when the brightness adjustment button 13 is pressed and the brightness adjustment mode is set.
[0031]
FIG. 2 shows an internal configuration example of the remote controller 1. The control unit 21 controls all the units connected via the bus 2 in accordance with a control program stored in the storage unit 26. For example, the control unit 21 controls the transmission / reception unit 27 according to the operation signal input from the operation detection unit 25 via the bus 22 to transmit a corresponding command signal to the television receiver that is the control target. Further, the control unit 21 generates operation history information based on the operation signal from the operation detection unit 25 and the measurement result from the actuator 24 with the pressure sensor, and stores the operation history information in the storage unit 26. Further, the control unit 21 generates feedback information to be supplied to the pressure sensor-equipped actuator 24 based on the operation history information stored in the storage unit 26.
[0032]
FIG. 3 shows an example of operation history information generated by the control unit 21. The operation history information includes a serial number indicating the sequence of the operated time series, the operated time (year, month, day, hour, minute, second), the type of operation button, and the pressing pressure during the operation, and An operation parameter consisting of the pressing time (in milliseconds) is included. Instead of recording the pressing time as the operation parameter, the time when the pressing operation is released may be stored. Further, when the joystick 12 is tilted, the tilt direction and tilt angle are also recorded as operation parameters.
[0033]
Returning to FIG. The user interface (user I / F) 23 corresponds to the power button 3 to the resolution adjustment button 14 provided on the outer surface of the remote controller 1. The actuator 24 with pressure sensor measures the user's operation pressure with respect to the user interface 23 and notifies the control unit 21 via the bus 23. Moreover, the actuator 24 with a pressure sensor adjusts the operational feeling of the user interface 23, that is, the repulsive force with respect to the pressing operation, according to the feedback information from the control unit 21.
[0034]
The operation detection unit 25 detects an operation from the user on the user interface 23, generates a corresponding operation signal, and outputs the operation signal to the control unit 21 via the bus 22.
[0035]
The storage unit 26 stores a control program executed by the control unit 21, operation history information generated by the control unit 21, and the like. The transmission / reception unit 27 transmits a command signal for the television receiver that is a control target, for example, by infrared rays according to the control from the control unit 21. Further, the transmission / reception unit 27 receives a status signal transmitted from a television receiver that is a control target, and outputs the status signal to the control unit 21 via the bus 22.
[0036]
Next, FIG. 4 will be described with reference to the flowchart of FIG. 4 for an operation feeling adjustment process for adjusting the operation feeling of the operation buttons and the like in accordance with the operation history of the user.
[0037]
In step S1, the operation detection unit 25 stands by until a user operation on the user interface 23 is detected. When it is determined that the user operation is detected, the operation detection unit 25 proceeds to step S2.
[0038]
In step S <b> 2, the operation detection unit 25 generates an operation signal corresponding to the user operation and outputs the operation signal to the control unit 21 via the bus 22. On the other hand, the actuator 24 with pressure sensor measures the user's pressing pressure on the user interface 23 and outputs the measurement result to the control unit 21 via the bus 22. The control unit 21 executes processing at the time of operation based on the operation signal from the operation detection unit 25.
[0039]
The process at the time of operation in step S2 is demonstrated with reference to the flowchart of FIG. In step S <b> 11, the control unit 21 compares the operation signal from the operation detection unit 25 with the operation history information stored in the storage unit 26 to determine whether or not to change to the operation estimation mode (stay in the normal mode). )).
[0040]
Specifically, for example, when the frequency of pressing the channel buttons 7 of different channels (number of operations / N seconds) or the frequency of pressing the channel shift button 10 is equal to or higher than a predetermined threshold, the user frequently switches the channel. Since it can be determined that the state (so-called zapping) is being performed, it is determined that the mode is changed to the zapping mode in the operation estimation mode.
[0041]
Further, for example, the channel button 7 of the same channel as the channel selected by the television receiver (determined based on the status signal from the television receiver) is pressed more than a predetermined number of times within a predetermined time. If the channel button 7 of the same channel has been pressed for a predetermined time or longer, it is determined that the operation mode transitions to the continuous operation mode.
[0042]
Further, for example, when the television receiver is not in the brightness adjustment mode (determined based on the status signal from the television receiver), the resolution adjustment button 14 is pressed a predetermined number of times within a predetermined time. Alternatively, when the resolution adjustment button 14 is kept pressed for a predetermined time or longer, it is determined that the operation mode transitions to the continuous operation mode.
[0043]
If it is determined in step S11 that the operation estimation mode is to be changed, the process proceeds to step S12. In step S <b> 12, the control unit 21 transitions to the operation estimation mode, and causes the transmission / reception unit 27 to transmit a command signal corresponding to the operation signal from the operation detection unit 25. The transmission / reception unit 27 transmits a command signal to the television receiver that is a control target in accordance with the control from the control unit 21.
[0044]
For example, if the operation signal from the operation detection unit 25 indicates that the channel button 7-6 of 6 channels has been pressed, and the transition is made to the zapping mode of the operation estimation mode, the response in the zapping mode As shown in FIG. 6, a command signal for controlling the screen 31 of the television receiver to be controlled to be divided and displayed (a command signal transmitted when the divided display button 9 is pressed) Further, a command signal for controlling the television receiver is transmitted so that the cursor 32 displayed on the screen 31 points to the divided area where the 6-channel video is displayed. In this case, the divided display is performed so as to help the user of the zapping user to select a channel.
[0045]
Further, for example, when the operation signal from the channel operation detection unit 25 indicates that the channel button 7-6 of 6 channels is pressed, and the operation signal is changed to the continuous operation mode in the operation estimation mode, As a corresponding command signal in the continuous operation mode, a command signal for controlling display of program information of 6 channels (the same as the command signal transmitted when the program information button 8 is pressed), and the volume increase. A command signal (the same as the command signal transmitted when the volume increase side of the volume button 11 is pressed) is transmitted. In this case, since the user seems to be interested in the channel being displayed, the program information is displayed.
[0046]
Furthermore, for example, when the operation signal from the channel operation detection unit 25 indicates that the resolution adjustment button 14 has been pressed, and the transition is made to the continuous operation mode of the operation estimation modes, the continuous operation mode As a corresponding command signal, a command signal (same as the command signal transmitted when the brightness adjustment button 13 is pressed) that is controlled to shift to the brightness adjustment mode is transmitted, and then the resolution is adjusted. A command signal is transmitted. In this case, since the user is going to change the resolution, a transition is made to the brightness adjustment mode in which the resolution can be changed.
[0047]
Thus, in the operation estimation mode, the user's operation intention is estimated and a command signal is transmitted. Therefore, by providing such an operation estimation mode, the program information button 8, the split display button 9, and the like can be omitted from the remote controller 1.
[0048]
On the other hand, when it is determined in step S11 that the operation estimation mode is not changed (stays in the normal mode), the process proceeds to step S13. The control unit 21 causes the transmission / reception unit 27 to transmit a command signal corresponding to the operation signal from the operation detection unit 25 in the normal mode. The transmission / reception unit 27 transmits a command signal to the television receiver that is a control target in accordance with the control from the control unit 21.
[0049]
For example, when the operation signal from the operation detection unit 25 indicates that the channel button 7-6 for 6 channels is pressed, the channel selection of the television receiver to be controlled is controlled to 6 channels. Command signal is transmitted.
[0050]
As described above, after the command signal is transmitted from the transmission / reception unit 27 in step S2, the process proceeds to step S3 in FIG.
[0051]
In step S <b> 3, the control unit 21 updates the operation history information stored in the storage unit 26 based on the operation signal from the operation detection unit 25 and the measurement result of the actuator 24 with the pressure sensor. In step S <b> 4, the control unit 21 determines whether to change the operational feeling of the user interface 23 based on the operation history information stored in the storage unit 26. For example, when the serial number of the operation history information becomes a predetermined value (for example, a multiple of 100), or when a predetermined number of days have passed since the previous operation feeling of the user interface 23 was changed, etc. It is determined that the operational feeling of the interface 23 is changed.
[0052]
If it is determined that the operational feeling of the user interface 23 is to be changed, the process proceeds to step S5. In step S <b> 5, the control unit 21 generates feedback information for controlling the actuator 24 with pressure sensor based on the operation history information stored in the storage unit 26, and sends the feedback information to the actuator 24 with pressure sensor via the bus 22. Output.
[0053]
In the feedback information, for example, when it can be determined that the user's pressing pressure on the user interface 23 is statistically strong based on the operation history information, information for increasing the repulsive force of the user interface 23 is written. On the other hand, when it can be determined that the user's pressing pressure on the user interface 23 is statistically weak, information for reducing the repulsive force of the user interface 23 is written.
[0054]
In addition, when it can be determined that the operation angle of tilting the joystick 12 included in the user interface 23 is statistically small, the joystick 12 is configured so that the operation range of the user tilting the joystick 12 (that is, the tilt angle) becomes wider. Information is written to reduce the repulsive force. On the other hand, when it can be determined that the angle of the operation of tilting the joystick 12 included in the user interface 23 is statistically large, the repulsive force of the joystick 12 is increased so that the operation range of the user tilting the joystick 12 becomes narrower. Information to be written is written.
[0055]
In step S <b> 6, the pressure sensor actuator 24 adjusts the repulsive force of the user interface 23 according to the feedback information from the control unit 21. The process returns to step S1, and the subsequent processes are repeated. Above, description of the operation feeling adjustment process of the remote control 1 is complete | finished.
[0056]
As described above, according to the operation feeling adjustment process, when the pressing pressure on the user interface 23 is statistically strong, the repulsive force of the user interface 23 is greatly adjusted, and conversely, the pressing pressure on the user interface 23 is statistical. When it is weak, the repulsive force of the user interface 23 is adjusted to be small, so that the operational feeling is improved for the user.
[0057]
In particular, the channel shift button 10 and the volume button 11 change the channel selection shift speed or the volume increase / decrease speed in accordance with the pressed depth. For example, even if a person with a strong pressing pressure operates, the repulsive force is increased and the pressing down is suppressed. Therefore, it is possible to prevent the channel selection shift speed and volume increase / decrease speed from becoming higher than necessary. On the other hand, when a person with low pressing pressure operates, the repulsive force becomes small and the pressing becomes easy. Therefore, the shift speed of channel selection and the increase / decrease speed of volume can be easily adjusted.
[0058]
It should be noted that the change in the operational feeling of the user interface 23 can be executed by the user at an arbitrary timing in addition to determining whether or not to execute it in the process of step S4.
[0059]
Further, the operation history information stored in the storage unit 26 is not only used to generate feedback information for controlling the actuator 24 with the pressure sensor, but also, for example, an operation pattern for the user interface 23 is extracted and the remote controller 1 is extracted. It may be used for personal authentication of the person who operates. And after performing personal authentication, you may make it produce | generate operation history information separately for every operator.
[0060]
The present invention can be applied not only to a remote controller for controlling a television receiver but also to any remote controller.
[0061]
Further, as described above, instead of the remote controller 1 generating and storing the operation history information and transmitting a command signal in accordance with the user's operation intention based on the operation history information, the control target television receiver Alternatively, the history of command signals transmitted from the remote controller 1 may be stored, the user's operation intention may be estimated based on the history, and autonomous operation may be performed accordingly.
[0062]
By the way, the above-described series of processing is realized by the control unit 21 executing the control program (software) stored in the storage unit 26, but may be executed by hardware.
[0063]
In this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.
[0064]
Further, in the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily processed in chronological order, either in parallel or individually. The process to be executed is also included.
[0065]
【The invention's effect】
As described above, according to the present invention, it is possible to realize a remote controller that is easy to operate and has few operation buttons without limiting the items of controllable functions.
[Brief description of the drawings]
FIG. 1 is a diagram showing an external appearance of a remote controller according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a configuration example of a remote control in FIG.
FIG. 3 is a diagram illustrating an example of operation history information.
FIG. 4 is a flowchart for explaining operation feeling adjustment processing by a remote controller;
FIG. 5 is a flowchart illustrating the process of step S2 of FIG.
FIG. 6 is a diagram illustrating a display example of a television receiver to be controlled.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Remote controller, 21 Control part, 23 User I / F, 24 Actuator with pressure sensor, 25 Operation detection part, 26 Storage part, 27 Transmission / reception part

Claims (9)

In response to a user operation on the user interface, a control device that transmits a command signal to the electronic device to be controlled.
Detecting means for detecting a user operation on the user interface;
Storage means for storing the detection result of the detection means as operation history information;
A determination unit that refers to the operation history information stored by the storage unit and determines whether or not to transition from the normal mode to the operation estimation mode;
When it is determined by the determination means that the operation estimation mode is not changed, a command signal corresponding to the user operation detected by the detection means is transmitted as the normal mode process, and the operation is performed by the determination means. If it is determined that the transition to the estimated mode, wherein the processing of the operation prediction mode, the including control and transmission means for transmitting a different command signals and said command signal corresponding to operation of the user detected by the detecting means apparatus. The storage unit stores at least one of operation date / time, operation content, operation pressure, operation direction, operation inclination angle, or operation duration time of the user's operation detected by the detection unit as the operation history information.
Control device according to 請 Motomeko 1. The determination unit refers to the operation date and time included in the operation history information stored by the storage unit, and determines that the normal mode is shifted to the operation estimation mode when the operation frequency for the same user interface is high.
Control device according to 請 Motomeko 1. The determination unit refers to the operation date and time included in the operation history information stored by the storage unit, and determines that the normal mode is shifted to the operation estimation mode when the operation frequency for the different user interface is high.
Control device according to 請 Motomeko 1. Wherein the controlled object is transmitted from the electronic apparatus, the control apparatus according to further including claim 1 receiving means state for receiving a signal indicative of the electronic device. In a control method of a control device that transmits a command signal to an electronic device to be controlled in response to a user operation on a user interface,
A detection step of detecting a user operation on the user interface;
A storage step of storing the detection result in the process of the detection step as operation history information;
A determination step of determining whether or not to transition from the normal mode to the operation estimation mode with reference to the operation history information stored by the processing of the storage step;
When it is determined that the operation estimation mode is not changed by the process of the determination step, a command signal corresponding to the user operation detected by the process of the detection step is transmitted as the process of the normal mode, and the determination If it is determined in step processing that the operation estimation mode is to be changed, a command signal different from the command signal corresponding to the user operation detected by the detection step processing is transmitted as the operation estimation mode processing. including control method and a transmission step for. In response to a user operation on the user interface , a program for controlling the control device that transmits a command signal to the electronic device to be controlled ,
A detection step of detecting a user operation on the user interface;
A storage step of storing the detection result in the process of the detection step as operation history information;
A determination step of determining whether or not to transition from the normal mode to the operation estimation mode with reference to the operation history information stored by the processing of the storage step;
When it is determined that the operation estimation mode is not changed by the process of the determination step, a command signal corresponding to the user operation detected by the process of the detection step is transmitted as the process of the normal mode, and the determination If it is determined in step processing that the operation estimation mode is to be changed, a command signal different from the command signal corresponding to the user operation detected by the detection step processing is transmitted as the operation estimation mode processing. A recording medium on which is recorded a computer-readable program that causes a computer of a control device to execute a process including a transmission step. In response to a user operation on a user interface, a control program for controlling a control device that transmits a command signal to an electronic device to be controlled ,
A detection step of detecting a user operation on the user interface;
A storage step of storing the detection result in the process of the detection step as operation history information;
A determination step of determining whether or not to transition from the normal mode to the operation estimation mode with reference to the operation history information stored by the processing of the storage step;
When it is determined that the operation estimation mode is not changed by the process of the determination step, a command signal corresponding to the user operation detected by the process of the detection step is transmitted as the process of the normal mode,
When it is determined that the operation estimation mode is changed in the determination step processing, the operation estimation mode processing is different from the command signal corresponding to the user operation detected by the detection step processing. program Ru to execute the processing including a transmission step to the computer of the control device for transmitting. In a remote control system including a control device that transmits a command signal in response to a user operation on a user interface, and an electronic device that operates in response to the command signal transmitted from the control device,
The controller is
Detecting means for detecting a user operation on the user interface;
Storage means for storing the detection result of the detection means as operation history information;
A determination unit that refers to the operation history information stored by the storage unit and determines whether or not to transition from the normal mode to the operation estimation mode;
When it is determined by the determination means that the operation estimation mode is not changed, a command signal corresponding to the user operation detected by the detection means is transmitted as the normal mode process, and the operation is performed by the determination means. If it is determined that the transition to the estimated mode, wherein the processing of the operation prediction mode, said command signal transmitting means and the including remote transmitting different command signals and corresponding to operation of the user detected by the detection means Control system.

Images