JP4505359B2 - Remote control system and method, program - Google Patents

Description

  The present invention relates to a remote control system and a remote control method composed of communication devices such as a telephone terminal, a mobile phone terminal, and a personal computer, and in particular, operates a remote communication device via a network and shares the operation result. The present invention relates to a remote control system and method that can be performed, and a program.

  Conventionally, when remotely operating a remote communication device or sharing an application with a remote communication device, the communication device on the operation side transmits an operation event to the communication device on the operated side. Then, the communication device on the operated side regularly realizes these processes of application sharing by transferring the screen output to the operating side as image data such as a bitmap and notifying the operation result ( (Refer nonpatent literature 1).

  As another method, a common application is started between the operation side communication device and the operated side communication device, and the operation command of the common application is not only the application started on the operation side communication device side. The application sharing is realized by transferring it to the operated communication device (see Patent Document 1).

  Both of the above two examples are realized by personal computers, that is, it is assumed that hardware such as operation devices provided in terminals constituting the system is substantially equal.

As an example of remote control between different hardware, there is one that realizes remote control of a personal computer using a mobile phone (see Patent Document 2). This realizes remote control from the mobile phone by converting the screen information of the personal computer into information that can be displayed and operated on the mobile phone.
JP-A-8-212162 JP2002-111893 T. Richardson et al: “Virtual Network Computing”, IEEE Internet Computing, Vol.2, No.1, Jan / Feb pp 33-38, 1998

  However, in the conventional technology, in the case of the conventional remote control system or application sharing system, it is assumed that the terminals constituting the system are general-purpose computers.

  In particular, only mouse and keyboard are assumed for operation devices, and these systems are applied when remote control is performed between devices that have special operation devices other than these and devices that do not have a mouse and keyboard. Difficult to do.

  In the future, remote control and application sharing between various information home appliances are expected. However, since these terminals are each provided with a specific operation device, methods such as Non-Patent Document 1 and Patent Document 1 are used. Then, it is difficult to realize the system.

  Moreover, the system of patent document 2 is mentioned as a prior art for the remote operation between different models. In this system, in order to absorb the hardware differences between the mobile phone and the PC, the screen display data to be displayed on the mobile phone and the processing of the operation commands sent from the mobile phone are all handled. It can be remotely controlled by the PC.

  However, since it is such a system, it is impossible to operate a mobile phone from a personal computer. Remote control and application sharing performed between various types of home information appliances is not a one-way control, and it is necessary to realize bidirectionality in which any device can behave as either the operating side or the operated side. There is.

  In the remote control system according to the prior art, either all functions are remotely controlled, or one predetermined application is remotely controlled.

  Also, each time remote control is performed, a desired operation target application is specified, or it is specified as an operation target of a plurality of applications, and further, which operation target application is controlled using which operation device. It has been difficult to realize a remote control system that allows a user to request remote control conditions with higher flexibility.

  Further, there has been no remote control system that can negotiate these remote control conditions between communication devices.

  In addition, when the operated communication device uses a remote control method in which output data is transferred to the operated communication device to reproduce the image on the operated communication device, the output data transfer speed is Therefore, there is a problem that the quality of the video obtained by the operation side communication device is deteriorated.

  In addition, when the remote control method according to the prior art is used, it is impossible to share an application installed only in the operated communication device.

  In addition, when writing to a certain database by remote control using this method, the database has been written twice.

In view of such a problem, the present invention can provide an application execution means suitable for a remote control target application and its operation state,
When switching the application execution method during remote control execution, the operation state of the application before switching can be taken over after switching,
An object of the present invention is to provide a remote control system, method, and program capable of resuming remote control from a state immediately before switching occurs when switching of application execution means fails.

In order to solve the above problems, the present invention according to claim 1, in the remote control system for operating-side communication apparatus to control the operated-side communication apparatus via the network to the remote, the operated-side communication device the input event input to the operating-side communication device, an input event routing unit Ru sorting based on the event distribution rules are distributed Ru rule predetermined application to which the operated-side communication device comprises the operated-side communication Device- side capability information describing processing capability including an operation-side input event list and an application that can be processed by the device, and the operated-side communication device that delegates the operation to the operating-side communication device received from the operated-side communication device Remote control information including the operated-side application and the operated-side input event list , based on the operated-side A capability exchange unit for generating a remote control condition for remotely operating an application, and an event distribution rule change instruction describing a method for changing the event distribution rule based on the remote control condition generated by the capability exchange unit A remote control command generation unit that generates and transmits to the input event routing unit, and transmits the input event that is input to the operation side communication device and distributed by the input event routing unit to the operated side communication device An event communication unit, a communication control unit that instructs the event communication unit to start or end transmission / reception, and an output unit that outputs output data of the application included in the operation side communication device .

In addition, the present invention described in claim 2 provides the operation side communication device according to claim 1, further comprising an event conversion unit that converts the input event according to an event conversion rule, wherein the remote control command generation unit includes: said it based on the remote control condition, if it is determined that the required conversion of the input events for the event conversion section, and the operated-side input event list included in the remote control condition, a list of the operation-side input event sends an event conversion instruction including the relative input event routing unit transmits the distribution destination in the event allocation rule specifies an event conversion unit change instruction input event, the event conversion section, wherein the event transformation The event conversion rule according to the instruction is acquired, and the event conversion is performed for the input event received from the input event routing unit. Convert accordance law, it is transmitted to the operated-side communication device through the event communication unit.

Further, the present invention according to claim 3, Oite to claim 1 or 2, wherein the remote control instruction generation unit, as the output data acquisition method of the operated-side application specified in the remote control condition, the operation When it is specified that the same application as the side application is executed on the operation side communication device, the event distribution rule change instruction describing the control method of the application is transmitted to the input event routing unit, the input event routing unit, the being mounted on the operating-side communication device in addition to the operated-side communication apparatus as a distribution destination of the input event specified by the event allocation rules change command received, the operated-side The same application as the application is also set as the distribution destination.

Further, the invention according to claim 4, Oite to claim 2 or 3, wherein the operated-side communication device, the output data analyzing unit for analyzing the output data of the operated-side application of the operated-side communication device The event conversion unit further includes the analysis in the case where it is necessary to execute a process of embedding an analysis program for executing event conversion in the output data of the operated-side application in the result of obtaining the event conversion rule. An output data analysis command in which a program is described is transmitted to the output data analysis unit , and when the output data analysis command is received, the output data analysis command acquires the analysis program specified in the output data analysis command. Operate.

According to a fifth aspect of the present invention, in the remote control method for an operation side communication device to remotely control the operated side communication device via a network, the operation side communication device is the operation side communication device. sorting Ru sorting step and, processable operating side input event in the operated-side communication device based on the entered input event, the event distribution rules are distributed Ru rule predetermined application to which the operated-side communication device is provided in Device capability information describing processing capability including a list and an application, and an operated side application and an operated side of the operated side communication device that are received from the operated side communication device and delegate the operation to the operated side communication device and remote control information including an input event list, based on, for remotely operating the operated-side application A remote control condition generating step of generating a隔制your condition, on the basis of the said remote control condition generated in the remote control condition generating step, to generate an event allocation rules change instructions describing a method of changing the event allocation rule A command generation step for transmitting to the input event routing unit; and an event communication step for transmitting the input event input to the operation side communication device and distributed by the input event routing unit to the operated side communication device ; And an output step of outputting output data of the application included in the operation side communication device .

Also, in the present invention described in claim 6 according to claim 5, the operation side communication device further performs an event conversion step of converting the input event in accordance with an event conversion rule, and the command generation step includes the remote command generation step. and based on the control condition, if it is determined that the required conversion of the input event to generate a the operated-side input event list included in the remote control condition, the event transformation instructions including a list of operating side input event, wherein event conversion step obtains the event conversion rules in accordance with said event conversion instruction to convert the input events according to the event transformation rule, and transmits the to the operated-side communication device.

Further, the invention according to claim 7, Oite to claim 5 or 6, wherein the instruction generation step, as output data acquisition method of the remote control the operated-side application specified in the condition, the operated-side When it is specified that the same application as the application is to be executed on the operation side communication device, the event distribution rule change instruction describing the control method of the application is generated, and the distribution step is received The same application as the operated-side application installed in the operating-side communication device in addition to the operated-side communication device as the allocation destination of the input event specified by the event distribution rule change command is also distributed. Set first.

Further, the invention according to claim 8, Oite to claim 6 or 7, wherein the operated-side communication device, the output data analyzing step of analyzing the output data of the operated-side application of the operated-side communication device Further , the event conversion step performs the analysis when it is necessary to execute processing for embedding an analysis program for executing event conversion in the output data of the operated-side application in the result of obtaining the event conversion rule. An output data analysis instruction in which a program is described is generated, and the output data analysis step operates by acquiring the analysis program specified in the generated output data analysis instruction.

Further, the invention according to claim 9, in the remote control program for operating-side communication apparatus to control the operated-side communication apparatus via the network to the remote, the operated-side communication apparatus, the operated-side communication device sorting Ru sorting step and, processable operating side input event in the operated-side communication device based on the entered input event, the event distribution rules are distributed Ru rule predetermined application to which the operated-side communication device is provided in Device capability information describing processing capability including a list and an application, and an operated side application and an operated side of the operated side communication device that are received from the operated side communication device and delegate the operation to the operated side communication device and remote control information including an input event list, based on, for remotely operating the the operated-side application A remote control condition generating step of generating a remote control condition because, based on the remote control condition generated in the remote control condition generating step, an event allocation rules change instructions describing a method of changing the event allocation rule A command generation step for generating and transmitting to the input event routing unit; and event communication for transmitting the input event input to the operation side communication device and distributed by the input event routing unit to the operated side communication device steps and an output step of outputting the output data of the application in which the operation-side communication device comprises, to the execution.

Further, the present invention described in claim 10 makes the operation-side communication device further execute an event conversion step of converting the input event according to an event conversion rule in claim 9, wherein the command generation step includes and based on the remote control condition, if it is determined that the required conversion of the input event to generate an event conversion instruction including the the operated-side input event list included in the remote control condition, and a list of the operating-side input event, wherein the event transformation step obtains the event conversion rules in accordance with said event conversion instruction to convert the input events according to the event transformation rule, and transmits the to the operated-side communication device.

Further, the invention according to claim 11, Oite to claim 9 or 10, wherein the instruction generation step, as output data acquisition method of the remote control the operated-side application specified in the condition, the operated-side When it is specified that the same application as the application is to be executed on the operation side communication device, the event distribution rule change instruction describing the control method of the application is generated, and the distribution step is received The same application as the operated-side application installed in the operating-side communication device in addition to the operated-side communication device as the allocation destination of the input event specified by the event distribution rule change command is also distributed. Set first.

Further, the invention according to claim 12, Oite to claim 10 or 11, wherein the operated-side communication device, the output data analyzing step of analyzing the output data of the operated-side application of the operated-side communication device Further , the event conversion step performs the analysis when it is necessary to execute processing for embedding an analysis program for executing event conversion in the output data of the operated-side application in the result of obtaining the event conversion rule. An output data analysis instruction in which a program is described is generated, and the output data analysis step operates by acquiring the analysis program specified in the generated output data analysis instruction.

According to the present invention, it is possible to provide an application execution means suitable for the remote control target application and its operating state,
When switching the application execution method during remote control execution, the operation state of the application before switching can be taken over after switching,
It is possible to provide a remote control system, method, and program capable of resuming remote control from a state immediately before switching occurs when switching of application execution means fails.

<First Embodiment>
FIG. 1 shows an overall configuration diagram for explaining a remote control system according to a first embodiment of the present invention.

  In FIG. 1, an operation side communication device 1 on a remote control side and an operated side communication device 2 on a remote control side are shown.

  The operation side communication device 1 includes an operation unit 3 to which an operation from the outside is input, an application control unit 4, a remote control management unit 7, an application execution rule database 9, an application A17, and an application B18. A display unit 19 and an output data communication application 11 are shown.

  The operated communication device 2 includes an operation unit 5, an application control unit 6, a remote control management unit 8, an application execution rule database 10, an application A14, an application B15, a display unit 16, and an output. A data analysis unit 13 and an output data communication application 12 are shown.

  The operation of the remote control system according to the first embodiment of the present invention will be described with reference to the configuration shown in FIG. 1 and the message sequence diagram of the remote control system shown in FIG.

  First, in the operated side communication device 2, as shown in FIG. 3, a process for exchanging capabilities between the operating side communication device 1 and the operated side communication device 2 is executed.

  First, in S401, the remote control management unit 8 outputs remote control target application identification information based on the input remote control conditions. By this process, the remote control target application is extracted from the remote control conditions, and the identification information of the application is output.

  Next, in S402, the remote control management unit 8 outputs operation state identification information based on the input remote control conditions. By this process, the initial operation state of the application is extracted from the remote control condition, and identification information of the operation state is output. In the case of a WEB browser, the initial display state is the URL being displayed.

  In step S403, the application execution rule database 10 outputs an application execution rule based on the input remote control target application identification information and operation state identification information. By this process, the application execution rule applied to the input information is searched, and the corresponding application execution rule is output.

  An example of the database stored in the application execution rule database 10 is shown in FIG. Depending on each of the Web browser, video player, address book, unimplemented application, etc., the operation state, the analysis result of the output data being displayed in the operation state, and the execution of the application in the operation side communication device 1 The presence or absence is indicated.

  In step S404, the remote control management unit 8 generates a remote control request based on the input remote control target application identification information, the operation state identification information, and the application execution rule. This process completes the generation of the remote control request based on the input information.

  The generated remote control request has the contents as shown in FIG. 8 as an example. The operation side is a communication device A, which is a component 1 and a component 2, and an operation target application, an initial state, an application execution rule, and an event type are shown for each.

  Next, in S 406, the remote control management unit 8 transmits the input remote control request to the operation side communication device 1.

  Next, in S406, the remote control management unit 8 waits for a response to the received remote control request, and when received, outputs the response.

  Next, in S407, the remote control management unit 8 analyzes the content of the response received from the operation side communication device 1, and outputs the capability exchange state identification information at the time when the response is received.

  In step S <b> 408, the remote control management unit 8 generates a remote control target application activation command based on the remote control target application identification information and the operation state identification information, and transmits the command to the application control unit 6. However, if it is specified as an application execution rule that the operation side communication device 1 does not execute the application, an output data transmission command is transmitted to the output data communication application 12.

  In step S409, the application control unit 6 sends a control command to the application specified in the input remote control target application start command, starts the application, and specifies the remote control target application start command. Transition to the initial state.

  Next, in S410, the application control unit 6 prohibits input of an input event from the operation unit 5 of the operated communication device 2 based on the input remote control target application activation command and the output data communication application activation confirmation notification. Then, the event distribution rule is changed so that the input event from the operation side communication device 1 is transmitted to the remote control target application.

  In step S411, when the remote control target application identification information is input from the remote control management unit 8 in the output data analysis unit 13, an item to be detected as an analysis result of the output data of the application is displayed in the application execution rule database. 10 is obtained. Furthermore, an output data analysis rule is set so that the acquired item can be detected.

  Next, in S412, the remote control management unit 8 outputs capability exchange state identification information indicating acceptance of the change request when the execution rule is defined as changeable in the application execution rule output in S403. If the change is impossible, the capability exchange state identification information indicating rejection of the change request is output.

  In step S413, the remote control management unit 8 changes the application execution rule based on the input capability exchange state identification information (change request acceptance). After that, the changed application execution rule and application execution rule change completion notification are output.

  Next, in S414, the remote control management unit 8 transmits a change request acceptance response to the operation side communication device 1.

  Next, in S415, the remote control management unit 8 transmits a change request rejection response to the operation side communication device 1 based on the input capability exchange state identification information (change request rejection).

  Next, in S416, the output data communication application 12 is activated and transmission of output data is started.

  Next, in the operation side communication device 1, as shown in FIG. 2, processing for capability exchange between the operation side communication device 1 and the operated side communication device 2 is executed.

  First, referring to FIG. 4, in S501, the remote control management unit 7 waits for and receives a response to the remote control request from the operated communication device 2.

  In step S502, the remote control management unit 7 analyzes the input remote control request and extracts remote control target application identification information, operation state identification information, and application execution rules.

  In step S503, the application execution rule database 9 is searched for an application execution rule applied to the input information, and the corresponding application execution rule is output. The application execution rule database 9 is referred to in FIG.

  Next, in S504, the remote control manager 7 compares the two input application execution rules, generates capability exchange state identification information based on the comparison result, and outputs it.

  Next, in S505, the remote control management unit 7 generates a rejection response to the remote control request.

  In step S <b> 506, the remote control management unit 7 transmits a rejection response to the remote control request to the operated communication device 2.

  Next, in S507, the remote control management unit 7 generates a rejection response to the remote control request.

  In step S <b> 508, the remote control management unit 7 transmits an acceptance response to the remote control request to the operated communication device 2.

  Next, in S509, when the remote control management unit 7 specifies execution of the application in the operation side communication device 1 as an application execution rule, the remote control management unit 7 performs remote control based on the remote control target application identification information and the operation state identification information. A control target application activation command is generated and transmitted to the application control unit 4. However, when it is specified as an application execution rule that the application is not executed in the operation side communication device 1, an output data reception command is transmitted to the output data communication application 11.

  Next, in S510, the application control unit 4 sends a control command to the application specified in the input remote control target application start command, starts the application, and specifies the remote control target application start command. Transition to the initial state.

  Next, in S511, when a remote control target application activation command is input in the application control unit 4, an input event from the operation unit 3 of the operation side communication device 1 is sent to the application and the operated side communication device 2. Change the event distribution rule to send to When the output data communication application activation notification is input, the event distribution rule is changed so that the input event from the operation unit of the operation side communication device 1 is transmitted only to the operated side communication device 2.

  Next, in S512, the remote control management unit 7 transmits an application execution rule change request in response to the remote control request.

  Next, in S513, the remote control management unit 7 transmits an application execution rule change request to the operated communication device 2 in response to the remote control request.

  Next, in S514, the remote control management unit 7 waits for a response to the transmitted application execution rule change request and outputs the response when received.

  Next, in S515, the remote control manager 7 inputs a response to the change request. The content of the response received from the operation side communication device 1 is analyzed, and the capability exchange state identification information at the stage where the response is received is output. This output is capability exchange state identification information (when receiving an acceptance response, in addition to identification information indicating the capability exchange success, remote control target application identification information, operation state identification information, application execution rule).

  Next, in S516, in the output data communication application 11, the output data communication application is activated and starts receiving output data.

  Further, processing in the operated communication device at the time of state analysis will be described with reference to FIG. 2 and FIG.

  First, in S601, the application control unit 6 acquires operation state identification information indicating the current state from each active application. Among the acquired operation state identification information, the operation state identification information of the remote control target application is transmitted to the remote control management unit 8.

  Next, in S602, when an application not specified at the time of capability exchange related to the remote control is activated by the operation of the control side communication device 1 in the application control unit 6, the remote control management unit 8 is newly Notify the launched application.

  In step S <b> 603, the output data analysis unit 13 transmits output data reception state identification information indicating whether or not new output data has been received to the remote control management unit 8.

  In step S604, the output data analysis unit 13 analyzes the input output data in accordance with the output data analysis rule set in step S411. Output data analysis information as an analysis result is transmitted to the remote control management unit 8.

  In step S605, the application execution rule database 10 is searched for application execution rules applied to the input remote control target application identification information, operation state identification information, and output data analysis information, and the corresponding application execution rules are output. To do.

  Next, in S606, the remote control management unit 8 compares the input application execution rule being applied by remote control with the application execution rule detected in S605. Generate. At this time, as the application execution rule after the change, when the operation side communication device 1 specifies to execute the application, the operation state identification information of the application acquired in S601 is also described in the application execution rule change request. To do. If both are equal, the state analysis process is terminated.

  Next, in S607, the remote control management unit 8 generates a remote control condition in which the new application is added to the remote control target.

  In step S <b> 608, the remote control management unit 8 transmits an application execution rule change request for the remote control request to the operation side communication device 1.

  In step S609, the remote control management unit 8 waits for a response to the transmitted application execution rule change request, and outputs the response when received.

  In step S610, the remote control management unit 8 outputs capability exchange state identification information in response to the input of a response to the application execution rule change request. At the time of inputting an acceptance response, remote control target application identification information, current operation state identification information, and application execution rules are output in addition to identification information indicating the ability exchange success.

  Next, in S611, when the remote control management unit 8 newly designates execution of the application in the operation side communication device 1 as an application execution rule, transmission of output data to the output data communication application 12 is stopped. Send instructions. Alternatively, when it is newly specified as an application execution rule that the application on the operation side communication device 1 is not executed, an output data transmission command is transmitted to the output data communication application 12.

  Next, in S612, the output data communication application 12 stops the transmission of the output data being executed in the output data communication application based on the input output data transmission stop command, and issues an output data communication application transmission stop confirmation notification. Output.

  In step S613, the output data communication application 12 receives an output data transmission command, outputs an output data communication application activation confirmation notification, activates the output data communication application, and starts receiving output data.

  Next, in S614, the application control unit 6 receives capability exchange state identification information (change request rejection) and outputs an application control command. As a process, a control command is sent to the application specified in the input remote control target application activation command, and the state is shifted to the state immediately before the operation state acquired in S601.

  Further, processing in the operated communication device at the time of state analysis will be described with reference to FIG. 2 and FIG.

  First, in S701, the operation unit 3 outputs an input event according to the input user operation.

  Next, in S702, the application control unit 4 routes an input event according to the event distribution rule. When the application is also executed on the operation side communication device 1, the operation state identification information of the application is acquired after the input event is output.

  Next, in S703, when the remote control management unit 7 receives a response to the remote control request from the operated-side communication device 2, the capability exchange is newly started.

  Next, in S704, when the remote control management unit 7 receives an application execution rule change request from the operated communication device 2, the control is interrupted.

  Next, in S705, if the remote control application execution rule is defined as changeable in the remote control management unit 7, the capability exchange state identification information indicating acceptance of the change request is output, and the change is not changed. If possible, the capability exchange state identification information indicating that the change request is rejected is output.

  Next, in S706, the remote control management unit 7 outputs an application execution rule (after change) and an application execution rule change completion notification according to the input capability exchange state identification information (change request acceptance), and executes the application execution. Change the rule.

  In step S <b> 707, the remote control management unit 7 receives an application execution rule change completion notification and transmits a change request acceptance response to the operation-side communication device 1.

  In step S708, the remote control management unit 7 inputs capability exchange state identification information (capability exchange success), application execution rules, and operation state identification information. The output includes an output data transmission command or an output data transmission stop command, and an application start command or application stop command. As for the details of the processing here, when the execution of the application in the operation side communication device 1 is newly designated as the application execution rule, the application start command and the output data transmission stop command are transmitted. Alternatively, when it is newly specified as an application execution rule that the application in the operation side communication device 1 is not executed, an output data reception command is transmitted to the application stop command and the output data communication application.

  Next, in S709, the application control unit 4 sends a control command to the application specified in the input remote control target application start command, starts the application, and specifies the remote control target application start command. Transition to the state to be performed.

  Next, in S710, the output data communication application 11 receives an output data transmission stop instruction, stops transmission of output data being executed in the output data communication application, and outputs an output data communication application transmission stop confirmation notification. .

  Next, in S711, based on the input remote control target application start command or the output data communication application transmission stop confirmation notification in the application control unit 4, the input event from the operation unit 3 of the operation side communication device 1 is displayed as the application. The event distribution rule is changed so as to be transmitted to the operated communication device 2.

  Next, in S712, the application control unit 4 sends a control command to the application specified in the input remote control target application start command, and stops the application.

  In step S713, the output data communication application 11 starts transmission of output data executed by the output data communication application in accordance with the input output data transmission command, and outputs an output data communication application activation confirmation notification.

  Next, in S714, the remote control target application stop command and the output data communication application activation confirmation notification are input to the application control unit 4, and the input event from the operation unit 3 of the operation side communication device 1 is changed to the operated side communication device. The event distribution rule is changed so that only 2 is transmitted.

  Next, in S715, the remote control management unit 7 transmits a change request rejection response to the operation side communication device in accordance with the input capability exchange state identification information (change request rejection).

  Next, in S716, in the case where the application is also executed on the operation side in response to the input capability exchange state identification information (change request rejection), the application control unit 4 sends a control command to the application. , Transition to the state immediately before the operation state acquired in S702.

<Second Embodiment>
FIG. 9 is a block diagram showing a remote control system according to the second embodiment of the present invention.

  This remote control system converts the operation by the user on the operation side into a corresponding input event and outputs it, the event input rules 101 and 201, the event distribution rule databases 102 and 202, and the event distribution rule databases 102 and 202. And input event routing units 103 and 203 that read the distribution rule and distribute the input event to a predetermined application based on the event distribution rule.

  Also, from the functional capability information databases 104 and 204, device capability information describing capabilities such as the format of input events that can be processed by the apparatus and executable applications is read from the functional capability information databases 104 and 204. Generate or analyze remote control information that describes the remote control conditions such as the operation target application, the method for obtaining the output data of the operation target application, the location of the operation right, and the type of input event to be used based on the information. Capability exchanging units 105 and 205 for exchanging capability regarding remote control conditions by transmitting and receiving control information are provided.

  Also, a remote control command generation unit that generates an event distribution rule change command describing a method for changing an event distribution rule based on the remote control condition determined by the capability exchange and transmits the event distribution rule change command to the input event routing units 103 and 203 106, 206 and event communication units 107, 207 for transmitting and receiving input events between remote communication devices, and input to the event communication units 107, 207 with remote communication devices Communication control units 108 and 208 for instructing the start or end of event transmission / reception.

  Also, output units 110 and 210 that output the output data of the applications 109 and 209, and an event conversion unit that reads a predetermined event conversion rule from the event conversion rule database 111, converts a predetermined input event according to the event conversion rule, and outputs it. 112 and a plurality of communication devices including an output data analysis unit 113 that analyzes output data of an application.

  In FIG. 9, for convenience of explanation, the operation side communication device 100 and the operated side communication device 200 are distinguished from each other, and the operated communication device 200 is effective when acting as the operated side communication device. Only the parts are listed. Therefore, actually, the processing unit described only in the operation side communication device 100 may be provided in the operated side communication device 200.

  In FIG. 9, the event distribution rule databases 102 and 202, the device capability information databases 104 and 204, and the event conversion rule database 111 are all provided in the communication device. And a system that acquires desired data by communicating with each processing unit via a network.

  As shown in FIG. 9, the communication device includes the event conversion unit 112 and the output data analysis unit 113. However, when it is not necessary to convert the input event, the communication device may be omitted. Good.

  Next, the present embodiment will be described with reference to FIG. 9 and a flowchart of processing performed in each processing unit.

  A remote operation start request of the operated user is transmitted to the capability exchange unit 205 via the operation input unit 201 and the input event routing unit 203. At this time, the capability exchange unit 205 executes remote control start processing.

  FIG. 10 is a flowchart of the remote control start process of the capability exchange unit 205.

  The capability exchange unit 205 always waits for reception of a remote control start request from the user, and starts remote control start processing when receiving the remote control start request. This remote control start request includes information specifying an operation delegation range such as an application entrusted to the operation side communication apparatus 100 or a partial function of the application. These pieces of information are designated by the user via the operation input unit.

  When a remote control start request from the operated user is received, an operation target application and input event necessary for the remote control are extracted from the device capability information database 204 based on information accompanying the remote control start request. The remote control information is generated (S201 ′).

  FIG. 11 is an example of remote control information generated in S201 ′. In this case, the operated-side communication device 200 indicates that the communication device A is requested to remotely control the video player and the browser among the applications installed in the operated-side communication device 200. Yes.

  Indicate which communication device is the operation side communication device in the remote device, an application that delegates the operation to the operation side communication device, a method for acquiring output data of the application, and an input event for operating the application A type is specified. The component indicates a combination of the operation target application, the output data acquisition method of the application, and the event type.

  In the case of FIG. 11, the up / down direction key event is assigned to the operation of the target player, and the left / right direction key event is assigned to the operation of the browser.

  The capability exchanging unit 205 transmits the remote control information generated in the process of S201 ′ to the capability exchanging unit 105 of the operation side communication device 100 (S202 ′).

  Next, it waits for the response of the operation side communication device to the remote control information transmitted in S202 ′ (S203 ′). When the response is received, the content of the response is analyzed, and if the response is a remote control acceptance notification based on the remote control information, the remote control command generation unit 206 is informed of the remote control conditions for the remote control. Is transmitted (S204 ′), and a capability exchange completion notification is transmitted to the communication control unit 208 (S205 ′).

  If the response received in S203 ′ is the remote control rejection notification, the remote control start process is terminated.

  When receiving the remote control information from the operated-side communication device 200, the capability exchanging unit 105 of the operating-side communication device 100 executes a remote control start process as in the case of the operated-side communication device 200.

  FIG. 12 is a flowchart of the remote control start process of the capability exchange unit 105 of the operation side communication device 100.

  The capability section unit 105 waits for remote control information transmitted from the operated communication device 200 via the network, and upon receiving the remote control information, remote control start processing is started.

  When the remote control information is received, the device capability information of its own is read from the device capability information database 104, and it is determined whether or not the remote control based on the remote control information can be executed (S401 'to S402').

  If it is determined in S402 ′ that the remote control can be executed, a notification of acceptance of the remote control is transmitted to the capability exchange unit 205 of the operated communication device 200 (S403 ′).

  Next, the remote control condition for the remote control is transmitted to the remote control command generation unit 106 (S404 ′). Further, a capability exchange completion notification is transmitted to the communication control unit 108 (S405 ′).

  Note that remote control information is received from the operated communication device 200, and the remote control requested by the remote control information is executed in the operation communication device 100 by the processing indicated by S401 ′ and S402 ′ in FIG. When it is determined that the remote control can be executed, a process of inquiring the operation side user about whether or not the remote control can be executed may be executed between S402 ′ and S403 ′ in FIG. As a result, whether or not the remote control can be performed is determined not only by the ability of the communication device but also by the user's intention.

  In addition to the conditions indicated in the remote control information, the remote control conditions transmitted in S404 ′ include a list of input events that can be executed by the own communication device. This list is used by the remote control command generation unit 112 to determine the necessity of event conversion.

  Next, based on the remote control condition determined by the remote control start process, a command for executing the remote control is generated from the capability exchange units 105 and 205. The remote control command generation units 106 and 206 will be described.

  First, the remote control command generation unit 106 of the operation side communication device 100 will be described. FIG. 13 is a flowchart showing the operation of the remote control command generation unit 106.

  When the remote control condition is received from the capability exchange unit, the process shown in FIG. 13 is started.

  First, in order to perform remote control based on the remote control condition, it is determined whether it is necessary to convert an input event input from the operation side communication device 100 (S501 ′). For this determination, the remote control condition received from the capability exchange unit is used.

  The remote control conditions include a list of input events used for the remote control and a list of input events that can be executed by the operation side communication device 100. In the case of input events that can be executed by the operation-side communication apparatus 100 by capability exchange performed between the capability exchange units 105 and 205, a completely equal set or a list of input events used for the remote control is included. It is one of the sets. If the two sets are exactly the same, it is determined that there is no need for event conversion. If not, an event conversion command is transmitted to the event conversion unit 112 (S502 ′).

  The event conversion command includes a list of input events used for the remote control and a list of input events that can be executed by the operation side communication device 100.

  Next, when an input event specified by the remote control condition is received from the operation input unit 101, the input event is transmitted so that the input event is transmitted to the operated communication device 200 via the event communication unit 107. An event distribution rule change command is transmitted to the routing unit (S503 ′).

  Here, in the remote control condition, when it is specified that the same application as the operation target application is to be executed by the operation side communication device 100 as a method for acquiring the output data of the application, an input event is input to the operated side communication device 200. In addition, the event distribution rule change command specifies that routing is performed not only for the application concerned but also for the application concerned.

  Next, the remote control command generation unit 206 of the operated communication device 200 will be described. The operation of the remote control command generation unit 206 of the operated side communication device 200 is executed only in S503 in the processing of the remote control command stationary unit 106 of the operation side communication device 100 shown in FIG. That is, when a remote control condition is received from the capability exchange unit 205, an event distribution rule change command according to the remote control condition is generated and transmitted to the input event routing 203.

  However, in the case of the operated communication device, when an input event specified for the remote control test is received from the operating communication device 100 via the event communication unit 207, the operation target application specified by the remote control condition On the other hand, transmission of the input event is specified in the event distribution rule change command.

  In addition, in this event distribution rule change command, it is also possible to block all input events input from its own operation input unit 101. As a result, it becomes possible to completely delegate the control right for the input event specified in the remote control condition to the operation side communication device 100.

  Next, the input event routing units 103 and 203 that receive the event distribution rule change command from the remote control command generation units 106 and 206 of the operation side communication device 100 or the operated side communication device 200 will be described. FIG. 14 is a flowchart of the input event routing unit 103 of the operation side communication device 100.

  First, an event distribution rule is read from the event distribution rule database 103, and an input event is set to be distributed to a predetermined application according to the event distribution rule (S601 ').

  FIG. 15 shows an example of the event distribution rule. For example, when the state of the application A is the state A1 and the application B is the state B3, when the event 1 is input, the event 1 is transmitted to both the applications A and B. At this time, event 2 is transmitted only to application B, and event X is not transmitted to any application.

  Next, it is determined whether there is an unprocessed event distribution rule change command received from the remote control command generation unit 106 (S602 ′). If there is an unprocessed event distribution rule change command, the event distribution rule set in S601 ′ is changed in accordance with the command (S603 ′).

  For example, when the event distribution rule of FIG. 14 is read in S601 ′, if the event distribution rule change command specifies that event 2 is to be transmitted to the operated communication device 200, event 2 is set. “X” indicating that transmission is not performed to a remote communication device is changed to “◯” indicating transmission.

  In the process of S602 ′, if there is no unprocessed event distribution rule change command, the process of S603 ′ is not executed.

  Next, when the setting of the event distribution rule is completed, an input event transmitted from the operation input unit 101 is waited (S604 ′). When an input event is received, the input event is input to the remote operated communication device 200 via a predetermined application or the event conversion unit 112 and the event communication unit 107 according to the set event distribution rule. Send an event.

  As shown in FIG. 14, the input event routing unit 103 waits for an input event to be received, and each time an input event is received, according to an event distribution rule, a predetermined application or the operated communication device 200 is operated. Transfer this. The setting change process by the event distribution rule change command is executed as an interrupt process for a loop process that performs event transfer.

  The processing in the input event routing unit 203 of the operated communication device 200 is the same as the processing of the operating communication device 100 shown in FIG.

  First, the event distribution rule referred to in FIG. 15 is read from the event distribution rule database 204, and an input event is set to be distributed to a predetermined application according to the event distribution rule. Next, it is determined whether there is an unprocessed event distribution rule change command received from the remote control command generation unit 206.

  When there is an unprocessed event distribution rule change command, the already set event distribution rule is changed according to the command. As described above, by changing the event distribution rule executed by the operated communication device 200, the input event distribution rule transmitted from the operation side communication device 100 is set in the input event routing unit 203. .

  In addition, when the operation side communication device 200 includes an operation input unit and an input event abstraction unit, and an application can be operated by operating the operation input unit and the input event abstraction unit, an input input in the operation side communication device 200 is performed. Both the event and the input event transmitted from the operation side communication device 100 are processed in the same manner in the input event routing unit.

  Next, the event conversion unit 112 will be described. FIG. 16 is a flowchart of the event conversion unit 112.

  The event conversion unit 112 waits for reception of an event conversion command from the remote control command generation unit 106 (S801 ′). The event conversion command includes an input event specified in the remote control information and a list of input events that can be executed by the operation side communication device 100. An appropriate event conversion rule is searched from the event conversion rule database 111 based on this list, and a matching event conversion rule is acquired (S802 ′).

  FIG. 17 is an example of an event conversion rule. “Input event before conversion” indicates that it is converted to “input event” after change and transmitted to the operated communication device 200.

  On the other hand, the operation program shown in FIG. 17 is an operation program necessary for acquiring a predetermined input event such as where the output data of the application is pointed by, for example, a mouse or a touch panel. The event conversion unit 112 determines whether an event detection program is specified in the acquired event conversion rule (S803 ′).

  As shown in FIG. 17, when the event conversion rule with the operation program specified is acquired, the event conversion unit 112 transmits an output data analysis command to the output data analysis unit 113 (S804 ′). In the output data analysis command, an operation program described in the acquired event conversion rule is specified.

  When the setting for operating based on the acquired event conversion rule is completed, an input event transmitted from the input event routing unit 103 is waited (S805 ′).

  When the input event is received, the input event is converted based on the event conversion rule (S806). For example, according to the event conversion rule of FIG. 17, when an input event “vertical vector +3” is input to the event conversion unit, this is “vertical vector +1”. Note that event conversion processing is not executed when an input event not specified by the event conversion rule is received or when an event conversion command itself is not received.

  The converted input event is transmitted to the operated communication device 200 via the event communication unit 107 (S807 ′).

  As shown in FIG. 16, the event conversion process (S805 ′ to S807 ′) based on a certain event conversion command is repeated each time an input event is received while the remote control continues. When a new event conversion command is received from the remote control command generation unit 106, the event conversion processing is terminated (S808 ′), and the processing is started again from S801 ′.

  Next, it operates according to the output data analysis command received from the event converter 112. The output data analysis unit 113 will be described. FIG. 18 is a flowchart showing the operation of the output data analysis unit 113.

  When an output data analysis command is received from the event conversion unit 112, an operation program specified in the output data analysis command is acquired (S1001 ′). In the present embodiment, the operation program is acquired from the event conversion rule database, but it may be another database or may be acquired from a remote database via a network. Based on the acquired operation program, the output data analysis unit 113 waits for reception of output data (S1002 ′).

  When the output data is received from the application, the output data is analyzed according to the acquired operation program (S1003 ′). As application output data, data described in a description language such as HTML or XML, image data such as a bitmap, and the like can be considered. Examples of operations in the output data analysis unit 113 include not only analyzing these output data but also adding an event script for detecting pointing position information to an appropriate location of the output data. It is conceivable to add data necessary for detection.

  When the analysis of the output data is completed, the output data is output via the output unit 110 (S1004 ′).

  As shown in FIG. 18, the output data analysis processing (S1002 ′ to S1004 ′) based on a certain output data analysis command is repeated each time output data is received while the remote control continues.

  As described above, the remote control system according to the second embodiment operates the same application as the application that operates on the operated-side communication apparatus 200, and the operation-side communication apparatus 100 generates both of these applications. Application synchronization is achieved by sending input events and acquiring output data. As a result, the same output data as the output data obtained by the operated-side communication device 200 can be obtained also by the operating-side communication device 100.

<Third Embodiment>
On the other hand, there is a possibility that the application cannot be synchronized in the output data acquisition method described in the second embodiment of the present invention described above, such as when remote control of an application that is only available in the operated communication device 200 is performed. .

  Therefore, the remote control system according to the third embodiment of the present invention transfers the output data of the operated communication device to the operating communication device and synchronizes the application, thereby causing the problem of the second embodiment. This is to solve the problem.

  FIG. 19 is a block diagram showing a remote control system according to the second embodiment of the present invention.

  In the case of this embodiment, in addition to the components of the remote control system of the second embodiment, in order to transmit the output data of the application executed on the operated communication device 200a to the operating communication device 100a. Output data communication applications 114 and 214 are provided.

  In the present embodiment, in the remote control information transmitted from the capability exchange unit 205a of the operated communication device 200a, acquisition from the operated communication device 200a is specified as an output data acquisition method.

  When the capability exchange unit 105a of the operating-side communication device 100a that has received the remote control information transmits a remote control condition based on the remote control information to the remote control command generation unit 106a, the remote control command generation unit 106a An event distribution rule change command based on the control condition is generated and transmitted to the input event routing unit 103a.

  At the same time, the remote control command generation unit 106a activates the output data communication application 114 in order to receive output data from the operated communication device 200a. The input event routing unit 105a that has received the event distribution rule change command changes the event distribution rule in accordance with the event distribution rule change command.

  Similarly, the remote control command generation unit 206a of the operated-side communication device 200a transmits an event distribution rule change command to the input event routing unit 203a and activates the output data communication application 214 to operate the operation-side communication device 100a. Is instructed to send output data. The input event routing unit 203a changes the event distribution rule according to the event distribution rule change command.

  As an output data communication application of the present embodiment, a method for transferring a file described in a description language such as HTML or XML acquired by a WEB browser or the like, an output screen of the application is acquired as bitmap data, A method of transferring this can be considered.

<Fourth embodiment>
As a remote control system according to the fourth embodiment of the present invention, a system for switching and executing an output data acquisition method of an application is conceivable. That is, it is a remote control system that can realize both the second and third embodiments already described, and determines which output data acquisition method to execute according to the description of the remote control information.

  When the user on the operated side or the communication device on the operated side specifies which output data acquisition method to use, the desired output data in the item of output data acquisition method in the remote control information of FIG. Specify the acquisition method.

  Also, if the operated user or operated communication device does not specify the output data acquisition method, or if the specified output data acquisition method cannot be executed by the operating communication device, the output data is output by the operating communication device. Specify the acquisition method again.

  For example, when the operation target application specified in the remote control information is not provided and it is specified that the application is executed by a generic communication device as an output data acquisition method, the remote of the present embodiment In the control system, remote control can be executed by switching the output data acquisition method to a method by transfer from the operated communication device.

<Fifth embodiment>
FIG. 20 is a block diagram showing a remote control system according to the fifth embodiment of the present invention. In the remote control system of this embodiment, unlike the second or third embodiment, the user on the operation side has a capability via the operation input unit 101b and the input event routing unit 103b of the operation side communication device 100b. A remote operation start request is transmitted to the exchange unit 105b.

  The capability exchange unit 105b of the operated communication device 100b that has received the remote operation start request generates remote control information based on the remote operation start request and transmits the remote control information to the operated communication device 200b. At this time, in the remote control information, its own communication device is designated as the operation side communication device.

  The capability exchange unit 205b of the operated side communication device 200b that has received the remote control information determines whether or not the remote control based on the remote control information can be executed, or thereafter performs the remote control on the operated side user. It is determined whether or not to execute the remote control, for example, by determining whether or not to execute the remote control. The subsequent operation is the same as that of the remote control system of the second embodiment.

<Sixth Embodiment>
FIG. 21 is a block diagram showing a remote control system according to the sixth embodiment of the present invention. In the present embodiment, as in the fourth embodiment already described, the operation side user makes a remote operation start request.

  The processing from the remote operation start request by the operation side user to the remote control acceptance determination in the operated side communication apparatus 200c is the same as that of the remote control system of the fourth embodiment of the present invention. This is the same as the remote control system of the third embodiment.

<Seventh embodiment>
As the remote control system of the seventh embodiment of the present invention, both the fifth and sixth embodiments can be realized, and which output data acquisition method is executed according to the description of the remote control information. Is a remote control system to determine.

  When the user on the operation side or the communication device on the operation side specifies which output data acquisition method to use, the desired output data acquisition method in the item of the output data acquisition method in the remote control information of FIG. Is specified.

  Also, when the operation side user or the operation side communication device does not specify the output data acquisition method, or when the specified output data acquisition method cannot be executed by the operation side communication device, the operation side communication device uses the output data acquisition method. Can be specified again.

<Eighth Embodiment>
As a remote control system according to the eighth embodiment of the present invention, a system is conceivable in which the communication device on the remote control information transmission side can be switched between the operation side and the operated side.

  That is, the remote control system is capable of executing both a request for the remote communication device to operate itself by the remote communication device and a request for the operation of the remote communication device by itself. .

  These functions can be switched depending on whether the remote communication device is specified in the item of the operation side communication device or the own communication device is specified in the remote control information transmitted to the remote communication device.

  As an implementation method, for example, it is possible to select whether to request the other party to operate the communication device or to accept the operation of the other communication device in the user interface when inputting a remote operation start request from the user. It is conceivable to have buttons and the like. As another method, it is conceivable that the capability exchange unit determines and designates based on the state of the communication apparatus and attribute information.

  According to the embodiment of the present invention described above, each time remote control is performed, the operation target application is based on the device capability information describing the capability of the input event format and executable application that can be processed by the own device. And various information appliances with different operation devices by exchanging capabilities related to remote control conditions such as the acquisition method of output data of the operation target application, the location of the operation right, the type of input event to be used, etc. It is possible to realize remote control and application sharing between devices.

In addition, each time remote control is performed, a desired operation target application is specified, or it is specified as an operation target of a plurality of applications, and which operation target application is controlled using which operation device, etc. Users can specify flexible remote control conditions,
In addition, by specifying the location of the operation right in the remote control conditions, any communication device constituting the remote control system can operate as the operation side or the operated side,
Further, it is possible to provide a remote control system capable of switching the operation result acquisition method according to the purpose and application of the remote control.

BRIEF DESCRIPTION OF THE DRAWINGS The block diagram for demonstrating the whole structure based on 1st Embodiment of the remote control system of this invention is shown. The message sequence diagram based on 1st Embodiment of the remote control system of this invention is shown. The flowchart of the operated side communication apparatus at the time of capability exchange based on 1st Embodiment of the remote control system of this invention is shown. The flowchart of the operation side communication apparatus at the time of capability exchange based on 1st Embodiment of the remote control system of this invention is shown. The flowchart of the operated side communication apparatus at the time of the state analysis based on 1st Embodiment of the remote control system of this invention is shown. The flowchart of the operation side communication apparatus at the time of control based on 1st Embodiment of the remote control system of this invention is shown. An example of the application operation rule database at the time of remote control according to the first embodiment of the remote control system of the present invention is shown. An example of the remote control request according to the first embodiment of the remote control system of the present invention will be shown. The block diagram for demonstrating the whole structure based on 2nd Embodiment of the remote control system of this invention is shown. The flowchart of the remote control start process of the capability exchange part based on 2nd Embodiment of the remote control system of this invention is shown. The example of the remote control information produced | generated by S201 based on 2nd Embodiment of the remote control system of this invention is shown. The flowchart of the remote control start process of the capability exchange part of the operation side communication apparatus based on 2nd Embodiment of the remote control system of this invention is shown. The flowchart which shows operation | movement of the remote control command production | generation part based on 2nd Embodiment of the remote control system of this invention is shown. The flowchart of the input event routing part of the operation side communication apparatus based on 2nd Embodiment of the remote control system of this invention is shown. An example of the event distribution rule based on 2nd Embodiment of the remote control system of this invention is shown. The flowchart of the event conversion part based on 2nd Embodiment of the remote control system of this invention is shown. An example of the event conversion rule according to the second embodiment of the remote control system of the present invention will be shown. The flowchart which shows operation | movement of the output data analysis part based on 2nd Embodiment of the remote control system of this invention is shown. The block diagram of the remote control system based on 3rd Embodiment of the remote control system of this invention is shown. The block diagram of the remote control system based on 5th Embodiment of the remote control system of this invention is shown. The block diagram of the remote control system based on 6th Embodiment of the remote control system of this invention is shown.

Explanation of symbols

100, 100a, 100b, 100c Operation side communication device 200, 200a, 200b, 200c Operated side communication device 101, 101b Operation input unit 102, 202 Event distribution rule database 103, 103a, 103b, 103c, 203, 203a, 203b , 203c Input event routing unit 104, 204 Device capability information database 105, 105a, 105b, 105c, 205, 205a, 205b, 205c Capability exchange unit 106, 106a, 106b, 106c, 206, 206a, 206b, 206c Remote control command generation Unit 107, 207 Event communication unit 108, 208 Communication control unit 109, 209 Application 110, 210 Output unit 111 Event conversion rule database 112 Event conversion unit 113 Force data analysis section 114 and 214 output data communication applications

Claims (12)

In the remote control system for the operation side communication device to remotely control the operated side communication device via the network,
The operation side communication device is:
An input event input to the operating-side communication device, an input event routing unit Ru sorting based on the event distribution rules are distributed Ru rule predetermined application to which the operated-side communication device comprises,
And device capability information describing the capacity containing processable operating side input event list and applications by the operating-side communication device, received from the operated-side communication apparatus, the object to delegate an operation to the operating-side communication device An ability exchange unit for generating a remote control condition for remotely operating the operated-side application based on remote-controlled information including the operated-side application and the operated-side input event list of the operating-side communication device ;
Based on the remote control condition generated by the capability exchange unit, a remote control command generation unit that generates an event distribution rule change command describing a method for changing the event distribution rule and transmits the command to the input event routing unit; ,
An event communication unit that transmits the input event that is input to the operation side communication device and distributed by the input event routing unit to the operated side communication device ;
A communication control unit that instructs the event communication unit to start or end transmission and reception;
An output unit that outputs output data of the application included in the operation side communication device . The operation side communication device is:
The event conversion section for converting the input event according to the event transformation rule, further comprising,
The remote control command generator is
Said based on the remote control condition, if it is determined that the required conversion of the input event,
Transmitted to the event conversion section, and the operated-side input event list included in the remote control condition, the event transformation instructions including a list of operating side input event,
To the input event routing unit, an event distribution rule change instruction that designates an event conversion unit as an input event distribution destination is transmitted,
The event converter is
Gets the event conversion rules in accordance with said event conversion instruction,
The input event received from the input event routing unit is converted according to the event conversion rule, and is transmitted to the operated communication device via the event communication unit. Remote control system. The remote control command generator is
As output data acquisition method of the operated-side application specified in the remote control condition, when able to perform the same the operated-side application Application in the operated-side communication device is specified, the application Sending the event distribution rule change instruction describing the control method to the input event routing unit,
The input event routing unit,
The same application as the operated-side application installed in the operating-side communication device in addition to the operated-side communication device as the allocation destination of the input event specified by the received event distribution rule change command The remote control system according to claim 1 , wherein the remote control system is set as a distribution destination. The operation side communication device is:
The output data analyzing unit for analyzing the output data of the operated-side application of the operated-side communication device, further comprising,
When the event conversion unit needs to execute processing for embedding an analysis program for executing event conversion in the output data of the operated-side application in the result of acquiring the event conversion rule, the analysis program is described. The output data analysis command sent to the output data analysis unit,
The output data analyzing unit receives the output data analysis instruction, the remote control system according to claim 2 or 3, characterized in that operates by acquiring the analysis program specified in the output data analysis instruction. In the remote control method for the operation side communication device to remotely control the operated side communication device via the network,
The operation side communication device is:
An input event input to the operating-side communication device, and the sorting step Ru sorting based on the event distribution rules are distributed Ru rule predetermined application to which the operated-side communication device comprises,
And device capability information describing the capacity containing processable operating side input event list and applications by the operating-side communication device, received from the operated-side communication apparatus, the object to delegate an operation to the operating-side communication device A remote control condition generating step for generating a remote control condition for remotely operating the operated-side application based on remote-controlled information including an operated-side application of the operating-side communication device and an operated-side input event list ; ,
A command generation step of generating an event distribution rule change command describing a method of changing the event distribution rule based on the remote control condition generated in the remote control condition generation step and transmitting the event distribution rule change command to the input event routing unit; ,
An event communication step of transmitting the input event input to the operation side communication device and distributed by the input event routing unit to the operated side communication device ;
An output step of outputting output data of the application provided in the operation side communication device . A remote control method comprising: The operation side communication device is:
Further performing an event conversion step of converting the input event according to an event conversion rule;
The instruction generation step includes:
Said remote control conditions and have based, if it is determined that the required conversion of the input event to generate a the operated-side input event list included in the remote control condition, the event transformation instructions including a list of operating side input event ,
The event conversion step includes:
The acquired event transformation event conversion rules in accordance with the instruction, and converting the input events according to the event transformation rule, the remote control method according to claim 5, characterized in that transmitted to the operated-side communication device. The instruction generation step includes:
As output data acquisition method of the operated-side application specified in the remote control condition, when able to perform the same the operated-side application Application in the operated-side communication device is specified, the application Generating the event distribution rule change instruction describing the control method;
The sorting step includes
The same application as the operated-side application installed in the operating-side communication device in addition to the operated-side communication device as the allocation destination of the input event specified by the received event distribution rule change command The remote control method according to claim 5 or 6 , wherein the remote control method is set as a distribution destination. The operation side communication device is:
Further performing an output data analysis step of analyzing output data of the operated application of the operated communication device ;
In the event conversion step, the analysis program is described when it is necessary to execute processing for embedding an analysis program for executing event conversion in the output data of the operated-side application in the result of obtaining the event conversion rule. Generated output data analysis instructions,
The remote control method according to claim 6 or 7 , wherein the output data analysis step acquires and operates the analysis program specified in the generated output data analysis command. In the remote control program for the operating side communication device to remotely control the operated side communication device via the network,
In the operation side communication device,
An input event input to the operating-side communication device, and the sorting step Ru sorting based on the event distribution rules are distributed Ru rule predetermined application to which the operated-side communication device comprises,
And device capability information describing the capacity containing processable operating side input event list and applications by the operating-side communication device, received from the operated-side communication apparatus, the object to delegate an operation to the operating-side communication device A remote control condition generating step for generating a remote control condition for remotely operating the operated-side application based on remote-controlled information including an operated-side application of the operating-side communication device and an operated-side input event list ; ,
A command generation step of generating an event distribution rule change command describing a method of changing the event distribution rule based on the remote control condition generated in the remote control condition generation step and transmitting the event distribution rule change command to the input event routing unit; ,
An event communication step of transmitting the input event input to the operation side communication device and distributed by the input event routing unit to the operated side communication device ;
An output step of outputting output data of the application provided in the operation side communication device is executed . In the operation side communication device,
Further performing an event conversion step of converting the input event according to an event conversion rule;
The instruction generation step includes:
Said remote control conditions and have based, if it is determined that the required conversion of the input event to generate a the operated-side input event list included in the remote control condition, the event transformation instructions including a list of operating side input event ,
The event conversion step includes:
The acquired event transformation event conversion rules in accordance with the instruction, the converting the input events according to event conversion rules, the remote control program according to claim 9, characterized in that sending the to the operated-side communication device. The instruction generation step includes:
As output data acquisition method of the operated-side application specified in the remote control condition, when able to perform the same the operated-side application Application in the operated-side communication device is specified, the application Generating the event distribution rule change instruction describing the control method;
The sorting step includes
The same application as the operated-side application installed in the operating-side communication device in addition to the operated-side communication device as the allocation destination of the input event specified by the received event distribution rule change command The remote control program according to claim 9 or 10 , wherein the remote control program is set as a distribution destination. The operation side communication device is:
Further performing an output data analysis step of analyzing output data of the operated application of the operated communication device ;
In the event conversion step, the analysis program is described when it is necessary to execute processing for embedding an analysis program for executing event conversion in the output data of the operated-side application in the result of obtaining the event conversion rule. Generated output data analysis instructions,
The remote control program according to claim 10 or 11 , wherein the output data analysis step acquires and operates the analysis program specified in the generated output data analysis instruction.

Images