WO2011058857A1 - Système d'opérations distantes, dispositif d'opérations distantes et procédé d'opérations distantes - Google Patents

Système d'opérations distantes, dispositif d'opérations distantes et procédé d'opérations distantes Download PDF

Info

Publication number
WO2011058857A1
WO2011058857A1 PCT/JP2010/068531 JP2010068531W WO2011058857A1 WO 2011058857 A1 WO2011058857 A1 WO 2011058857A1 JP 2010068531 W JP2010068531 W JP 2010068531W WO 2011058857 A1 WO2011058857 A1 WO 2011058857A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
scenario
remote
operation scenario
control unit
Prior art date
Application number
PCT/JP2010/068531
Other languages
English (en)
Japanese (ja)
Inventor
宇野　博之
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Priority to JP2011540455A priority Critical patent/JP5996869B2/ja
Priority to CN201080051091.1A priority patent/CN102668593B/zh
Priority to EP10829817.5A priority patent/EP2501150B1/fr
Priority to US13/502,915 priority patent/US8704644B2/en
Publication of WO2011058857A1 publication Critical patent/WO2011058857A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/30—User interface
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/90—Additional features
    • G08C2201/92—Universal remote control

Definitions

  • the present invention relates to a remote operation system, a remote operation device, and a remote operation method, and more particularly to a remote operation system, a remote operation device, and a remote operation method for a device connected to a network.
  • Infrared remote controls are currently widely used as remote control devices for operating machines and electronic devices from a remote location.
  • infrared light modulated by control data is transmitted to an infrared light receiving unit of a machine or electronic device, so that a desired operation is remotely performed on the machine or electronic device.
  • the operation range when using the infrared remote control is limited to a range of about ⁇ 5 degrees or less from the front, which is limited by the spread of the infrared beam, and a range of about 5 to 10 meters, which is limited by the reach of the infrared beam. It is done.
  • this infrared remote control is attached to every device because of its easy operation.
  • televisions, DVDs (Digital Versatile Disk) recorders / players, audio devices, air conditioners, lighting devices, cameras, game machines, personal computers and the like are provided to consumers.
  • learning remote controllers and multi-remote controllers that are provided for the purpose of consolidating the infrared remote controllers attached to many devices into one.
  • AV Audio Visual
  • control devices such as air conditioners, lighting devices, and security devices are connected to the home network, and those devices are connected from the outside. Can be operated.
  • Patent Document 1 when a device connected to a network is imaged by a camera unit and the device is operated, the captured image is displayed on a display unit, and the desired device is selected to remotely control the device via the network.
  • a remote control device technology A single remote control device can remotely control a plurality of different types of devices.
  • a remote operation device disclosed in Patent Document 1 images a device to be remotely operated, device-specific information is acquired from the device itself with an infrared signal and stored in a memory in association with the captured image. Keep it.
  • the user interface, operation control program, and device specific information of the device corresponding to the selected image are read out.
  • Patent Document 2 discloses a technology of an operation device for remote operation that includes an imaging device that a user wears on the head and images an area in the user's field of view. This single operating device can also remotely control a plurality of different types of devices. The operation device disclosed in Patent Document 2 recognizes the operation target device based on the image information obtained by the imaging device by entering the user's field of view and the identification information stored in the storage device.
  • Patent Document 3 discloses a technology of a remote control device that can remotely control a plurality of target devices without adding any function to the remote control target device.
  • the remote operation device disclosed in Patent Literature 3 images a device to be remotely operated with a camera unit, extracts a character string from the captured image, and specifies the operation target device from a plurality of target devices.
  • the remote operation device sets each button of the operation unit in accordance with the identified operation target device, and displays the operation method of the operation unit on the liquid crystal display unit.
  • This remote control device uses a conventional infrared beam for remote control of the specified device. Therefore, the technique disclosed in Patent Document 3 is devised such as providing a remote control device for relaying in order to widen the operation range.
  • Remote operation using an infrared remote controller is a very intuitive operation in which an operation button is pressed toward a target device.
  • the operation range when using the infrared remote control is about ⁇ 5 degrees or less from the front, which is limited by the spread of the infrared beam, and from about 5 meters limited by the reach of the infrared beam. Limited to 10 meters.
  • devices that can aggregate a large number of infrared remote controllers such as a learning remote controller and a multi-remote controller, it is difficult to operate a plurality of devices in cooperation.
  • the remote operation device disclosed in Patent Literature 1 can perform remote operation without depending on the distance from the operation target device. However, even if the operation target device exists at a short distance, the operation is performed by calling up the image stored in the memory and viewing the specific image while viewing the image displayed on the liquid crystal screen on the remote operation device. It is necessary to perform an operation of selecting. For this reason, this remote operation device cannot be operated intuitively, which has been used for many years, such as operating toward the operation target device.
  • the operation device disclosed in Patent Document 2 is characterized in that an operation target device is specified by a captured image.
  • the user needs a special operation of inputting an operation command by pointing to the virtual controller displayed on the transflective optical element. For this reason, a complicated apparatus configuration is required.
  • the remote operation device disclosed in Patent Document 3 is characterized in that a character string is extracted from a captured image when specifying an operation target device. This remote operation device is a remote operation using an infrared beam as in the past. The operation is being performed.
  • Patent Documents 1 to 3 can provide a remote control device that can remotely control a plurality of different types of devices with a single device. However, it is difficult for the techniques disclosed in Patent Documents 1 to 3 to provide a remote control device that can perform remote control of a plurality of different types of devices in cooperation.
  • An object of the present invention is to provide a remote operation system, a remote operation device, and a remote operation method that solve the above-described problems.
  • the remote operation system identifies each operation target device by imaging each of a plurality of devices connected to the network, and determines a plurality of operations determined by a combination of the types of the specified operation target devices.
  • a remote operation device that transmits operation scenario information of a cooperative operation between the operation target devices of the device, and the network that includes the plurality of devices and receives the operation scenario information from the remote operation device; And a network control unit that outputs an operation instruction for causing the device specified by the operation scenario information to execute the operation specified by the received operation scenario information.
  • the remote operation device of the present invention is a remote operation device that remotely operates a plurality of devices accommodated by the network control unit, and is an operation target that identifies a device to be operated by imaging each of the plurality of devices.
  • Said network control comprising: device specifying means; and operation scenario output means for outputting operation scenario information that defines the operation of each device in a cooperative operation between a plurality of operation target devices determined by a combination of types of the specified operation target devices.
  • the unit receives the operation scenario information and causes the operation target device to execute an operation specified by the operation scenario information.
  • the remote operation method of the present invention includes an operation target device specifying step in which a remote operation device images a plurality of devices connected to a network control unit to specify an operation target device, and the type of the specified operation target device.
  • An operation scenario transmission step in which the remote operation device transmits operation scenario information of a cooperative operation between a plurality of operation target devices determined by a combination of the above and the received operation with respect to the device specified by the received operation scenario information
  • an operation instruction output step in which the network control unit outputs an operation instruction for executing an operation specified by the scenario information.
  • FIG. 1 is a block diagram showing a system configuration according to the basic embodiment of the present invention.
  • the remote operation device 10 is a device for remotely operating a device connected to a network.
  • devices to be operated by the remote operation device 10 are illustrated as an operation target device A30 and an operation target device B40, for example.
  • the device C50 is a device connected to the network, but is not a current operation target device.
  • the network control unit 20 accommodates these operation target devices A30, operation target devices B40, and devices C50 to form a network.
  • the remote operation device 10 images each of a plurality of arbitrary devices connected to the network, specifies a device to be operated, and links between a plurality of operation target devices determined by a combination of the types of the specified operation target devices Send operation scenario information for the operation.
  • the network control unit 20 receives the operation scenario information from the remote operation device 10
  • the network control unit 20 instructs the device specified by the received operation scenario information to execute the operation specified by the received operation scenario information.
  • FIG. 1 schematically illustrates the above-described state, in which the remote operation device 10 images each device and transmits operation scenario information.
  • FIG. 1 shows that the network control unit 20 instructs the devices specified by the received operation scenario information (the operation target device A30 and the operation target device B40) to execute the operation specified by the operation scenario information.
  • FIG. 2 is a sequence diagram showing an operation according to the basic embodiment of the present invention.
  • the remote operation device 10 images each of a plurality of arbitrary devices connected to the network, and specifies an operation target device (S201).
  • the remote operation device 10 transmits operation scenario information determined by the combination of the types of operation target devices (S202).
  • the operation scenario information is sent to the network control unit 20.
  • the network control unit 20 outputs an operation instruction for instructing execution of an operation specified by the operation scenario information to a device specified by the operation scenario information (S203).
  • the operation instruction is sent to each operation target device.
  • Each operation target device that has received the operation instruction executes the operation instructed by the operation instruction (S204).
  • FIG. 3 is a block diagram showing the configuration of the remote control device according to the basic embodiment of the present invention.
  • the remote operation device 10 is a remote operation device that remotely operates a plurality of devices accommodated by the network control unit, and includes an operation target device specifying unit 11 that images each of the devices and specifies a device to be operated. .
  • the remote operation device 10 includes operation scenario output means 12 that outputs operation scenario information that defines the operation of each device in a cooperative operation between a plurality of operation target devices determined by the combination of the types of the specified operation target devices.
  • the network control unit receives the operation scenario information and causes the operation target device to execute an operation specified by the operation scenario information.
  • the user images the devices by pointing the remote operation device 10 at the devices that are desired to be operated in the cooperative operation.
  • FIG. 4 is a block configuration diagram showing the configuration of the remote control device according to the first embodiment of the present invention. As described in the basic embodiment, the user directs the remote operation device 10 toward the device that is desired to be the operation target of the cooperative operation and images the devices.
  • the operation target device specifying unit 11 uses the image matching unit 111 to collate the input device image with the collation image 112 stored in advance to identify the operation target device.
  • Information on the specified operation target device is transferred to the operation scenario output means 12.
  • the operation scenario output unit 12 corresponds to which operation scenario of the operation scenario registration information stored in advance in the operation scenario registration information storage unit 122 based on the combination of the types of control devices specified by the operation scenario search unit 121. Search for what to do.
  • an operation scenario will be described later, for example, it is assumed that the following control operation is performed as an operation scenario when a television and a DVD player are respectively imaged.
  • the information retrieved from the operation scenario registration information storage unit 122 includes the above-described content that is an operation scenario corresponding to a combination of a television and a DVD player, or an operation that can specify an operation scenario of the content. Contains scenario identification information.
  • the operation scenario output unit 12 outputs the operation scenario information obtained by this search through the communication unit 123.
  • the operation scenario information output from the remote operation device 10 is an operation scenario itself that defines a specific operation of each device, or an operation scenario identification that can specify that the operation scenario has such contents. Contains any of the information. In this case, a display flag indicating which operation scenario information is output may be added.
  • FIG. 5 is a block configuration diagram showing the configuration of the network control unit according to the first embodiment of the present invention.
  • the operation scenario information output from the remote operation device 10 is received by the communication means 21 of the network control unit 20 and transferred to the operation scenario analysis means 22.
  • the operation scenario analysis unit 22 searches the operation scenario registration information storage unit 25 with the operation scenario identification information, and specifies each operation scenario specified by the operation scenario.
  • the operation scenario analysis means 22 can identify which operation scenario information is by looking at the data amount of the received operation scenario information.
  • the operation scenario analysis unit 22 acquires the operation target device specified by the operation scenario and the specific operation contents, the operation scenario analysis unit 22 analyzes them, specifies each operation target device, and prepares to generate operation instruction data for each operation target device. I do.
  • operation instruction device information specifying each operation object device and operation instruction data including the type of operation instruction generated for each operation object device are output. Moreover, the information regarding the connection between operation target apparatuses may be included.
  • the operation scenario analysis unit 22 transfers these analysis result data to the operation instruction data generation unit 23 and instructs generation of the operation instruction data.
  • the operation instruction data generation unit 23 When the operation scenario data generation unit 23 is instructed by the operation scenario analysis unit 22 to generate operation instruction data for each operation target device, the operation instruction data generation unit 23 generates operation instruction data corresponding to each operation target device based on the transferred analysis result data. Generate. Then, the operation instruction data generation unit 23 transfers the generated operation instruction data to the device connection unit 24.
  • the device connection unit 24 includes a port for connecting each device, and can identify which port the operation target device is connected to.
  • the device connection means 24 is instructed to control the connection. For example, when the control of “connecting the video and audio of the DVD player to the line input of the television” can be executed by the device connection means 24, the connection control is instructed to the device connection means 24.
  • operation instruction data is transmitted from the device connection means 24 to the operation target device. For example, operation instruction data “power on” and “switch input source to line input” are sent to the television, and operation instruction data “power on” is sent to the DVD player.
  • the user can operate the remote operation device 10 by pointing the remote operation device 10 at the remote operation device 10 to the device that the operation target of the cooperation operation is desired. Can be executed. That is, it is assumed that the user collates the image of the device input by the image collating unit 111 with the collation image 112 stored in advance and sets the operation target devices to be the television and the DVD player by simply imaging the television and the DVD player. Identify.
  • the operation scenario search unit 121 knows that the operation target device is a television and a DVD player, the operation scenario search unit 121 searches which operation scenario in the operation scenario registration information storage unit 122 stored in advance.
  • FIG. 6 is a block diagram showing a system configuration according to Embodiment 2 of the present invention.
  • the second embodiment is an example applied to an internal network constructed by a wireless LAN (Local Area Network), a power line network, or the like.
  • the network control unit 20 incorporates a control device for constructing such an internal network, and communicates with the remote operation device 10 by radio.
  • a control device for constructing such an internal network
  • wireless communication in this case, application of wireless LAN, Bluetooth (registered trademark) or low-power wireless is conceivable. Therefore, communication is possible between the remote control device 10 and the network control unit 20 even if there is a distance of at least 10 meters to 100 meters. Therefore, this embodiment can be used in a conference room, a small hall, an event venue, or the like without being limited to use at home.
  • Other system configurations are the same as those of the basic embodiment described with reference to FIG.
  • the network control unit 20 can accommodate a plurality of devices. In FIG. 6, three accommodation devices are illustrated.
  • FIG. 7 is a block configuration diagram showing the configuration of the remote control device 10 according to the second embodiment of the present invention.
  • the remote operation device 10 shows a camera unit 102 for imaging a device to be operated, an operation unit 104 for performing remote operation input operation, an operation method for the operation unit 104, and the like.
  • a display unit 103 is provided outside the housing. Inside the housing, a main control unit 101, a camera control unit 105, an interface control unit 106, a memory unit 107, and a wireless communication unit 108 are included as main components.
  • the main control unit 101 controls the overall operation of the remote operation device 10 by the main program stored in the memory unit 107.
  • various application programs are stored in the memory unit 107, and control operations of the remote operation device 10 are performed in cooperation with other control units such as the main control unit 101, the camera control unit 105, and the interface control unit 106.
  • the image collating unit and the operation scenario retrieving unit described in the first embodiment are realized by a control operation executed by the main control unit 101.
  • the memory unit 107 includes an area for storing the verification image information and operation scenario registration information described in the first embodiment. Further, an operation interface program for each operation target device described later is also stored in the memory unit 107.
  • the camera control unit 105 executes control related to an imaging operation using the camera unit 102.
  • the interface control unit 106 performs control such as display control on the display unit 103 and identification of information input through the operation unit 104.
  • the wireless communication unit 108 performs wireless communication between the remote control device 10 and the network control unit 20.
  • FIG. 8 is a block diagram showing an example of the configuration of the network control unit 20 according to the second embodiment of the present invention.
  • the control unit 201 governs control related to the overall operation of the network control unit 20 by a program stored in the memory unit 204.
  • the operation scenario analysis unit and the operation instruction data generation unit described in the first embodiment are realized by a control operation executed by the control unit 201.
  • the memory unit 204 includes an area for storing the operation scenario registration information described in the first embodiment and various data related to the accommodated devices.
  • the connection unit 205 includes a device connection port 206 for connecting accommodation devices, and the connection unit 205 executes control capable of setting connection between devices in the network control unit.
  • the routing unit 202 routes the operation instruction data transmitted from the control unit 201 to the operation target device to the target port of the connection unit 205.
  • the wireless communication unit 203 performs wireless communication between the network control unit 20 and the remote operation device 10. Next, the operation of this embodiment will be described.
  • FIG. 10 is a diagram illustrating an example of an initial menu screen displayed on the display unit 103 of the remote control device 10 according to the second embodiment of the present invention.
  • the remote control device 10 has three operation modes.
  • the registration mode is an operation mode for registering a device to be remotely operated in advance.
  • the single operation mode is an operation mode for individually operating devices individually.
  • the cooperative operation mode is an operation mode for remotely operating a plurality of devices in cooperation.
  • FIG. 11 is a flowchart showing the initial menu operation of the remote operation device 10.
  • the initial menu screen shown in FIG. 10 is displayed on the display unit 103 of the remote operation device 10 in the initial state when the power is turned on, and the apparatus waits for the user's operation input (S1101, No S1102).
  • FIG. 12 is a flowchart showing an operation target device registration operation of the remote operation device 10. First, accommodation device information managed by the network control unit 20 will be described.
  • each device When each device is connected to the device connection port 206 of the network control unit 20, the device is recognized by the control unit 201 of the network control unit 20 through communication with a control unit of a device (not shown). Then, the type information and connection position information of the connected device are specified. Further, an address used in the internal network is given to each device by, for example, a DHCP (Dynamic Host Configuration Protocol) function.
  • the memory unit 204 of the network control unit 20 stores these pieces of information of each device connected to the network control unit 20 as connected device information. In this state, when the remote operation device 10 operates in the registration mode, the remote operation device 10 communicates with the network control unit 20 and acquires connected device information from the network control unit 20 (S1201).
  • DHCP Dynamic Host Configuration Protocol
  • the connected device information acquired from the network control unit 20 is displayed on the display unit 103 of the remote control device 10 as shown in FIG. 13 (S1202).
  • FIG. 13 shows a state in which the device type, port number, and address connected to the network control unit 20 are displayed.
  • the user selects a device to be registered as an operation target device and performs a confirmation operation (S1203). Since this user operation is transmitted from the operation unit 104 of the remote operation device 10 to the main control unit 101 via the interface control unit 106, the main control unit 101 instructs the camera control unit 105 to start the camera unit 102. .
  • the user uses the activated camera unit 102 to image the appearance of the operation target device and performs a registration operation (S1204).
  • the user may image a plurality of appearances from different angles.
  • movement which specifies the apparatus made into operation object in the single operation mode and cooperation operation mode mentioned later is performed more correctly.
  • a display of registration completion is added to the display unit 103 and associated with related device information such as a device type, a port number, and an address as a verification image in the memory unit 107 of the remote operation device 10. Is memorized.
  • the registration operation S1205, yes
  • the operation is repeated again from S1203.
  • the registration mode operation ends.
  • FIG. 14 is a sequence diagram showing an operation related to the single operation mode.
  • the user selects a single operation mode on the initial menu screen of the display unit 103 of the remote operation device 10 and performs a confirmation operation (S1401). Since this user operation is transmitted from the operation unit 104 of the remote operation device 10 to the main control unit 101 via the interface control unit 106, the main control unit 101 instructs the camera control unit 105 to start the camera unit 102. .
  • the user performs an imaging operation with the activated camera unit 102 directed toward the operation target device (S1402).
  • the user may confirm that the operation target device is displayed on the monitor screen and release the shutter.
  • the image captured by the user is sent from the camera control unit 105 to the main control unit 101 (S1403), and collation with the collation image registered in the registration mode is performed (S1404).
  • the device information stored in association with the matched image for collation is read, and the operation target device is specified (S1405).
  • the main control unit 101 reads an interface program corresponding to the device from the memory unit 107 and transfers the interface program to the interface control unit 106.
  • FIG. 15 is a diagram illustrating a display example of the explanation of the operation keys in the single operation mode displayed on the display unit 103 of the remote operation device 10.
  • FIG. 15A is displayed when the operation target device is identified as a television.
  • the four-way key is used for volume adjustment and channel switching, the numeric key is used for direct channel input, and the enter key is used for power on / off.
  • FIG. 15B is displayed when the operation target device is specified as an audio device.
  • the four-way key is used to adjust the volume and change the performance station, the numeric key is used to directly specify the performance station, and the enter key is used to turn on / off the power.
  • FIG. 15C is displayed when the operation target device is specified as a lighting device.
  • a four-way key is used for brightness adjustment, and a confirmation key is used for power on / off.
  • S1408 a key of the operation unit 104 of the remote operation device 10 to perform a desired remote operation (S1408). This user operation is transmitted from the operation unit 104 of the remote operation device 10 to the main control unit 101 via the interface control unit 106.
  • the main control unit 101 identifies the control content operated by the user, generates the operation instruction data, and transmits it to the network control unit 20 via the wireless communication unit 108 (S1409).
  • the operation instruction data transmitted to the network control unit 20 includes address information for specifying the operation target device.
  • an operation mode flag indicating that the operation mode is a single operation mode is added to distinguish it from a cooperative operation mode described later.
  • the operation instruction data is received by the wireless communication unit 206 of the network control unit 20 and transferred to the control unit 201.
  • the control unit 201 of the network control unit 20 identifies the single operation mode from the operation mode flag added to the operation instruction data, and specifies the operation target device from the address information included in the operation instruction data (S1410).
  • the control unit 201 transmits the operation instruction data to the device to be operated through the routing unit 202 and the connection unit 205 (S1411).
  • the operation target device executes an operation specified by the received operation instruction data (S1412).
  • the above-described operations from S1408 to S1412 are repeated each time the user operates the key of the operation unit 104 of the remote operation device 10.
  • the device that is imaged by the user facing the camera unit 102 of the remote operation device 10 is identified as the device to be remotely operated, and an operation corresponding to the device type is performed. It can be carried out.
  • the target device can be imaged even from a remote location, so that it can be used in a large conference room, a small hall, an event venue, or the like.
  • the remote operation device 10 includes, for example, an image that the camera unit 102 recognizes as an imaging target among images displayed on the display unit 103. A square frame may be displayed.
  • the remote operation device 10 transmits a control signal indicating the specified device to the network control unit 20. Also good.
  • the network control unit 20 transmits operation instruction data instructing to turn on the display means installed in the target device.
  • An example of the display means is an LED (Light Emitting Diode).
  • the cooperative operation mode is an operation mode in which a coordinated operation can be performed between a plurality of devices to be operated.
  • the operation in the cooperative operation mode includes an operation for registering an operation scenario and a cooperative operation mode execution operation for performing remote operation by linking a plurality of devices in a situation where the operation scenario is registered.
  • FIG. 16 is a sequence diagram illustrating an operation related to operation scenario registration in the cooperative operation mode according to the second embodiment of the present invention.
  • the display unit 103 When the user selects a cooperative operation mode on the initial menu screen of the remote operation device 10 and performs a confirmation operation, the display unit 103 is switched to the menu screen of the cooperative operation mode shown in FIG. On the menu screen of this cooperative operation mode, an operation scenario registration operation and a cooperative operation mode execution operation can be selected.
  • S1601 registration
  • the display unit 103 displays a list of devices registered as operation target devices by the registration operation described with reference to FIG.
  • the user registers a cooperative operation scenario of “outputting video and audio to be played back on a DVD player from a television”.
  • the user selects and sets “DVD player” from the registered device list screen (S1602).
  • an operation registration screen is displayed on the display unit 103 so that operation contents that can be set corresponding to the selected device type are selected. Therefore, the user selects and sets an operation “video output” (S1603). If there is an operation to be further set (S1604, not yet), the operation registration screen is displayed again, and the desired operation is set and registered. In this case, “audio output” is selected and set, and then “power on” is selected and set.
  • Scenario identification number No. 1 is “outputs audio from a television from an audio device”.
  • Scenario identification number No. 2 “outputs video and audio to be played back on a DVD player from the television”.
  • Scenario identification number No. 3 outputs video to be played back on a DVD player from a television and outputs audio from an audio device”.
  • the operation scenario registration method described above is merely an example, and the present invention is not limited to this. You may comprise so that the scenario from which operation content differs according to the order which selects operation object apparatus can be registered. For example, “TV” may be selected to define an operation of “recording”, and then an operation scenario that defines an operation for recording a television with “DVD” may be registered. As a remote operation of the user in this case, when executing an operation scenario of “outputting video and audio to be reproduced by a DVD player from a television”, “DVD” is selected, and then “TV” is selected.
  • FIG. 18 is a sequence diagram illustrating an operation related to the remote operation in the cooperative operation mode.
  • the camera control unit 105 is instructed to start the camera unit 102.
  • the user performs an operation on the plurality of operation target devices for imaging the activated camera unit 102 toward the operation target device (S1802).
  • the user may image “DVD player”, then image “TV” and perform a confirmation operation.
  • Images captured by the user are sequentially sent from the camera control unit 105 to the main control unit 101 (S1803), and collation with a collation image registered in the registration mode is performed (S1804).
  • collation operation the device information stored in association with the matched image for collation is read, and the operation target device is specified (S1805).
  • the main control unit 101 determines an operation scenario determined by the combination of the specified operation target devices from the registered operation scenarios stored in the memory unit 107. Search is performed (S1806). For example, from the operation scenario list shown in FIG. 2 is searched. Subsequently, the main control unit 101 transmits operation scenario information to the network control unit 20 in order to execute an operation based on the operation scenario.
  • the operation scenario information transmitted from the remote operation device 10 to the network control unit 20 may be the content of the operation scenario itself or identification information that can specify the content of the operation scenario. In this case, a scenario identification number is transmitted to reduce the amount of information to be transmitted.
  • the main control unit 101 generates operation instruction data including an operation mode flag indicating a cooperative operation mode and a scenario identification number (No. 2), and transmits the operation instruction data to the network control unit 20 via the wireless communication unit 108 ( S1807).
  • Control data received by the wireless communication unit 203 of the network control unit 20 is transferred to the control unit 201.
  • the control unit 201 searches the operation scenario stored in the memory unit 204 from the operation mode flag indicating the cooperative operation mode included in the operation instruction data and the scenario identification number (No. 2), and performs the corresponding operation.
  • the scenario is read out (S1808). That is, “DVD player” and “TV” are specified as the operation target devices together with their addresses and port numbers.
  • the control unit 201 executes an operation that can be executed by the network control unit 20 such as an inter-device connection setting among the specified operations (S1809). For example, when the operation of “output DVD player video and audio to television” can be executed by controlling the connection unit 205, the connection unit 205 is instructed to execute the connection. Subsequently, the control unit 201 generates operation instruction data to be transmitted to each operation target device, and transmits the operation instruction data from a port to which each device is connected via the routing unit 202 and the connection unit 205 (S1810).
  • the operation instruction data includes an instruction for instructing an operation to be executed, address information for routing, and port information. Then, information on the operation to be performed is transmitted to the target device by the operation instruction data. In this case, operation instruction data including a “turn on power” command is transmitted to the “DVD player”, and operation instruction data including a “power on” command and an “input source switching” command are transmitted to the “TV”. Including operation instruction data is transmitted. Each device executes an operation in accordance with a command included in the received operation instruction data (S1811). On the other hand, the remote operation device 10 that has transmitted the operation scenario information sets the operation unit 104 so that the user can perform an operation input performed after the cooperative operation.
  • the main control unit 101 reads the interface program corresponding to the operation target device identified in S1805 from the memory unit 107 (S1812), and transfers it to the interface control unit 106. In this case, the “DVD player” and “TV” interface programs are read.
  • the interface control unit 106 assigns the keys of the operation unit 104 to the operation key array according to the transferred interface program, and displays the description on the display unit 103 (S1813).
  • interface programs related to a plurality of devices are read out, and only one interface is displayed on the display unit 103, but can be switched by a user operation.
  • FIG. 19 is a diagram illustrating a display example in the cooperative operation mode displayed on the display unit 103 of the remote operation device 10.
  • FIG. 19 shows a state where four interface programs of “DVD player”, “audio device”, “TV”, and “lighting device” are read out and switched appropriately.
  • the user operates a key of the operation unit 104 of the remote operation device 10 to perform a desired remote operation (S1814).
  • the DVD player and the TV are connected by the cooperative operation described above, and both devices are turned on, and the operation interface of the operation unit 104 is set to “DVD player”.
  • the user performs an operation corresponding to “play”.
  • This user operation is transmitted from the operation unit 104 of the remote operation device 10 to the main control unit 101 via the interface control unit 106.
  • the main control unit 101 identifies the control content operated by the user, generates the operation instruction data, and transmits the operation instruction data to the network control unit 20 via the wireless communication unit 108 (S1815).
  • the operation instruction data transmitted to the network control unit 20 includes address information for specifying the operation target device.
  • an operation mode flag indicating the cooperative operation mode is added.
  • the operation instruction data is received by the wireless communication unit 203 of the network control unit 20 and transferred to the control unit 201.
  • the control unit 201 of the network control unit 20 identifies the cooperative operation mode from the operation mode flag added to the operation instruction data, and specifies the operation target device from the address information included in the operation instruction data (S1816).
  • the control unit 201 transmits the operation instruction data to the device to be operated through the routing unit 202 and the connection unit 205 (S1817).
  • the operation target device executes an operation specified by the received operation instruction data (S1818).
  • the operations from S1814 to S1818 described above are repeated each time the user operates the key of the operation unit 104 of the remote operation device 10.
  • the cooperative operation mode of this embodiment can set a cooperative operation scenario between a plurality of devices. Then, a plurality of devices captured by the user facing the camera unit 102 of the remote operation device 10 are specified as remote operation target devices, and a cooperative operation corresponding to the combination of the devices can be performed.
  • the target device can be imaged even from a remote location. Therefore, such a cooperative operation between devices can be performed in a large conference room, a small hall, an event venue, or the like. Can be used.
  • a square is recognized as an image that the camera unit 102 recognizes as an imaging target. A frame may be displayed.
  • the operation target device is specified by the acquired image in S1805 of FIG. 18, the display unit including the LED of the specified device may be turned on.
  • FIG. 21 is a block diagram showing a system configuration according to the third embodiment of the present invention.
  • the operation target device is connected to an internal network such as a local area network as in the second embodiment, but the remote operation device 60 is incorporated in a mobile communication terminal such as a mobile phone. Therefore, the network control unit 70 according to the third embodiment does not need to directly communicate with the remote operation device 60, and communicates at least via the mobile communication network.
  • FIG. 22 is a block diagram showing an example of the configuration of the network control unit according to the third embodiment of the present invention.
  • the network control unit 70 has a configuration in which the wireless communication unit 203 is deleted from the network control unit 20 of the second embodiment illustrated in FIG.
  • the network control unit 70 includes a communication unit 703 capable of communicating with the router 80 as shown in FIG.
  • Other configurations and operations are the same as those described in the second embodiment, and include a registration mode, a single operation mode, and a cooperative operation mode.
  • a square is recognized as an image that the camera unit 102 recognizes as an imaging target.
  • a frame may be displayed.
  • mobile phone communication can be used for transmission of operation information, and if the zoom function of the camera unit is used, it is possible to specify a device installed far away. It is suitable for use in a wide open place such as a theme park.
  • the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. This application claims the priority on the basis of Japanese application Japanese Patent Application No. 2009-256909 for which it applied on November 10, 2009, and takes in those the indications of all here.
  • Operation scenario output means 111 Image collation means 121 Operation scenario search means 13, 21 Communication means 112 Collation image 122 , 25 Operation scenario registration information storage unit 22 Operation scenario analysis unit 23 Operation instruction data generation unit 24 Device connection unit 101 Main control unit 102 Camera unit 103 Display unit 104 Operation unit 105 Camera control unit 106 Interface control unit 107, 204 Memory unit 108 203 Wireless communication unit 201 701 Control unit 202 702 Routing unit 205 705 Connection unit 206 706 Device connection port 703 Communication unit 80 Router 90 Modem

Abstract

L'invention concerne un système d'opérations distantes susceptible de coordonner les opérations d'une pluralité de dispositifs sans nuire au style de fonctionnement intuitif familier d'une opération de commande à distance. Le système d'opérations distantes est pourvu : d'un dispositif d'opérations distantes qui saisit les images de chacun d'une pluralité de dispositifs connectés à un réseau et spécifie les dispositifs à mettre en œuvre, et qui transmet des informations de scénario d'opérations sur les opérations coordonnées réalisées parmi la pluralité de dispositifs à mettre en œuvre, les opérations coordonnées étant déterminées par la combinaison des types des dispositifs spécifiés à mettre en œuvre; et d'une unité de commande de réseau qui produit les commandes d'opérations destinées à exécuter les opérations spécifiées par les informations de scénario d'opérations reçues, pour les dispositifs spécifiés par les informations de scénario d'opérations reçues, lorsque le réseau hébergeant la pluralité de dispositifs est construit et que les informations de scénario d'opérations sont transmises depuis le dispositif d'opérations distantes.
PCT/JP2010/068531 2009-11-10 2010-10-14 Système d'opérations distantes, dispositif d'opérations distantes et procédé d'opérations distantes WO2011058857A1 (fr)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2011540455A JP5996869B2 (ja) 2009-11-10 2010-10-14 遠隔操作システム、遠隔操作機器及び遠隔操作方法
CN201080051091.1A CN102668593B (zh) 2009-11-10 2010-10-14 遥控系统、遥控设备以及遥控方法
EP10829817.5A EP2501150B1 (fr) 2009-11-10 2010-10-14 Dispositif d'opérations distantes, système d'opérations distantes et procédé d'opérations distantes
US13/502,915 US8704644B2 (en) 2009-11-10 2010-10-14 Remote control system, remote control apparatus and remote control method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2009-256909 2009-11-10
JP2009256909 2009-11-10

Publications (1)

Publication Number Publication Date
WO2011058857A1 true WO2011058857A1 (fr) 2011-05-19

Family

ID=43991517

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2010/068531 WO2011058857A1 (fr) 2009-11-10 2010-10-14 Système d'opérations distantes, dispositif d'opérations distantes et procédé d'opérations distantes

Country Status (5)

Country Link
US (1) US8704644B2 (fr)
EP (1) EP2501150B1 (fr)
JP (1) JP5996869B2 (fr)
CN (1) CN102668593B (fr)
WO (1) WO2011058857A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013132750A1 (fr) * 2012-03-09 2013-09-12 パナソニック株式会社 Système de réglage d'opération pour appareil électroménager
WO2014115316A1 (fr) * 2013-01-25 2014-07-31 三菱電機株式会社 Système de climatisation
JP2015228184A (ja) * 2014-06-02 2015-12-17 富士通株式会社 監視プログラム、監視システムおよび監視方法
JP5975135B1 (ja) * 2015-03-31 2016-08-23 ダイキン工業株式会社 制御システム
JP2019184779A (ja) * 2018-04-09 2019-10-24 シャープ株式会社 端末装置、情報処理装置、表示システム、情報表示方法、情報処理方法、制御プログラム、及び電気機器

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6002771B2 (ja) * 2012-08-21 2016-10-05 日本電気通信システム株式会社 無線装置、それによって制御される制御対象機器、無線装置および制御対象機器を備える制御システム、および無線装置において制御対象機器の制御をコンピュータに実行させるためのプログラム
US9843831B2 (en) * 2013-05-01 2017-12-12 Texas Instruments Incorporated Universal remote control with object recognition
CN103533706A (zh) * 2013-09-25 2014-01-22 浙江生辉照明有限公司 无线led照明装置、无线照明控制系统及控制方法
JP6145034B2 (ja) * 2013-12-03 2017-06-07 アズビル株式会社 監視制御システム
JP2016086221A (ja) * 2014-10-23 2016-05-19 アイシン精機株式会社 リモコン装置
TWI611379B (zh) * 2015-03-27 2018-01-11 寶貝安科技股份有限公司 遙控燈具方法
CN106101783A (zh) * 2016-05-24 2016-11-09 乐视控股（北京）有限公司 设备的控制方法和装置
KR102384518B1 (ko) * 2017-08-28 2022-04-08 삼성전자 주식회사 메시지 처리 방법 및 이를 지원하는 전자 장치
CN109213039A (zh) * 2018-09-04 2019-01-15 攀枝花学院 一种遥控特斯拉线圈

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005065118A (ja) * 2003-08-19 2005-03-10 Hitachi Ltd リモコン機能付き携帯端末及びリモコンサーバ
JP2005268941A (ja) 2004-03-16 2005-09-29 Sony Corp 遠隔制御装置、遠隔制御方法及びそのプログラム
JP2005332070A (ja) * 2004-05-18 2005-12-02 Nippon Telegr & Teleph Corp <Ntt> 端末操作方法とその装置、プログラム及び記録媒体
JP2006146803A (ja) 2004-11-24 2006-06-08 Olympus Corp 操作装置及び遠隔操作システム
JP2006196956A (ja) * 2005-01-11 2006-07-27 Matsushita Electric Ind Co Ltd 端末装置
JP2007259328A (ja) 2006-03-24 2007-10-04 Fujifilm Corp 遠隔制御装置、方法、プログラムおよびシステム
JP2009260523A (ja) * 2008-04-15 2009-11-05 Nippon Telegr & Teleph Corp <Ntt> 制御システム、制御装置、管理装置、制御方法、管理方法、制御プログラム、管理プログラム及びそのプログラムを記録した記録媒体
JP2009256909A (ja) 2008-04-14 2009-11-05 Komatsu Ltd 作業車両の配管取付構造

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003022224A (ja) * 2001-07-09 2003-01-24 Fujitsu Ltd ネットワークを介して相互接続された複数の機器の連携動作の制御
US7224903B2 (en) 2001-12-28 2007-05-29 Koninklijke Philips Electronics N. V. Universal remote control unit with automatic appliance identification and programming
US7653212B2 (en) * 2006-05-19 2010-01-26 Universal Electronics Inc. System and method for using image data in connection with configuring a universal controlling device
US20040203387A1 (en) * 2003-03-31 2004-10-14 Sbc Knowledge Ventures, L.P. System and method for controlling appliances with a wireless data enabled remote control
JP2006041747A (ja) * 2004-07-23 2006-02-09 Funai Electric Co Ltd 遠隔見守りシステム、及び遠隔見守りシステムに用いられる宅内装置
DE102006018238A1 (de) * 2005-04-20 2007-03-29 Logitech Europe S.A. System und Verfahren zur adaptiven Programmierung einer Fernbedienung
FR2897186B1 (fr) * 2006-02-06 2008-05-09 Somfy Sas Procede de communication par relais entre une telecommande nomade et des equipements domotiques.
JP2007259329A (ja) * 2006-03-24 2007-10-04 Fujifilm Corp 遠隔制御装置、システムおよび方法
JP2007318380A (ja) * 2006-05-25 2007-12-06 Pioneer Electronic Corp リモートコントローラ
US20080028430A1 (en) * 2006-07-28 2008-01-31 Barrett Kreiner Control gateways that control consumer electronic devices responsive to RF command signals
KR101362221B1 (ko) * 2007-10-18 2014-02-12 삼성전자주식회사 배치 인스트럭션 기반의 통합 리모트 제어 장치, 통합리모콘 제어 시스템, 및 그 제어 방법
JP2009200784A (ja) * 2008-02-21 2009-09-03 Nikon Corp 画像処理装置およびプログラム
JP4286896B1 (ja) * 2008-05-20 2009-07-01 株式会社東芝 無線機器、無線制御システムおよび無線制御方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005065118A (ja) * 2003-08-19 2005-03-10 Hitachi Ltd リモコン機能付き携帯端末及びリモコンサーバ
JP2005268941A (ja) 2004-03-16 2005-09-29 Sony Corp 遠隔制御装置、遠隔制御方法及びそのプログラム
JP2005332070A (ja) * 2004-05-18 2005-12-02 Nippon Telegr & Teleph Corp <Ntt> 端末操作方法とその装置、プログラム及び記録媒体
JP2006146803A (ja) 2004-11-24 2006-06-08 Olympus Corp 操作装置及び遠隔操作システム
JP2006196956A (ja) * 2005-01-11 2006-07-27 Matsushita Electric Ind Co Ltd 端末装置
JP2007259328A (ja) 2006-03-24 2007-10-04 Fujifilm Corp 遠隔制御装置、方法、プログラムおよびシステム
JP2009256909A (ja) 2008-04-14 2009-11-05 Komatsu Ltd 作業車両の配管取付構造
JP2009260523A (ja) * 2008-04-15 2009-11-05 Nippon Telegr & Teleph Corp <Ntt> 制御システム、制御装置、管理装置、制御方法、管理方法、制御プログラム、管理プログラム及びそのプログラムを記録した記録媒体

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2501150A4

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013132750A1 (fr) * 2012-03-09 2013-09-12 パナソニック株式会社 Système de réglage d'opération pour appareil électroménager
WO2014115316A1 (fr) * 2013-01-25 2014-07-31 三菱電機株式会社 Système de climatisation
JP6008994B2 (ja) * 2013-01-25 2016-10-19 三菱電機株式会社 空気調和システム
US9810445B2 (en) 2013-01-25 2017-11-07 Mistubishi Electric Corporation Air-conditioning system
JP2015228184A (ja) * 2014-06-02 2015-12-17 富士通株式会社 監視プログラム、監視システムおよび監視方法
JP5975135B1 (ja) * 2015-03-31 2016-08-23 ダイキン工業株式会社 制御システム
WO2016157640A1 (fr) * 2015-03-31 2016-10-06 ダイキン工業株式会社 Système de commande, pour commander une pluralité d'appareils en liaison
JP2016195303A (ja) * 2015-03-31 2016-11-17 ダイキン工業株式会社 制御システム
US11609018B2 (en) 2015-03-31 2023-03-21 Daikin Industries, Ltd. Control system for controlling multiple apparatuses in linkage
JP2019184779A (ja) * 2018-04-09 2019-10-24 シャープ株式会社 端末装置、情報処理装置、表示システム、情報表示方法、情報処理方法、制御プログラム、及び電気機器

Also Published As

Publication number Publication date
CN102668593B (zh) 2015-09-02
JP5996869B2 (ja) 2016-09-21
EP2501150B1 (fr) 2014-08-27
EP2501150A4 (fr) 2013-05-29
CN102668593A (zh) 2012-09-12
JPWO2011058857A1 (ja) 2013-03-28
US8704644B2 (en) 2014-04-22
EP2501150A1 (fr) 2012-09-19
US20120206245A1 (en) 2012-08-16

Similar Documents

Publication Publication Date Title
JP5996869B2 (ja) 遠隔操作システム、遠隔操作機器及び遠隔操作方法
CN100508554C (zh) 遥控系统、远程命令器及遥控服务器
JP4207900B2 (ja) リモコン・システム、リモート・コマンダ、並びにリモコン・サーバ
JP4812841B2 (ja) Ａｖ機器のための映像再生装置
US9800837B2 (en) Virtual control device
CN104247388B (zh) 自走式电子设备、终端装置以及带遥控器电子设备的操作系统
KR100759139B1 (ko) 멀티비젼 시스템의 제어장치 및 그 방법
CN102082941A (zh) 显示控制装置、显示控制系统和遥控装置
TW201037594A (en) Control system for controlling one or more controllable devices sources and method for enabling such control
JP2007142806A (ja) 遠隔制御システムおよび遠隔制御装置
JP2006109404A (ja) アダプタ装置及びネットワークカメラシステム
JP2007184745A (ja) リモコン・システム、リモコン制御対象機器、並びにコンピュータ・システム
CN109587536A (zh) 一种远程遥控方法、设备、服务器和系统
KR101241967B1 (ko) 제어장치 및 방법, 프로그램과 기록매체
KR101726578B1 (ko) 모바일 원격 제어 장치
KR101283322B1 (ko) 서비스 프로파일 기반의 통합 리모트 제어 장치 및 그 방법
US20140152901A1 (en) Control system for video device and video device
WO2018087805A1 (fr) Système de commande à distance, procédé de commande à distance et terminal d&#39;informations mobile
CN101305405A (zh) 产品的无人操作
JP6302062B2 (ja) 電子機器及び方法及びプログラム
US11457260B2 (en) Systems and methods for controlling device configuration in a networked environment
AU2017258977B2 (en) Audio-video distribution system
KR101380483B1 (ko) 원격 제어 장치, 원격 제어 장치의 채널 정보 전송 방법 및원격 제어 시스템

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080051091.1

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10829817

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2011540455

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2010829817

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 13502915

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 4060/CHENP/2012

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE