JP2010130632A - Device remote control system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device remote control system capable of controlling a device even in a dark room, while preventing misoperations of the device. <P>SOLUTION: A device remote control system remotely controls a plurality of devices using device operation signals and includes: a single remote controller 100, having a plurality of operating buttons 101, corresponding to device operation signals of the plurality of devices; a head-mounted display 200 allowing a user to visually recognize an image; an imaging apparatus 151 for reading a device identification symbol described in each device and identifying the device to be controlled remotely; a suiting means 13b for suiting each operation button 101 of the remote controller, to each device operation signal of the device to be controlled; and an operation information image generating means 13d for generating an operation information image for each operating button 101, corresponding to each device operation signal of the device to be controlled and outputting the generated image to the head-mounted display 200. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a device remote operation system that displays operation information of a remotely operated device on a head-mounted display when a plurality of devices are remotely operated with a single remote controller.

  Conventionally, as disclosed in Patent Document 1 and Patent Document 2, so-called learning remote controllers and multi-remote controllers capable of operating a plurality of electronic devices (TV receivers, DVD players, audio devices, air conditioners, etc.) are known. ing. Since these can operate a plurality of electronic devices with a single remote controller, the remote controllers corresponding to the respective devices do not overflow, which is convenient.

  However, the user forgets which operation button corresponds to the operation of the electronic device that the user is trying to operate, or the electronic device that the user is trying to operate is difficult to understand. There was a problem of being lost. For example, there is a case where the user intends to change the channel of the television receiver but activates the air conditioner. Further, there is a problem that it is difficult to visually recognize the operation buttons of the remote controller in a dark room.

JP-A-5-56484 JP-A-7-123479

  An object of the present invention is to solve the above-mentioned problems, to prevent an erroneous operation of the device, and to provide a device remote operation system that can be operated even in a dark room.

The invention according to claim 1, which has been made to solve the above-described problem, is a device remote control system for remotely controlling a plurality or a single device with a device operation signal that is a radio signal.
A single remote controller having a plurality of operation buttons corresponding to each device operation signal of a plurality or a single device;
A head mounted display that is mounted on the user's head and allows the user to visually recognize the image;
Device identification means for identifying a device remotely operated by the remote controller;
Adapting means for adapting each operation button of the remote controller to each equipment operation signal of the equipment identified by the equipment identifying means;
Operation information image generation means for generating an operation information image of each operation button corresponding to each device operation signal of the device identified by the device identification means, and outputting the operation information image to the head mounted display.

  According to a second aspect of the present invention, in the first aspect of the present invention, the device identification means is an imaging device that reads a device identification symbol described in each device.

  The invention according to claim 3 is the invention according to claim 1, wherein the device identification means is a tag reader that reads device identification information of an IC tag attached to each device.

  The invention according to claim 1 is a device identifying means for identifying a device remotely operated by a remote controller, and an adapting means for adapting each operation button of the remote controller to each device operation signal of the device identified by the device identifying means. And operation information image generation means for generating an operation information image of each operation button corresponding to each device operation signal of the device identified by the device identification means and outputting it to the head mounted display It is possible to press down the operation button while confirming the operation content of the operation button, and it is possible to prevent erroneous operation of the device. In addition, since the operation information image is displayed on the head mounted display, the device can be easily operated even in a dark room.

  According to the second aspect of the present invention, since the device identification means is configured by an imaging device that reads a device identification symbol described in each device, it is possible to reliably identify the device that the user is trying to operate.

  In the invention according to claim 3, since the device identification means is configured by a tag reader that reads the device identification information of the IC tag attached to each device, it is possible to reliably identify the device that the user is trying to operate. Become.

(Outline of the present invention)
FIG. 1 shows a schematic diagram of an apparatus remote control system of the present invention, and the outline of the present invention will be described below. The apparatus remote operation system of the present invention includes a single remote controller 100 having a plurality of operation buttons 101 as shown in FIG. 2 and a head that is mounted on the head of a user 500 and allows the user 500 to visually recognize an image. It is comprised from the mount display 200. FIG. In the present invention, an “apparatus operation signal”, which is a radio signal output from the single remote controller 100, uses an air conditioner 600 (apparatus A), a television receiver 700 (apparatus B), an audio apparatus 800 (apparatus C), and the like. One or a plurality of devices can be operated. In order to realize such a function, the device remote operation system of the present invention has “device identification means” for identifying a device to be operated, and each operation button of the remote controller 500 before operating the device. 101 is adapted to each “device operation signal” of the device identified by the “device identifying means”.

  When the user directs the remote controller 100 to the device to be operated and presses the device selection button 102 (shown in FIG. 2), the “device identifying means” identifies the device to be operated. Then, each operation button 101 of the remote controller 500 is adapted to each “apparatus operation signal” of the apparatus, and as shown in FIG. 3 and FIG. In B700, the operation button 101 of the remote controller 100 and the operation information image 910 representing the content of the operation of the operation button 101 or the operation information image 920 are displayed on the head mounted display 200. Therefore, the user 500 can operate the device A 600 and the device B 700 while confirming the operation information images 910 and 920. Hereinafter, the details of the device remote control system will be described with reference to the drawings.

(Block diagram of equipment remote control system)
FIG. 5 shows a block diagram of the device remote control system, which will be described below. In the embodiment shown in FIG. 5, the remote controller 100 is provided with a device identification unit 150 that reads “device identification information”. The device identification unit 150 includes an imaging device 151 and a tag reader 152. Hereinafter, an embodiment in which the device identification unit 150 is the imaging device 151 will be described.

  As shown in FIG. 1, FIG. 2, FIG. 4, and FIG. 5, each device 600, 700, 800 has device identification symbols 601, 701, which are symbols (device identification information) for identifying these devices. 801 is described. The device identification symbols 601, 701, and 801 include barcodes and two-dimensional codes.

  The imaging device 151 images the device identification symbols 601, 701, and 801. The imaging device 151 includes a image sensor and an imaging optical system. An image sensor is a two-dimensional arrangement of photodiodes (pixels) that detect light and generate charges. Image sensors include sensors such as a CCD (Charge Coupled Device Image Sensor) and CMOS (Complementary Metal Oxide Semiconductor). The imaging optical system includes a single lens or a plurality of lenses, and forms an incident image on an image sensor. Note that when the imaging device 151 is configured by a so-called infrared camera or a light emitting device is provided, the device identification symbols 601, 701, and 801 can be reliably imaged even in a dark place.

  When the user brings the imaging device 151 of the remote controller 100 close to the device identification symbol 601 and presses the device selection button 102, the imaging device 151 captures the device identification symbol 601. "Device identification symbol" is acquired ((1) in FIG. 5).

  The remote controller 100 recognizes that the device that the user is trying to operate is the device A 600 based on the acquired “device identification symbol”. The infrared light emitting unit 120 of the remote controller 100 outputs a “remote controller information request signal” to the infrared light receiving and emitting unit of the device A 600 ((2) in FIG. 5).

  The device A 600 to which the “remote controller information request signal” is input outputs “remote controller information” to the infrared light receiving unit 110 of the remote controller 100 ((3) in FIG. 5).

  The remote controller 100 that has acquired “remote controller information” adapts each operation button 101 to each “device operation signal” of the device A 600 and outputs “remote controller information” to the control unit 50 ((( 4)).

  The control unit 50 that has acquired the “remote controller information” generates an operation information image 910 based on the “remote controller information” and outputs the operation information image 910 to the head mounted display 200 ((5) in FIG. 5). The head mounted display 200 that has acquired the operation information image 910 displays the operation information image 910 (state shown in FIG. 3).

  When the user presses the operation button 101 of the remote controller 100, the infrared light emitting unit 120 outputs a “device operation signal” to the infrared light receiving and emitting unit 605 of the device A600. In this way, the user can operate the device A 600 while viewing the operation information image 910.

  Similar to the above-described operation of selecting and operating the device A600, the user captures the device B700 and the device C800 simply by capturing the image pickup device 151 close to the device identification symbols 701 and 801 of the device B700 and the device C800. One remote controller 100 can be used for operation.

  In the present embodiment, the control unit 50 is attached to the remote controller 100.

(Block diagram of control unit 50)
FIG. 6 shows a block diagram of the control unit 50, and the control unit 50 will be described below. The control unit 50 includes a CPU 11, a RAM 12, a ROM 13, a nonvolatile memory 14, an interface 21, an imaging device controller 31, an imaging device VRAM 32, a head mounted display controller 41, and an image generation unit VRAM 42. The CPU 11, RAM 12, ROM 13, nonvolatile memory 14, interface 21, imaging device controller 31, imaging device VRAM 32, and head mounted display controller 41 are connected to each other via a bus 45.

  A CPU (abbreviation for central processing unit) 11 performs various calculations and processes in cooperation with a RAM (abbreviation for random access memory) 12 and a ROM (abbreviation for read only memory) 13.

  The RAM 12 temporarily stores programs processed by the CPU 11 and data processed by the CPU 11 in its address space.

  Various programs and parameters for controlling the control unit 50 are stored in the ROM 13. Various functions are realized by the various programs being processed by the CPU 11. The ROM 13 stores device identification information discriminating means 13a, adapting means 13b, operation button operation detecting means 13c, operation information image generating means 13d, and light emission code light emitting means 13e. Note that these programs and data may be stored in the nonvolatile memory 14.

  The device identification information determination unit 13 a determines the device that the user is trying to operate based on the “device identification symbol” captured by the imaging device 151.

  The adapting means 13b adapts each operation button 101 of the remote controller 100 to each “apparatus operation signal” of the equipment identified by the equipment identification information discriminating means 13a.

  The operation button operation detection unit 13c is a unit that detects an operation in which the user presses the operation button 101 halfway, touches the operation button 101, or fully presses (presses) the operation button 101.

  The operation information image generation unit 13 d outputs a command for generating an “operation information image” to be displayed on the head mounted display 200 to the head mounted display controller 41.

  Based on the signal that the operation button 101 is pressed, the light emission code light emission means 13e reads the “light emission code” that is the “device operation signal” corresponding to the operation button 101 from the non-volatile memory 14, and the “light emission code”. The infrared light emitting unit 120 emits light as infrared light.

  Note that the device identification information discriminating means 13a, the adapting means 13b, the operation button operation detecting means 13c, the operation information image generating means 13d, and the light emission code light emitting means 13e may be configured as ASIC (Application Specific Integrated Circuit).

  The nonvolatile memory 14 stores data such as various settings of the remote controller 100. The nonvolatile memory 14 stores device identification data 14a and a light emission code 14b. The device identification data 14 a is data for identifying a device from the “device identification information” read by the device identification means 150. As shown in FIG. 9, the light emission code 14b is an enumeration of numbers corresponding to the operation buttons 101 of the remote controller 100, and is a “device operation signal” for operating the device A600, the device B700, and the device C800. .

  The interface 21 converts the physical and logical form of the signal. The interface 21 is connected to the operation button 101, the device selection button 102, the power button 105, the infrared light receiving unit 110, and the infrared light emitting unit 120 of the remote controller 100. When the operation button 101, the device selection button 102, and the power button 105 are pressed, signals corresponding to these buttons are converted by the interface 21 and output to the bus 45. The device selection button 102 is a two-stage switch, and can detect that the user has pressed the device selection button 102 halfway. Alternatively, the device selection button 102 includes an electrostatic sensor, and can detect that the user has touched the device selection button 102.

  The imaging device controller 31 is connected to the imaging device 151, the imaging device VRAM 32, and the bus 45. The imaging device controller 31 generates a “captured image” by expressing the charges generated by the photodiodes of the imaging device 151 with gradation for each of the RGB colors, and stores it in the imaging device VRAM 32.

  The head mounted display controller 41 communicates with the head mounted display 200. In the embodiment shown in FIG. 1, the head mounted display controller 41 and the head mounted display 200 communicate with each other wirelessly, but they may be communicated with each other by wire. The head mounted display controller 41 has a so-called GPU (Graphics Processing Unit), receives an instruction from the operation information image generation unit 13d, generates an “operation information image” that is pixel data, and stores it in the image generation unit VRAM 42. At the same time, the “operation information image” stored in the image generation unit VRAM 42 is output to the head mounted display 200 as an “image signal”. Further, the head mounted display controller 41 outputs a “control signal” to the head mounted display 200. The “control signal” includes control signals such as turning on / off the power of the head mounted display 200 and adjusting the image position.

  As shown in FIG. 1, the head-mounted display 200 includes a head mounting unit 210 that is mounted on the user's head and an image generation unit that is attached to the head mounting unit 210 and generates an image that is visually recognized by the user. 220. The image generation unit 220 generates an “operation information image” based on the “image signal” output from the head mounted display controller 40. The image generation unit 220 includes an LCD and a structure that directly irradiates a user's eyeball with scanned image light that is two-dimensionally scanned with laser light whose intensity is modulated according to an image. When the head mounted display 200 is configured by the image generation unit 220 configured to directly irradiate the user's eyeball with the scanning image light, the user can see the outside world while visually recognizing the image generated by the image generation unit 220 (so-called so-called). This is preferable for the present invention.

  In the embodiment described above, the imaging device 151 captures the device identification symbols 601, 701, and 801 to identify the device that the user is trying to operate, but the imaging device 151 is about to be operated by the user. Device A600, device B700, and device C800 themselves are imaged, feature points such as color and shape are extracted, and the feature points are collated with the feature point data of each device stored in advance in the nonvolatile memory 14, The configuration may be such that the determination is made using a predetermined threshold and the device that the user is trying to operate is identified. Alternatively, the remote controller 100 itself is provided with a device identification button for identifying the device that the user intends to operate, and the user operates the device identification button to identify the device that the user intends to operate. There is no problem.

  In the embodiment shown in FIG. 6, the control unit 50 is attached to the remote controller 100 side, but the control unit 50 may be attached to the head mounted display 200 side.

  Further, as shown in FIG. 7, the “device identification unit” may be attached to the head mounted display 200 side.

  In the embodiment shown in FIG. 5 and FIG. 7, the remote controller 100 acquires “remote controller information” from the device to be operated, but the “remote controller information” is previously stored in a nonvolatile memory. 14 may be saved.

(Flow of the present invention)
FIG. 8 shows a flowchart of the present invention, and the flow of the present invention will be described below with respect to the embodiment shown in FIG. When the user depresses the power button 105 to turn on the power to the remote controller 100, the process proceeds to S12 “initialization process”. In the process of S12, the CPU 11 performs an initialization process such as clearing the storage area of the RAM 12. When the process of S12 is completed, the process proceeds to the determination process of S13 “device selection?”.

  In the determination process of S13 “device selection?”, The device identification information determination unit 13a determines whether or not the imaging device controller 31 has generated “imaging data” (device identification information). When the user presses the device selection button 102, the imaging device 151 captures the device identification symbol 601 of the device A600, and the device identification information determination unit 13a determines that “imaging data” has been generated ( 5 (1)), the “imaging data” is stored in the imaging device VRAM 32, and the process proceeds to S14 “device identification symbol determination”.

  In the process of S14 “device identification symbol determination”, the device identification information determination unit 13a reads “imaging data” stored in the imaging device VRAM 32 and compares it with the device identification data 14 stored in the non-volatile source memory 14. To identify the device that the user is trying to operate. When the process of S14 is completed, the process proceeds to S15 “Remote controller information request signal transmission”.

  In the process of S15 “remote controller information request signal transmission”, the infrared light emitting unit 120 of the remote controller 100 transmits a “remote controller information request signal” to the device A600 identified in the process of S14 ((2 in FIG. 5). )). When the process of S15 ends, the process proceeds to the determination process of S16 “remote controller information received?”.

  In the determination process of S16 “remote controller information received?”, The adaptation unit 13b determines whether “remote controller information” is transmitted from the device A600 and the infrared light receiving unit 110 has received the “remote controller information”. . When the adapting means 13b determines that the “remote controller information” has been received ((3) and (4) in FIG. 5), the process proceeds to S17 “operating button adaptation”.

  In the process of S17 “Adjust Operation Buttons”, the adapting means 13b determines that each operation button 101 of the remote controller 100 is identified by the process of S14 based on the “remote controller information” received in the determination process of S16. Adapt to each equipment operation signal. When the processing of S17 ends, the process proceeds to S18 “operation information image display” processing.

  In the process of S18 “operation information image display”, the operation information image generation means 13d generates a command for generating an “operation information image” based on the “remote controller information” received in the determination process of S16, as a head mounted display controller. 41 is output. Based on the command, the head mounted display controller 41 generates an “operation information image”, stores it in the image generation unit VRAM 42, and outputs the “operation information image” to the head mounted display 200 as an “image signal”. ((5) in FIG. 5). The head mounted display 200 displays an operation information image 910 as shown in FIG. When the process of S18 ends, the process proceeds to the determination process of S19 “select another device?”.

  In the determination process of S19 “select another device?”, The device identification information determination unit 13a determines whether or not the user is selecting another device by pressing the device selection button 102. If the device selection button 102 is pressed, the process returns to the determination process of S13. On the other hand, if the device selection button 102 is not pressed, the process proceeds to the determination process of S20 “operate operation button?”

  In the determination process of S20 “operating the operation button?”, The operation button operation detecting unit 13c determines whether or not the user intends to operate the operation button 101 by half-pressing or touching the operation button 101. Determine whether. If the operation button operation detection unit 13c detects that the operation button 101 is half-pressed or that the operation button 101 is being touched, the process proceeds to S21 “highlight the operation button to be pressed”. . On the other hand, if the operation button operation detection unit 13c does not detect that the operation button 101 is half-pressed or that the operation button 101 is touched, the process returns to S19.

  In the process of S21 “highlight the device selection button to be pressed”, the operation information image generation unit 13d determines that the operation button 101 is detected to be half-pressed or touched in the determination process of S20. A command for generating the highlighted operation information image 910 is output to the head mounted display controller 41. The head mounted display 200 displays an operation information image 910 in which the operation button 101 that is half-pressed or touched by the user is highlighted. Thus, since the operation button 101 that the user is trying to press is highlighted on the operation information image 910, the user can operate the remote controller 100 by groping without looking at the remote controller 100. This is particularly convenient when the room is dark and the remote controller 100 cannot be viewed. When the process of S21 is completed, the process proceeds to the determination process of S22 “Removing hand?”.

  In the determination process of S22 “Removing Hand?”, The operation button operation detecting means 13c determines whether or not the hand has been released from all the operation buttons 101. When the operation button operation detection unit 13c determines that all the operation buttons 101 have been released, the process proceeds to the determination process of S23 “A certain time has passed?” On the other hand, if the operation button operation detection unit 13c does not determine that all the operation buttons 101 have been released, the process proceeds to the determination process of S25 “Operate another operation button?”.

  In the determination process of S23 “A certain time has passed?”, The operation button operation detection unit 13c determines whether or not a certain time has passed since all the operation buttons 101 are released. If the operation button operation detection unit 13c determines that all of the operation buttons 101 have been released from the operation button 101 and a predetermined time has elapsed, the process proceeds to S24 "End operation information image display". If the operation button operation detection means 13c determines that the user's hand has touched the operation button 101 again before a certain time has passed since all the operation buttons 101 have been released, the process proceeds to S25. move on.

  In the process of S24 “end operation information image display”, the operation information image generating means 13d outputs a command to end the generation of the operation information image 910 to the head mounted display controller 41, and the operation information image on the head mounted display 200 is displayed. The display of 910 is terminated. When the process of S24 ends, the process returns to the determination process of S19.

  In the determination process of S25 “operating another operation button?”, The operation button operation detection unit 13c causes the user to half-press the operation button 101 different from the operation button 101 recognized in the S20 determination process, or the operation button By touching 101, it is determined whether or not another operation button 101 is to be operated. When the operation button operation detection means 13c detects that the other operation button 101 is half-pressed or that the operation button 101 is touched, S26 "highlights the operation button to be pressed" is displayed. Proceed to processing. On the other hand, if the operation button operation detection unit 13c does not detect that the other operation button 101 is half-pressed or that the operation button 101 is touched, the determination in S27 "Is the operation button pressed?" Proceed to processing.

  In the process of S26 “highlight the operation button that is about to be pressed”, the operation button operation detection unit 13c highlights the operation button 101 that is determined to be half-pressed or touched by the user in the determination process of S25. A command for generating the operation information image 910 is output to the head mounted display controller 41. The head mounted display 200 displays the operation information image 910. When the process of S26 ends, the process returns to the determination process of S22.

  In the determination process of S27 “Press the operation button?”, The operation button operation detection unit 13c determines whether or not the user has pressed the operation button 101 completely. If the operation button operation detection unit 13c determines that the user has pressed the operation button 101 completely, the process proceeds to S28 "light emission code". On the other hand, when the operation button operation detection unit 13c determines that the state where the user has not completely pressed down the operation button 101 has passed for a certain period of time, the process returns to the determination process of S22.

  In the process of S28 “light emission code”, the light emission code light emission means 13e is “light emission code” which is an “apparatus operation signal” corresponding to the operation button 101 pressed by the user in the process of S27 ((B) of FIG. 9). Is emitted as infrared light by the infrared light emitting unit 120 ((6) in FIG. 5). When the process of S28 ends, the process proceeds to the determination process of S29 "End of operation button press?"

  In the determination process of S29 “operation button press end?”, The operation button operation detection unit 13c determines whether or not the operation button 101 has been pressed. When the operation button operation detection unit 13c determines that the operation button 101 has been pressed by releasing the operation button 101 being pressed by the user, the process returns to the determination process of S22.

(Embodiment using tag reader as device identification means)
Hereinafter, a device remote control system using a tag reader 152 as the device identification means 150 will be described. The tag reader 152 is connected to the bus 45. In the case of this embodiment, as shown in FIGS. 1, 3, and 4, in the devices A600, B700, and C800 to be operated, IC tags 602, 702 in which “device identification information” is embedded, 802 is attached. When the user brings the tag reader 152 close to the IC tags 602, 702, and 802, the tag reader 152 reads “apparatus identification information” and passes it to the bus 45. The device identification information discriminating means 13a compares the “device identification information” with the device identification data 14a stored in the nonvolatile memory 14 to identify the device that the user is using for the operation. The IC tags 602, 702, and 802 include both so-called passive tags (IC tags that generate power from radio waves from a tag reader) and active tags (IC tags to which power is supplied), and tag readers that read these tags. 152 corresponds to a passive tag and an active tag.

  The remote controller 100 used in the present invention is not limited to a remote controller configured with physical buttons as shown in FIG. 2, but instead of physical buttons, an image display unit such as an LCD is used. A remote controller using a so-called touch panel with a contact detection film attached may be used.

  Although the present invention has been described above in connection with the most practical and preferred embodiments at the present time, the present invention is not limited to the embodiments disclosed herein. The scope of the invention can be changed as appropriate without departing from the spirit or concept of the invention that can be read from the claims and the entire specification, and a device remote control system with such changes is also understood to be included in the technical scope. There must be.

It is a schematic diagram of an apparatus remote control system of the present invention. It is explanatory drawing of a remote controller. It is a figure showing a user's field of vision when trying to operate an air conditioner. It is a figure showing a user's field of vision when it is going to operate a television receiver. It is a block diagram of an apparatus remote control system. It is a block diagram of a control part. It is a block diagram of an embodiment in which device identification means is attached to the head mounted display side. It is a flowchart of this invention. It is explanatory drawing of a light emission cord.

Explanation of symbols

11 CPU
12 RAM
13 ROM
13a Device identification information discrimination means 13b Adaptation means
13c Operation button operation detection means 13d Operation information image generation means 13e Light emission code light emission means 14 Non-volatile memory 14a Device identification data 14b Light emission code 21 Interface 31 Imaging device controller 32 Imaging device VRAM
41 Head Mount Display Controller 42 Image Generator VRAM
45 Bus 50 Control unit 100 Remote controller 101 Operation button 102 Device selection button 105 Power button 110 Infrared light receiving unit 120 Infrared light emitting unit 150 Device identification means 151 Imaging device 152 Tag reader 200 Head mounted display 210 Head mounting unit 220 Image generation unit 600 Device A (air conditioner)
601 Device identification symbol 602 IC tag 700 Device B (TV receiver)
701 Device identification symbol 702 IC tag 800 Device C (audio device)
801 Device identification symbol 802 IC tag 910 Operation information image 920 Operation information image

Claims (3)

In a device remote control system that remotely controls a plurality or a single device with a device operation signal that is a radio signal,
A single remote controller having a plurality of operation buttons corresponding to each device operation signal of a plurality or a single device;
A head mounted display that is mounted on the user's head and allows the user to visually recognize the image;
Device identification means for identifying a device remotely operated by the remote controller;
Adapting means for adapting each operation button of the remote controller to each equipment operation signal of the equipment identified by the equipment identifying means;
The apparatus remote operation comprising: an operation information image generation means for generating an operation information image of each operation button corresponding to each apparatus operation signal of the apparatus identified by the apparatus identification means and outputting the operation information image to the head mounted display system.   2. The device remote control system according to claim 1, wherein the device identification means is an imaging device that reads a device identification symbol written on each device.   2. The device remote operation system according to claim 1, wherein the device identification means is a tag reader that reads device identification information of an IC tag attached to each device.