JP4107288B2 - Control system, controlled apparatus and remote control apparatus compatible with this system - Google Patents

Description

  The present invention relates to a control system including, for example, a television receiver as a controlled device and a remote controller (hereinafter referred to as a remote controller) as a corresponding remote control device, a controlled device compatible with this system, and a remote control device. As an example of the control device, the position of the viewer who is highly likely to be in a place that roughly matches the place where the remote control exists is estimated, and the position of the remote control device (and hence the user having the remote control) is adapted. The present invention relates to a control system that makes it possible to select content and adjust sound effects, and a controlled device and a remote control device compatible with this system.

  A number of techniques have already been proposed for providing various conveniences to the user with respect to the operation of a system composed of a remote control device and a remote controlled device by making the remote control device multifunctional. For example, the remote controller uses a GPS algorithm or the like to detect its own position based on radio wave reception from three radio wave sources and the reception time, and the detected position and position information of each device prepared in advance To identify the device closest to itself, obtain information defining the remote control signal and information for constructing the operation image from that device, and display the operation image of the specified device on the display Then, by specifying the remote control signal according to the user operation and causing the remote control signal transmission control unit to control transmission, the user can more accurately specify the device that the user wants to control without increasing the number of button operations by the user. A technique has been proposed that enables the device to be controlled (see Patent Document 1).

  Also, in a system in which a projector is operated by a remote controller, the projector receives the projection area imaging information and orientation information acquired by the remote controller having the image sensor at its own receiver, and looks in advance based on the received information. There has been proposed an image processing system in which a trapezoidal distortion correction value prepared in an up table is selected and the keystone distortion is corrected based on the correction value (see Patent Document 2).

  Furthermore, in a pointing device that points to an arbitrary point on the display screen with a laser pointer, a display screen including a laser spot projected from the remote control is imaged by a CCD camera provided on the remote control side, and raster scanning of the image by this imaging, etc. To calculate the coordinates of the laser spot, wirelessly transmit the data representing the coordinates from the remote control side to the TV side, and display the indication point on the screen, thereby enabling pointing from various angles Has been proposed (see Patent Document 3).

In response to the proposal of Patent Document 3 described above, the coordinates of the three corner positions of the image display surface on the raster imaged by the imaging device provided on the remote control side and the coordinates of the three corner positions of the actual image display surface Based on the comparison, it is possible to perform pointing on the display screen without projecting a laser spot or the like from the remote control side by calculating which coordinate on the actual screen the raster center coordinate of the captured image corresponds to. It has been proposed (see Patent Document 4).
JP 2004-166193 A (paragraphs 0016 to 0018, FIGS. 1 and 2) Japanese Patent Laying-Open No. 2004-187052 (paragraph 0039 to paragraph 0045, FIG. 1) Japanese Patent Laying-Open No. 2001-236181 (paragraphs 0004 to 0009, FIG. 1) JP 2003-208260 A (paragraphs 0013 to 0021, FIGS. 1 and 2)

  From the viewpoint of enabling the selection of contents and adjustment of sound effects to suit the position of the user (and hence the remote controller), the conventional technology described above has various types as described below. There are still challenges. That is, in the technique described in Patent Document 1, it is essential in principle that three radio wave sources are installed in advance as a reference for position detection. It is difficult to select a device that conforms to the control target with appropriate accuracy.

  Further, the technique proposed in Patent Document 1 is configured to unconditionally select any device closest to the position of the remote control (and therefore the user) as a control target, so that it can be adapted to the original intention of the user. The selected device is not necessarily selected. Therefore, when it is used for actual use, the user himself / herself must approach the device himself / herself, and it cannot be expected that the control target intended for operation is automatically selected literally.

  The technique proposed in Patent Document 2 acquires azimuth information of a remote controller as much as necessary to correct trapezoidal distortion in a projector, and executes correction of trapezoidal distortion based on the acquired azimuth information. There is no suggestive disclosure about recognizing the position of the remote control (and hence the user) relative to the device body and selecting content or adjusting the sound effect to match the recognition.

  Further, in the proposal of Patent Document 3, the display screen including the projected laser spot is imaged by the imaging unit on the remote control side, and the position coordinate data of the laser spot is acquired based on the raster scanning related to the video signal by this imaging. This is different from the technique of recognizing the position of the remote control relative to the device body and selecting content or adjusting the sound effect so as to match the recognition.

  On the other hand, the proposal of Patent Document 4 is limited as long as it enables pointing on the display screen without projecting a laser spot or the like from the remote control side as in Patent Document 3. However, there are no proposals for recognizing the position of the remote control relative to the device body and selecting content or adjusting the sound effect so as to match the recognition.

  The present invention has been made paying attention to the problems in the prior art as described above, and uses the imaging means provided on the remote control device side to position the remote control device relative to the controlled device. A control system that enables an automatic response operation, for example, to enable recognition, and in other words, to select content or adjust sound effects in a controlled device so as to conform to the recognition, and It is an object of the present invention to provide a controlled device and a remote control device compatible with this system.

In order to solve the above-described problems, the present application proposes the following techniques .

(4) Consists of a remote control device and a controlled device that can be controlled by the remote control device.
Control system,
The remote control device includes a housing configured separately from the controlled device, and the housing.
The phase between the controlled device and the remote control device when imaging is performed toward the controlled device side.
Imaging means capable of generating image information including information that contributes to recognizing a pair position; and
Information transmission means for transmitting image information generated by the imaging means to the controlled device side;
Prepared,
The controlled device receives image information transmitted from information transmission means of the remote control device.
Information receiving means adapted to obtain and image information received by said information receiving means.
A relative position calculating means for calculating a relative position between the controlled device and the remote control device;
With
The relative position calculation means of the controlled device is the image information received by the information receiving means.
Information that contributes to recognizing the relative position between the controlled device and the remote control device
And the controlled device based on information relating to the external dimensions of the controlled device prepared for use.
It is configured to calculate a relative position with the remote control device.
Control system.

According to the control system of (4) above, the image pickup means provided on the remote control device side is utilized.
Imaging is performed in an imaging field including the controlled device, and the image information acquired by the imaging is controlled.
The controlled device that received the transmitted image information by the information receiving means
On the side, the relative position between the remote control device and the controlled device can be calculated. The calculated
On the controlled device side that has recognized the position of the remote control device, an operation in a mode suitable for this recognition is performed.
It becomes possible.
In addition to the above-described operation, the controlled device is prepared in advance so as to be able to use information relating to its external dimensions, and the information receiving means recognizes the relative position between the controlled device and the remote control device. When the information that contributes to the operation is received, the relative position calculation means of the controlled device calculates the relative position between the remote control device and the controlled device based on the received information and the information prepared in advance. calculate. The controlled device can recognize the calculated position of the remote control device and perform an operation in a mode suitable for the recognition.

(5) It is configured so that it can be controlled from a predetermined remote control device configured separately from itself.
A controlled device, which is generated by an imaging means provided in the remote control device and the controlled device
Image information including information contributing to recognizing the relative position between the control device and the remote control device is
When transmitted from the remote control device side, the transmitted image information can be received.
Information receiving means and the controlled object based on the image information received by the information receiving means.
A relative position calculating means for calculating a relative position between the device and the remote control device,
The relative position calculating means is the controlled position in the image information received by the information receiving means.
Information that contributes to recognizing the relative position of the control device and the remote control device and prepared in advance for use
And the remote control based on the information related to the external dimensions of the controlled device.
A controlled device characterized in that it is configured to calculate a relative position with respect to the device.

According to the controlled device of (5) above , the relative position between the controlled device and the remote control device is
When image information including information that contributes to recognition is transmitted from the remote control device side,
The transmitted image information is received by the own information receiving means, and the relative information is received based on the received image information.
The relative position between the controlled device and the remote control device is calculated by the position calculation means. Calculation
It is possible to recognize the position of the remote control device that has been issued and to perform operations in a manner suitable for this recognition.
Become capable.
In addition to the above-described operation, the controlled device prepares information relating to its external dimensions in advance so that the relative position between the controlled device and the remote control device is recognized by the information receiving means. When the information that contributes to the operation is received, the relative position calculation means of the controlled device calculates the relative position between the remote control device and the controlled device based on the received information and the information prepared in advance. calculate. The controlled device can recognize the calculated position of the remote control device and perform an operation in a mode suitable for the recognition.

(6) The controlled device includes an information holding unit that holds information related to an external dimension of the controlled device that is prepared to be available in advance. Control system.
According to the control system of (6) above, in addition to the operation of the control system described in (4), the controlled device can previously use information relating to the external dimensions of the controlled device for its own information holding means. The information held in this way can be used for calculation to calculate the relative position between the controlled device and the remote control device at a required timing.

(7) The controlled device according to (5), further comprising information holding means for holding information related to an external dimension of the controlled device prepared to be available in advance.
According to the controlled device of (7) above, in addition to the operation of the controlled device described in (5), the information relating to the external dimensions of the controlled device is held in advance in its own information holding means. Thus, the information held in this way can be used for calculation to calculate the relative position between the controlled device and the remote control device at a required timing.

(10) A control system including a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the housing.
The phase between the controlled device and the remote control device when imaging is performed toward the controlled device side.
Imaging means capable of generating image information including information that contributes to recognizing a pair position; and
Information transmission means for transmitting image information generated by the imaging means to the controlled device side;
Prepared,
The controlled device receives image information transmitted from information transmission means of the remote control device.
Information receiving means adapted to obtain and image information received by said information receiving means.
A relative position calculating means for calculating a relative position between the controlled device and the remote control device;
With
The relative position calculation means of the controlled device has a specific position marker as information contributing to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means. A trapezoidal distortion calculating means for executing a calculation for obtaining a trapezoidal distortion using the marker information to be represented, and information relating to the result of the calculation by the trapezoidal distortion calculating means and the external dimensions of the controlled device prepared in advance. A control system configured to calculate a relative position between the controlled device and the remote control device using a computer.

According to the control system of (10) above, when image information including information contributing to recognizing the relative position between the controlled device and the remote control device is transmitted from the remote control device side, it receives its own information. The transmitted image information is received by the means, and the relative position between the controlled apparatus and the remote control apparatus is calculated by the relative position calculating means based on the received image information. It is possible to recognize the calculated position of the remote control device and perform an operation in a mode suitable for this recognition.
In addition to the above action, the relative position calculation unit of the controlled device contributes to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving unit. When the marker information representing a specific position marker (corresponding to a known position) is included, a trapezoidal distortion is obtained by using the marker information by the trapezoidal distortion calculation means, and the information representing the trapezoidal distortion is used in advance. The relative position between the controlled device and the remote control device can be calculated using the information relating to the external dimensions of the controlled device prepared as possible.

(11) A controlled device configured to be controlled from a predetermined remote control device configured separately from itself, the controlled device generated by an imaging unit provided in the remote control device And information receiving means adapted to receive the transmitted image information when image information including information contributing to recognizing a relative position between the remote control device and the remote control device is transmitted from the remote control device side; A relative position calculating means for calculating a relative position between the controlled device and the remote control device based on the image information received by the information receiving means,
The relative position calculating means is the controlled position in the image information received by the information receiving means.
A specific position marker as information contributing to recognizing the relative position between the control device and the remote control device.
A trapezoidal distortion calculating means for executing a calculation for obtaining a trapezoidal distortion using marker information representing a marker,
Results of calculation by trapezoidal distortion calculation means and external dimensions of the controlled device prepared to be available in advance
And calculating the relative position between the controlled device and the remote control device.
A controlled apparatus characterized by being configured.

According to the controlled device of (11) above, when image information including information that contributes to recognizing the relative position between the controlled device and the remote control device is transmitted from the remote control device side, its own information The received image information is received by the receiving means, and the relative position between the controlled apparatus and the remote control apparatus is calculated by the relative position calculating means based on the received image information. It is possible to recognize the calculated position of the remote control device and perform an operation in a mode suitable for this recognition.
Further, in addition to the above-described operation, the self relative position calculating means serves as information contributing to recognizing the relative position between the controlled apparatus and the remote control apparatus in the image information received by the information receiving means. When marker information representing a specific position marker (corresponding to a known position) is included, a trapezoidal distortion is obtained by using the marker information by the trapezoidal distortion calculating means, and information indicating this trapezoidal distortion can be used in advance. The relative position between the controlled device and the remote control device can be calculated using the prepared information related to the external dimensions of the controlled device.

(18) A control system including a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the housing.
The phase between the controlled device and the remote control device when imaging is performed toward the controlled device side.
Imaging means capable of generating image information including information that contributes to recognizing a pair position; and
Information transmission means for transmitting image information generated by the imaging means to the controlled device side;
Prepared,
The controlled device receives image information transmitted from information transmission means of the remote control device.
Information receiving means adapted to obtain and image information received by said information receiving means.
A relative position calculating means for calculating a relative position between the controlled device and the remote control device;
With
The remote control device includes a communication unit that communicates with an external information processing device, and an external shape information acquisition unit that acquires information on the external shape of one or more controlled devices that are scheduled for control through the communication unit. Control target discriminating means for discriminating the controlled apparatus to be controlled based on the correlation between the information related to the outer shape of the controlled apparatus acquired by the outer shape information acquiring means and the image information captured by the imaging means. control system, characterized in that with further.

According to the control system of (18) , imaging is performed in an imaging field including the controlled device by using imaging means provided on the remote control device side, and image information acquired by the imaging is transmitted to the controlled device. By doing so, the relative position between the remote control device and the controlled device can be calculated on the controlled device side that has received the transmitted image information by the information receiving means. On the controlled device side that recognizes the calculated position of the remote control device, it is possible to perform an operation in a mode suitable for this recognition.
Further, in addition to the above operation, by utilizing the function of the external information processing device through the communication means of the remote control device, a more advanced configuration can be achieved with a simple configuration without significantly increasing the burden on the remote control device itself. It is possible to perform control, and the remote control device itself discriminates the controlled device to be controlled by its own controlled object discriminating means, so that the control command code system suitable for the controlled device to be discriminated Recognize the specifications and perform precise control.

(19) A remote control device configured to be able to perform predetermined control on the controlled device and configured separately from the controlled device, when imaging is performed toward the controlled device side An imaging unit provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the controlled device and the remote control device, and image information generated by the imaging unit An information transmission means for transmitting to the controlled device side,
A communication unit that communicates with an external information processing device, an outer shape information acquisition unit that acquires information about the outer shape of one or more controlled devices that are scheduled to be controlled through the communication unit, and the outer shape information acquisition unit. Control object discrimination means for discriminating the controlled apparatus to be controlled based on the correlation between the acquired information relating to the outer shape of the controlled apparatus and the image information captured by the imaging means. A remote control device characterized by that.
According to the remote control device of the above (19) , imaging is performed in an imaging field including the remote control device using its own imaging means, and image information acquired by the imaging is transmitted to the controlled device by the information transmission means. Is possible. On the controlled device side that has received the transmitted image information, the position of the remote control device is calculated relative to the controlled device, the calculated position of the remote control device is recognized, and an aspect suitable for this recognition It becomes possible to perform an operation.
In addition to the above-described operation, by utilizing the function of the external information processing apparatus through its own communication means, it is possible to perform more advanced control with a simple configuration without significantly increasing the burden on the remote control apparatus itself. In order to discriminate the controlled device that should be controlled by its own controlled object discriminating means, it is necessary to recognize the code system and specifications of the control commands suitable for the controlled device being discriminated and Control can be performed.

(20) A control system including a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the housing.
The phase between the controlled device and the remote control device when imaging is performed toward the controlled device side.
Imaging means capable of generating image information including information that contributes to recognizing a pair position; and
Information transmission means for transmitting image information generated by the imaging means to the controlled device side;
Prepared,
The controlled device receives image information transmitted from information transmission means of the remote control device.
Information receiving means adapted to obtain and image information received by said information receiving means.
A relative position calculating means for calculating a relative position between the controlled device and the remote control device;
With
The remote control device is information related to the outer shape of one or more controlled devices scheduled for control.
External shape information holding means, image information captured by the imaging means, and the external shape information
Control target and all information to be controlled based on the correlation with the information related to the external shape of the controlled device.
A control system further comprising a control object discriminating means for discriminating the controlled device.

According to the control system of (20) above, when image information including information contributing to recognizing the relative position between the controlled device and the remote control device is transmitted from the remote control device side, it receives its own information. The transmitted image information is received by the means, and the relative position between the controlled apparatus and the remote control apparatus is calculated by the relative position calculating means based on the received image information. It is possible to recognize the calculated position of the remote control device and perform an operation in a mode suitable for this recognition.
In addition to the above operation, the remote control device itself discriminates the controlled device to be controlled by its own controlled object discriminating means, so that the control command code system and specifications suitable for the controlled device to be discriminated are provided. Recognize and perform precise control.

(21) A remote control device configured to be able to perform predetermined control on the controlled device and configured separately from the controlled device, when imaging is performed toward the controlled device side An imaging unit provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the controlled device and the remote control device, and image information generated by the imaging unit An information transmission means for transmitting to the controlled device side,
Outline information storage that holds information related to the outline of one or more controlled devices scheduled for control
Possessing means, image information captured by the image capturing means, and the external shape information retaining means.
Discriminate the controlled device to be controlled based on the correlation with the information related to the external shape of the controlled device
The remote control device further comprising a control object discriminating means.

According to the remote control device of the above (21) , imaging is performed in an imaging field including the remote control device by utilizing its own imaging means, and image information acquired by the imaging is transmitted to the controlled device by the information transmission means. Is possible. On the controlled device side that has received the transmitted image information, the position of the remote control device is calculated relative to the controlled device, the calculated position of the remote control device is recognized, and an aspect suitable for this recognition It becomes possible to perform an operation.
In addition to the above operation, in order to discriminate the controlled device to be controlled by its own controlled object discriminating means, it recognizes the code system and specification of the control command suitable for the controlled device that has been discriminated and is accurate. Control can be performed.

(22) The external information holding means of the remote control device has an image relating to the external shape of one or more controlled devices scheduled as the control target acquired by imaging in advance by the imaging means. The control system according to (20), characterized in that
According to the control system of (22) above, in addition to the action of the control system described in (20), the remote control device displays an image relating to the outer shape of the controlled device itself that is planned to be controlled. The discriminating means can be used as a reference for discriminating the controlled device to be controlled, and accurate discrimination of the controlled object is performed.

(23) The outer shape information holding unit holds an image related to the outer shape of one or more controlled devices scheduled as the control target acquired by imaging in advance by an imaging unit ( 21) The remote control device described in 21).
According to the remote control device of (23) above, in addition to the operation of the remote control device described in (21), the remote control device displays an image relating to the external shape of the controlled device itself that is planned to be controlled. The control target discriminating means can be used as a reference for discriminating the controlled device to be controlled, and the control target is accurately discriminated.

(24) A control system including a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. An imaging unit capable of generating image information including information that contributes to recognizing a relative position with the device, a communication unit that communicates with an external information processing device, and image information generated by the imaging unit Information acquisition and transmission means for transferring to the information processing apparatus through the communication means, acquiring related information relating to the controlled apparatus supplied from the information processing apparatus as a response to the transfer, and transmitting the related information to the controlled apparatus side; With
The controlled device uses the information receiving means adapted to receive the relevant information transmitted from the information acquisition / transmission means of the remote control device, and the relevant information received by the information receiving means. Relative position recognition means for recognizing the relative position between the controlled device and the remote control device, and adjustment means for performing a predetermined adjustment operation based on recognition by the relative position recognition means. Feature control system.

According to the control system of (24), image information relating to the controlled device acquired by imaging in the remote control device is supplied to an external information processing device through communication means, and an advanced information acquisition process by the information processing device By using the capability, the relevant information of the sufficient content related to the controlled device is acquired without excessively increasing its own burden, and transmitted to the controlled device side by the information acquisition and transmission means.
On the controlled device side, it is possible to recognize the relative position between the controlled device and the remote control device using the related information by this transmission, and to perform an accurate operation based on this recognition. Become.

(25) A controlled device configured to be controlled from a predetermined remote control device configured separately from itself, and the image information generated by the imaging means by the remote control device is communicated by itself. Information receiving means adapted to receive the related information relating to the controlled device acquired from the information processing apparatus as a response to the transfer, and received by the information receiving means Relative position recognition means for recognizing the relative position between the controlled apparatus and the remote control apparatus using the related information, and adjustment means for performing a predetermined adjustment operation based on recognition by the relative position recognition means; A controlled apparatus characterized by comprising:

  According to the controlled device of (25) above, sufficient information related to the controlled device acquired by cooperation with an external information processing device having relatively high information acquisition processing capability in the remote control device Is received by its own information receiving means, and the relative position with respect to the remote control device is recognized based on the received related information having sufficient contents related to the controlled device, and an appropriate mode of operation is performed based on this recognition. It becomes possible.

(26) A remote control device configured to be able to perform predetermined control on the controlled device and configured separately from the controlled device, and is provided in its own casing and directed toward the controlled device side Communication between an imaging unit capable of generating image information including information contributing to recognizing a relative position between the controlled device and the remote control device and an external information processing device. And communication information to be performed, and image information generated by the imaging means is transferred to the information processing apparatus through the communication means, and related information related to the controlled apparatus supplied from the information processing apparatus is acquired as a response to the transfer. An information acquisition and transmission means for transmitting to the controlled device side.

According to the remote control device of the above (26), the image information related to the controlled device acquired by imaging by its own imaging means is supplied to the external information processing apparatus through the communication means, and advanced information acquisition by the information processing apparatus is performed. By using the processing capability, the relevant information with sufficient contents related to the controlled device is acquired without excessively increasing its own burden and transmitted to the controlled device side by the information acquisition and transmission means.
On the controlled device side, it is possible to recognize the relative position between the controlled device and the remote control device using the related information by this transmission, and to perform an accurate operation based on this recognition. Become.

(27) Signal form information representing a form of a signal applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus through the communication means, the information acquisition / transmission means of the remote control apparatus The control system according to (24), further configured to transmit the information to the controlled device by a signal in a mode based on the acquired signal form information.

  According to the control system of (27) above, in addition to the operation of the control system described in (24), the information acquisition / transmission means of the remote control device utilizes the advanced information acquisition processing capability of the external information processing device. And further acquiring signal form information representing a signal form (code system or the like) applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus, and the acquired signal form information The remote control device and the controlled device can accurately exchange information with a signal in a mode compliant with the above.

(28) The information acquisition / transmission means further acquires signal form information representing a form of a signal applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus through the communication means. The remote control device according to (26), wherein the remote control device is configured to transmit information to the controlled device by a signal in a mode based on the acquired signal form information.

  According to the remote control device of (28) above, in addition to the operation of the remote control device described in (26), the information acquisition / transmission means of its own uses the advanced information acquisition processing capability of the external information processing device. Further acquiring signal form information representing a signal form (code system or the like) applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus, and the acquired signal form information Accurate information can be exchanged with the controlled device by a signal in a compliant manner.

(29) The controlled device further includes coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit (24). The control system described in.
According to the control system of (29), in addition to the operation of the control system described in (24), it is possible to perform more various or highly accurate control using the coded information pattern.

(30) The controlled device according to (25), further comprising coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit. .
According to the controlled device of (30), in addition to the operation of the controlled device described in (25), it is possible to perform more various or highly accurate control using the coded information pattern.

(31) The controlled device displays a coded information pattern including information representing an interval between the plurality of markers and a code recognizable by the control device on its display unit. The control system according to (24), further comprising a coded information pattern projecting unit.
According to the control system of (31) above, in addition to the operation of the control system described in (24), the use of markers and coded information patterns displayed on the display unit of the controlled device further increases the accuracy or accuracy. High control can be performed.

(32) A marker for displaying a coded information pattern including information representing an interval between the plurality of markers and a plurality of markers and a code recognizable by the control device on the display unit thereof, and the coded information pattern projection The controlled apparatus according to (25), further comprising an exit means.
According to the controlled device of (32) above, in addition to the operation of the controlled device described in (25), the use of markers and coded information patterns displayed on its own display unit makes it more diverse or accurate. High control can be performed.

(33) A control system including a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. Imaging means capable of generating image information including information that contributes to recognizing a relative position with respect to the apparatus, and outline information holding means for holding information relating to the outline of one or more controlled apparatuses scheduled as control targets A control object discriminating means for discriminating a controlled device to be controlled based on the correlation between the image information acquired by the imaging means and the information held in the outline information holding means, and the outline information holding means A phase between the controlled device and the remote control device using the information related to the outer shape of the device discriminated as the controlled device by the held control target discriminating unit and the image information acquired by the imaging unit. A relative position calculating means for calculating a position; and an information transmitting means for transmitting information representing the relative position between the controlled device calculated by the relative position calculating means and the remote control device to the controlled device. ,
The controlled device is configured to receive information indicating a relative position between the controlled device and the remote control device transmitted from the information transmission unit of the remote control device; and the information receiving device. A control system comprising: adjusting means for executing a predetermined adjusting operation based on information received by the means.

  According to the control system of (33) above, the imaging means provided on the remote control device side is used to perform imaging in an imaging field including the controlled device, and image information acquired by the imaging and self-external information in advance. Discrimination of controlled devices to be controlled by comparison with information related to the external shape of one or more controlled devices held in the holding means, and information on the external shape and the like related to the controlled device according to the discrimination result and the imaging The relative position between the controlled device and the remote control device is calculated using the image information acquired by the control unit, and the calculated information indicating the relative position between the controlled device and the remote control device is transmitted to the controlled device. Thus, on the controlled device side that has received the transmitted information representing the relative position by the information receiving means, an adjustment operation in a mode suitable for the relative position between the controlled device and the remote control device can be performed. It becomes possible.

(34) A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, when imaging is performed toward the controlled device side Imaging means provided on its own housing capable of generating image information including information contributing to recognizing the relative position between the controlled device and the remote control device, and one or more controlled devices scheduled for control. An external information holding unit that holds information relating to the external shape of the control device, and a controlled device to be controlled based on the correlation between the image information acquired by the imaging unit and the information held in the external shape information holding unit. Control target discriminating means for discrimination, information relating to the outer shape of the apparatus discriminated as a controlled device by the control target discriminating means held in the outer shape information holding means, and image information acquired by the imaging means Relative position calculation means for calculating a relative position between the controlled apparatus and the remote control apparatus using information, and information representing a relative position between the controlled apparatus and the remote control apparatus calculated by the relative position calculation means An information transmission means for transmitting the information to the controlled device.

  According to the remote control device of (34), imaging is performed in an imaging field including the controlled device by utilizing its own imaging means, and the image information acquired by the imaging and the own external shape information holding means are held in advance. In addition, the controlled device to be controlled is discriminated by comparison with the information related to the outer shape of one or more controlled devices, and information such as the outer shape of the controlled device according to the discrimination result and the image information acquired by the imaging Can be used to calculate the relative position between the controlled device and the remote control device, and to transmit information indicating the calculated relative position between the controlled device and the remote control device to the controlled device. For this reason, on the controlled device side that has received the transmitted information representing the relative position by the information receiving means, it is possible to perform an adjustment operation in a mode suitable for the relative position between the controlled device and the remote control device. become.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings to be referred to below, for the sake of convenience, the main part that is the subject of the description is exaggerated as appropriate, and other than the main part is appropriately simplified or omitted.
FIG. 1 shows a control system (liquid crystal television) as an embodiment of the present invention including a controlled device (liquid crystal television receiver main body) and a remote control device (remote control corresponding to the liquid crystal television receiver main body). 1 is a conceptual diagram showing a John receiver system). In FIG. 1, a liquid crystal television receiver main body (hereinafter referred to as a liquid crystal television) 100 as a remote control device receives a control signal by infrared light or the like from a remote controller 200 as a remote control device corresponding to the main body. It is configured to be controlled.

  The liquid crystal television 100 has a housing 102 with a screen 102 for projecting images, a left speaker 103 and a right speaker 104 constituting a stereo acoustic device at a position lower than the bottom of the screen 102, and the screen 102. A light receiving window 105 that receives a control signal Sc (illustrated by a two-dot chain line) by infrared light or the like from the remote controller 200 is provided immediately below the bottom right.

  On the other hand, the remote controller 200 has an independent case 201 that can be placed at a position separated from the liquid crystal television 100 (the case 101), and when imaging is performed on the case 201 toward the liquid crystal television 100 side. An imaging means 210 capable of generating image information including information (described later) that contributes to recognizing the relative position between the liquid crystal television 100 (the casing 101) as the controlled apparatus and the casing 201 of the self-control apparatus; A control signal projection unit 220 including a light emitting element such as an infrared LED that emits a control signal Sc by infrared light or the like to the television 100 is provided.

And the control system (liquid crystal television system) 100 + 200 of this invention is comprised including the above-mentioned liquid crystal television 100 and the remote control 200. FIG. Note that the control signal Sc using infrared light or the like includes a signal representing image information as described later in addition to a signal representing information itself for controlling the liquid crystal television 100 according to an arbitrary operation of the operator. .
FIG. 2 is a block diagram showing a circuit configuration of the liquid crystal television 100 of FIG. The broadcast wave received by the antenna 110 is demodulated by the demodulation / filtering unit 120, a transport stream is extracted, and filtering is performed to acquire video and audio of the channel selected by the viewer (user) and program information. . The video output of the demodulation / filtering unit 120 is supplied to the video processing unit 130, the audio output is supplied to the audio processing unit 140, and the program information is supplied to the OSD unit 150.

  An image is displayed on the liquid crystal display 160 via the liquid crystal driving unit 131 by the output of the image processing unit 130. Further, based on the output of the OSD unit 150, program information and other information are displayed on the screen of the liquid crystal display 160 so as to be superimposed on the above-mentioned video or to occupy one screen in the screen. On the other hand, the output of the audio processing unit 140 is supplied to the corresponding left and right speakers 143 and 144 via the left and right amplifiers 141 and 142 to produce stereo sound.

  A system controller 170 is provided that comprehensively controls the entire system of the liquid crystal television 100 including the demodulation / filtering unit 120, the audio processing unit 140, and the OSD unit 150 described above. The system controller 170 is supplied with an output of an operation unit 171 configured to include operation keys for accepting an operation by a viewer (user), and a memory 172 is connected so as to be accessible. Data (information) is stored and read at the timing.

  On the other hand, referring to FIG. 1, the output of the light receiving element 181 provided so as to receive the control signal Sc behind the light receiving window 105 described above is connected to the system via the light receiving circuit 182 including a signal amplifying circuit. The controller 170 is connected so as to be supplied. The control signals from the system controller 170 are supplied to the left and right amplifiers 141 and 142 and the amplification rate is adjusted to adjust the balance of stereo sound. In this example, detailed description will be given later. As described above, this balance adjustment can be appropriately performed according to the location (position / direction) of the remote controller (viewer having the remote controller).

  In the above description, the position markers 1021, 1022, 1023, which will be described in detail later with reference to FIG. 6, including the corresponding functional unit of the system controller 170 that comprehensively controls the entire system of the liquid crystal television 100 and the OSD unit 150. Coded information pattern projection for projecting on the screen 102 a position marker projecting means for projecting 1024 on the screen 102 and a coded information pattern 1025 taking a two-dimensional barcode such as QR code (registered trademark) as an example. Out means are configured.

  FIG. 3 is a block diagram illustrating a circuit configuration of the remote controller 200. A control signal projection unit 220 including a light emitting element such as an infrared LED that emits a control signal Sc based on infrared light or the like described with reference to FIG. 1 controls the circuit system of the remote controller 200 in an integrated manner and performs various calculations. A system controller 230 including a microprocessor to be executed as a main component is connected, and a required control signal Sc is issued in response to a command from the system controller 230.

In addition, an imaging element 211 and an imaging circuit 212 are provided as the imaging unit 210 described with reference to FIG. The imaging circuit 212 drives the imaging device 211 under the control of the system controller 230 to perform imaging, reads out an image signal acquired by the imaging, performs necessary signal conversion, and supplies the generated image data to the system controller 230. To do.
The system controller 230 is supplied with an operation signal from an operation key 231 for performing a channel switching operation or the like provided on the casing 201 of the remote controller 200, and accesses the memory 232 to exchange data. Has been made to get. The system controller 230 is further connected to an external device interface 240 for communicating with an external information processing apparatus such as a personal computer.

  FIG. 4 shows, for example, an image of a subject having a known shape and size, such as a screen of a rectangular television receiver or a case outside thereof, captured by an image pickup means (camera). It is a conceptual diagram for demonstrating the principle of relative position calculation utilized by embodiment of this invention which calculates | requires the relative position of the said subject and camera from a state. In FIG. 4, it is assumed that the screen 10 of the television receiver as a known subject is imaged by the camera 20, and an image 30 represented by the image data is generated by this imaging.

  The horizontal dimension of the screen 10 of the television receiver is W, and the vertical dimension is H, which is known. The screen 10 is imaged on the imaging surface 22 of the imaging device by the lens 21 of the camera 20, and an image 30 represented by image data is obtained as a photoelectrically converted output. If the position of the camera 20 is directly facing the center of the screen 10 of the television receiver that is the subject, the shape of the image 30 is similar to that of the actual screen 10, but shifted from such a facing position. When it is in the position, the shape of the image 30 as a result of being imaged is distorted into a trapezoid as shown in the figure, and so-called trapezoidal distortion is generated.

  Now, the horizontal dimension of the screen 10 as a subject is known as W, and the vertical dimension is known as H. The trapezoid of an image which is image information (image 30 represented by image data) acquired by imaging by the camera 20 is known. It is assumed that the trapezoidal image due to distortion has dimensions of long side a, short side b, and height c. The distance D from the camera 20 to the screen 10 as the subject is calculated from the dimensional relationship between the corresponding parts, such as the relationship between the imaging magnification (focal length of the lens 21) and the above-described W and c, or a compact camera. It is easily determined by a well-known active AF technique based on the principle of triangulation, which is frequently used in the above.

  Therefore, from the above-described relationship between the horizontal dimension W of the screen 10, the vertical dimension H, the height c of the trapezoidal image, the long side a, the short side b, and the distance D, the camera is the subject. The degree of deviation from the position (normal direction) facing the center of the screen 10 is calculated as the angle θ. This means that if the above-mentioned data are prepared, the relative position between the controlled device (television receiver) and the remote control device (remote control) can be calculated based on these data.

  In an actual apparatus, when calculating the relative position between the controlled apparatus (television receiver) and the remote control apparatus (remote control) based on the above-described principle, the above W, H, c, a, b, D The data representing the relationship between the values that can be taken in the practical range is collected in the lookup table. In the embodiment in which the television receiver 100 calculates the relative position described above, a lookup table holding such data is stored in the memory 172 in the configuration of FIG. 2, and the system controller 170 responds as necessary. The angle θ is calculated by referring to this look-up table at the determined timing.

  Similarly, in the case where the above-described relative position is calculated on the remote controller 200 side as in the embodiment described later with reference to FIGS. 11 and 12, this is similarly applied to the memory 232 in the configuration of FIG. A look-up table that holds various data is stored, and the system controller 230 calculates the angle θ by referring to this look-up table at a required timing. In this case, since the above-mentioned relative position is calculated on the remote controller 200 side, the television receiver 100 receives information on the calculated relative position from the remote controller 200 side and performs an adaptive adjustment operation. Can be done.

  Note that, instead of the method of calculating the relative position between the controlled device (television receiver) and the remote control device (remote control) by referring to the lookup table prepared in advance in the memory as described above, Information that contributes to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means on the control device side (for example, corresponding to the four corners of a square having a known size) A trapezoidal distortion calculating means for executing a calculation for obtaining a trapezoidal distortion using marker information indicating a specific position marker arranged at a position, for example, by a corresponding functional unit of the system controller. The controlled device and the remote control device using the result of the calculation by the trapezoidal distortion calculating means and the information related to the external dimensions of the controlled device prepared to be available in advance Method for calculating the relative position may be applied.

  FIG. 5 is a flowchart showing an outline of the operation of the control system (liquid crystal television system) 100 + 200 as an embodiment of the present invention including the liquid crystal television 100 and the remote controller 200 as described above. Hereinafter, embodiments of the present invention will be described in more detail with reference to this flowchart and the above-described drawings as appropriate. Note that the flowchart of FIG. 5 is expressed in an abstract manner so as to correspond to a plurality of modified examples.

  In FIG. 5, first, on the remote controller 200 side having the configuration of FIG. 3, after the operation is started, the imaging unit 210 (imaging element 211 + imaging circuit 212) performs imaging (S201). Next, the image data acquired in S201 is converted into a control signal Sc by infrared light or the like and projected by the system controller 230 (its corresponding functional unit) as an information transmission unit and the control signal projection unit 220. The transmitted signal Sc is received by the light receiving element 181 of the liquid crystal television 100 of FIG. 2 and subjected to predetermined signal conversion via the light receiving circuit 182 and supplied to the system controller 170 (S101). . The light receiving element 181, the light receiving circuit 182 and the system controller 170 (corresponding functional part) constitute information receiving means.

  Next, in the system controller 170 as a relative position calculation unit of the liquid crystal television 100, processing according to the principle described with reference to FIG. 4 is performed using information (image data corresponding to the signal Sc) representing the received image. Is executed, and the relative position between the liquid crystal television 100 as the controlled device and the remote controller 200 as the remote control device is calculated (S102). On the liquid crystal television 100 side (FIG. 2), a command is issued from the system controller 170 in accordance with the relative position between the self 100 and the remote controller 200 calculated in this way, and the location of the remote controller 200 (the vicinity of this position is the viewer's position). Direction of sound generation by adjusting the amplification factors of the left and right amplifiers 141 and 142 and adjusting the volume of the left and right speakers 143 and 144 so that optimal viewing can be performed at the Is adjusted (S103), and the series of operations is terminated.

  According to the above-described control system, image information obtained by performing imaging in an imaging field including the controlled device (the liquid crystal television 100) using the imaging means provided on the remote control device (remote control 200) side is acquired. Is transmitted to the controlled device, the relative position between the remote control device and the controlled device can be calculated on the controlled device side that has received the transmitted image information by the information receiving means. On the controlled device side that recognizes the calculated position of the remote control device, it is possible to perform an operation in a mode suitable for this recognition.

  Here, the operation in a mode suitable for the recognition after recognizing the position of the remote control device is, for example, the direction of sound generation of the left and right speakers 143 and 144 by the remote controller 200 (therefore, holding this remote controller 200). Or a volume balance adjustment that adjusts along the direction of the viewer close to the remote control 200, or a specific viewer who has a high probability of being in that position (for example, the position on the side of the screen of the liquid crystal television 100) This is an operation such as preferentially selecting and displaying contents suitable for the family's owner, the wife at the position facing the center, and the child at the middle position.

  In one modification of the embodiment described with reference to the flowchart of FIG. 5, at the remote control 200 side as a remote control device, one or more scheduled as control targets in the memory 232 that also functions as external information holding means. Information on the outer shape of the controlled device is stored, and the system controller 230 configured to function also as a control target discriminating unit and the image information captured by the imaging unit and the controlled device stored in the memory 232 The controlled device to be controlled is discriminated based on the correlation with the information related to the outer shape of the device.

  If the remote controller 200 is configured in this way, the remote controller 200 itself discriminates the controlled device to be controlled by its own controlled object discriminating means, so that the control instruction code system suitable for the controlled device thus discriminated Recognize the specifications and perform precise control. More specifically, for example, in the transmission of the image information in step S202, the image data acquired in S201 is converted into a control signal Sc using infrared light or the like that conforms to the above-described code system, and is transmitted to the liquid crystal television 100. Since the projection can be performed, the single remote controller 200 can be commonly used for a plurality of controlled devices having different control command code systems.

  In the above-described modification, the memory 232 on the remote controller 200 side stores an image related to the outer shape of one or more controlled devices scheduled as the control target, which is acquired by imaging in advance by appropriate imaging means. May be. In this way, the remote controller 200 discriminates the controlled device to be controlled by its own controlled object discriminating means (system controller 230) from the image relating to the external shape of the controlled device itself that is planned as the controlled object. At that time, it can be used as a criterion for the discrimination, and an accurate discrimination of the controlled object is performed.

  FIG. 6 shows the relative position of the remote control 200 with respect to the liquid crystal television 100 based on the trapezoidal distortion described with reference to FIG. 4 on the display screen (screen 102) of the liquid crystal television 100 as the controlled device in another embodiment. It is a schematic diagram which shows a mode that the position marker used for the label | marker at the time of calculating is projected. In the example of FIG. 6, four position markers 1021, 1022, 1023, and 1024 whose horizontal distance is W and whose vertical distance is H are projected on the screen 102 as illustrated.

  In the system in which the position marker is projected as shown in FIG. 6, the distance W in the horizontal direction and the distance H in the vertical direction related to the marker information are set to the known values W and H described with reference to FIG. Can be used to calculate the relative position between the controlled device (liquid crystal television 100) and the remote control device (remote control 200). Usually, such a simple image of a bright spot can be easily extracted as a peculiar pattern from a captured image, and functions as a trapezoidal distortion calculation means by applying precisely extracted information. Based on the trapezoidal distortion calculation in the system controller 230, the above-described relative position can be determined.

  In the embodiment of FIG. 6, the above-described four position markers 1021, 1022, 1023, and 1024 of the controlled device (liquid crystal television 100) are displayed, but in addition to this, the remote control device (remote control 200). A coded information pattern 1025 that can be recognized on the side is displayed. The coded information pattern 1025 is a two-dimensional barcode such as a QR code (registered trademark).

  Such a coded information pattern 1025 is projected on the controlled device side, and by this coded information pattern 1025, for example, the horizontal and vertical intervals between the four position markers 1021, 1022, 1023, and 1024, By representing information on the specifications of the control device itself (corresponding control command code system), the position of the position markers 1021, 1022, 1023, 1024 and the coded information pattern 1025 on the remote control device (remote control 200) side. If the image is taken in the imaging field of view, information that contributes to recognizing the relative position between the controlled device (liquid crystal television 100) and the remote control device (remote control 200) can be acquired easily and reliably.

  FIG. 7 shows a control system substantially the same as the control system (liquid crystal television system) 100 + 200 described with reference to FIG. 1, in which the remote control device (remote controller 200) communicates with the external device described above with reference to FIG. FIG. 6 is a conceptual diagram showing an embodiment in which a cooperative operation with an external information processing apparatus is performed through an interface 240). In FIG. 7, the corresponding parts to those of FIG. 1 described above are shown with the same reference numerals.

  The liquid crystal television 100 is configured such that its operation can be controlled in response to a control signal by infrared light or the like from a remote controller 200 as a corresponding remote control device. The liquid crystal television 100 has a housing 102 with a screen 102 for projecting images, a left speaker 103 and a right speaker 104 constituting a stereo acoustic device at a position lower than the bottom of the screen 102, and the screen 102. A light receiving window 105 that receives a control signal Sc (illustrated by a two-dot chain line) by infrared light or the like from the remote controller 200 is provided immediately below the bottom right.

  On the other hand, the remote controller 200 has an independent case 201 that can be placed at a position separated from the liquid crystal television 100 (the case 101), and when imaging is performed on the case 201 toward the liquid crystal television 100 side. An imaging unit 210 capable of generating image information including information contributing to recognizing the relative position between the liquid crystal television 100 (the housing 101) as the controlled device and the housing 201 of the device, and the liquid crystal television 100 On the other hand, a control signal projection unit 220 including a light emitting element such as an infrared LED that emits a control signal Sc by infrared light or the like is provided.

  And the control system (liquid crystal television system) 100 + 200 of this invention is comprised including the above-mentioned liquid crystal television 100 and the remote control 200. FIG. Note that the control signal Sc using infrared light or the like includes a signal representing image information as described later in addition to a signal representing information itself for controlling the liquid crystal television 100 according to an arbitrary operation of the operator. This is also the same as the embodiment described with reference to FIG.

  As described above with reference to FIG. 3, the remote controller 200 further includes an external device interface 240 as communication means for performing communication with a personal computer (hereinafter referred to as a personal computer) 300 as an external information processing apparatus. More precisely, the communication means is configured to include the corresponding functional unit of the external device interface 240 and the system controller 230 to which the external device interface 240 is connected. Since the personal computer 300 is further connected to the Internet 400, it is possible to acquire and use various data through the Internet 400 in addition to the data held by the personal computer 300.

According to the control system of FIG. 7, in addition to the operation of the control system of FIG. 1, the burden on the remote control device itself is greatly increased by utilizing the function of the external information processing device through this communication means. It is possible to perform more advanced control with a simple configuration.
FIG. 8 is a flowchart showing an outline of the operation of the control system (liquid crystal television system) 100 + 200 as an embodiment in which the function of the external information processing apparatus is utilized using the communication means of the remote control device. Hereinafter, embodiments of the present invention will be described in more detail with reference to this flowchart and the above-described drawings as appropriate. Note that the flowchart of FIG. 8 is also abstracted to the extent that it corresponds to a plurality of modified examples.

  In FIG. 8, first, on the remote controller 200 side having the configuration of FIG. 3, after the operation is started, imaging by the imaging means 210 (imaging element 211 + imaging circuit 212) is performed (S211). Next, information relating to the outer shape of one or more controlled devices that are scheduled to be controlled is acquired through communication means (corresponding function unit of 240 + 230) by the corresponding function of the system controller 230 as the outer shape information acquiring means (S212). .

  Further, the system controller 230 as the control target discriminating means includes the image of the control target in the image including the control target previously acquired by the imaging means 210 in step S211 in the imaging visual field, and the controlled device acquired in step S212. Based on the correlation with the information relating to the outer shape, the controlled device to be controlled is discriminated (S213). When the controlled device is discriminated in step S213, the remote control device (remote controller 200) can recognize the control command code system and specifications suitable for the controlled device and perform accurate control.

  The remote controller 200 transmits an image including the control target acquired in S211 in the imaging field of view to the liquid crystal television 100 as the control target using a code in a mode conforming to the control command code system suitable for the controlled device (S214). ). The liquid crystal television 100 side receives the image information thus transmitted (S111), calculates the relative position between the remote controller 200 and the liquid crystal television 100 as described above (S112), and according to this relative position. Therefore, the direction of sound generation is adjusted by adjusting the amplification factor of the left and right amplifiers 141 and 142 and adjusting the volume of the left and right speakers 143 and 144 (S113). End the operation.

  FIG. 9 is a flowchart showing an outline of the operation of a control system (liquid crystal television system) 100 + 200 of still another embodiment in which the function of the external information processing apparatus is utilized using the communication means of the remote control apparatus. Hereinafter, embodiments of the present invention will be described in more detail with reference to this flowchart and the above-described drawings as appropriate. Note that the flowchart of FIG. 9 is also abstracted to the extent that it is commonly applicable to a plurality of variations.

  In FIG. 9, first, on the remote controller 200 side having the configuration shown in FIG. 3, after the operation is started, the imaging unit 210 (imaging element 211 + imaging circuit 212) performs imaging (S221). Next, the image data obtained by imaging acquired in step S221 is transferred to the personal computer 300 as an external information processing apparatus through the communication means (corresponding function unit of 240 + 230) (S222).

  When the image data transferred in step S222 is received on the personal computer 300 side, the image data and the data prepared by acquiring it via the Internet 300 as required, the algorithm for the calculation, etc. are appropriately used to generate the image data. The specifications of the related controlled device and other data are prepared and sent back to the remote controller 200 as related information. The remote controller 200 obtains the related information through communication means (corresponding function unit of 240 + 230) (S223). The remote controller 200 transmits the related information acquired in step S223 to the liquid crystal television 100 as the controlled device (S224).

  In the above, the image data acquired by imaging is transferred to the personal computer 300 side in step S222, and the related information of this image data supplied by the response from the personal computer 300 side is acquired through the communication means in step S223. The function of transmitting the related information to the liquid crystal television 100 in step S224 is covered by the system controller 230 as information acquisition and transmission means and each related function unit.

  The liquid crystal television 100 side receives the related information transmitted to itself in step S224 (S121), and based on the received related information, the system controller 170 as the relative position recognition means controls the controlled device (the liquid crystal television 100). ) And the remote control device (remote control 200) are recognized (S122), and the amplification factors of the left and right amplifiers 141 and 142 are adjusted according to this recognition, and the volume of the left and right speakers 143 and 144 is adjusted. Thus, the directivity direction of the sound is adjusted (S123), and the series of operations is terminated.

  In the embodiment described with reference to FIG. 9, the image information related to the controlled device (liquid crystal television 100) acquired by imaging in the remote control device (remote control 200) is communicated with the external information processing device (personal computer 300). By using the advanced information acquisition processing capability of the personal computer 300, it is possible to acquire sufficient information related to the liquid crystal television 100 without excessively increasing the burden on the remote controller 200, and to obtain the liquid crystal by the information acquisition transmission means It can be transmitted to the television 100.

  On the controlled device (liquid crystal television 100) side, the relative position between the controlled device (liquid crystal television 100) and the remote control device (remote control 200) is recognized using the related information by this transmission, and based on this recognition. It is possible to perform an operation in an accurate manner. For example, by utilizing the advanced information acquisition processing capability of an external information processing apparatus (personal computer 300), the controlled apparatus (liquid crystal television 100) and the remote control apparatus (remote control 200) are used as the related information in this information processing apparatus. It is also possible to acquire even information indicating the relative position of.

  In this way, the controlled device (the liquid crystal television 100) side relies on the controlled device (the liquid crystal television 100) based on the information indicating the relative position as the related information that has already been obtained without any further calculation. Recognizing the relative position to the remote control device (remote controller 200), adjusting the amplification factors of the left and right amplifiers 141 and 142 according to this recognition, and adjusting the volume of the left and right speakers 143 and 144, thereby directing the sound A configuration in which the direction is adjusted can be taken, and the configuration on the controlled device (liquid crystal television 100) side can also be simplified.

  FIG. 10 is a conceptual diagram showing an embodiment in which the present invention is applied to an automatic explanation device for an aquarium. The example shown in the figure is a system in which audio explanations are automatically broadcast at an appropriate timing for a creature in a huge panoramic migratory tank. A plurality of sets of marker groups MK1, MK2,... Having four points as described above with reference to FIG. 4 at a predetermined interval at an intermediate level position of the transparent screen SR by the acrylic thick plate. Affixed or projected by appropriate optical means.

In addition, an equipment storage section EM is formed to cover the cables, electrical circuits and other equipment so as to protrude in a band shape along the lower side of the screen SR, and to cover the cables, electric circuits and other equipment. The infrared signal light receiving portions IR1, IR2,... Are further spaced from the shoulder portion so as to substantially correspond to the plurality of sets of marker groups MK1, MK2,.
Speakers LS1, LS for producing commentary audio so as to be adjacent to R1, IR2,.
2, ... are provided.

Each spectator SP1, SP2,... Carries remote controls RC1, RC2,. With the imaging means of each remote control RC1, RC2 ...
When the marker groups MK1, MK2,... Are imaged, the marker groups MK1, MK2 obtained by these imaging
,... Are automatically received by infrared light signals IR signal receiving portions IR1, IR2,
.., And by the equipment provided in the equipment storage unit EM, in the same manner as described with reference to FIG. 4, each of the corresponding remote controllers RC 1, RC 2. , ... are determined.

  When the positions of the spectators SP1, SP2,... Are determined, the field of view of the spectators SP1, SP2,... From the speakers LS1, LS2,. A commentary about the creature that is entering or is about to enter is automatically broadcast. That is, the position of the organism in the aquarium to be explained is determined by detecting the signal generated by the ultrasonic tag attached to each individual by the principle of passive sonar, and using the remote controls RC1, RC2,. Depending on the position of the audience determined based on this signal, the living thing in the field of view is judged and the corresponding explanation is broadcast from the speakers LS1, LS2,.

As shown in the figure, when the spectator SP1 in the left hand of the screen SR images the marker group MK1 by the imaging means using the remote controller RC1, the position is determined as described above.
About the hammerhead shark trying to cross the field of view of the audience SP1 from the speaker LS1 that is closest to the audience SP1, "It is now the hammerhead shark that is trying to cross the front of the customer with the first remote control." This is a great white shark, a species of shark family that lives in the temperate and tropical seas of the world. Some individuals grow up to 6 meters, and it is the largest species among hammerhead sharks .... " Is broadcast with directivity from the speaker LS1 toward the audience SP1.

  In the same way, for the spectator SP2 who is on the right side of the screen SR and the green turtle cm is in front of them, “The green turtle is now in front of the customer with the second remote control.” “Turtle, Sea turtle reptiles inhabit the tropical to temperate seas or the Mediterranean Sea, and some of them extend from 80 cm to 1 meter in length ... "commentary from speaker LS2 to audience SP2 Broadcast with directivity. Even if the explanations as described above are broadcast simultaneously from the speakers LS1 and LS2, the audience SP1 and SP2 are broadcast with the directivity suitable for the explanations of the objects they are paying attention to. It is possible to watch without worrying.

  Although the above is an example applied to a large panoramic aquarium, depending on the position of the audience, even a relatively small aquarium that bred and displays limited types of creatures. If it is configured to broadcast a commentary that is optimal or adaptive and adapts to the audience's field of view, a comfortable automatic commentary system that is extremely easy to hear even under some background noise can be realized.

  In the embodiment applied to the aquarium described above, the explanation may be displayed on a display provided in the remote control. In particular, in a small aquarium, the range of movement of organisms to be explained is limited, so the signal of the ultrasonic tag affixed to each individual organism in a large aquarium is sent with passive sonar. Equipment to capture can be omitted.

  FIG. 11 is a conceptual diagram for explaining an embodiment in which the present invention is applied to a remote control system of an air conditioner (hereinafter referred to as an air conditioner). The illustrated example represents a case where the air conditioner AC is remotely operated using a remote controller MR that can adaptively cope with various control objects. The remote controller MR carried by the user HU in his / her hand has a configuration provided with image pickup means in substantially the same manner as described with reference to FIG. The user HU remotely controls the air conditioner AC with the remote control MR, but automatic adjustment as described below is performed in addition to any manual operation.

  FIG. 12 is a flowchart showing an outline of the operation of the air conditioner remote control system of FIG. In FIG. 12, first, on the remote control MR side having the configuration of FIG. 3, after the operation is started, the imaging unit takes the image of the air conditioner AC (the indoor unit, but hereinafter referred to as the air conditioner AC) in the imaging field of view. (S221). Next, the controlled device is discriminated based on the correlation between the external shape of one or more controlled devices scheduled as control targets held in the memory 232 as the external shape information holding means and the image of the air conditioner AC in the captured image. It is executed (S222).

  When the controlled device is identified in step S222, data (specification information) such as the shape dimension of the air conditioner AC corresponding to the model and the code system of the control signal to be applied (specification information) is read from the memory 232 as specification information holding means. (S223). Next, the relative position of the remote controller MR with respect to the air conditioner AC is calculated based on the principle described with reference to FIG. 4 by the corresponding function of the system controller 230 as the relative position calculating means (S224).

  The remote control MR uses as control object relative position information representing the relative position of the remote control MR with respect to the air conditioner AC calculated in step S224 using a code in a mode conforming to the code system of the control command suitable for the air conditioner AC acquired in step S223. Is transmitted to the air conditioner AC (S224). The air conditioner AC side receives the image information transmitted in this way (S121).

  The air conditioner AC adjusts the angle of the louver LV for adjusting the wind direction provided at the air outlet that blows out the temperature-adjusted air based on the relative position information representing the relative position of the remote control MR with respect to the air conditioner AC received in step S121. (S122), the series of operations relating to the automatic wind direction adjustment is terminated. In addition to the function of automatically adjusting the wind direction as described above, the air conditioner AC receives an infrared light command from the remote control MR through the light receiving window RW in order to adjust the wind direction and the temperature even in the manual mode by switching the mode. Perform appropriate adjustment actions.

  FIG. 13 is a flowchart showing an outline of the operation of the remote control system for an air conditioner in which the burden on the remote control device side is less than that in FIG. In FIG. 13, first, on the remote control MR side having the same configuration as that in FIG. 3, after the operation is started, imaging is performed so that the air conditioner AC is included in the imaging field of view (S231). Next, the controlled device is specified based on the correlation between the external shape of one or more controlled devices scheduled as control targets held in the memory 232 as the external shape information holding means and the image of the air conditioner AC in the captured image. Discrimination is executed (S232).

  When the controlled device is specified in step S232, data (specification information) such as the shape dimensions of the air conditioner AC corresponding to the model and the code system of the control signal to be applied (specification information) is read out from the memory 232 as specification information holding means. (S233). The image information acquired in step S231 by the system controller 230 (corresponding functional unit) as the information transmission means and the control signal projection unit 220 becomes the control signal Sc by infrared light or the like according to the specification information recognized in step S233. Image information is transmitted by being converted and projected (S234).

  The projected signal Sc is received by the light receiving window RW of the air conditioner AC (S131), and based on the image information received in this way, the corresponding functional unit in the system controller or the like as the relative position calculating means on the air conditioner AC side. Then, the relative position of the remote control MR with respect to the air conditioner AC is calculated by the memory unit (the look-up table described above) in accordance with the principle described with reference to FIG. 4 (S132).

  The air conditioner AC is provided at an air outlet that blows out temperature-adjusted air by reacting an internal wind direction adjusting servo mechanism based on relative position information representing the relative position of the remote control MR with respect to the air conditioner AC calculated in step S132. Then, the angle of the wind direction adjusting louver LV is adjusted (S133) so that the wind direction is directed toward the user HU, and the series of operations relating to the wind direction automatic adjustment is completed.

  In each of the above embodiments, Bluetooth (registered trademark), IEEE802.11b, IEEE802.11g, or the like can be applied to communication between apparatuses. In addition, a portable information terminal such as a cellular phone is used as the above-described remote controller, and switching to a call using a wireless IP network is performed according to information representing a relative position, or voice information is provided using Bluetooth (registered trademark). May be equal.

It is a conceptual diagram showing the control system (liquid crystal television receiver system) as embodiment of this invention. It is a block diagram which shows the circuit structure of the liquid crystal television in the control system of FIG. It is a block diagram which shows the circuit structure of the remote control in the control system of FIG. It is a conceptual diagram for demonstrating the principle of the relative position calculation utilized in embodiment of this invention. It is a flowchart showing the outline | summary of operation | movement of the control system (liquid crystal television system) as embodiment of this invention. In other embodiment of this invention, it is a schematic diagram which shows a mode that the position marker used for the label | marker at the time of calculating the relative position with respect to the liquid crystal television of a remote control is projected on the display screen of a to-be-controlled device (liquid crystal television). is there. FIG. 2 is a conceptual diagram illustrating an embodiment in which a remote control device (remote controller) performs a link operation with an external information processing device through a communication unit in a control system substantially similar to the control system of FIG. 1. It is a flowchart showing the outline | summary of operation | movement of the control system as embodiment which utilized the function of the external information processing apparatus using the communication means of the remote control apparatus. It is a flowchart showing the outline | summary of operation | movement of the control system of further another embodiment which utilized the function of the external information processing apparatus using the communication means of a remote control apparatus. It is a conceptual diagram showing embodiment which applied this invention to the automatic description apparatus of the aquarium. It is a conceptual diagram for demonstrating embodiment which applied this invention to the remote control system of the air conditioner. It is a flowchart showing the outline | summary of operation | movement of the remote control system of the air conditioner of FIG. It is a flowchart showing the outline | summary of operation | movement of the remote control system of the air conditioner which reduced the burden by the side of the remote control apparatus rather than the thing of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Television receiver screen 20 ... Camera 21 ... Lens 22 ... Imaging surface 30 ... Image 100 ... Liquid crystal television 101 ... Housing 102 ... Screen 103 ... Left speaker 104 ... Right speaker 105 ... Light receiving window 110 ... Antenna 120 ... Demodulation Filtering unit 130: Video processing unit 140 ... Audio processing unit 141 ... Left amplifier 142 ... Right amplifier 143 ... Left speaker 144 ... Right speaker 150 ... OSD unit 160 ... Liquid crystal display 170 ... System controller 171 ... Operation unit 172 ... Memory 181 ... Light receiving element 182 ... Light receiving circuit 200 ... Remote control 201 ... Housing 210 ... Imaging means 211 ... Imaging element 212 ... Imaging circuit 220 ... Control signal projection unit 230 ... System controller 231 ... Operation key 232 ... Memory 240 ... External device interface 300 ... PC 400 ... Internet 1021,1022,1023,1024 ... Position marker 1025 ... Coded information pattern

Claims (23)

A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. Imaging means capable of generating image information including information that contributes to recognizing a relative position to the apparatus, and information transmission means for transmitting the image information generated by the imaging means to the controlled apparatus side. Prepared,
The controlled device includes an information receiving unit configured to receive image information transmitted from an information transmitting unit of the remote control device, and the controlled device based on the image information received by the information receiving unit. Relative position calculating means for calculating a relative position between the remote control device and the remote control device;
Equipped with a,
The relative position calculation means of the controlled device is the image information received by the information receiving means.
Information that contributes to recognizing the relative position between the controlled device and the remote control device
And the controlled device based on information relating to the external dimensions of the controlled device prepared for use.
It is configured to calculate a relative position with the remote control device.
Control system. A controlled device configured to be controlled from a predetermined remote control device configured separately from the self, and generated by an imaging unit provided in the remote control device and the controlled device and the remote device An information receiving means configured to receive the transmitted image information when image information including information contributing to recognizing a relative position with the control device is transmitted from the remote control device; A relative position calculating means for calculating a relative position between the controlled device and the remote control device based on the image information received by the means ,
The relative position calculating means is the controlled position in the image information received by the information receiving means.
Information that contributes to recognizing the relative position of the control device and the remote control device and prepared in advance for use
And the remote control based on the information related to the external dimensions of the controlled device.
A controlled device characterized in that it is configured to calculate a relative position with respect to the device. The controlled device, the control system according to claim 1, wherein those having information holding means for holding information relating to external dimensions of the previously available in prepared the controlled device. The controlled device according to claim 2 , further comprising information holding means for holding information related to an external dimension of the controlled device prepared to be available in advance. A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. Imaging means capable of generating image information including information that contributes to recognizing a relative position to the apparatus, and information transmission means for transmitting the image information generated by the imaging means to the controlled apparatus side. Prepared,
The controlled device includes an information receiving unit configured to receive image information transmitted from an information transmitting unit of the remote control device, and the controlled device based on the image information received by the information receiving unit. Relative position calculating means for calculating a relative position between the remote control device and the remote control device;
Equipped with a,
The relative position calculation means of the controlled device is the image information received by the information receiving means.
As information that contributes to recognizing the relative position of the controlled device and the remote control device
A trapezoidal distortion operator that performs a calculation to determine the trapezoidal distortion using marker information representing a specific position marker
The controlled device having a stage and the result of the calculation by the trapezoidal distortion calculating means and prepared in advance for use
The relative position between the controlled device and the remote control device is calculated using information on the external dimensions of the device.
A control system characterized by being configured to emit. A controlled device configured to be controlled from a predetermined remote control device configured separately from the self, and generated by an imaging unit provided in the remote control device and the controlled device and the remote device An information receiving means configured to receive the transmitted image information when image information including information contributing to recognizing a relative position with the control device is transmitted from the remote control device; A relative position calculating means for calculating a relative position between the controlled device and the remote control device based on the image information received by the means ,
The relative position calculating means is the controlled position in the image information received by the information receiving means.
A specific position marker as information contributing to recognizing the relative position between the control device and the remote control device.
A trapezoidal distortion calculating means for executing a calculation for obtaining a trapezoidal distortion using marker information representing a marker,
Results of calculation by trapezoidal distortion calculation means and external dimensions of the controlled device prepared to be available in advance
And calculating the relative position between the controlled device and the remote control device.
A controlled apparatus characterized by being configured. A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. Imaging means capable of generating image information including information that contributes to recognizing a relative position to the apparatus, and information transmission means for transmitting the image information generated by the imaging means to the controlled apparatus side. Prepared,
The controlled device includes an information receiving unit configured to receive image information transmitted from an information transmitting unit of the remote control device, and the controlled device based on the image information received by the information receiving unit. Relative position calculating means for calculating a relative position between the remote control device and the remote control device;
Equipped with a,
The remote control device includes a communication unit that communicates with an external information processing device, and an external shape information acquisition unit that acquires information on the external shape of one or more controlled devices that are scheduled for control through the communication unit. Control target discriminating means for discriminating the controlled apparatus to be controlled based on the correlation between the information related to the outer shape of the controlled apparatus acquired by the outer shape information acquiring means and the image information captured by the imaging means. A control system further comprising the control system . A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, wherein the controlled device is imaged when imaging is performed toward the controlled device side. An imaging unit provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the apparatus and the remote control device; and the image information generated by the imaging unit is controlled An information transmission means for transmitting to the device side ,
A communication unit that communicates with an external information processing device, an outer shape information acquisition unit that acquires information about the outer shape of one or more controlled devices that are scheduled to be controlled through the communication unit, and the outer shape information acquisition unit. Control object discrimination means for discriminating the controlled apparatus to be controlled based on the correlation between the acquired information relating to the outer shape of the controlled apparatus and the image information captured by the imaging means. A remote control device characterized by that. A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. Imaging means capable of generating image information including information that contributes to recognizing a relative position to the apparatus, and information transmission means for transmitting the image information generated by the imaging means to the controlled apparatus side. Prepared,
The controlled device includes an information receiving unit configured to receive image information transmitted from an information transmitting unit of the remote control device, and the controlled device based on the image information received by the information receiving unit. Relative position calculating means for calculating a relative position between the remote control device and the remote control device;
Equipped with a,
The remote control device is information related to the outer shape of one or more controlled devices scheduled for control.
External shape information holding means, image information captured by the imaging means, and the external shape information
Control target and all information to be controlled based on the correlation with the information related to the external shape of the controlled device.
A control system further comprising a control object discriminating means for discriminating the controlled device. A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, wherein the controlled device is imaged when imaging is performed toward the controlled device side. An imaging unit provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the apparatus and the remote control device; and the image information generated by the imaging unit is controlled An information transmission means for transmitting to the device side ,
Outline information storage that holds information related to the outline of one or more controlled devices scheduled for control
Possessing means, image information captured by the image capturing means, and the external shape information retaining means.
Discriminate the controlled device to be controlled based on the correlation with the information related to the external shape of the controlled device
The remote control device further comprising a control object discriminating means. The external information holding means of the remote control device holds an image relating to the external shape of one or more controlled devices scheduled as the control target acquired by imaging in advance by an imaging means. The control system according to claim 9 . The external shape information retaining means, in claim 10, characterized in that it possesses an image according to the outline of the controller of one or more that are scheduled as acquired the control target by pre captured by the imaging means The remote control device described. A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control when imaging is performed toward the controlled device provided on the housing. An imaging unit capable of generating image information including information that contributes to recognizing a relative position with the device, a communication unit that communicates with an external information processing device, and image information generated by the imaging unit Information acquisition and transmission means for transferring to the information processing apparatus through the communication means, acquiring related information relating to the controlled apparatus supplied from the information processing apparatus as a response to the transfer, and transmitting the related information to the controlled apparatus side; With
The controlled device uses the information receiving means adapted to receive the relevant information transmitted from the information acquisition / transmission means of the remote control device, and the relevant information received by the information receiving means. Relative position recognition means for recognizing the relative position between the controlled device and the remote control device, and adjustment means for performing a predetermined adjustment operation based on recognition by the relative position recognition means. Feature control system. A controlled device configured to be controlled from a predetermined remote control device configured separately from the self, wherein the remote control device externally transmits image information generated by the imaging means through its own communication means. An information receiving unit configured to receive the related information related to the controlled device acquired from the information processing device as a response to the transfer, and the information received by the information receiving unit Relative position recognition means for recognizing the relative position between the controlled apparatus and the remote control apparatus using related information, and adjustment means for performing a predetermined adjustment operation based on recognition by the relative position recognition means A controlled device characterized in that the controlled device. A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, wherein the controlled device is imaged when imaging is performed toward the controlled device side. An imaging unit provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the device and the remote control device, and a communication unit that communicates with an external information processing device ,
The image information generated by the imaging means is transferred to the information processing apparatus through the communication means, and related information related to the controlled apparatus supplied from the information processing apparatus as a response to the transfer is acquired to obtain the controlled apparatus. An information acquisition / transmission means for transmitting to a side. The information acquisition / transmission means of the remote control apparatus further acquires signal form information representing a form of a signal applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus through the communication means. and, according to claim 13, characterized in that the signal aspect that conforms to the acquired signal form information those adapted to transmit information to the controlled device
The control system described in. The information acquisition / transmission means further acquires signal form information representing a form of a signal applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus through the communication means, and acquires the information The remote control device according to claim 15 , wherein the remote control device is configured to transmit information to the controlled device by a signal in a mode conforming to the signal form information. The controlled device further includes coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit.
The control system according to claim 13 . 15. The controlled device according to claim 14 , further comprising coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit. The controlled device displays a coded information pattern including a plurality of markers and information representing an interval between the plurality of markers by a code recognizable by the control device on its display unit, and coding 14. The control system according to claim 13 , further comprising information pattern projecting means. A marker and a coded information pattern projecting means for projecting a coded information pattern including a plurality of markers and information representing an interval between the plurality of markers by a code recognizable by the control device on its own display unit The controlled device according to claim 14 , further comprising: A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. Imaging means capable of generating image information including information that contributes to recognizing a relative position with respect to the apparatus, and outline information holding means for holding information relating to the outline of one or more controlled apparatuses scheduled as control targets A control object discriminating means for discriminating a controlled device to be controlled based on the correlation between the image information acquired by the imaging means and the information held in the outline information holding means, and the outline information holding means A phase between the controlled device and the remote control device using the information related to the outer shape of the device discriminated as the controlled device by the held control target discriminating unit and the image information acquired by the imaging unit. A relative position calculating means for calculating a position; and an information transmitting means for transmitting information indicating a relative position between the controlled apparatus calculated by the relative position calculating means and the remote control apparatus to the controlled apparatus. Prepared,
The controlled device is configured to receive information indicating a relative position between the controlled device and the remote control device transmitted from the information transmission unit of the remote control device;
A control system comprising: adjusting means for executing a predetermined adjusting operation based on information received by the information receiving means. A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, wherein the controlled device is imaged when imaging is performed toward the controlled device side. An imaging means provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the device and the remote control device, and one or more controlled devices scheduled for control Control for discriminating controlled devices to be controlled based on the correlation between image information acquired by the imaging unit and information stored in the external shape information storage unit, external shape information storage unit that stores external information Using the object discriminating means, the information relating to the outer shape of the device discriminated as the controlled device by the control target discriminating means held in the outer shape information holding means, and the image information acquired by the imaging means. Relative position calculating means for calculating a relative position between the controlled apparatus and the remote control apparatus, and information representing a relative position between the controlled apparatus and the remote control apparatus calculated by the relative position calculating means An information transmission means for transmitting to a controlled device.

Images