JP2008172817A - Control system and controlled apparatus suitable for the control system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve a control system which can recognize the relative position between a remote controller and a television set, suitably select the content or adjust the sound effects on the television side according to the recognition, by utilizing imaging means provided in a remote controller. <P>SOLUTION: An image of an outer shape of a liquid crystal television set 100 is photographed by the imaging means 210 provided in the remote controller 200 and the photographed image is supplied, together with a control signal Sc from a control signal projector 220 to the liquid crystal television set 100; then the relative position of the remote controller 200 (hence, the viewer), with respect to the liquid crystal television set 100, is calculated on the side of the television set 100, based on the extent of trapezoidal distortions on the photographed image and the sound volume balance of right and left speakers 103 and 104 is adjusted so as to suit the calculated relative position and sound directivity is directed toward the viewer. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a control system including, for example, a television receiver as a controlled device and a remote controller (hereinafter referred to as a remote controller) as a corresponding remote control device, a controlled device compatible with this system, and a remote control device. As an example of the control device, the position of the viewer who is highly likely to be in a place that roughly matches the place where the remote control exists is estimated, and the position of the remote control device (and hence the user having the remote control) is adapted. The present invention relates to a control system that makes it possible to select content and adjust sound effects, and a controlled device and a remote control device compatible with this system.

  A number of techniques have already been proposed for providing various conveniences to the user with respect to the operation of a system composed of a remote control device and a remote controlled device by making the remote control device multifunctional. For example, the remote controller uses a GPS algorithm or the like to detect its own position based on radio wave reception from three radio wave sources and the reception time, and the detected position and position information of each device prepared in advance To identify the device closest to itself, obtain information defining the remote control signal and information for constructing the operation image from that device, and display the operation image of the specified device on the display Then, by specifying the remote control signal according to the user operation and causing the remote control signal transmission control unit to control transmission, the user can more accurately specify the device that the user wants to control without increasing the number of button operations by the user. A technique has been proposed that enables the device to be controlled (see Patent Document 1).

  Also, in a system in which a projector is operated by a remote controller, the projector receives the projection area imaging information and orientation information acquired by the remote controller having the image sensor at its own receiver, and looks in advance based on the received information. There has been proposed an image processing system in which a trapezoidal distortion correction value prepared in an up table is selected and the keystone distortion is corrected based on the correction value (see Patent Document 2).

  Furthermore, in a pointing device that points to an arbitrary point on the display screen with a laser pointer, a display screen including a laser spot projected from the remote control is imaged by a CCD camera provided on the remote control side, and raster scanning of the image by this imaging, etc. To calculate the coordinates of the laser spot, wirelessly transmit the data representing the coordinates from the remote control side to the television side, and display the indication point on the screen, thereby enabling pointing from various angles Has been proposed (see Patent Document 3).

  In response to the proposal of Patent Document 3 described above, the coordinates of the three corner positions of the image display surface on the raster imaged by the imaging device provided on the remote control side and the coordinates of the three corner positions of the actual image display surface Based on the comparison, it is possible to perform pointing on the display screen without projecting a laser spot or the like from the remote control side by calculating which coordinate on the actual screen the raster center coordinate of the captured image corresponds to. It has been proposed (see Patent Document 4).

JP 2004-166193 A (paragraphs 0016 to 0018, FIGS. 1 and 2) Japanese Patent Laying-Open No. 2004-187052 (paragraph 0039 to paragraph 0045, FIG. 1) Japanese Patent Laying-Open No. 2001-236181 (paragraphs 0004 to 0009, FIG. 1) JP 2003-208260 A (paragraphs 0013 to 0021, FIGS. 1 and 2)

  From the viewpoint of enabling the selection of contents and adjustment of sound effects to suit the position of the user (and hence the remote controller), the conventional technology described above has various types as described below. There are still challenges. That is, in the technique described in Patent Document 1, it is essential in principle that three radio wave sources are installed in advance as a reference for position detection. It is difficult to select a device that conforms to the control target with appropriate accuracy.

  Further, the technique proposed in Patent Document 1 is configured to unconditionally select any device closest to the position of the remote control (and therefore the user) as a control target, so that it can be adapted to the original intention of the user. The selected device is not necessarily selected. Therefore, when it is used for actual use, the user himself / herself must approach the device himself / herself, and it cannot be expected that the control target intended for operation is automatically selected literally.

  The technique proposed in Patent Document 2 acquires azimuth information of a remote controller as much as necessary to correct trapezoidal distortion in a projector, and executes correction of trapezoidal distortion based on the acquired azimuth information. There is no suggestive disclosure about recognizing the position of the remote control (and hence the user) relative to the device body and selecting content or adjusting the sound effect to match the recognition.

  Further, in the proposal of Patent Document 3, the display screen including the projected laser spot is imaged by the imaging unit on the remote control side, and the position coordinate data of the laser spot is acquired based on the raster scanning related to the video signal by this imaging. This is different from the technique of recognizing the position of the remote control relative to the device body and selecting content or adjusting the sound effect so as to match the recognition.

  On the other hand, the proposal of Patent Document 4 is limited as long as it enables pointing on the display screen without projecting a laser spot or the like from the remote control side as in Patent Document 3. However, there are no proposals for recognizing the position of the remote control relative to the device body and selecting content or adjusting the sound effect so as to match the recognition.

  The present invention has been made paying attention to the problems in the prior art as described above, and uses the imaging means provided on the remote control device side to position the remote control device relative to the controlled device. A control system that enables an automatic response operation, for example, to enable recognition, and in other words, to select content or adjust sound effects in a controlled device so as to conform to the recognition, and It is an object of the present invention to provide a controlled device and a remote control device compatible with this system.

In order to solve the above problems, the present application proposes the following technologies.
(1) A control system including a remote control device and a controlled device that can be controlled by the remote control device, wherein the remote control device is a housing configured separately from the controlled device. It is possible to generate image information including information that contributes to recognizing the relative position of the controlled device and the remote control device when imaging toward the controlled device side provided on the body and the controlled device side And an information transmission means for transmitting image information generated by the imaging means to the controlled device side, wherein the controlled device is transmitted from the information transmission means of the remote control device. Information receiving means adapted to receive the received image information, and relative position calculating means for calculating the relative position between the controlled device and the remote control device based on the image information received by the information receiving means; Control system, characterized in that with the.

  According to the control system of (1) above, the imaging means provided on the remote control device side is used to take an image in an imaging field including the controlled device, and image information acquired by the imaging is transmitted to the controlled device. By doing so, the relative position between the remote control device and the controlled device can be calculated on the controlled device side that has received the transmitted image information by the information receiving means. On the controlled device side that recognizes the calculated position of the remote control device, it is possible to perform an operation in a mode suitable for this recognition.

  (2) A controlled device configured to be controlled from a predetermined remote control device configured separately from itself, the controlled device generated by an imaging unit provided in the remote control device And information receiving means adapted to receive the transmitted image information when image information including information contributing to recognizing a relative position between the remote control device and the remote control device is transmitted from the remote control device side; A controlled device comprising: a relative position calculating unit that calculates a relative position between the controlled device and the remote control device based on image information received by the information receiving unit.

  According to the controlled device of (2) above, when image information including information that contributes to recognizing the relative position between the controlled device and the remote control device is transmitted from the remote control device side, its own information The received image information is received by the receiving means, and the relative position between the controlled apparatus and the remote control apparatus is calculated by the relative position calculating means based on the received image information. It is possible to recognize the calculated position of the remote control device and perform an operation in a mode suitable for this recognition.

  (3) A remote control device configured to be able to perform predetermined control on the controlled device and configured separately from the controlled device, when imaging is performed toward the controlled device side An imaging unit provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the controlled device and the remote control device, and image information generated by the imaging unit An information transmission means for transmitting to the controlled device side.

  According to the remote control device of (3) above, imaging is performed in an imaging field including the remote control device by utilizing its own imaging means, and image information acquired by the imaging is transmitted to the controlled device by the information transmission means. Is possible. On the controlled device side that has received the transmitted image information, the position of the remote control device is calculated relative to the controlled device, the calculated position of the remote control device is recognized, and an aspect suitable for this recognition It becomes possible to perform an operation.

  (4) The relative position calculation means of the controlled device can be used in advance with information that contributes to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means. (1), wherein the relative position between the controlled device and the remote control device is calculated based on the information relating to the external dimensions of the controlled device prepared in (1). The control system described in.

  According to the control system of (4) above, in addition to the operation of the control system described in (1), the controlled device is prepared in advance so as to be able to use information related to its external dimensions, and the information reception When information contributing to recognizing the relative position between the controlled device and the remote control device is received by the means, the relative of the controlled device is determined based on the received information and the information prepared in advance. The position calculation means calculates the relative position between the remote control device and the controlled device. The controlled device can recognize the calculated position of the remote control device and perform an operation in a mode suitable for the recognition.

  (5) The relative position calculation means is prepared in advance so as to be usable with information contributing to recognizing the relative position between the controlled apparatus and the remote control apparatus in the image information received by the information receiving means. The controlled device according to (2), which is configured to calculate a relative position between the controlled device and the remote control device based on information related to an external dimension of the controlled device. Control device.

  According to the controlled device of (5) above, in addition to the operation of the controlled device described in (2), the controlled device is prepared in advance so as to be able to use information relating to its external dimensions, When information contributing to recognizing the relative position of the controlled device and the remote control device is received by the information receiving means, the controlled device is based on the received information and the previously prepared information. The relative position calculating means calculates the relative position between the remote control device and the controlled device. The controlled device can recognize the calculated position of the remote control device and perform an operation in a mode suitable for the recognition.

(6) The controlled device includes an information holding unit that holds information related to an external dimension of the controlled device that is prepared to be available in advance. Control system.
According to the control system of (6) above, in addition to the operation of the control system described in (4), the controlled device can previously use information relating to the external dimensions of the controlled device for its own information holding means. The information held in this way can be used for calculation to calculate the relative position between the controlled device and the remote control device at a required timing.

(7) The controlled device according to (5), further comprising information holding means for holding information related to an external dimension of the controlled device prepared to be available in advance.
According to the controlled device of (7) above, in addition to the operation of the controlled device described in (5), the information relating to the external dimensions of the controlled device is held in advance in its own information holding means. Thus, the information held in this way can be used for calculation to calculate the relative position between the controlled device and the remote control device at a required timing.

  (8) The relative position calculation means of the controlled device is specified as information that contributes to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means. A device configured to calculate a relative position between the controlled device and the remote control device using marker information representing a position marker and information related to the external dimensions of the controlled device prepared in advance. (1) The control system according to (1).

  According to the control system of (8) above, in addition to the operation by the control system described in (1), the relative position calculation means of the controlled device includes the controlled information in the image information received by the information receiving means. When marker information representing a specific position marker (corresponding to a known position) is included as information contributing to recognizing the relative position between the device and the remote control device, this marker information can be used in advance. The relative position between the controlled device and the remote control device can be calculated using the prepared information related to the external dimensions of the controlled device.

  (9) The relative position calculation means represents a specific position marker as information contributing to recognizing the relative position between the controlled apparatus and the remote control apparatus in the image information received by the information receiving means. It is configured to calculate a relative position between the controlled device and the remote control device using marker information and information related to the external dimensions of the controlled device prepared to be available in advance. The controlled apparatus according to (2), which is characterized.

  According to the controlled device of (9) above, in addition to the operation of the controlled device described in (2), the controlled device and the remote control device are included in the image information received by its own information receiving means. When marker information representing a specific position marker (corresponding to a known position) is included as information that contributes to recognizing the relative position, the marker information and the controlled device prepared in advance to be available The relative position between the controlled device and the remote control device can be calculated using the information related to the external dimensions of the remote control device.

  (10) The relative position calculation means of the controlled device is specified as information that contributes to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means. It has a trapezoidal distortion calculating means for executing a calculation for obtaining a trapezoidal distortion using marker information representing a position marker, and the result of the calculation by the trapezoidal distortion calculating means and the external dimensions of the controlled device prepared in advance are available. The control system according to (1), wherein the information is used to calculate a relative position between the controlled device and the remote control device.

  According to the control system of (10) above, in addition to the operation of the control system described in (1), the relative position calculation means of the controlled device includes the controlled information in the image information received by the information receiving means. When marker information representing a specific position marker (corresponding to a known position) is included as information contributing to recognizing the relative position between the device and the remote control device, the marker information is calculated by the trapezoidal distortion calculation means. The trapezoidal distortion is obtained using the information indicating the trapezoidal distortion and the information on the external dimensions of the controlled apparatus prepared in advance that can be used to determine the relative position between the controlled apparatus and the remote control apparatus. Can be calculated.

  (11) The relative position calculation means represents a specific position marker as information contributing to recognizing the relative position between the controlled apparatus and the remote control apparatus in the image information received by the information receiving means. A trapezoidal distortion calculating means for executing a calculation for obtaining a trapezoidal distortion using the marker information, and a result of the calculation by the trapezoidal distortion calculating means and information related to an external dimension of the controlled device prepared in advance. The controlled device according to (2), wherein the controlled device is configured to calculate a relative position between the controlled device and the remote control device.

  According to the controlled device of (11) above, in addition to the operation of the controlled device described in (2), the self relative position calculating means includes the controlled information in the image information received by the information receiving means. When marker information representing a specific position marker (corresponding to a known position) is included as information contributing to recognizing the relative position between the device and the remote control device, the marker information is calculated by the trapezoidal distortion calculation means. The trapezoidal distortion is obtained using the information indicating the trapezoidal distortion and the information on the external dimensions of the controlled apparatus prepared in advance that can be used to determine the relative position between the controlled apparatus and the remote control apparatus. Can be calculated.

(12) The controlled device includes a position marker projecting unit that projects a specific position marker serving as information contributing to recognizing a relative position between the controlled device and the remote control device on its display unit. The control system according to (1), further comprising:
According to the control system of (12) above, in addition to the operation of the control system described in (1), the relative position between the controlled device and the remote control device is displayed by the position marker projecting means of the controlled device. Since a specific position marker serving as information that contributes to recognizing the image is displayed on its own display unit, the controlled device and the remote control device can be used when the remote control device performs imaging in an imaging field including the position marker. Information that contributes to recognizing the relative position can be acquired.

(13) The display unit further includes a position marker projecting unit that projects a specific position marker serving as information contributing to recognizing a relative position between the controlled device and the remote control device. (2) The controlled device according to (2).
According to the controlled device of (13) above, in addition to the operation of the controlled device described in (2), the relative position between the controlled device and the remote control device is recognized by the position marker projecting means. Since a specific position marker serving as information that contributes to the image is displayed on its own display unit, if the imaging is performed in the imaging field of view including the position marker on the remote control device side, the relative between the controlled device and the remote control device Information that contributes to recognizing the position can be acquired.

(14) The controlled device further includes coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit (1) The control system described in.
According to the control system of (14), in addition to the operation of the control system described in (1), it is possible to perform more various or highly accurate control using the coded information pattern.

(15) The controlled device according to (2), further comprising coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit. .
According to the controlled device of (15), in addition to the operation of the controlled device described in (2), it is possible to perform more various or highly accurate control using the coded information pattern.

(16) The control system according to (1), wherein the remote control device further includes communication means for performing communication with an external information processing device.
According to the control system of (16), in addition to the operation of the control system described in (1), the remote control device itself is utilized by utilizing the function of the external information processing device through the communication means of the remote control device. It is possible to perform more advanced control with a simple configuration without significantly increasing the burden of the above.

(17) The remote control device according to (3), further comprising communication means for performing communication with an external information processing device.
According to the remote control device of the above (17), in addition to the operation of the remote control device described in (3), the remote control device itself is utilized by utilizing the function of the external information processing device through its own communication means. It is possible to perform more advanced control with a simple configuration without significantly increasing the burden of the above.

  (18) The remote control device includes outer shape information acquisition means for acquiring information related to the outer shape of one or more controlled devices scheduled as control targets through the communication means, and the controlled information acquired by the outer shape information acquisition means. The apparatus further includes a control target discriminating unit that discriminates a controlled apparatus to be controlled based on a correlation between information relating to an outer shape of the apparatus and image information captured by the imaging unit. The control system according to (16).

  According to the control system of (18) above, in addition to the action by the control system described in (16), the remote control device itself discriminates the controlled device to be controlled by its own control target discriminating means. Accurate control can be performed by recognizing the code system and specifications of the control commands suitable for the discriminated controlled device.

(19) Outline information acquisition means for acquiring information relating to the outline of one or more controlled apparatuses scheduled as control targets through the communication means, and information relating to the outline of the controlled apparatus acquired by the outline information acquisition means (17), further comprising: control target discriminating means for discriminating a controlled device to be controlled based on a correlation between the image information captured by the imaging unit and the image information captured by the imaging unit. Remote control device.
According to the remote control device of the above (19), in addition to the action by the remote control device described in (17), the control target discriminating means discriminates the controlled device to be controlled by the own control target discriminating means. Accurate control can be performed by recognizing the code system and specifications of control commands suitable for the controlled device.

  (20) The remote control device includes outer shape information holding means for holding information related to the outer shape of one or more controlled devices scheduled as control targets, image information captured by the imaging means, and the outer shape information holding means. (1), further comprising a control target discriminating means for discriminating a controlled device to be controlled based on a correlation with information relating to an external shape of the controlled device held in The described control system.

  According to the control system of (20) above, in addition to the operation by the control system described in (1), the remote control device itself discriminates the controlled device to be controlled by its own control target discriminating means. Accurate control can be performed by recognizing the code system and specifications of the control commands suitable for the discriminated controlled device.

  (21) Outline information holding means for holding information related to the outline of one or more controlled devices scheduled as control targets, image information captured by the imaging means, and controlled information held by the outline information holding means (3) The remote control device according to (3), further comprising controlled object discrimination means for discriminating controlled devices to be controlled based on correlation with information relating to the external shape of the device.

  According to the remote control device of the above (21), in addition to the operation by the remote control device described in (3), it is discriminated in order to discriminate the controlled device to be controlled by its own control target discriminating means. Accurate control can be performed by recognizing the code system and specifications of control commands suitable for the controlled device.

(22) The external information holding means of the remote control device has an image relating to the external shape of one or more controlled devices scheduled as the control target acquired by imaging in advance by the imaging means. The control system according to (20), characterized in that
According to the control system of (22) above, in addition to the action of the control system described in (20), the remote control device displays an image relating to the outer shape of the controlled device itself that is planned to be controlled. The discriminating means can be used as a reference for discriminating the controlled device to be controlled, and accurate discrimination of the controlled object is performed.

(23) The outer shape information holding unit holds an image related to the outer shape of one or more controlled devices scheduled as the control target acquired by imaging in advance by an imaging unit ( 21) The remote control device described in 21).
According to the remote control device of (23) above, in addition to the operation of the remote control device described in (21), the remote control device displays an image relating to the external shape of the controlled device itself that is planned to be controlled. The control target discriminating means can be used as a reference for discriminating the controlled device to be controlled, and the control target is accurately discriminated.

  (24) A control system including a remote control device and a controlled device that can be controlled by the remote control device, wherein the remote control device is a housing configured separately from the controlled device. It is possible to generate image information including information that contributes to recognizing the relative position of the controlled device and the remote control device when imaging toward the controlled device side provided on the body and the controlled device side The image processing unit configured to communicate with the external information processing apparatus, the image information generated by the image capturing unit is transferred to the information processing apparatus through the communication unit, and the information processing is performed as a response to the transfer. Information acquisition / transmission means for acquiring related information relating to the controlled device supplied from a device and transmitting it to the controlled device side, wherein the controlled device is an information acquisition / transmission unit of the remote control device. The information receiving means adapted to receive the related information transmitted from the mobile station and the relative position between the controlled device and the remote control device using the related information received by the information receiving means A control system comprising: a relative position recognizing unit that performs a predetermined adjusting operation based on recognition by the relative position recognizing unit.

According to the control system of (24), image information relating to the controlled device acquired by imaging in the remote control device is supplied to an external information processing device through communication means, and an advanced information acquisition process by the information processing device By using the capability, the relevant information of the sufficient content related to the controlled device is acquired without excessively increasing its own burden, and transmitted to the controlled device side by the information acquisition and transmission means.
On the controlled device side, it is possible to recognize the relative position between the controlled device and the remote control device using the related information by this transmission, and to perform an accurate operation based on this recognition. Become.

  (25) A controlled device configured to be controlled from a predetermined remote control device configured separately from itself, and the image information generated by the imaging means by the remote control device is communicated by itself. Information receiving means adapted to receive the related information relating to the controlled device acquired from the information processing apparatus as a response to the transfer, and received by the information receiving means Relative position recognition means for recognizing the relative position between the controlled apparatus and the remote control apparatus using the related information, and adjustment means for performing a predetermined adjustment operation based on recognition by the relative position recognition means; A controlled apparatus characterized by comprising:

  According to the controlled device of (25) above, sufficient information related to the controlled device acquired by cooperation with an external information processing device having relatively high information acquisition processing capability in the remote control device Is received by its own information receiving means, and the relative position with respect to the remote control device is recognized based on the received related information having sufficient contents related to the controlled device, and an appropriate mode of operation is performed based on this recognition. It becomes possible.

  (26) A remote control device configured to be able to perform predetermined control on the controlled device and configured separately from the controlled device, and is provided in its own casing and directed toward the controlled device side Communication between an imaging unit capable of generating image information including information contributing to recognizing a relative position between the controlled device and the remote control device and an external information processing device. And communication information to be performed, and image information generated by the imaging means is transferred to the information processing apparatus through the communication means, and related information related to the controlled apparatus supplied from the information processing apparatus is acquired as a response to the transfer. An information acquisition and transmission means for transmitting to the controlled device side.

According to the remote control device of the above (26), the image information related to the controlled device acquired by imaging by its own imaging means is supplied to the external information processing apparatus through the communication means, and advanced information acquisition by the information processing apparatus is performed. By using the processing capability, the relevant information with sufficient contents related to the controlled device is acquired without excessively increasing its own burden and transmitted to the controlled device side by the information acquisition and transmission means.
On the controlled device side, it is possible to recognize the relative position between the controlled device and the remote control device using the related information by this transmission, and to perform an accurate operation based on this recognition. Become.

  (27) Signal form information representing a form of a signal applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus through the communication means, the information acquisition / transmission means of the remote control apparatus The control system according to (24), further configured to transmit the information to the controlled device by a signal in a mode based on the acquired signal form information.

  According to the control system of (27) above, in addition to the operation of the control system described in (24), the information acquisition / transmission means of the remote control device utilizes the advanced information acquisition processing capability of the external information processing device. And further acquiring signal form information representing a signal form (code system or the like) applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus, and the acquired signal form information The remote control device and the controlled device can accurately exchange information with a signal in a mode compliant with the above.

  (28) The information acquisition / transmission means further acquires signal form information representing a form of a signal applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus through the communication means. The remote control device according to (26), wherein the remote control device is configured to transmit information to the controlled device by a signal in a mode based on the acquired signal form information.

  According to the remote control device of (28) above, in addition to the operation of the remote control device described in (26), the information acquisition / transmission means of its own uses the advanced information acquisition processing capability of the external information processing device. Further acquiring signal form information representing a signal form (code system or the like) applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus, and the acquired signal form information Accurate information can be exchanged with the controlled device by a signal in a compliant manner.

(29) The controlled device further includes coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit (24). The control system described in.
According to the control system of (29), in addition to the operation of the control system described in (24), it is possible to perform more various or highly accurate control using the coded information pattern.

(30) The controlled device according to (25), further comprising coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit. .
According to the controlled device of (30), in addition to the operation of the controlled device described in (25), it is possible to perform more various or highly accurate control using the coded information pattern.

(31) The controlled device displays a coded information pattern including information representing an interval between the plurality of markers and a code recognizable by the control device on its display unit. The control system according to (24), further comprising a coded information pattern projecting unit.
According to the control system of (31) above, in addition to the operation of the control system described in (24), the use of markers and coded information patterns displayed on the display unit of the controlled device further increases the accuracy or accuracy. High control can be performed.

(32) A marker for displaying a coded information pattern including information representing an interval between the plurality of markers and a plurality of markers and a code recognizable by the control device on the display unit thereof, and the coded information pattern projection The controlled apparatus according to (25), further comprising an exit means.
According to the controlled device of (32) above, in addition to the operation of the controlled device described in (25), the use of markers and coded information patterns displayed on its own display unit makes it more diverse or accurate. High control can be performed.

  (33) A control system including a remote control device and a controlled device that can be controlled by the remote control device, wherein the remote control device is a casing configured separately from the controlled device. It is possible to generate image information including information that contributes to recognizing the relative position of the controlled device and the remote control device when imaging toward the controlled device side provided on the body and the controlled device side The image capturing means made, the external shape information storing means for storing information related to the external shape of one or more controlled devices scheduled as control targets, the image information acquired by the image capturing means and the external shape information storing means Control target discriminating means for discriminating controlled devices to be controlled based on the correlation with the detected information, and devices discriminated as controlled devices by the control target discriminating means held in the outer shape information holding means. The relative position calculation means for calculating the relative position between the controlled device and the remote control device using the information related to the outer shape of the image and the image information acquired by the imaging means, and the relative position calculation means. Information transmitting means for transmitting information representing a relative position between the controlled device and the remote control device to the controlled device, wherein the controlled device is transmitted from the information transmitting means of the remote control device. An information receiving means adapted to receive information representing a relative position between the controlled device and the remote control device, and an adjustment for executing a predetermined adjusting operation based on the information received by the information receiving means. And a control system.

  According to the control system of (33) above, the imaging means provided on the remote control device side is used to perform imaging in an imaging field including the controlled device, and image information acquired by the imaging and self-external information in advance. Discrimination of controlled devices to be controlled by comparison with information related to the external shape of one or more controlled devices held in the holding means, and information on the external shape and the like related to the controlled device according to the discrimination result and the imaging The relative position between the controlled device and the remote control device is calculated using the image information acquired by the control unit, and the calculated information indicating the relative position between the controlled device and the remote control device is transmitted to the controlled device. Thus, on the controlled device side that has received the transmitted information representing the relative position by the information receiving means, an adjustment operation in a mode suitable for the relative position between the controlled device and the remote control device can be performed. It becomes possible.

  (34) A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, when imaging is performed toward the controlled device side Imaging means provided on its own housing capable of generating image information including information contributing to recognizing the relative position between the controlled device and the remote control device, and one or more controlled devices scheduled for control. An external information holding unit that holds information relating to the external shape of the control device, and a controlled device to be controlled based on the correlation between the image information acquired by the imaging unit and the information held in the external shape information holding unit. Control target discriminating means for discrimination, information relating to the outer shape of the apparatus discriminated as a controlled device by the control target discriminating means held in the outer shape information holding means, and image information acquired by the imaging means Relative position calculation means for calculating a relative position between the controlled apparatus and the remote control apparatus using information, and information representing a relative position between the controlled apparatus and the remote control apparatus calculated by the relative position calculation means An information transmission means for transmitting the information to the controlled device.

  According to the remote control device of (34), imaging is performed in an imaging field including the controlled device by utilizing its own imaging means, and the image information acquired by the imaging and the own external shape information holding means are held in advance. In addition, the controlled device to be controlled is discriminated by comparison with the information related to the outer shape of one or more controlled devices, and information such as the outer shape of the controlled device according to the discrimination result and the image information acquired by the imaging Can be used to calculate the relative position between the controlled device and the remote control device, and to transmit information indicating the calculated relative position between the controlled device and the remote control device to the controlled device. For this reason, on the controlled device side that has received the transmitted information representing the relative position by the information receiving means, it is possible to perform an adjustment operation in a mode suitable for the relative position between the controlled device and the remote control device. become.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings to be referred to below, for the sake of convenience, the main part that is the subject of the description is exaggerated as appropriate, and other than the main part is appropriately simplified or omitted.
FIG. 1 shows a control system (liquid crystal television) as an embodiment of the present invention including a controlled device (liquid crystal television receiver main body) and a remote control device (remote control corresponding to the liquid crystal television receiver main body). 1 is a conceptual diagram showing a John receiver system). In FIG. 1, a liquid crystal television receiver main body (hereinafter referred to as a liquid crystal television) 100 as a remote control device receives a control signal by infrared light or the like from a remote controller 200 as a remote control device corresponding to the main body. It is configured to be controlled.

  The liquid crystal television 100 has a housing 102 with a screen 102 for projecting images, a left speaker 103 and a right speaker 104 constituting a stereo acoustic device at a position lower than the bottom of the screen 102, and the screen 102. A light receiving window 105 that receives a control signal Sc (illustrated by a two-dot chain line) by infrared light or the like from the remote controller 200 is provided immediately below the bottom right.

  On the other hand, the remote controller 200 has an independent case 201 that can be placed at a position separated from the liquid crystal television 100 (the case 101), and when imaging is performed on the case 201 toward the liquid crystal television 100 side. An imaging means 210 capable of generating image information including information (described later) that contributes to recognizing the relative position between the liquid crystal television 100 (the casing 101) as the controlled apparatus and the casing 201 of the self-control apparatus; A control signal projection unit 220 including a light emitting element such as an infrared LED that emits a control signal Sc by infrared light or the like to the television 100 is provided.

And the control system (liquid crystal television system) 100 + 200 of this invention is comprised including the above-mentioned liquid crystal television 100 and the remote control 200. FIG. Note that the control signal Sc using infrared light or the like includes a signal representing image information as described later in addition to a signal representing information itself for controlling the liquid crystal television 100 according to an arbitrary operation of the operator. .
FIG. 2 is a block diagram showing a circuit configuration of the liquid crystal television 100 of FIG. The broadcast wave received by the antenna 110 is demodulated by the demodulation / filtering unit 120, a transport stream is extracted, and filtering is performed to acquire video and audio of the channel selected by the viewer (user) and program information. . The video output of the demodulation / filtering unit 120 is supplied to the video processing unit 130, the audio output is supplied to the audio processing unit 140, and the program information is supplied to the OSD unit 150.

  An image is displayed on the liquid crystal display 160 via the liquid crystal driving unit 131 by the output of the image processing unit 130. Further, based on the output of the OSD unit 150, program information and other information are displayed on the screen of the liquid crystal display 160 so as to be superimposed on the above-mentioned video or to occupy one screen in the screen. On the other hand, the output of the audio processing unit 140 is supplied to the corresponding left and right speakers 143 and 144 via the left and right amplifiers 141 and 142 to produce stereo sound.

  A system controller 170 is provided that comprehensively controls the entire system of the liquid crystal television 100 including the demodulation / filtering unit 120, the audio processing unit 140, and the OSD unit 150 described above. The system controller 170 is supplied with an output of an operation unit 171 configured to include operation keys for accepting an operation by a viewer (user), and a memory 172 is connected so as to be accessible. Data (information) is stored and read at the timing.

  On the other hand, referring to FIG. 1, the output of the light receiving element 181 provided so as to receive the control signal Sc behind the light receiving window 105 described above is connected to the system via the light receiving circuit 182 including a signal amplifying circuit. The controller 170 is connected so as to be supplied. The control signals from the system controller 170 are supplied to the left and right amplifiers 141 and 142 and the amplification rate is adjusted to adjust the balance of stereo sound. In this example, detailed description will be given later. As described above, this balance adjustment can be appropriately performed according to the location (position / direction) of the remote controller (viewer having the remote controller).

  In the above description, the position markers 1021, 1022, 1023, which will be described in detail later with reference to FIG. 6, including the corresponding functional unit of the system controller 170 that comprehensively controls the entire system of the liquid crystal television 100 and the OSD unit 150. Coded information pattern projection for projecting on the screen 102 a position marker projecting means for projecting 1024 on the screen 102 and a coded information pattern 1025 taking a two-dimensional barcode such as QR code (registered trademark) as an example. Out means are configured.

  FIG. 3 is a block diagram illustrating a circuit configuration of the remote controller 200. A control signal projection unit 220 including a light emitting element such as an infrared LED that emits a control signal Sc based on infrared light or the like described with reference to FIG. 1 controls the circuit system of the remote controller 200 in an integrated manner and performs various calculations. A system controller 230 including a microprocessor to be executed as a main component is connected, and a required control signal Sc is issued in response to a command from the system controller 230.

In addition, an imaging element 211 and an imaging circuit 212 are provided as the imaging unit 210 described with reference to FIG. The imaging circuit 212 drives the imaging device 211 under the control of the system controller 230 to perform imaging, reads out an image signal acquired by the imaging, performs necessary signal conversion, and supplies the generated image data to the system controller 230. To do.
The system controller 230 is supplied with an operation signal from an operation key 231 for performing a channel switching operation or the like provided on the casing 201 of the remote controller 200, and accesses the memory 232 to exchange data. Has been made to get. The system controller 230 is further connected to an external device interface 240 for communicating with an external information processing apparatus such as a personal computer.

  FIG. 4 shows, for example, an image of a subject having a known shape and size, such as a screen of a rectangular television receiver or a case outside thereof, captured by an image pickup means (camera). It is a conceptual diagram for demonstrating the principle of relative position calculation utilized by embodiment of this invention which calculates | requires the relative position of the said subject and camera from a state. In FIG. 4, it is assumed that the screen 10 of the television receiver as a known subject is imaged by the camera 20, and an image 30 represented by the image data is generated by this imaging.

  The horizontal dimension of the screen 10 of the television receiver is W, and the vertical dimension is H, which is known. The screen 10 is imaged on the imaging surface 22 of the imaging device by the lens 21 of the camera 20, and an image 30 represented by image data is obtained as a photoelectrically converted output. If the position of the camera 20 is directly facing the center of the screen 10 of the television receiver that is the subject, the shape of the image 30 is similar to that of the actual screen 10, but shifted from such a facing position. When it is in the position, the shape of the image 30 as a result of being imaged is distorted into a trapezoid as shown in the figure, and so-called trapezoidal distortion is generated.

  Now, the horizontal dimension of the screen 10 as a subject is known as W, and the vertical dimension is known as H. The trapezoid of an image which is image information (image 30 represented by image data) acquired by imaging by the camera 20 is known. It is assumed that the trapezoidal image due to distortion has dimensions of long side a, short side b, and height c. The distance D from the camera 20 to the screen 10 as the subject is calculated from the dimensional relationship between the corresponding parts, such as the relationship between the imaging magnification (focal length of the lens 21) and the above-described W and c, or a compact camera. It is easily determined by a well-known active AF technique based on the principle of triangulation, which is frequently used in the above.

  Therefore, from the above-described relationship between the horizontal dimension W of the screen 10, the vertical dimension H, the height c of the trapezoidal image, the long side a, the short side b, and the distance D, the camera is the subject. The degree of deviation from the position (normal direction) facing the center of the screen 10 is calculated as the angle θ. This means that if the above-mentioned data are prepared, the relative position between the controlled device (television receiver) and the remote control device (remote control) can be calculated based on these data.

  In an actual apparatus, when calculating the relative position between the controlled apparatus (television receiver) and the remote control apparatus (remote control) based on the above-described principle, the above W, H, c, a, b, D The data representing the relationship between the values that can be taken in the practical range is collected in the lookup table. In the embodiment in which the television receiver 100 calculates the relative position described above, a lookup table holding such data is stored in the memory 172 in the configuration of FIG. 2, and the system controller 170 responds as necessary. The angle θ is calculated by referring to this look-up table at the determined timing.

  Similarly, in the case where the above-described relative position is calculated on the remote controller 200 side as in the embodiment described later with reference to FIGS. 11 and 12, this is similarly applied to the memory 232 in the configuration of FIG. A look-up table that holds various data is stored, and the system controller 230 calculates the angle θ by referring to this look-up table at a required timing. In this case, since the above-mentioned relative position is calculated on the remote controller 200 side, the television receiver 100 receives information on the calculated relative position from the remote controller 200 side and performs an adaptive adjustment operation. Can be done.

  Note that, instead of the method of calculating the relative position between the controlled device (television receiver) and the remote control device (remote control) by referring to the lookup table prepared in advance in the memory as described above, Information that contributes to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means on the control device side (for example, corresponding to the four corners of a square having a known size) A trapezoidal distortion calculating means for executing a calculation for obtaining a trapezoidal distortion using marker information indicating a specific position marker arranged at a position, for example, by a corresponding functional unit of the system controller. The controlled device and the remote control device using the result of the calculation by the trapezoidal distortion calculating means and the information related to the external dimensions of the controlled device prepared to be available in advance Method for calculating the relative position may be applied.

  FIG. 5 is a flowchart showing an outline of the operation of the control system (liquid crystal television system) 100 + 200 as an embodiment of the present invention including the liquid crystal television 100 and the remote controller 200 as described above. Hereinafter, embodiments of the present invention will be described in more detail with reference to this flowchart and the above-described drawings as appropriate. Note that the flowchart of FIG. 5 is expressed in an abstract manner so as to correspond to a plurality of modified examples.

  In FIG. 5, first, on the remote controller 200 side having the configuration of FIG. 3, after the operation is started, the imaging unit 210 (imaging element 211 + imaging circuit 212) performs imaging (S201). Next, the image data acquired in S201 is converted into a control signal Sc by infrared light or the like and projected by the system controller 230 (its corresponding functional unit) as an information transmission unit and the control signal projection unit 220. The transmitted signal Sc is received by the light receiving element 181 of the liquid crystal television 100 of FIG. 2 and subjected to predetermined signal conversion via the light receiving circuit 182 and supplied to the system controller 170 (S101). . The light receiving element 181, the light receiving circuit 182 and the system controller 170 (corresponding functional part) constitute information receiving means.

  Next, in the system controller 170 as a relative position calculation unit of the liquid crystal television 100, processing according to the principle described with reference to FIG. 4 is performed using information (image data corresponding to the signal Sc) representing the received image. Is executed, and the relative position between the liquid crystal television 100 as the controlled device and the remote controller 200 as the remote control device is calculated (S102). On the liquid crystal television 100 side (FIG. 2), a command is issued from the system controller 170 in accordance with the relative position between the self 100 and the remote controller 200 calculated in this way, and the location of the remote controller 200 (the vicinity of this position is the viewer's position). Direction of sound generation by adjusting the amplification factors of the left and right amplifiers 141 and 142 and adjusting the volume of the left and right speakers 143 and 144 so that optimal viewing can be performed at the Is adjusted (S103), and the series of operations is terminated.

  According to the above-described control system, image information obtained by performing imaging in an imaging field including the controlled device (the liquid crystal television 100) using the imaging means provided on the remote control device (remote control 200) side is acquired. Is transmitted to the controlled device, the relative position between the remote control device and the controlled device can be calculated on the controlled device side that has received the transmitted image information by the information receiving means. On the controlled device side that recognizes the calculated position of the remote control device, it is possible to perform an operation in a mode suitable for this recognition.

  Here, the operation in a mode suitable for the recognition after recognizing the position of the remote control device is, for example, the direction of sound generation of the left and right speakers 143 and 144 by the remote controller 200 (therefore, holding this remote controller 200). Or a volume balance adjustment that adjusts along the direction of the viewer close to the remote control 200, or a specific viewer who has a high probability of being in that position (for example, the position on the side of the screen of the liquid crystal television 100) This is an operation such as preferentially selecting and displaying contents suitable for the family's owner, the wife at the position facing the center, and the child at the middle position.

  In one modification of the embodiment described with reference to the flowchart of FIG. 5, at the remote control 200 side as a remote control device, one or more scheduled as control targets in the memory 232 that also functions as external information holding means. Information on the outer shape of the controlled device is stored, and the system controller 230 configured to function also as a control target discriminating unit and the image information captured by the imaging unit and the controlled device stored in the memory 232 The controlled device to be controlled is discriminated based on the correlation with the information related to the outer shape of the device.

  If the remote controller 200 is configured in this way, the remote controller 200 itself discriminates the controlled device to be controlled by its own controlled object discriminating means, so that the control instruction code system suitable for the controlled device thus discriminated Recognize the specifications and perform precise control. More specifically, for example, in the transmission of the image information in step S202, the image data acquired in S201 is converted into a control signal Sc using infrared light or the like that conforms to the above-described code system, and is transmitted to the liquid crystal television 100. Since the projection can be performed, the single remote controller 200 can be commonly used for a plurality of controlled devices having different control command code systems.

  In the above-described modification, the memory 232 on the remote controller 200 side stores an image related to the outer shape of one or more controlled devices scheduled as the control target, which is acquired by imaging in advance by appropriate imaging means. May be. In this way, the remote controller 200 discriminates the controlled device that is to be controlled by its own control target discriminating means (system controller 230) from the image related to the external shape of the controlled device that is scheduled to be controlled. At that time, it can be used as a criterion for the discrimination, and an accurate discrimination of the controlled object is performed.

  FIG. 6 shows the relative position of the remote control 200 with respect to the liquid crystal television 100 based on the trapezoidal distortion described with reference to FIG. 4 on the display screen (screen 102) of the liquid crystal television 100 as the controlled device in another embodiment. It is a schematic diagram which shows a mode that the position marker used for the label | marker at the time of calculating is projected. In the example of FIG. 6, four position markers 1021, 1022, 1023, and 1024 having a horizontal distance W and a vertical distance H are projected on the screen 102 as illustrated.

  In the system in which the position marker is projected as shown in FIG. 6, the distance W in the horizontal direction and the distance H in the vertical direction related to the marker information are set to the known values W and H described with reference to FIG. Can be used to calculate the relative position between the controlled device (liquid crystal television 100) and the remote control device (remote control 200). Usually, such a simple image of a bright spot can be easily extracted as a peculiar pattern from a captured image, and functions as a trapezoidal distortion calculation means by applying precisely extracted information. Based on the trapezoidal distortion calculation in the system controller 230, the above-described relative position can be determined.

  In the embodiment of FIG. 6, the above-described four position markers 1021, 1022, 1023, and 1024 of the controlled device (liquid crystal television 100) are displayed, but in addition to this, the remote control device (remote control 200). A coded information pattern 1025 that can be recognized on the side is displayed. The coded information pattern 1025 is a two-dimensional barcode such as a QR code (registered trademark).

  Such a coded information pattern 1025 is projected on the controlled device side, and by this coded information pattern 1025, for example, the horizontal and vertical intervals between the four position markers 1021, 1022, 1023, and 1024, By representing information on the specifications of the control device itself (corresponding control command code system), the position of the position markers 1021, 1022, 1023, 1024 and the coded information pattern 1025 on the remote control device (remote control 200) side. If the image is taken in the imaging field of view, information that contributes to recognizing the relative position between the controlled device (liquid crystal television 100) and the remote control device (remote control 200) can be acquired easily and reliably.

  FIG. 7 shows a control system substantially the same as the control system (liquid crystal television system) 100 + 200 described with reference to FIG. 1, in which the remote control device (remote controller 200) communicates with the external device described above with reference to FIG. FIG. 6 is a conceptual diagram showing an embodiment in which a cooperative operation with an external information processing apparatus is performed through an interface 240). In FIG. 7, the corresponding parts to those of FIG. 1 described above are shown with the same reference numerals.

  The liquid crystal television 100 is configured such that its operation can be controlled in response to a control signal by infrared light or the like from a remote controller 200 as a corresponding remote control device. The liquid crystal television 100 has a housing 102 with a screen 102 for projecting images, a left speaker 103 and a right speaker 104 constituting a stereo acoustic device at a position lower than the bottom of the screen 102, and the screen 102. A light receiving window 105 that receives a control signal Sc (illustrated by a two-dot chain line) by infrared light or the like from the remote controller 200 is provided immediately below the bottom right.

  On the other hand, the remote controller 200 has an independent case 201 that can be placed at a position separated from the liquid crystal television 100 (the case 101), and when imaging is performed on the case 201 toward the liquid crystal television 100 side. An imaging unit 210 capable of generating image information including information contributing to recognizing the relative position between the liquid crystal television 100 (the housing 101) as the controlled device and the housing 201 of the device, and the liquid crystal television 100 On the other hand, a control signal projection unit 220 including a light emitting element such as an infrared LED that emits a control signal Sc by infrared light or the like is provided.

  And the control system (liquid crystal television system) 100 + 200 of this invention is comprised including the above-mentioned liquid crystal television 100 and the remote control 200. FIG. Note that the control signal Sc using infrared light or the like includes a signal representing image information as described later in addition to a signal representing information itself for controlling the liquid crystal television 100 according to an arbitrary operation of the operator. This is also the same as the embodiment described with reference to FIG.

  As described above with reference to FIG. 3, the remote controller 200 further includes an external device interface 240 as communication means for performing communication with a personal computer (hereinafter referred to as a personal computer) 300 as an external information processing apparatus. More precisely, the communication means is configured to include the corresponding functional unit of the external device interface 240 and the system controller 230 to which the external device interface 240 is connected. Since the personal computer 300 is further connected to the Internet 400, it is possible to acquire and use various data through the Internet 400 in addition to the data held by the personal computer 300.

According to the control system of FIG. 7, in addition to the operation of the control system of FIG. 1, the burden on the remote control device itself is greatly increased by utilizing the function of the external information processing device through this communication means. It is possible to perform more advanced control with a simple configuration.
FIG. 8 is a flowchart showing an outline of the operation of the control system (liquid crystal television system) 100 + 200 as an embodiment in which the function of the external information processing apparatus is utilized using the communication means of the remote control device. Hereinafter, embodiments of the present invention will be described in more detail with reference to this flowchart and the above-described drawings as appropriate. Note that the flowchart of FIG. 8 is also abstracted to the extent that it corresponds to a plurality of modified examples.

  In FIG. 8, first, on the remote controller 200 side having the configuration of FIG. 3, after the operation is started, imaging by the imaging means 210 (imaging element 211 + imaging circuit 212) is performed (S211). Next, information relating to the outer shape of one or more controlled devices that are scheduled to be controlled is acquired through communication means (corresponding function unit of 240 + 230) by the corresponding function of the system controller 230 as the outer shape information acquiring means (S212). .

  Further, the system controller 230 as the control target discriminating means includes the image of the control target in the image including the control target previously acquired by the imaging means 210 in step S211 in the imaging visual field, and the controlled device acquired in step S212. Based on the correlation with the information relating to the outer shape, the controlled device to be controlled is discriminated (S213). When the controlled device is discriminated in step S213, the remote control device (remote controller 200) can recognize the control command code system and specifications suitable for the controlled device and perform accurate control.

  The remote controller 200 transmits an image including the control target acquired in S211 in the imaging field of view to the liquid crystal television 100 as the control target using a code in a mode conforming to the control command code system suitable for the controlled device (S214). ). The liquid crystal television 100 side receives the image information thus transmitted (S111), calculates the relative position between the remote controller 200 and the liquid crystal television 100 as described above (S112), and according to this relative position. Therefore, the direction of sound generation is adjusted by adjusting the amplification factor of the left and right amplifiers 141 and 142 and adjusting the volume of the left and right speakers 143 and 144 (S113). End the operation.

  FIG. 9 is a flowchart showing an outline of the operation of a control system (liquid crystal television system) 100 + 200 of still another embodiment in which the function of the external information processing apparatus is utilized using the communication means of the remote control apparatus. Hereinafter, embodiments of the present invention will be described in more detail with reference to this flowchart and the above-described drawings as appropriate. Note that the flowchart of FIG. 9 is also abstracted to the extent that it is commonly applicable to a plurality of variations.

  In FIG. 9, first, on the remote controller 200 side having the configuration shown in FIG. 3, after the operation is started, the imaging unit 210 (imaging element 211 + imaging circuit 212) performs imaging (S221). Next, the image data obtained by imaging acquired in step S221 is transferred to the personal computer 300 as an external information processing apparatus through the communication means (corresponding function unit of 240 + 230) (S222).

  When the image data transferred in step S222 is received on the personal computer 300 side, the image data and the data prepared by acquiring it via the Internet 300 as required, the algorithm for the calculation, etc. are appropriately used to generate the image data. The specifications of the related controlled device and other data are prepared and sent back to the remote controller 200 as related information. The remote controller 200 obtains the related information through communication means (corresponding function unit of 240 + 230) (S223). The remote controller 200 transmits the related information acquired in step S223 to the liquid crystal television 100 as the controlled device (S224).

  In the above, the image data acquired by imaging is transferred to the personal computer 300 side in step S222, and the related information of this image data supplied by the response from the personal computer 300 side is acquired through the communication means in step S223. The function of transmitting the related information to the liquid crystal television 100 in step S224 is covered by the system controller 230 as information acquisition and transmission means and each related function unit.

  The liquid crystal television 100 side receives the related information transmitted to itself in step S224 (S121), and based on the received related information, the system controller 170 as the relative position recognition means controls the controlled device (the liquid crystal television 100). ) And the remote control device (remote control 200) are recognized (S122), and the amplification factors of the left and right amplifiers 141 and 142 are adjusted according to this recognition, and the volume of the left and right speakers 143 and 144 is adjusted. Thus, the directivity direction of the sound is adjusted (S123), and the series of operations is terminated.

  In the embodiment described with reference to FIG. 9, the image information related to the controlled device (liquid crystal television 100) acquired by imaging in the remote control device (remote control 200) is communicated with the external information processing device (personal computer 300). By using the advanced information acquisition processing capability of the personal computer 300, it is possible to acquire sufficient information related to the liquid crystal television 100 without excessively increasing the burden on the remote controller 200, and to obtain the liquid crystal by the information acquisition transmission means It can be transmitted to the television 100.

  On the controlled device (liquid crystal television 100) side, the relative position between the controlled device (liquid crystal television 100) and the remote control device (remote control 200) is recognized using the related information by this transmission, and based on this recognition. It is possible to perform an operation in an accurate manner. For example, by utilizing the advanced information acquisition processing capability of an external information processing apparatus (personal computer 300), the controlled apparatus (liquid crystal television 100) and the remote control apparatus (remote control 200) are used as the related information in this information processing apparatus. It is also possible to acquire even information indicating the relative position of.

  In this way, the controlled device (the liquid crystal television 100) side relies on the controlled device (the liquid crystal television 100) based on the information indicating the relative position as the related information that has already been obtained without any further calculation. Recognizing the relative position to the remote control device (remote controller 200), adjusting the amplification factors of the left and right amplifiers 141 and 142 according to this recognition, and adjusting the volume of the left and right speakers 143 and 144, thereby directing the sound A configuration in which the direction is adjusted can be taken, and the configuration on the controlled device (liquid crystal television 100) side can also be simplified.

  FIG. 10 is a conceptual diagram showing an embodiment in which the present invention is applied to an automatic explanation device for an aquarium. The example shown in the figure is a system in which audio explanations are automatically broadcast at an appropriate timing for a creature in a huge panoramic migratory tank. A plurality of sets of marker groups MK1, MK2,... Having four points as described above with reference to FIG. 4 at a predetermined interval at an intermediate level position of the transparent screen SR by the acrylic thick plate. Affixed or projected by appropriate optical means.

  In addition, an equipment storage section EM is formed to cover the cables, electrical circuits and other equipment so as to protrude in a band shape along the lower side of the screen SR, and to cover the cables, electric circuits and other equipment. The infrared signal light receiving portions IR1, IR2,... Are further spaced from the shoulder portion so as to substantially correspond to the plurality of sets of marker groups MK1, MK2,. Are provided adjacent to the speakers LS1, LS2,...

  Each spectator SP1, SP2,... Carries remote controls RC1, RC2,. When the marker groups MK1, MK2,... Are imaged by the imaging means of each remote controller RC1, RC2,..., The image data of the marker groups MK1, MK2,. .., And is carried by each of the corresponding remote controllers RC 1, RC 2, and so on, in the same way as described with reference to FIG. The positions of the spectators SP1, SP2,.

  When the positions of the spectators SP1, SP2,... Are determined, the field of view of the spectators SP1, SP2,... From the speakers LS1, LS2,. A commentary about the creature that is entering or is about to enter is automatically broadcast. That is, the position of the organism in the aquarium to be explained is determined by detecting the signal generated by the ultrasonic tag attached to each individual by the principle of passive sonar, and using the remote controls RC1, RC2,. Depending on the position of the audience determined based on this signal, the living thing in the field of view is judged and the corresponding explanation is broadcast from the speakers LS1, LS2,.

  As shown in the figure, when the spectator SP1 on the left hand side of the screen SR images the marker group MK1 by the imaging means using the remote controller RC1, the position is determined as described above, and the position is closest to the spectator SP1. From the loudspeaker LS1, about the giant shark trying to cross the field of view of the spectator SP1, "It is now the giant shark that is trying to cross the front of the customer with the first remote control." Inhabiting the temperate and tropical seas around the world. Some individuals grow up to 6 meters, and it is the largest species among hammerhead sharks ... "commentary from the speaker LS1 to the audience SP1 Broadcast with directivity.

  Similarly, for the audience SP2 who is on the right side of the screen SR and the green turtle cm is in front of her eyes, “The green turtle is coming to the front of the customer with the second remote control.” “Turtle eyes, sea turtle Reptiles of the family that inhabit the tropical to temperate seas or the Mediterranean Sea, and some that range from 80 centimeters to over 1 meter in length ... "commentary from the speaker LS2 towards the audience SP2 Broadcast with directivity. Even if the explanations as described above are broadcast simultaneously from the speakers LS1 and LS2, the audience SP1 and SP2 are broadcast with the directivity in which the explanations about the objects that they are paying attention to, so there is not much interference. It is possible to watch without worrying.

  Although the above is an example applied to a large panoramic aquarium, depending on the position of the audience, even a relatively small aquarium that bred and displays limited types of creatures. If it is configured to broadcast a commentary that is optimal or adaptive and adapts to the audience's field of view, a comfortable automatic commentary system that is extremely easy to hear even under some background noise can be realized.

  In the embodiment applied to the aquarium described above, the explanation may be displayed on a display provided in the remote control. In particular, in a small aquarium, the range of movement of organisms to be explained is limited, so the signal of the ultrasonic tag affixed to each individual organism in a large aquarium is sent with passive sonar. Equipment to capture can be omitted.

  FIG. 11 is a conceptual diagram for explaining an embodiment in which the present invention is applied to a remote control system of an air conditioner (hereinafter referred to as an air conditioner). The illustrated example represents a case where the air conditioner AC is remotely operated using a remote controller MR that can adaptively cope with various control objects. The remote controller MR carried by the user HU in his / her hand has a configuration provided with image pickup means in substantially the same manner as described with reference to FIG. The user HU remotely controls the air conditioner AC with the remote control MR, but automatic adjustment as described below is performed in addition to any manual operation.

  FIG. 12 is a flowchart showing an outline of the operation of the air conditioner remote control system of FIG. In FIG. 12, first, on the remote control MR side having the configuration of FIG. 3, after the operation is started, the imaging unit takes the image of the air conditioner AC (the indoor unit, but hereinafter referred to as the air conditioner AC) in the imaging field of view. (S221). Next, the controlled device is discriminated based on the correlation between the external shape of one or more controlled devices scheduled as control targets held in the memory 232 as the external shape information holding means and the image of the air conditioner AC in the captured image. It is executed (S222).

  When the controlled device is identified in step S222, data (specification information) such as the shape dimension of the air conditioner AC corresponding to the model and the code system of the control signal to be applied (specification information) is read from the memory 232 as specification information holding means. (S223). Next, the relative position of the remote controller MR with respect to the air conditioner AC is calculated based on the principle described with reference to FIG. 4 by the corresponding function of the system controller 230 as the relative position calculating means (S224).

  The remote control MR uses as control object relative position information representing the relative position of the remote control MR with respect to the air conditioner AC calculated in step S224 using a code in a mode conforming to the code system of the control command suitable for the air conditioner AC acquired in step S223. Is transmitted to the air conditioner AC (S224). The air conditioner AC side receives the image information transmitted in this way (S121).

  The air conditioner AC adjusts the angle of the louver LV for adjusting the wind direction provided at the air outlet that blows out the temperature-adjusted air based on the relative position information representing the relative position of the remote control MR with respect to the air conditioner AC received in step S121. (S122), the series of operations relating to the automatic wind direction adjustment is terminated. In addition to the function of automatically adjusting the wind direction as described above, the air conditioner AC receives an infrared light command from the remote control MR through the light receiving window RW in order to adjust the wind direction and the temperature even in the manual mode by switching the mode. Perform appropriate adjustment actions.

  FIG. 13 is a flowchart showing an outline of the operation of the remote control system for an air conditioner in which the burden on the remote control device side is less than that in FIG. In FIG. 13, first, on the remote control MR side having the same configuration as that in FIG. 3, after the operation is started, imaging is performed so that the air conditioner AC is included in the imaging field of view (S231). Next, the controlled device is specified based on the correlation between the external shape of one or more controlled devices scheduled as control targets held in the memory 232 as the external shape information holding means and the image of the air conditioner AC in the captured image. Discrimination is executed (S232).

  When the controlled device is specified in step S232, data (specification information) such as the shape dimensions of the air conditioner AC corresponding to the model and the code system of the control signal to be applied (specification information) is read out from the memory 232 as specification information holding means. (S233). The image information acquired in step S231 by the system controller 230 (corresponding functional unit) as the information transmission means and the control signal projection unit 220 becomes the control signal Sc by infrared light or the like according to the specification information recognized in step S233. Image information is transmitted by being converted and projected (S234).

  The projected signal Sc is received by the light receiving window RW of the air conditioner AC (S131), and based on the image information received in this way, the corresponding functional unit in the system controller or the like as the relative position calculating means on the air conditioner AC side. Then, the relative position of the remote control MR with respect to the air conditioner AC is calculated by the memory unit (the look-up table described above) in accordance with the principle described with reference to FIG. 4 (S132).

  The air conditioner AC is provided at an air outlet that blows out temperature-adjusted air by reacting an internal wind direction adjusting servo mechanism based on relative position information representing the relative position of the remote control MR with respect to the air conditioner AC calculated in step S132. Then, the angle of the wind direction adjusting louver LV is adjusted (S133) so that the wind direction is directed toward the user HU, and the series of operations relating to the wind direction automatic adjustment is completed.

  In each of the above embodiments, Bluetooth (registered trademark), IEEE802.11b, IEEE802.11g, or the like can be applied to communication between apparatuses. In addition, a portable information terminal such as a cellular phone is used as the above-mentioned remote controller, and switching to a call using a wireless IP network is performed according to information indicating a relative position, or voice information is provided using Bluetooth (registered trademark). May be equal.

It is a conceptual diagram showing the control system (liquid crystal television receiver system) as embodiment of this invention. It is a block diagram which shows the circuit structure of the liquid crystal television in the control system of FIG. It is a block diagram which shows the circuit structure of the remote control in the control system of FIG. It is a conceptual diagram for demonstrating the principle of the relative position calculation utilized in embodiment of this invention. It is a flowchart showing the outline | summary of operation | movement of the control system (liquid crystal television system) as embodiment of this invention. In other embodiment of this invention, it is a schematic diagram which shows a mode that the position marker used for the label | marker at the time of calculating the relative position with respect to the liquid crystal television of a remote control is projected on the display screen of a to-be-controlled device (liquid crystal television). is there. FIG. 2 is a conceptual diagram illustrating an embodiment in which a remote control device (remote controller) performs a link operation with an external information processing device through a communication unit in a control system substantially similar to the control system of FIG. 1. It is a flowchart showing the outline | summary of operation | movement of the control system as embodiment which utilized the function of the external information processing apparatus using the communication means of the remote control apparatus. It is a flowchart showing the outline | summary of operation | movement of the control system of further another embodiment which utilized the function of the external information processing apparatus using the communication means of a remote control apparatus. It is a conceptual diagram showing embodiment which applied this invention to the automatic description apparatus of the aquarium. It is a conceptual diagram for demonstrating embodiment which applied this invention to the remote control system of the air conditioner. It is a flowchart showing the outline | summary of operation | movement of the remote control system of the air conditioner of FIG. It is a flowchart showing the outline | summary of operation | movement of the remote control system of the air conditioner which reduced the burden by the side of the remote control apparatus rather than the thing of FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Television receiver screen, 20 ... Camera, 21 ... Lens, 22 ... Imaging surface, 30 ... Image, 100 ... Liquid crystal television, 101 ... Housing, 102 ... Screen, 103 ... Left speaker, 104 ... Right speaker, DESCRIPTION OF SYMBOLS 105 ... Light-receiving window, 110 ... Antenna, 120 ... Demodulation / filtering part, 130 ... Video processing part, 140 ... Audio processing part, 141 ... Left amplifier, 142 ... Right amplifier, 143 ... Left speaker, 144 ... Right Speaker, 150 ... OSD section, 160 ... Liquid crystal display, 170 ... System controller, 171 ... Operation section, 172 ... Memory, 181 ... Light receiving element, 182 ... Light receiving circuit, 200 ... Remote control, 201 ... Housing, 210 ... Imaging means , 211 ... imaging device, 212 ... imaging circuit, 220 ... control signal projection unit, 230 ... system controller, 231 ... operation keys 232 ... memory, 240 ... external device interface, 300 ... PC 400 ... Internet, 1021,1022,1023,1024 ... position marker, 1025 ... coded information pattern.

Claims (34)

A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. Imaging means capable of generating image information including information that contributes to recognizing a relative position to the apparatus, and information transmission means for transmitting the image information generated by the imaging means to the controlled apparatus side. Prepared,
The controlled device includes an information receiving unit configured to receive image information transmitted from an information transmitting unit of the remote control device, and the controlled device based on the image information received by the information receiving unit. And a relative position calculating means for calculating a relative position between the remote control device and the remote control device.   A controlled device configured to be controlled from a predetermined remote control device configured separately from the self, and generated by an imaging unit provided in the remote control device and the controlled device and the remote device An information receiving means configured to receive the transmitted image information when image information including information contributing to recognizing a relative position with the control device is transmitted from the remote control device; A controlled device comprising: a relative position calculating unit that calculates a relative position between the controlled device and the remote control device based on image information received by the unit.   A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, wherein the controlled device is imaged when imaging is performed toward the controlled device side. An imaging unit provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the apparatus and the remote control device; and the image information generated by the imaging unit is controlled An information transmission means for transmitting to the apparatus side.   The relative position calculation means of the controlled device is prepared in advance so as to be usable with information contributing to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means. 2. The apparatus according to claim 1, wherein the relative position between the controlled device and the remote control device is calculated based on the information related to the external dimensions of the controlled device. Control system.   The relative position calculation means includes information that contributes to recognizing a relative position between the controlled apparatus and the remote control apparatus in the image information received by the information receiving means, and the controlled control prepared in advance. The controlled device according to claim 2, wherein the controlled device is configured to calculate a relative position between the controlled device and the remote control device based on information related to an external dimension of the device.   The control system according to claim 4, wherein the controlled device includes information holding means for holding information related to an external dimension of the controlled device prepared to be available in advance.   6. The controlled device according to claim 5, further comprising information holding means for holding information relating to an external dimension of the controlled device prepared to be available in advance.   The relative position calculation means of the controlled device has a specific position marker as information contributing to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means. The relative position between the controlled device and the remote control device is calculated using the marker information to be represented and the information related to the external dimensions of the controlled device that is prepared in advance. The control system according to claim 1.   The relative position calculating means includes marker information representing a specific position marker as information contributing to recognizing the relative position between the controlled apparatus and the remote control apparatus in the image information received by the information receiving means. It is configured to calculate a relative position between the controlled device and the remote control device using information relating to an external dimension of the controlled device prepared to be available in advance. The controlled device according to claim 2.   The relative position calculation means of the controlled device has a specific position marker as information contributing to recognizing the relative position between the controlled device and the remote control device in the image information received by the information receiving means. A trapezoidal distortion calculating means for executing a calculation for obtaining a trapezoidal distortion using the marker information to be represented, and information relating to the result of the calculation by the trapezoidal distortion calculating means and the external dimensions of the controlled device prepared in advance. 2. The control system according to claim 1, wherein the control system is configured to calculate a relative position between the controlled device and the remote control device using a computer.   The relative position calculating means includes marker information representing a specific position marker as information contributing to recognizing the relative position between the controlled apparatus and the remote control apparatus in the image information received by the information receiving means. Using a trapezoidal distortion calculation means for performing a calculation for obtaining a trapezoidal distortion using the trapezoidal distortion calculation means and the information relating to the external dimensions of the controlled device prepared in advance that can be used. The controlled device according to claim 2, wherein the controlled device is configured to calculate a relative position between the controlled device and the remote control device.   The controlled apparatus further includes a position marker projecting unit that projects a specific position marker serving as information contributing to recognizing a relative position between the controlled apparatus and the remote control apparatus on its own display unit. The control system according to claim 1, wherein:   The apparatus further comprises a position marker projecting means for projecting a specific position marker serving as information contributing to recognizing the relative position between the controlled device and the remote control device on its own display unit. The controlled device according to claim 2.   2. The controlled device according to claim 1, further comprising a coded information pattern projecting unit that projects a coded information pattern recognizable by the control device on its own display unit. Control system.   The controlled apparatus according to claim 2, further comprising coded information pattern projecting means for projecting a coded information pattern recognizable by the control apparatus on its own display unit.   The control system according to claim 1, wherein the remote control device further includes communication means for performing communication with an external information processing device.   The remote control device according to claim 3, further comprising communication means for performing communication with an external information processing device.   The remote control device includes an outer shape information acquisition unit that acquires information related to an outer shape of one or more controlled devices that are scheduled to be controlled through the communication unit, and an outer shape of the controlled device acquired by the outer shape information acquisition unit. 17. A control object discriminating means for discriminating a controlled device to be controlled based on a correlation between the information related to the image information and the image information captured by the imaging means. The control system described in.   Outline information acquisition means for acquiring information relating to the outline of one or more controlled devices scheduled as control targets through the communication means, information relating to the outline of the controlled apparatus acquired by the outline information acquisition means, and the imaging 18. The remote control device according to claim 17, further comprising control target discrimination means for discriminating controlled devices to be controlled based on correlation with image information captured by the means. .   The remote control device is held in the outer shape information holding means for holding information related to the outer shape of one or more controlled devices scheduled as control targets, the image information captured by the imaging means, and the outer shape information holding means. 2. The control according to claim 1, further comprising: a control target discriminating unit that discriminates a controlled apparatus to be controlled based on a correlation with information related to an outer shape of the controlled apparatus. system.   Outline information holding means for holding information related to the outline of one or more controlled devices scheduled as control targets, image information captured by the imaging means, and outline of the controlled device held by the outline information holding means The remote control device according to claim 3, further comprising a control target discriminating unit that discriminates a controlled device to be controlled based on a correlation with the information related to the control information.   The external information holding means of the remote control device holds an image relating to the external shape of one or more controlled devices scheduled as the control target acquired by imaging in advance by an imaging means. The control system according to claim 20.   The outer shape information holding unit holds an image related to the outer shape of one or more controlled devices scheduled as the control target acquired by imaging in advance by an imaging unit. The remote control device described. A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control when imaging is performed toward the controlled device provided on the housing. An imaging unit capable of generating image information including information that contributes to recognizing a relative position with the device, a communication unit that communicates with an external information processing device, and image information generated by the imaging unit Information acquisition and transmission means for transferring to the information processing apparatus through the communication means, acquiring related information relating to the controlled apparatus supplied from the information processing apparatus as a response to the transfer, and transmitting the related information to the controlled apparatus side; With
The controlled device uses the information receiving means adapted to receive the relevant information transmitted from the information acquisition / transmission means of the remote control device, and the relevant information received by the information receiving means. Relative position recognition means for recognizing the relative position between the controlled device and the remote control device, and adjustment means for performing a predetermined adjustment operation based on recognition by the relative position recognition means. Feature control system.   A controlled device configured to be controlled from a predetermined remote control device configured separately from the self, wherein the remote control device externally transmits image information generated by the imaging means through its own communication means. An information receiving unit configured to receive the related information related to the controlled device acquired from the information processing device as a response to the transfer, and the information received by the information receiving unit Relative position recognition means for recognizing the relative position between the controlled apparatus and the remote control apparatus using related information, and adjustment means for performing a predetermined adjustment operation based on recognition by the relative position recognition means A controlled device characterized in that the controlled device.   A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, wherein the controlled device is imaged when imaging is performed toward the controlled device side. An imaging unit provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the device and the remote control device, and a communication unit that communicates with an external information processing device The image information generated by the imaging means is transferred to the information processing apparatus through the communication means, and related information related to the controlled apparatus supplied from the information processing apparatus as a response to the transfer is acquired and the controlled An information acquisition / transmission means for transmitting to the apparatus side.   The information acquisition / transmission means of the remote control apparatus further acquires signal form information representing a form of a signal applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus through the communication means. 25. The control system according to claim 24, wherein the control system is configured to transmit information to the controlled apparatus by a signal in a mode based on the acquired signal form information.   The information acquisition / transmission means further acquires signal form information representing a form of a signal applied to carry information transmitted to the controlled apparatus as related information related to the controlled apparatus through the communication means, and acquires the information 27. The remote control device according to claim 26, wherein the remote control device is configured to transmit information to the controlled device by a signal in a mode conforming to the signal form information.   25. The controlled device according to claim 24, further comprising coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit. Control system.   26. The controlled device according to claim 25, further comprising coded information pattern projecting means for projecting a coded information pattern recognizable by the control device on its own display unit.   The controlled device displays a coded information pattern including a plurality of markers and information representing an interval between the plurality of markers by a code recognizable by the control device on its display unit, and coding The control system according to claim 24, further comprising information pattern projection means.   A marker and a coded information pattern projecting means for projecting a coded information pattern including a plurality of markers and information representing an interval between the plurality of markers by a code recognizable by the control device on its own display unit 26. The controlled device according to claim 25, further comprising: A control system comprising a remote control device and a controlled device that can be controlled by the remote control device,
The remote control device includes a housing configured separately from the controlled device, and the controlled device and the remote control provided when imaging is performed toward the controlled device provided in the housing. Imaging means capable of generating image information including information that contributes to recognizing a relative position with respect to the apparatus, and outline information holding means for holding information relating to the outline of one or more controlled apparatuses scheduled as control targets A control object discriminating means for discriminating a controlled device to be controlled based on the correlation between the image information acquired by the imaging means and the information held in the outline information holding means, and the outline information holding means A phase between the controlled device and the remote control device using the information related to the outer shape of the device discriminated as the controlled device by the held control target discriminating unit and the image information acquired by the imaging unit. A relative position calculating means for calculating a position; and an information transmitting means for transmitting information indicating a relative position between the controlled apparatus calculated by the relative position calculating means and the remote control apparatus to the controlled apparatus. Prepared,
The controlled device is configured to receive information indicating a relative position between the controlled device and the remote control device transmitted from the information transmission unit of the remote control device; and the information receiving device. A control system comprising: adjusting means for executing a predetermined adjusting operation based on information received by the means.   A remote control device configured to perform predetermined control on the controlled device and configured separately from the controlled device, wherein the controlled device is imaged when imaging is performed toward the controlled device side. An imaging means provided in its own casing so as to be able to generate image information including information contributing to recognizing a relative position between the device and the remote control device, and one or more controlled devices scheduled for control Control for discriminating controlled devices to be controlled based on the correlation between image information acquired by the imaging unit and information stored in the external shape information storage unit, external shape information storage unit that stores external information Using the object discriminating means, the information relating to the outer shape of the device discriminated as the controlled device by the control target discriminating means held in the outer shape information holding means, and the image information acquired by the imaging means. Relative position calculating means for calculating a relative position between the controlled apparatus and the remote control apparatus, and information representing a relative position between the controlled apparatus and the remote control apparatus calculated by the relative position calculating means An information transmission means for transmitting to a controlled device.

Images