JP2010045730A - Information processing device, information processing method, remote control apparatus, and information processing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To more improve user operability with a simple configuration without complicating the configuration. <P>SOLUTION: In the invention, an infrared reflection unit 7 composed of a recursive reflection material reflects infrared radiation light IF<SB>OUT</SB>, radiated from an infrared radiator 4, at the same reflection angle as an incidence angle. The infrared reflection light IF<SB>REF</SB>reflected by the infrared reflection section 7 provided on a surface of a remote control apparatus 3 is imaged and on the basis of the image captured as a result, a reflection image 7G corresponding to the infrared reflection section 7 is extracted and after a motion of the reflection image 7G is detected, a control code D4 made corresponding to a gesture pattern of the motion of the reflection image 7G beforehand is read out. Processing corresponding to the control code D4 is then carried out, so that processing can be carried out in accordance with a gesture in moving the remote control apparatus 3 itself while gripping the remote control apparatus 3 by a user without complicating and expanding the remote control apparatus 3. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing method, a remote control apparatus, and an information processing system, and is applied to, for example, a television apparatus that accepts commands from a remote controller (hereinafter referred to as a remote controller) and realizes various functions. And suitable.

  Conventionally, in a television device, various functions can be controlled in accordance with a command supplied via a remote control using infrared rays. At that time, a button associated with a function to be controlled by a user is searched. To push down.

  However, there is a limit on the size of the function display character described on the button, and since there are a plurality of buttons of the same size, the operation itself for searching for and pressing down the button associated with the function to be controlled itself Is cumbersome and troublesome for the user.

In addition, there has been proposed a remote controller that has a built-in gyro sensor for the purpose of determining the movement of the remote controller itself and notifies the television apparatus of the movement determined by the gyro sensor (see, for example, Patent Document 1).
JP 2007-142513 JP

  By the way, in a remote controller with a built-in gyro sensor, there is a need to incorporate the gyro sensor, and there is a need to electronically notify the movement of the remote control itself by radio waves or the like, which makes the structure complicated and large. There was a problem.

  In order to detect the movement of the remote controller, a method of incorporating a camera capable of capturing visible light into the television device and detecting the movement of the remote controller based on the visible light imaging result may be considered. When a room with John's device is dark, there is a problem that noise increases and the movement of the remote control cannot be accurately determined.

  The present invention has been made in consideration of the above points, and intends to propose an information processing apparatus, an information processing method, a remote control apparatus, and an information processing system that can further improve user operability with a simple configuration. It is.

  In order to solve this problem, in the information processing apparatus and the information processing method of the present invention, the infrared control unit that reflects the infrared irradiation light irradiated from the infrared irradiation unit that irradiates infrared rays at the same reflection angle as the incident angle is a remote control device. Infrared reflected light reflected by the infrared reflecting portion provided on the surface of the image is imaged, and a reflected image corresponding to the infrared reflecting portion is extracted based on a captured image obtained as a result, and movement of the reflected image is detected. Thereafter, a control code associated in advance with the motion pattern of the reflected image is read, and processing corresponding to the control code is executed.

  Thereby, the process according to the movement pattern when the remote control device itself is moved while being held by the user can be executed without complicating and increasing the size of the remote control device.

  In the remote control device of the present invention, the infrared reflected light when the infrared irradiation light emitted from the infrared irradiation unit is reflected at the same reflection angle as the incident angle is picked up by the image pickup unit, and a captured image obtained as a result An information processing apparatus that extracts an infrared reflection image based on the image, detects a movement of the reflection image, and executes a process according to a control code previously associated with the movement pattern of the reflection image; An infrared reflection portion provided on the surface and configured to reflect infrared rays at the same reflection angle as the incident angle is provided.

  As a result, the information processing apparatus can be remotely controlled with only a simple movement without complicating and increasing the size of the structure.

  Further, in the information processing system of the present invention, the infrared ray reflection unit that reflects the infrared irradiation light emitted from the infrared ray irradiation unit that emits infrared rays at the same reflection angle as the incident angle is provided on the surface of the remote control device. An imaging unit that captures infrared reflected light reflected by the reflecting unit, a reflected image extracting unit that extracts a reflected image corresponding to the infrared reflecting unit based on a captured image obtained by the imaging unit, and a motion of the reflected image An information processing apparatus that includes a motion detection unit and a processing execution unit that reads a control code associated with a motion pattern of the reflected image in advance and executes a process according to the control code, and an infrared reflection unit A remote control device provided on the surface for reflecting infrared rays at the same reflection angle as the incident angle.

  Thereby, it is possible to cause the information processing apparatus to execute processing according to the movement pattern when the remote control device itself is moved while being held by the user without increasing the complexity and size of the remote control device.

  According to the present invention, it is possible to execute processing according to a movement pattern when the remote control device itself is moved while being held by a user without complicating and increasing the size of the remote control device. It is possible to realize an information processing apparatus and an information processing method that can further improve user operability with a simple configuration.

  Further, according to the present invention, it is possible to remotely control the information processing apparatus with only a simple movement without complicating and increasing the size of the structure, and thus a remote structure that can further improve user operability with a simple configuration. A control device can be realized.

  Furthermore, according to the present invention, the information processing apparatus is caused to execute processing corresponding to the movement pattern when the remote control apparatus itself is moved while being held by the user without complicating and increasing the size of the remote control apparatus. Thus, it is possible to realize an information processing system that can further improve user operability with a simple configuration.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

(1) First Embodiment (1-1) Overall Configuration of Television System In FIG. 1, reference numeral 1 indicates the overall configuration of a television system according to the first embodiment of the present invention as a whole. 2 and a remote controller (hereinafter referred to as a remote controller) device 3.

(1-2) Appearance Configuration of Television Device The television device 2 (FIG. 1) has an LCD (Liquid Crystal Display) 2A for displaying video and a speaker 2B provided below the LCD 2A. An infrared camera 5 is attached to the upper left end of the LCD 2A, and an infrared irradiator 4 is attached to the upper right end.

The infrared irradiator 4 emits the infrared irradiation light IF _OUT toward the remote control device 3, and the infrared camera 5 transmits the infrared reflected light IF when the infrared irradiation light IF _OUT is reflected by the remote control device 3. _REF is imaged.

  In the television device 2, a remote control light receiving unit 2C is provided between the LCD 2A and the speaker 2B.

(1-3) Appearance Configuration of Remote Control Device The remote control device 3 (FIG. 1) has a remote control button group 3B on the surface of the remote control main body 3A, and the remote control according to the user's pressing operation on the buttons of the remote control button group 3B. The code is transmitted from the remote control code light emitting unit 6 provided at the tip to the television apparatus 2 by infrared IF.

  At this time, the television apparatus 2 receives the remote control code transmitted by the infrared IF from the remote control light emitting section 6 of the remote control apparatus 3 by the remote control light receiving section 2C provided between the LCD 2A and the speaker 2B, and the remote control code It is possible to execute a predetermined function according to the above.

Further, in the remote control device 3, an infrared reflecting portion 7 made of a rectangular retroreflecting material is provided next to the remote control code light emitting portion 6 and is irradiated from the infrared irradiator 4 of the television device 2. The infrared irradiation light IF _OUT is reflected by the infrared reflection section 7 at the same reflection angle as the incident angle. In addition, as the infrared reflection part 7, not only a retroreflection material but a mirror and an aluminum beat may be used.

  Here, as shown in FIG. 2, the structure of the retroreflecting material MD used in the infrared reflecting portion 7 will be described. The retroreflecting material MD has an exposed lens type structure in which a hemispherical reflecting film M1 is formed on the liner L1, and a spherical lens R1 made of a large number of glass beads is embedded in the reflecting film M1. ing.

  As shown in FIG. 3, the infrared incident light IL entering the spherical lens R1 made of glass beads having transmission properties at an incident angle 2α is refracted on the surface, reflected inside the spherical lens R1, and again on the surface. After being refracted, the light exits from the spherical lens R1 as outgoing light OL.

  That is, the retroreflecting material MD finally reflects the infrared light through the spherical lens R1 because the incident angle of the incident light IL is equal to the outgoing angle of the outgoing light OL. Has been made. As described above, the retroreflecting material MD is configured to always reflect the infrared light in the incident direction with respect to the infrared light incident from any direction.

  The structure of the retroreflecting material MD is not limited to the exposed lens type as shown in FIG. 2, but may be various structures such as a capsule lens type (high luminance type) or an encapsulated lens type.

Therefore, as shown in FIG. 4, the retroreflecting material MD used in the infrared reflecting portion 7 of the remote control device 3 is the infrared irradiation light IF _OUT (solid line) emitted from the infrared irradiator 4 of the television device 2. Can be sent back as infrared reflected light IF _REF (broken line) in the same incident direction.

As a result, in the television system 1, no matter what angle the user moves while holding the remote control device 3 with respect to the infrared irradiation light IF _OUT irradiated from the infrared irradiator 4 of the television device 2. Since the infrared reflected light IF _REF can be sent back to the television apparatus 2, the infrared reflected light IF _REF can be _captured by the infrared camera 5.

(1-4) Circuit Configuration of Television Device As shown in FIG. 5, the television device 2 includes a control unit 30 having a CPU (Central Processing Unit) configuration, a digital television broadcast receiving unit 10, a gesture detecting unit 11, and the like. It is designed to control the entire system including

  As a result, the control unit 30 of the television apparatus 2 performs normal television broadcast reception display processing by the digital television broadcast reception unit 10, and the gesture detection unit 11 represents the movement of the user holding the remote control device 3. A gesture detection process for detecting a char action is performed.

  In the television apparatus 2, when the digital television broadcast receiving unit 10 receives and displays the television broadcast, the terrestrial digital broadcast wave S <b> 1 received through the antenna 12 is set to a predetermined level by the RF (Radio Frequency) receiving unit 13. By amplifying, it is converted into a broadcast signal S2 and sent to the demodulator 14.

  The demodulator 14 reconstructs the digital multiplexed data S3 by demodulating the broadcast signal S2 according to a predetermined demodulation method in accordance with the demodulation control signal from the controller 30, and sends it to the demultiplexer 15.

  The demultiplexer 15 demultiplexes the digital multiplexed data S3 into video data VD1, audio data AD1, channel data CD1, and EPG (Electric Program Guide) data ED1.

  The demultiplexing unit 15 then sends the video data VD1 to the video decoding unit 16, sends the audio data AD1 to the audio decoding unit 17, and sends the channel data CD1 and the EPG data ED1 to the control unit 30.

  At this time, when the control unit 30 receives the remote control code RC1 indicating the selected station of the broadcasting station transmitted from the remote control code light emitting unit 6 of the remote control device 3 via the remote control light receiving unit 2C, the control unit 30 receives the video decoding unit 16 from the remote control code RC1. And outputs an instruction to decode the video data VD1 of the channel selection destination.

  In response to this, the video decoding unit 16 decodes the video data VD1 of the broadcasting station instructed as the channel selection destination according to a predetermined method, and sends the resulting video signal VD2 to the video mixer 18. Yes.

  Further, the control unit 30 acquires related information related to terrestrial digital broadcasting such as a television program guide, a broadcasting station name, and a channel number based on the channel data CD1 and EPG data ED1 supplied from the demultiplexing unit 15.

  Then, the control unit 30 generates display image data IM to be superimposed on the video signal VD2 based on related information related to terrestrial digital broadcasting, and transmission when the display image data IM1 is superimposed on the video signal VD2. It is sent to the OSD (On Screen Display) display generation unit 25 together with the degree information α.

  The OSD display generation unit 25 processes the display image data IM1 supplied from the control unit 30 according to the transmittance of the ratio information α, and sends the display image data IM2 having a predetermined transmittance to the video mixer 18.

  The video mixer 18 superimposes the video signal VD2 supplied from the video decoding unit 16 by mixing the display image data IM2 supplied from the OSD display generation unit 25, and the resulting mixed video signal VD3. Is displayed on the LCD 2A as a program video.

  On the other hand, the audio decoding unit 17 decodes the channel selection destination audio data AD1 supplied from the demultiplexing unit 15 by a predetermined method, and outputs the audio signal AD2 obtained as a result from the speaker 2B as program audio. Has been made.

By the way, the television device 2 emits the infrared irradiation light IF _OUT from the infrared irradiator 4 toward the remote control device 3 according to the control signal from the control unit 30 during the gesture detection process by the gesture detection unit 11. The infrared reflected light IF _REF reflected by the infrared reflecting unit 7 is imaged by the infrared camera 5.

The infrared camera 5 acquires the reflected image video data D1 of the remote control device 3 when the user moves his / her hand while holding the remote control device 3 by imaging the infrared reflected light IF _REF , and this is reflected image The data is sent to the extraction unit 21.

The reflected image extracting unit 21 indicates that the reflected image video data D1 includes not only the infrared reflected light IF _REF reflected by the infrared reflecting unit 7 of the remote control device 3, but also reflected light reflected by other factors. Considering this, only the reflection image corresponding to the infrared reflection unit 7 of the remote control device 3 is extracted from the reflection image corresponding to the first frame of the reflection image video data D1.

  Actually, as shown in FIG. 6, the reflected image extraction unit 21 performs infrared reflection of the remote control device 3 from the reflected image G1 corresponding to the first frame of the reflected image video data D1 photographed by the infrared camera 5. A reflected image 7G approximate to the shape and size of the portion 7 is specified, and only the reflected image 7G is extracted.

  As a result, as shown in FIG. 7, the reflected image extraction unit 21 uses the reflected image extracted image G2 including only the reflected image 7G as the first frame, and reflects the extracted image of the reflected image 7G. Data D2 is sent to the motion detector 22.

  Incidentally, at this time, since the focal length corresponding to the angle of view of the infrared camera 5 is known, the reflected image extraction unit 21 can also predict the size of the reflected image 7G displayed in the reflected image G1, The predicted size of the reflected image 7G is compared with the size of the infrared reflecting portion 7 so as to be able to determine whether or not to approximate.

  In addition, the reflected image extracting unit 21 corresponds to the infrared reflecting unit 7 of the remote control device 3 only when the shapes of the reflected image 7G and the infrared reflecting unit 7 are also compared and approximated. By estimating that there is, it is possible to further improve the accuracy of the estimation result.

  The motion detection unit 22 detects a trajectory of the reflected image 7G by obtaining an inter-frame difference based on the reflected image extracted video data D2.

  Specifically, as shown in FIG. 8A, when the reflected image 7G moves from the right direction to the left direction and stops, the motion detection unit 22 moves the remote control device 3 to “right to left”. A gesture pattern can be detected.

  Further, as shown in FIG. 8B, the motion detection unit 22 is a gesture pattern in which the movement of the remote control device 3 is “from bottom to top” when the reflected image 7G moves from the lower direction to the upper direction and stops. It is made to be able to detect that.

  Further, as shown in FIG. 8C, the motion detector 22 moves when the reflected image 7G moves in a circle from the lower left direction toward the lower right direction and stops, and the movement of the remote control device 3 is “ It is possible to detect that the gesture pattern is “counterclockwise ○”.

  Further, as shown in FIG. 8D, the motion detection unit 22 is a gesture pattern in which the movement of the remote control device 3 is “lower left to upper right” when the reflected image 7G moves from the lower left direction to the upper right direction and stops. It is made to be able to detect that.

  Further, as shown in FIG. 8 (E), the motion detecting unit 22 is shaped like a letter “F” as if the reflected image 7G once moved from the lower left direction to the upper center direction and then moved to the lower right direction and stopped. When the movement of the remote controller 3 is performed, it can be detected that the movement of the remote control device 3 is a gesture pattern “character shape from left to right”.

  As described above, the motion detection unit 22 can detect the gesture pattern corresponding to the motion of the remote control device 3 by detecting the temporal speed and direction of the reflected image 7G, and the gesture pattern information D3 is obtained. The data is sent to the code conversion unit 23.

  Note that the motion detection unit 22 has a variation in the speed of movement of the reflected image 7G, so that the gesture pattern can be reliably detected by making a determination with redundancy.

  In the code conversion rule storage unit 24, as shown in FIG. 9, a gesture pattern in which gesture pattern information D3 corresponding to each gesture pattern in advance and a control code D4 for the digital television broadcast receiving unit 10 are combined with each other. / Control code conversion table T1 is stored.

  Therefore, the code conversion unit 23 supplies the gesture pattern information D3 detected by the motion detection unit 22 to the code conversion rule storage unit 24. Thereby, the code conversion unit 23 receives the control code D4 corresponding to the gesture pattern information D3 from the code conversion rule storage unit 24, and sends it to the control unit 30.

  Here, in the gesture pattern / control code conversion table T1, the control code D4 of “Power ON” is associated with the gesture pattern information D3 of “from right to“ to ””, and “from left to“ to ”. The control code D4 of “Power OFF” is associated with the gesture pattern information D3 of “letter”.

  In the gesture pattern / control code conversion table T1, for example, “channel up” control code D4 is associated with “right to left” gesture pattern information D3, and “left to right” gesture pattern information D3. Is associated with a “channel down” control code D4.

  Further, in the gesture pattern / control code conversion table T1, the “up from bottom” gesture pattern information D3 is associated with the “volume up” control code D4 and the “up to down” gesture pattern information D3. Is associated with the “volume down” control code D4.

  Further, in the gesture pattern / control code conversion table T1, the gesture pattern information D3 “lower left to upper right” is associated with the control code D4 “brightness up”, and the gesture pattern information “upper right to lower left” is used. D3 is associated with a control code D4 of “brightness down”.

  Further, in the gesture pattern / control code conversion table T1, the “pattern ON” control code D4 is associated with the “clockwise ○” gesture pattern information D3, and the “counterclockwise ○” gesture pattern information D3. Is associated with a control code D4 of “menu OFF”.

  Further, in the gesture pattern / control code conversion table T1, the gesture pattern information D3 of “clockwise Δ” is associated with the control code D4 of “input switching feed”, and the gesture pattern information of “counterclockwise Δ” D3 is associated with a control code D4 of “input switching return”.

  In the gesture pattern / control code conversion table T1, not only the above-described combinations but also other various combinations of gesture pattern information D3 and control codes D4 are associated with each other.

  The control unit 30 outputs a control command corresponding to the control code D4 from the code conversion unit 23 to the digital television broadcast receiving unit 10 to change the channel, change the volume, adjust the brightness, turn the power on / off, etc. Various functions for the digital television broadcast receiver 10 of the television apparatus 2 can be controlled.

  When the control unit 30 receives the remote control code RC1 from the remote control device 3 via the remote control light receiving unit 2C, the control unit 30 performs television change such as channel change, volume change, brightness adjustment, power ON / OFF, etc. according to the remote control code RC1. Various functions for the two digital television broadcast receivers 10 can be controlled.

(1-5) Circuit Configuration of Remote Control Device As shown in FIG. 10, the remote control device 3 has an infrared reflecting material 7 attached to the surface thereof, and the internal CPU 40 operates in accordance with the power supplied from the battery 42 to read the ROM (Read The overall control is performed according to the basic program stored in the (Only Memory) 41, and the basic processing as the remote control device is executed.

  When any button of the remote control button group 3B is pressed by the user, the CPU 40 of the remote control device 3 receives the remote control code RC1 associated with the button via the bus 43, and receives the remote control code RC1 from the remote control code RC1. Transmission from the light emitting unit 6 to the television apparatus 2 is performed by infrared IF.

(1-6) Operation and Effect in First Embodiment In the above configuration, in the television system 1, the infrared irradiation light IF _OUT emitted from the infrared irradiator 4 of the television device 2 is the same as the incident direction. By reflecting the reflected light as the infrared reflected light IF _REF by the infrared reflecting portion 7 made of a retroreflecting material that can be sent back in the reflection direction, the user's gesture to move and hold the remote control device 3 is reliably and accurately performed by the infrared camera 5. Can be taken.

  Therefore, in the television system 1, the control code D 4 is associated with the gesture pattern information D 3 obtained as a result of photographing by the infrared camera 5 of the television device 2 based on the gesture pattern / control code conversion table T 1. It is possible to discriminate and control the function of the digital television broadcast receiver 10 according to the control code D4.

  That is, the television system 1 does not allow the user to perform various button operations on the remote control button group 3B of the remote control device 3, and simply moves the remote control device 3 while holding the remote control device 3. The gesture pattern at that time can be accurately recognized, and a function corresponding to the gesture pattern can be immediately realized.

  At this time, since the infrared reflecting portion 7 made of a retroreflecting material is attached to the remote control device 3, it is necessary to face the infrared irradiator 4 of the television device 2 and the infrared reflecting portion 7 of the remote control device 3 with each other. Absent.

  Therefore, in the television system 1, as long as the user moves the remote control device 3 while holding it, the television device 2 can easily execute the function desired by the user.

Furthermore, in the television system 1, the infrared irradiation light IF _OUT emitted from the infrared irradiator 4 of the television device 2 is reflected by the remote control device 3 and is photographed by the infrared camera 5 as the infrared reflected light IF _REF . Even in a use environment where the indoor brightness is insufficient, the user's intention can be reliably transmitted to the television device 2 via the remote control device 3.

  Furthermore, since the remote control device 3 has a simple configuration in which the infrared reflection portion 7 is simply attached to the surface thereof, the structure is not complicated and large, and the user-friendliness is not hindered. As well as ease of use.

  According to the above configuration, the television system 1 can be simply moved while the user holds the remote control device 3 without complicating and increasing the size of the structure of the television device 2 and the remote control device 3. Thus, the television device 2 can be remotely controlled, and thus the user operability can be further improved with a simple configuration.

(2) Second Embodiment (2-1) Overall Configuration of Television System As shown in FIG. 1, reference numeral 50 indicates the overall configuration of the television system in the second embodiment of the present invention as a whole. The television system 1 in the first embodiment basically has the same overall configuration, and includes the television device 52 and the remote control device 3.

(2-2) Appearance Configuration of Television Device and Remote Control Device The appearance configuration of the television device 52 and remote control device 3 in the second embodiment is the same as that in the first embodiment and will be described for convenience. Is omitted.

(2-3) Circuit Configuration of Television Device As shown in FIG. 11 in which parts corresponding to those in FIG. 5 are assigned the same reference numerals, also in the television device 52, the control unit 30 having a CPU configuration receives digital television broadcasts. The entire system including the unit 10 and the gesture detection unit 11 is controlled in an integrated manner.

  As a result, the control unit 30 of the television apparatus 52 performs a normal television broadcast reception display process by the digital television broadcast reception unit 10, and detects a gesture operation of the user holding the remote control device 3 by the gesture detection unit 11. A gesture detection process is performed.

  Also in this television apparatus 52, the reception and display processing of the television broadcast by the digital television broadcast receiver 10 and the television broadcast by the digital television broadcast receiver 10 of the television apparatus 2 in the first embodiment are performed. Since the reception display process is the same, the description thereof is omitted for convenience.

Meanwhile the television apparatus 52, when the gesture detection processing by the gesture detection unit 11 emits infrared radiation beam IF _OUT toward the infrared irradiation unit 4 to the remote control device 3 in accordance with a control signal from the control unit 30, then the remote control device 3 The infrared reflected light IF _REF reflected by the infrared reflecting unit 7 is imaged by the infrared camera 5.

The infrared camera 5 acquires the reflected image video data D1 of the remote control device 3 when the user moves his / her hand while holding the remote control device 3 by imaging the infrared reflected light IF _REF , and this is reflected image The data is sent to the extraction unit 21.

The reflected image extracting unit 21 indicates that the reflected image video data D1 includes not only the infrared reflected light IF _REF reflected by the infrared reflecting unit 7 of the remote control device 3, but also reflected light reflected by other factors. Considering this, only the reflection image corresponding to the infrared reflection unit 7 of the remote control device 3 is extracted from the reflection image corresponding to the first frame of the reflection image video data D1.

  Actually, as shown in FIG. 6, the reflected image extraction unit 21 uses the infrared light of the remote control device 3 from the reflected image image G1 corresponding to the first frame of the reflected image video data D1 photographed by the infrared camera 5. A reflection image 7G approximate to the shape and size of the reflection section 7 is specified, and only the reflection image 7G is extracted.

  As a result, as shown in FIG. 7, the reflected image extraction unit 21 uses the reflected image extracted image G2 including only the reflected image 7G as the first frame, and extracts a reflected image that represents the movement of the reflected image 7G alone. The video data D2 is sent to the motion detector 22.

  Incidentally, at this time, since the focal length corresponding to the angle of view of the infrared camera 5 is known, the reflected image extraction unit 21 can also predict the size of the reflected image 7G displayed in the reflected image G1, The predicted size of the reflected image 7G is compared with the size of the infrared reflecting portion 7 so as to be able to determine whether or not to approximate.

  In addition, the reflected image extracting unit 21 corresponds to the infrared reflecting unit 7 of the remote control device 3 only when the shapes of the reflected image 7G and the infrared reflecting unit 7 are also compared and approximated. By estimating that there is, it is possible to further improve the accuracy of the estimation result.

  The motion detection unit 22 detects a trajectory of the reflected image 7G by obtaining an inter-frame difference based on the reflected image extracted video data D2.

  Specifically, as shown in FIGS. 8A to 8E, the motion detection unit 22 can detect each gesture pattern based on the motion of the reflected image 7G. .

  As described above, the motion detection unit 22 can detect the gesture pattern by detecting the temporal speed and direction of the reflected image 7G, and sends the gesture pattern information D3 to the code conversion unit 23.

  The motion detector 22 can detect the gesture pattern with certainty by determining with redundancy since the motion of the reflected image 7G varies in speed.

  The code conversion rule storage unit 24 stores a gesture pattern / control code conversion table T in which the gesture pattern information D3 and the control code D4 are combined in advance as shown in FIG.

  Therefore, the code conversion unit 23 supplies the gesture pattern information D3 detected by the motion detection unit 22 to the code conversion rule storage unit 24. Thereby, the code conversion unit 23 receives the control code D4 corresponding to the gesture pattern information D3 from the code conversion rule storage unit 24, and sends it to the control unit 30.

  Here, in the gesture pattern / control code conversion table T1, the control code D4 of “Power ON” is associated with the gesture pattern information D3 of “from right to“ to ””, and “from left to“ to ”. The control code D4 of “Power OFF” is associated with the gesture pattern information D3 of “letter”.

  In the gesture pattern / control code conversion table T1, for example, “channel up” control code D4 is associated with “right to left” gesture pattern information D3, and “left to right” gesture pattern information D3. Is associated with a “channel down” control code D4.

  Further, in the gesture pattern / control code conversion table T1, the “up from bottom” gesture pattern information D3 is associated with the “volume up” control code D4 and the “up to down” gesture pattern information D3. Is associated with the “volume down” control code D4.

  Further, in the gesture pattern / control code conversion table T1, the gesture pattern information D3 “lower left to upper right” is associated with the control code D4 “brightness up”, and the gesture pattern information “upper right to lower left” is used. D3 is associated with a control code D4 of “brightness down”.

  Further, in the gesture pattern / control code conversion table T1, the “pattern ON” control code D4 is associated with the “clockwise ○” gesture pattern information D3, and the “counterclockwise ○” gesture pattern information D3. Is associated with a control code D4 of “menu OFF”.

  Further, in the gesture pattern / control code conversion table T1, the gesture pattern information D3 of “clockwise Δ” is associated with the control code D4 of “input switching feed”, and the gesture pattern information of “counterclockwise Δ” D3 is associated with a control code D4 of “input switching return”.

  In the gesture pattern / control code conversion table T1, not only the above-described combinations but also other various combinations of gesture pattern information D3 and control codes D4 are associated with each other.

  The control unit 30 outputs a control command corresponding to the control code data D4 received from the code conversion unit 23 via the OR circuit 31 to the digital television broadcast reception unit 10, thereby changing the channel, changing the volume, and brightness. Various functions for the digital television broadcast receiver 10 of the television apparatus 2 such as adjustment and power ON / OFF can be controlled.

  Further, the control unit 30 receives the remote control code RC1 from the remote control device 3 via the remote control light receiving unit 2C and the OR circuit 31, and changes the channel, changes the volume, adjusts the brightness, turns the power on / off, etc. according to the remote control code RC1. Various functions for the digital television broadcast receiver 10 of the television apparatus 2 can be controlled.

  Here, the control code D4 received by the control unit 30 from the code conversion unit 23 via the logical sum circuit 31 and the remote control code RC1 received from the remote control device 3 via the remote control light receiving unit 2C and the logical sum circuit 31 are the number of bits and its The same system code with the same value.

  Therefore, the control unit 30 does not need to determine the supply source, regardless of whether the control code D4 or the remote control code RC1 is supplied from the OR circuit 31, and the control code D4 or the remote control code RC1 is common. It is designed to be able to recognize the meaning of meaning.

  Thereby, the control unit 30 of the television apparatus 2 can control the function desired by the user according to the control code D4 or the remote control code RC1 of the same system without being aware of the supply source of the control code D4 or the remote control code RC1. ing.

(2-4) Circuit configuration of the remote control device The circuit configuration of the remote control device 3 in the second embodiment is the same as the circuit configuration of the remote control device 3 in the first embodiment, and therefore the description thereof is omitted for convenience. To do.

(2-5) Operation and Effect As described above in the second embodiment, the television system 50, the infrared radiation beam IF _OUT emitted from the infrared ray irradiation device 4 of the television apparatus 52, the same as the incident direction By reflecting the reflected light as the infrared reflected light IF _REF by the infrared reflecting portion 7 made of a retroreflecting material that can be sent back in the reflection direction, the user's gesture to move and hold the remote control device 3 is reliably and accurately performed by the infrared camera 5. Can be taken.

  Therefore, in the television system 50, the control code D4 is associated with the gesture pattern information D3 obtained as a result of photographing by the infrared camera 5 of the television device 52 based on the gesture pattern / control code conversion table T1. It is possible to discriminate and control the function of the digital television broadcast receiver 10 according to the control code D4.

  That is, the television system 50 does not allow the user to perform various button operations on the remote control button group 3B of the remote control device 3, and simply moves the remote control device 3 while holding the gesture pattern. Can be recognized accurately, and a function corresponding to the gesture pattern can be immediately realized.

  At this time, since the infrared reflecting portion 7 made of a retroreflecting material is attached to the remote control device 3, it is necessary to face the infrared irradiator 4 of the television device 52 and the infrared reflecting portion 7 of the remote control device 3 with each other. Absent.

  Therefore, in the television system 50, as long as the user moves the remote control device 3 while holding it, the television device 52 can easily execute the function desired by the user.

In the television system 50, the infrared irradiation light IF _OUT emitted from the infrared irradiator 4 of the television device 52 is reflected by the remote control device 3, and is photographed by the infrared camera 5 as the infrared reflected light IF _REF. Even in a use environment with insufficient power, the user's intention can be reliably transmitted to the television device 52 via the remote control device 3.

  At this time, since the remote control device 3 has a simple configuration in which the infrared reflecting portion 7 is simply attached to the surface thereof, the structure is not complicated and large, and the user-friendliness is not hindered. Ease of use can be provided as well.

  Further, the control unit 30 of the television system 50 controls the remote control code RC1 supplied from the remote control light receiving unit 2C via the logical sum circuit 31, and the control supplied from the code conversion unit 23 of the gesture detection unit 11 via the logical sum circuit 31. Since the code D4 is a code of the same system, the function according to the remote control code RC1 or the control code D4 meaning the same content can be executed without being aware of the supplier.

  Therefore, for the user, whether to transmit the remote control code RC1 to the television device 52 via the remote control device 3 or to make the television device 52 recognize a gesture pattern by moving the remote control device 3 while holding it. The function of the television apparatus 52 can be easily controlled by any method without particular awareness.

  According to the above configuration, the television system 50 allows the user to perform button operations on the remote control device 3 or grasp the remote control device 3 without complicating and increasing the structure of the television device 52 and the remote control device 3. The television device 52 can be remotely controlled as long as it is moved while being held, and thus the operability of the user can be further improved with a simple configuration.

(3) Third Embodiment (3-1) Overall Configuration of Television System In FIG. 1, reference numeral 60 indicates the overall configuration of the television system according to the third embodiment of the present invention as a whole. The television system 1 according to the embodiment has basically the same overall configuration, and includes a television device 62 and a remote control device 3.

(3-2) Appearance Configuration of Television Device The appearance configuration of the television device 62 in the third embodiment is the same as that in the first embodiment and the second embodiment, and will be described for convenience. Omitted.

(3-3) External configuration of remote control device Also, the external configuration of the remote control device 3 in the third embodiment is the same as that in the first and second embodiments, and the description thereof is omitted for the sake of convenience. However, the remote control code transmission mode and the gesture detection processing mode can be switched alternately in response to a user pressing operation on a gesture button (not shown) of the remote control button group 3B.

  Basically, when the gesture button (not shown) of the remote control button group 3B is not pressed down by the user, the remote control device 3 is in the normal remote control code transmission mode, and the gesture button (not shown) of the remote control button group 3B. When the user presses the button, a transition is made from the remote control code transmission mode to the gesture detection mode.

  Therefore, in the remote control device 3, in the remote control code transmission mode, the remote control code corresponding to the user's pressing operation on the buttons of the remote control button group 3B is transmitted from the remote control code light emitting unit 6 provided at the tip portion by the infrared IF to the television device 2. To be sent to.

  At this time, the television apparatus 2 receives the remote control code transmitted by the infrared IF from the remote control light emitting section 6 of the remote control apparatus 3 by the remote control light receiving section 2C provided between the LCD 2A and the speaker 2B. It is possible to control a predetermined function according to the above.

  On the other hand, the remote control device 3 transitions from the normal remote control code transmission mode to the gesture detection processing mode in response to a user pressing operation on a gesture button (not shown) of the remote control button group 3B, and when the button is pressed down. However, the remote control code is not transmitted from the remote control code light emitting unit 6.

(3-4) Circuit Configuration of Television Device As shown in FIG. 12 in which parts corresponding to those in FIG. 5 are assigned the same reference numerals, the television device 62 is basically the television device in the first embodiment. Only the differences will be described.

When the control unit 30 of the television device 62 receives a remote control code RC1 indicating that a gesture button (not shown) in the remote control button group 3B of the remote control device 3 is pressed via the remote control light receiving unit 2C, with activating the detection unit 11 are adapted to emit infrared radiation beam IF _OUT toward the infrared irradiation unit 4 to the remote control device 3.

  That is, the control unit 30 of the television device 62 supplies the activation command K1 to the gesture detection unit 11 unless it receives a remote control code RC1 that means that a gesture button (not shown) is pressed from the remote control device 3. Therefore, it is not necessary to operate the gesture detection unit 11 unnecessarily.

Therefore, the control unit 30 of the television device 62 wastefully emits the infrared irradiation light IF _OUT to increase power consumption, or the user moves his / her hand unconsciously while holding the remote control device 3. It is possible to prevent erroneous detection of an unintended gesture.

(3-5) Circuit Configuration of Remote Control Device As shown in FIG. 10, the remote control device 3 has the infrared reflecting material 7 attached to the surface thereof, and the internal CPU 40 operates according to the power supplied from the battery 42, The overall control is performed according to the stored basic program, and the basic processing is executed.

  The CPU 40 of the remote control device 3 receives the remote control code RC1 associated with the button via the bus 43 when any button of the remote control button group 3B is pressed by the user in the normal remote control code transmission mode. The remote control code RC1 is transmitted from the remote control code light emitting unit 6 to the television apparatus 2 by infrared IF.

  On the other hand, when a gesture button (not shown) of the remote control button group 3B is pressed by the user, the CPU 40 of the remote control device 3 receives the remote control code RC1 associated with the gesture button via the bus 43, The remote control code RC1 is transmitted from the remote control code light emitting unit 6 to the television apparatus 2 by infrared IF.

  At this time, even when another button on the remote control button group 3B is pressed by the user, the CPU 40 of the remote control device 3 transmits the remote control code RC1 associated with the button from the remote control code light emitting unit 6 to the television device 2. It is made so that there is nothing to do.

(3-6) Operation and Effect in Third Embodiment In the above configuration, in the television system 60, the infrared irradiation light emitted from the infrared irradiator 4 of the television device 62 when transitioning to the gesture detection mode. The user's gesture of holding and moving the remote control device 3 by reflecting the IF _OUT as the infrared reflected light IF _REF by the infrared reflecting portion 7 made of a retroreflecting material that can be sent back in the same reflection direction as the incident direction. Can be reliably and accurately photographed by the infrared camera 5.

  Therefore, in the television system 60, in the gesture detection mode, the gesture pattern / control code conversion is performed to determine what control code D4 is associated with the gesture pattern information D3 obtained as a result of photographing by the infrared camera 5 of the television device 2. It is possible to discriminate based on the table T1 and control the function of the digital television broadcast receiver 10 in accordance with the control code D4.

  That is, in the gesture detection mode, the television system 60 does not allow the user to perform various button operations on the remote control button group 3B of the remote control device 3, and simply moves the remote control device 3 while holding it. It is possible to accurately recognize the current gesture pattern and immediately realize a function corresponding to the gesture pattern.

  At this time, since the infrared reflecting portion 7 made of a retroreflecting material is attached to the remote control device 3, it is necessary to face the infrared irradiator 4 of the television device 62 and the infrared reflecting portion 7 of the remote control device 3 with each other. Absent.

  Therefore, in the television system 60, in the gesture detection mode, as long as the user moves the remote control device 3 while holding it, the television device 62 can easily execute the function desired by the user.

On the other hand, in the television system 60, in the remote control code transmission mode, the television device 62 does not activate the gesture detection unit 11, so that the infrared irradiation light IF _OUT is unnecessarily emitted to increase power consumption. Or erroneously detecting an unintended gesture when the user moves his / her hand unconsciously while holding the remote control device 3 can be reliably prevented.

  In particular, in the television system 60, the remote control code transmission mode and the gesture detection mode can be switched via the remote control device 3 in accordance with a pressing operation on a gesture button (not shown) of the remote control button group 3B. The remote controller 3 can be used as an optimal input interface that matches the user's usage environment.

Further, in the television system 60, the infrared irradiation light IF _OUT emitted from the infrared irradiator 4 of the television device 62 is reflected by the remote control device 3, and is photographed by the infrared camera 5 as the infrared reflected light IF _REF. Even under a use environment that is insufficient, the user's intention can be reliably transmitted to the television device 62 via the remote control device 3.

  Furthermore, since the remote control device 3 has a simple configuration in which the infrared reflection portion 7 is simply attached to the surface thereof, the structure is not complicated and large, and the user-friendliness is not hindered. As well as ease of use.

  According to the above configuration, the television system 60 can perform a pressing operation on the remote control button group 3B of the remote control device 3 without complicating and increasing the structure of the television device 62 and the remote control device 3. The television device 2 can be remotely controlled simply by moving the remote control device 3 while holding the remote control device 3 to the user, thus further improving the operability of the user with a simple configuration.

(4) Fourth Embodiment (4-1) Overall Configuration of Television System In FIG. 1, reference numeral 70 indicates the overall configuration of the television system according to the fourth embodiment of the present invention as a whole. The television system 1 according to the embodiment has basically the same overall configuration, and includes a television device 72 and a remote control device 3.

(4-2) Appearance Configuration of Television Device and Remote Control Device The appearance configuration of the television device 72 and the remote control device 3 in the fourth embodiment is the same as that in the first to third embodiments. Therefore, the description thereof is omitted for convenience.

(4-3) Circuit Configuration of Television Device As shown in FIG. 13 in which parts corresponding to those in FIG. 5 are assigned the same reference numerals, the television device 72 is basically the television device in the first embodiment. Only the differences will be described.

  The control unit 30 of the television device 72 converts the gesture pattern information D3 in the gesture pattern / control code conversion table T1 (FIG. 9) registered in advance in the code conversion rule storage unit 24 into a desired gesture pattern that is easy for the user to operate. It is made to be customizable.

  In practice, when the gesture pattern customization button (not shown) in the remote control button group 3B of the remote control device 3 is pressed, the control unit 30 of the television device 72 performs a gesture registered in advance in the code conversion rule storage unit 24. In accordance with the pattern / control code conversion table T1, a gesture list screen G4 as shown in FIG. 14 is generated and displayed on the LCD 2A.

  Thereby, the control unit 30 of the television apparatus 72 can make the user visually check the correspondence between the current gesture pattern and various functions via the gesture list screen G4.

  For example, on the gesture list screen G4, a “power ON” function is assigned to the gesture pattern image P1, a “power OFF” function is assigned to the gesture pattern image P2, and a “channel” is assigned to the gesture pattern image P3. The “up (+)” function is assigned, the “channel down (−)” function is assigned to the gesture pattern image P4, the “volume up (+)” function is assigned to the gesture pattern image P5, and the gesture pattern It is shown that the “volume down (−)” function is assigned to the image P6.

  When the user who confirms the correspondence between the current gesture pattern and various functions via the gesture list screen G4 presses the “Next” button B1 on the gesture list screen G4, the television device 72 The control unit 30 recognizes that the user has an intention to change the gesture pattern.

  And the control part 30 of the television apparatus 72 produces | generates the function selection screen G5 for gesture customization registration as shown in FIG. 15, and displays this on LCD2A. In the function selection screen G5, various functions registered in advance in the gesture pattern / control code conversion table T1 (FIG. 9) are displayed in a list.

  The user moves the cursor C1 to the function for which the gesture pattern is to be changed from the function selection screen G5 (for example, “Power ON” in this case) via the remote control device 3 and determines a button (not shown) of the remote control button group 3B. ) Can be pressed to determine a function whose gesture pattern is desired to be changed.

  In response to this, the control unit 30 of the television apparatus 72 generates a function registration start screen G6 for gesture customization registration as shown in FIG. 16, and displays it on the LCD 2A.

  In the function registration start screen G6 (FIG. 16), the cursor C1 is set to “start”, and a gesture pattern image P1 indicating the currently set gesture pattern is displayed on the left side. A scheduled registration gesture pattern image PN indicating a gesture pattern to be registered is displayed.

  At this time, when the infrared ray irradiator 4 irradiates infrared rays from the infrared irradiator 4, the control unit 30 of the television device 72 indicates the movement locus when the remote control device 3 is moved along the gesture pattern that the user wants to newly register with the infrared camera. As shown in FIG. 17, the gesture pattern represented by the trajectory of the shooting result is displayed as a registered scheduled gesture pattern image PN.

  Then, when the control unit 30 of the television device 72 recognizes that the cursor C1 is set to “end” and the decision button (not shown) of the remote control button group 3B is pressed by the user's operation on the remote control device 3. A new gesture pattern / control code conversion table T1N is generated from the gesture pattern displayed as the registered gesture pattern image PN, and this is re-registered in the code conversion rule storage unit 24.

  As a result, the control unit 30 of the television apparatus 72 generates a new customized gesture list screen G4N as shown in FIG. 18 according to the new gesture pattern / control code conversion table T1N and displays it on the LCD 2A. Has been made.

  Accordingly, the user can visually confirm the new customized gesture pattern image P1N via the new gesture list screen G4N, so that the customized gesture pattern is newly added to the “power ON” function. It is made to be able to recognize that it has been registered.

(4-4) Circuit configuration of the remote control device The circuit configuration of the remote control device 3 in the fourth embodiment is the same as the circuit configuration of the remote control device 3 in the first embodiment, and therefore the description thereof is omitted for convenience. To do.

(4-5) Operation and Effect As described above in the fourth embodiment, the television system 70, the infrared radiation beam IF _OUT emitted from the infrared ray irradiation device 4 of the television apparatus 72, the same as the incident direction By reflecting the infrared reflected light IF _REF as the infrared reflected light IF _REF by the infrared reflecting portion 7 made of a retroreflective material that can be sent back in the reflection direction, the user's gesture to move the remote control device 3 is surely and accurately performed by the infrared camera 5. Can be taken.

  Therefore, in the television system 70, it is determined, based on the gesture pattern / control code conversion table T1, what control code D4 is associated with the gesture pattern information D3 obtained as a result of photographing by the infrared camera 5 of the television device 72. It is possible to discriminate and control the function of the digital television broadcast receiver 10 according to the control code D4.

  That is, the television system 70 does not allow the user to perform various button operations on the remote control button group 3B of the remote control device 3 and simply moves the remote control device 3 while holding it, so that the gesture pattern at that time can be accurately determined. The function corresponding to the gesture pattern can be immediately realized.

  At this time, since the infrared reflecting portion 7 made of a retroreflecting material is attached to the remote control device 3, it is necessary to face the infrared irradiator 4 of the television device 72 and the infrared reflecting portion 7 of the remote control device 3 with each other. Absent.

  Therefore, in the television system 70, as long as the user moves the remote control device 3 while holding it, the television device 72 can easily execute the function desired by the user.

In the television system 70, the infrared irradiation light IF _OUT emitted from the infrared irradiator 4 of the television device 72 is reflected by the remote control device 3 and photographed by the infrared camera 5 as the infrared reflected light IF _REF , thereby increasing the brightness of the room. Even in a use environment with insufficient power, the user's intention can be reliably transmitted to the television device 72 via the remote control device 3.

  Furthermore, since the remote control device 3 has a simple configuration in which the infrared reflection portion 7 is simply attached to the surface thereof, the structure is not complicated and large, and the user-friendliness is not hindered. As well as ease of use.

  Further, in the television system 70, the gesture pattern / control code conversion table T1 registered in advance in the code conversion rule storage unit 24 is changed to a new gesture pattern / control code conversion table T1N changed to a user desired gesture pattern. This can be re-registered in the code conversion rule storage unit 24.

  Accordingly, the television device 72 can generate a new gesture pattern / control code conversion table T1N customized with a gesture pattern that is easy to move for the user via the remote control device 3, so that the user can connect via the remote control device 3. Usability when the television apparatus 72 is remotely controlled can be further improved.

  According to the above configuration, the television system 70 has a gesture pattern desired by the user while the user holds the remote control device 3 without complicating and increasing the structure of the television device 72 and the remote control device 3. The television apparatus 2 can be remotely controlled only by moving along, and thus the operability of the user can be further improved with a simple configuration.

(5) Other Embodiments In the first to fourth embodiments described above, only one infrared reflecting portion 7 is provided on one surface of the distal end portion of the remote control device 3. As described above, the present invention is not limited to this, and one or a plurality of infrared reflecting portions 7 may be provided on all surfaces such as the side surface, top surface, and bottom surface of the tip portion.

  In the first to fourth embodiments described above, the television devices 2, 52, 62, and 72 to which the infrared camera 5 and the infrared irradiator 4 are externally attached are used. Said.

  However, the present invention is not limited to this, and as shown in FIG. 19, a television device 82 in which the infrared camera 5 and the infrared irradiator 4 are incorporated in advance may be used.

  Further, in the first to fourth embodiments described above, the case where the remote control device 3 having the flat plate-like infrared reflecting portion 7 attached to the tip portion is used has been described.

  However, the present invention is not limited to this, and as shown in FIG. 20, a spherical shape in which a remote control code light emitting portion 86 is provided at the tip of the remote control main body portion 83A provided with the remote control button group 83 at the center of the apex portion. A remote control device 83 having an infrared reflecting portion 87 made of

In this case, since the remote control device 83 includes the spherical infrared reflecting portion 87, the infrared irradiator 4 is always in a good state regardless of the orientation when the user holds the remote control device 83. infrared radiation beam IF _OUT from can be reflected by the infrared reflecting portion 87.

  At this time, in the television apparatus 2 (52, 62 and 72), the reflected image extraction unit 21 actually corresponds to the first frame of the reflected image video data D1 photographed by the infrared camera 5, as shown in FIG. The reflected image 8G that approximates the shape and size of the spherical infrared reflector 87 in the remote control device 83 is identified from the reflected image G10 to be extracted, and only the reflected image 8G is extracted.

  At this time, as shown in FIG. 22, the reflected image extraction unit 21 uses the reflected image extracted image G11 including only the reflected image 8G as the first frame, and reflects the extracted image of the reflected image 8G. The data D2 may be sent to the motion detection unit 22.

  Furthermore, in the first to fourth embodiments described above, the television apparatuses 2, 52, 62, and 72 are configured by hardware as shown in FIGS. Although the case has been described, the present invention is not limited to this, and may be a software configuration based on a CPU and application programs.

  Furthermore, in the first to fourth embodiments described above, the infrared irradiator 4 as an infrared irradiating unit, the infrared camera 5 as an imaging unit, the reflected image extracting unit 21 as a reflected image extracting unit, and the movement About the case where the television apparatus 2, 52, 62 and 72 as the information processing apparatus of the present invention are configured by the motion detection section 22 as the detection section, the code conversion section 23 as the process execution section, and the control section 30. Stated.

  However, the present invention is not limited to this, and the information processing apparatus of the present invention may be configured by an infrared irradiation unit, an imaging unit, a reflected image extraction unit, a motion detection unit, and a processing execution unit having various other configurations. .

  The information processing apparatus, information processing method, remote control apparatus, and information processing system of the present invention include, for example, a DVD (Digital Versatile Disc) recorder, a personal computer, and a PDA (Personal Digital) that are remotely controlled by a remote control device in addition to a television device. Assistant), game machines, mobile phones, air conditioners, and other various electronic devices.

It is a rough-line perspective view which shows the whole structure of the television system in the 1st Embodiment thru | or 4th Embodiment of this invention. It is an approximate line sectional view showing the structure of a retroreflection material. It is a basic diagram with which it uses for description of the principle of operation of a retroreflection material. It is a rough-line perspective view which shows the operation example of a retroreflection material. 1 is a schematic block diagram illustrating a configuration of a television device according to a first embodiment. It is a basic diagram which shows the reflected image image by an infrared camera. It is a basic diagram which shows a reflected image extraction image. It is a basic diagram which shows a gesture pattern. It is a basic diagram which shows a gesture pattern / control code conversion table. It is a rough-line block diagram which shows the circuit structure of a remote control device. It is a basic block diagram which shows the structure of the television apparatus in 2nd Embodiment. It is a basic block diagram which shows the structure of the television apparatus in 3rd Embodiment. It is a basic block diagram which shows the structure of the television apparatus in 4th Embodiment. It is a basic diagram which shows a gesture list screen. It is a basic diagram which shows the function selection screen for gesture customization registration. It is a basic diagram which shows the function registration start screen for gesture customization registration. It is a basic diagram which shows the function registration completion | finish screen for gesture customization registration. It is a basic diagram which shows the gesture list screen after customization. It is a rough-line perspective view which shows the structure of the television apparatus in other embodiment. It is a rough-line perspective view which shows the structure of the remote control apparatus in other embodiment. It is a basic diagram which shows the reflected image image by the infrared camera in other embodiment. It is a basic diagram which shows the reflected image extraction image in other embodiment.

Explanation of symbols

  1, 50, 60, 70: Television system, 2, 52, 62, 72, 82: Television device, 3, 83: Remote control device, 4: Infrared camera, 5: Infrared irradiator, 6 ...... Remote control code light emitting unit, 7 ... Infrared reflecting unit, 10 ... Digital television broadcast receiving unit 10 ... Gesture detecting unit 11 ... Antenna, 13 ... RF receiving unit, 14 ... Demodulating unit, 15 ... Demultiplexing unit, 16 ... Video decoding unit, 17 ... Audio decoding unit, 18 ... Video mixer, 21 ... Reflection image extraction unit, 22 ... Motion detection unit, 23 ... Code conversion unit, 24 ... Code conversion rule storage unit, 25... OSD display generation unit, 30... Control unit, 40... CPU, 41... ROM, 42 battery, 43.

Claims (7)

An infrared irradiation unit that emits infrared rays;
An infrared reflection unit that reflects the infrared irradiation light emitted from the infrared irradiation unit at the same reflection angle as the incident angle captures the infrared reflected light reflected by the infrared reflection unit provided on the surface of the remote control device. An imaging unit;
A reflection image extraction unit that extracts a reflection image corresponding to the infrared reflection unit based on a captured image obtained by the imaging unit;
A motion detector for detecting the motion of the reflected image;
An information processing apparatus comprising: a process execution unit that reads a control code associated with the motion pattern of the reflected image in advance and executes a process according to the control code. The processing execution unit has the same code as a control code associated in advance with the movement pattern of the reflected image and an input operation control code transmitted in response to an input operation to the input unit of the remote control device The information processing apparatus according to claim 1, wherein the information processing apparatus is a system that executes processing according to the control code or processing according to the input operation control code as the same content. The processing execution unit controls the infrared irradiation unit and the imaging unit to operate according to a specific input operation control code indicating mode switching transmitted in response to the input operation on the input unit of the remote control device. The information processing apparatus according to claim 1. The processing execution unit has a predetermined conversion table in which the motion pattern of the reflected image is associated with the control code, and the motion pattern of the reflected image newly detected by the motion detection unit The information processing apparatus according to claim 1, wherein the conversion table is customized by newly registering the control code in association with the control code. Infrared reflected light reflected from the infrared reflecting portion provided on the surface of the remote control device is provided with an infrared reflecting portion that reflects the infrared irradiation light emitted from the infrared irradiation portion that irradiates infrared rays at the same reflection angle as the incident angle. An imaging step of imaging by the imaging unit;
A reflected image extracting step of extracting a reflected image corresponding to the infrared reflecting unit based on the captured image obtained in the imaging step by a projective image extracting unit;
A motion detection step of detecting the motion of the reflected image by a motion detector;
An information processing method comprising: a process execution step of reading a control code associated with the motion pattern of the reflected image in advance by a process execution unit and executing a process corresponding to the control code by the process execution unit When the infrared irradiation light irradiated from the infrared irradiation unit is reflected at the same reflection angle as the incident angle, the infrared reflected light is imaged by the imaging unit, and the infrared reflected image is extracted based on the obtained captured image. And an information processing apparatus that detects the movement of the reflected image and executes a process according to a control code associated in advance with the movement pattern of the reflected image,
A remote control device comprising an infrared reflecting portion provided on the surface and configured to reflect the infrared ray at the same reflection angle as the incident angle. Infrared reflected light reflected from the infrared reflecting portion provided on the surface of the remote control device is provided with an infrared reflecting portion that reflects the infrared irradiation light emitted from the infrared irradiation portion that irradiates infrared rays at the same reflection angle as the incident angle. An imaging unit for imaging, a reflection image extraction unit for extracting a reflection image corresponding to the infrared reflection unit based on a captured image obtained by the imaging unit, a motion detection unit for detecting a motion of the reflection image, and the reflection An information processing apparatus that includes a processing execution unit that reads a control code associated in advance with an image movement pattern and executes processing according to the control code;
An information processing system comprising: a remote control device provided with the infrared reflection portion on a surface thereof and reflecting the infrared ray at the same reflection angle as the incident angle.

Images