JP3132391U - Input device - Google Patents

Abstract

An input device is provided in which an image is picked up by an image pickup means and an image pickup result is used as an input of an information processing device.
Input devices 3R and 3L, which are imaged by an image sensor and used as input of an information processing device and are mounted on an operator's hand, are arranged on the palm side of the operator, and the operator's fingers and / or Alternatively, retroreflective sheets 31R and 31L having perforations 32 that bend along the bending of the palm are provided. The retroreflective sheets 31R and 31L are arranged so as to be hidden in the operator's hand when the operator holds the hand. The retroreflective sheets 31R and 31L are arranged on the index finger side of the center line of the operator's palm.
[Selection] Figure 2

Description

  The present invention relates to an input device that is picked up by an image pickup means and whose image pickup result is used as an input of an information processing device, and related technology.

  Patent Document 1 by the present applicant discloses an input system using a strobe camera and a retroreflective sheet.

JP2004-85524

  An object of the present invention is to provide a novel input device which is picked up by an image pickup unit and whose image pickup result is used as an input of an information processing device.

  According to the first aspect of the present invention, in an input device that is imaged by an imaging unit and the imaging result is used as an input of an information processing device and is mounted on an operator's hand, It has a sheet-like marker which is arranged on the palm side and bends along the bend of the operator's finger and / or palm and has a linear bend.

  According to this configuration, when the operator holds the hand to hide the marker from the imaging means of the information processing apparatus, the marker also bends along the bent portion, so that the marker is positioned near the joint of the operator Even in such a case, the operator can smoothly hold the hand.

  The marker may be arranged to be hidden in the operator's hand when the operator holds a hand in the input device.

  According to this configuration, the operator can hide the marker from the information processing apparatus only by performing an operation of grasping the hand, and can easily perform input / non-input control. For example, the information processing apparatus can determine that there is an input because the marker is imaged when the operator opens his hand, and the marker is not imaged when the hand is closed. Judgment can be made.

  The marker may be arranged on the index finger side of the center line of the operator's palm in the input device.

  According to this configuration, when an operator who puts the input device on both hands contacts the right side of the right index finger and the left side of the left index finger with his hands open, the left and right markers are adjacent to each other. Can do. Thereby, two markers on the left and right appear as one image on the image obtained by the imaging means. The size of the image is naturally larger than the image when one of the left and right markers is captured. Therefore, the information processing apparatus compares the size of the image when the two left and right images of the marker appear on the image as one image, and the size of the image is only one of the markers. If it is larger, it can be considered that the operator has performed an action of bringing the two open hands closer together. With such a simple process, it is possible to detect an operation in which the operator opens both hands close to each other.

  According to the second aspect of the present invention, in the input device mounted on the operator's hand, which is captured by the imaging means and the imaging result is used as input of the information processing device, The marker is located on the palm side of the operator, and the marker is positioned on the index finger side of the center line of the palm of the operator.

  According to this configuration, when an operator who puts the input device on both hands contacts the right side of the right index finger and the left side of the left index finger with his hands open, the left and right markers are adjacent to each other. Can do. Thereby, two markers on the left and right appear as one image on the image obtained by the imaging means. The size of the image is naturally larger than the image when one of the left and right markers is captured. Therefore, the information processing apparatus compares the size of the image when the two left and right images of the marker appear on the image as one image, and the size of the image is only one of the markers. If it is larger, it can be considered that the operator has performed an action of bringing the two open hands closer together. With such a simple process, it is possible to detect an operation in which the operator opens both hands close to each other.

  The marker may be arranged to be hidden in the operator's hand when the operator holds a hand in the input device.

  In the first and second embodiments of the present invention, the marker may be a retroreflective sheet.

  Embodiments of the present invention will be described below with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals, and the description thereof is incorporated.

  FIG. 1 is a diagram showing an overall configuration of an information processing system using an input device according to an embodiment of the present invention. As shown in FIG. 1, this information processing system includes an information processing device 1, input devices 3 </ b> L and 3 </ b> R, and a television monitor 5. Hereinafter, the input device 3R and the input device 3L may be collectively referred to as the input device 3.

  FIG. 2 is a diagram illustrating the input device according to the embodiment of the present invention. FIG. 2 shows a state where the input device 3 and the operator's hand of FIG. 1 are viewed from the information processing device 1 side. As shown in FIG. 2, the input device 3R is attached to the operator's right hand, and the input device 3L is attached to the operator's left hand. The input device 3 is in the shape of a glove with a finger exposed. A retroreflective sheet 31R is attached to the input device 3R, and an input device 31L is attached to the input device 3L. Hereinafter, the retroreflective sheet 31R and the retroreflective sheet 31L may be collectively referred to as the retroreflective sheet 31.

  When the input device 3 is attached to the operator as shown in FIG. 1, the retroreflective sheet 31 is positioned on the interdigital ball between the index finger and the middle finger of the operator's palm. This position is a position where the retroreflective sheet 31 is hidden in the operator's hand by the operator's index finger and middle finger when the operator holds the hand. The retroreflective sheet 31 has a perforation 32 corresponding to the above-described bent portion in the vicinity of the brain line of the operator. When the operator holds a hand, the retroreflective sheet 31 is bent along the bend of the palm of the operator, with the perforation 32 serving as a bent portion.

  Further, since the retroreflective sheet 31 is arranged on the index finger side from the center line of the palm of the operator as described above, when the player brings the left hand and the right hand close to each other in the form shown in FIG. The sheets 31L and 31R are adjacent to each other.

  Returning to FIG. 1, the information processing apparatus 1 is connected to the television monitor 5 by the AV cable 7. Further, although not shown, the information processing apparatus 1 is supplied with a power supply voltage by an AC adapter or a battery. Although not shown, a power switch is provided on the back surface of the information processing apparatus 1.

  The information processing apparatus 1 is provided with an infrared filter 20 that transmits only infrared light on the front side thereof, and further, four infrared light emitting diodes 9 that generate infrared light are exposed so as to surround the infrared filter 20. is doing. Although not shown in FIG. 1, the image sensor 12 is disposed on the back side of the infrared filter 20. The image sensor 12 is a low-resolution CMOS image sensor (for example, 32 × 32 pixels).

  The four infrared light emitting diodes 9 emit infrared light intermittently. The infrared light from the infrared light emitting diode 9 is reflected by the retroreflective sheet 31 or 32 attached to the input device 3 and input to the image sensor 12 provided on the back side of the infrared filter 20. In this way, the input device 3 is photographed by the image sensor 12. When infrared light is irradiated intermittently, photographing processing by the image sensor 12 is performed even when infrared light is not irradiated. The information processing apparatus 1 obtains the difference between the image signal at the time of infrared light irradiation and the image signal at the time of non-irradiation of the input device 3 moved by the operator, and based on the difference signal DI (difference image DI). The position of the input device 3 (that is, the retroreflective sheet 31) is calculated.

  Thus, by obtaining the difference, noise due to light other than the reflected light from the retroreflective sheet 31 can be removed as much as possible, and the retroreflective sheet 31 can be detected with high accuracy.

  FIG. 3 is a diagram showing an electrical configuration of the information processing apparatus 1 of FIG. As illustrated in FIG. 3, the information processing apparatus 1 includes a multimedia processor 10, an image sensor 12, an infrared light emitting diode 9, an external memory 16, and a bus 18. Specifically, the external memory 16 includes a read only memory (ROM), a random access memory (RAM), and / or a flash memory.

  The multimedia processor 10 can access the external memory 16 through the bus 18. Therefore, the multimedia processor 10 can execute the program stored in the external memory 16 and can read and process the data stored in the external memory 16. The external memory 16 stores programs, image data, audio data, and the like in advance.

  Although not shown, the multimedia processor includes a central processing unit (hereinafter referred to as “CPU”), a graphics processing unit (hereinafter referred to as “GPU”), and a sound processing unit (hereinafter referred to as “SPU”). ), A geometry engine (hereinafter referred to as “GE”), an external interface block, a main RAM, an A / D converter (hereinafter referred to as “ADC”), and the like.

  The CPU executes programs stored in the external memory 16 to perform various calculations and control of the entire system. As processing of the CPU related to graphics processing, a program stored in the external memory 16 is executed, and parameters for enlargement / reduction, rotation, and / or translation of each object, viewpoint coordinates (camera coordinates), and line-of-sight vector are calculated. Perform calculations. Here, a unit composed of one or a plurality of polygons or sprites and applied with the same transformation of enlargement / reduction, rotation, and translation is called an object.

  The GPU generates a three-dimensional image composed of polygons and sprites in real time and converts it into an analog composite video signal. The SPU generates PCM (Pulse Code Modulation) waveform data, amplitude data, and main volume data, and analog-multiplies them to generate an analog audio signal. The GE performs a geometric operation for displaying a three-dimensional image. Specifically, the GE performs operations such as matrix product, vector affine transformation, vector orthogonal transformation, perspective projection transformation, vertex brightness / polygon brightness calculation (vector inner product), and polygon back surface culling processing (vector outer product).

  The external interface block is an interface with peripheral devices (in this embodiment, the image sensor 12 and the infrared light emitting diode 9), and includes a 24-channel programmable digital input / output (I / O) port. The ADC is connected to four-channel analog input ports, and converts an analog signal input from an analog input device (in this embodiment, the image sensor 12) into a digital signal via these. The main RAM is used as a CPU work area, a variable storage area, a virtual storage mechanism management area, and the like.

  Now, the input device 3 is irradiated with the infrared light of the infrared light emitting diode 9, and the infrared light is reflected by the retroreflective sheet 31. The reflected light from the retroreflective sheet 31 is photographed by the image sensor 12. Therefore, an image signal including the retroreflective sheet 31 is output from the image sensor 12. As described above, the multimedia processor 10 intermittently blinks the infrared light-emitting diode 9 for flash photography, so that the image sensor 12 also outputs an image signal when the infrared light is extinguished. These analog image signals from the image sensor 12 are converted into digital data by an ADC built in the multimedia processor 10.

  The multimedia processor 10 generates the difference signal DI (difference image DI) from the digital image signal input from the image sensor 12 via the ADC, and based on this, determines whether there is an input by the input device 3 or The position of the input device 3 is calculated, other calculations, graphic processing, sound processing, etc. are executed, and a video signal and an audio signal are output. The video signal and the audio signal are given to the television monitor 5 through the AV cable 7, and accordingly, an image is displayed on the television monitor 5, and sound is output from a speaker (not shown).

  Next, some examples of the input operation performed by the operator will be described with reference to the drawings.

  As shown in FIG. 2, the operator holds the retroreflective sheet 31 toward the information processing apparatus 1 and inputs an input to the information processing apparatus 1 by holding or opening the hand or moving it in the open state. give.

  First, the information processing apparatus 1 determines input (first input) / non-input depending on whether an image of the retroreflective sheet 31 is reflected on the differential image DI. As described above, since the retroreflective sheet 31 is arranged in a position hidden in the operator's hand by the operator's middle finger and index finger when the operator holds the hand, the operator can open and close the hand. Thus, the retroreflective sheet 31 can be copied to the image sensor 12 or not, so that input (first input) / non-input can be controlled.

  Further, the information processing apparatus 1 determines the amount of movement of an object such as a cursor or a character displayed on the television monitor 7 according to the amount of movement of the image of the retroreflective sheet 31. That is, the operator can move the object by opening and moving the hand.

  FIG. 4 is a diagram illustrating a state in which the operator brings the right hand and the left hand closer to and in contact with the state illustrated in FIG. 2. As shown in FIG. 4, when the operator makes the input devices 3L and 3R contact each other in an open state, the retroreflective sheets 31L and 31R are adjacent to each other. At this time, since the image sensor 12 has a low resolution as described above, the two left and right images of the retroreflective sheet 31 appear as one image on the difference image DI without being distinguished. At this time, the size of the image is about twice as large as when the operator closes one of the left and right hands and only one image of the retroreflective sheet 31L or 31R is captured. The information processing apparatus 1 captures the two right and left images of the retroreflective sheet 31 as one image by imaging, and the size of the image when only one of the retroreflective sheets 31L or R is captured. It is determined that there is a second input when the input is approximately twice as large as the above. That is, the operator can perform the second input by bringing the left and right retroreflective sheets 31 close to each other as shown in FIG.

  As described above, according to the present embodiment, the operator can hide the retroreflective sheet 31 from the information processing apparatus 1 only by performing an operation of grasping a hand, and can easily input (first input). / Non-input control can be performed.

  When the operator performs an operation of grasping the hand to hide the retroreflective sheet 31 from the information processing apparatus 1, the retroreflective sheet 31 is also bent along the perforation 32, so that the operator smoothly performs an operation of grasping the hand. be able to.

  The present invention is not limited to the above-described embodiment, and can be implemented in various modes without departing from the gist thereof. For example, the following modifications are possible.

  In the above description, the number of the bent portions (perforations 32) provided in the retroreflective sheet 31 is one, but a plurality of the bent portions may exist. It may be designed according to the joints, brain lines, emotion lines, etc. of the operator near the retroreflective sheet 31.

  Further, in the above, by providing the retroreflective sheet 31 with a bent portion (perforation 32), the operator can easily grasp the hand. However, for example, the retroreflective sheet is formed on the basis of the position where the perforation 32 is present. You may divide into two upper and lower sheets.

  In the above description, the retroreflective sheet 31 is used as a marker, but the type of marker is not limited to this. For example, a light emitter such as a light emitting diode may be used. In that case, it is unnecessary to provide a device corresponding to the light emitting diode 9 of the information processing apparatus 1.

1 is a diagram illustrating an overall configuration of an information processing system using an input device according to an embodiment of the present invention. It is a figure explaining the input device in embodiment of this invention. It is a figure which shows the electrical constitution of the information processing apparatus 1 of FIG. It is a figure which shows the state which the operator made the right hand and the left hand approach from the state of FIG. 2, and contacted the retroreflective sheet | seat 31 on either side.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 3R and 3L ... Input device, 31R and 31L ... Retroreflection sheet, 32 ... Perforation, 5 ... Television monitor, 7 ... AV cable, 9 ... Red light emitting diode, 20 ... Infrared filter, 12 ... Image sensor

Claims (6)

In an input device mounted on an operator's hand, which is imaged by an imaging means, and the imaging result is used as an input of an information processing device
In the mounted state of the input device, it is arranged on the palm side of the operator, and has a sheet-like marker having a linear bend that bends along the bend of the operator's finger and / or palm. Input device.   The input device according to claim 1, wherein the marker is arranged to be hidden in an operator's hand when the operator holds a hand in the input device.   The input device according to claim 1, wherein the marker is arranged on the index finger side of the center line of an operator's palm in the input device. In an input device mounted on an operator's hand, which is imaged by an imaging means, and the imaging result is used as an input of an information processing device
In the mounted state of the input device, it has a sheet-like marker arranged on the palm side of the operator,
The input device according to claim 1, wherein the marker is located closer to the index finger side than the center line of the palm of the operator.   The input device according to claim 4, wherein the marker is arranged to be hidden in an operator's hand when the operator holds a hand in the input device.   The input device according to claim 1, wherein the marker is a retroreflective sheet.