JP2015152448A - Information processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processor capable of operating with a simple gesture.SOLUTION: A personal computer 1 includes: a projection part 100 that projects a beam of light of a predetermined wavelength to a target area; an imaging part 200 that receives a beam of reflected light from the target area to take an image of the target area; an information input plane Pi on which a keyboard 4 is disposed; and a main body part 11 which includes an information input plane Pi as the upper face. The imaging part 200 takes an image of the target area via a window part 11b which is disposes at the rear-side than the keyboard 4 on the main body part 11. The reception light axis of the imaging part 200 is inclined at a predetermined inclination angle relative to an information input plane Pi. With this, a user is allowed to operate with a simple gesture.

Description

  The present invention relates to an information processing apparatus that acquires information in a target area.

  Conventionally, an information processing apparatus including an object detection unit using light has been developed in various fields (for example, Patent Document 1). In this type of information processing apparatus, an imaging unit including an image sensor and a projection unit that projects light onto a target area are arranged at the top of the display.

JP 2008-225985 A

  However, when the projection unit and the imaging unit are arranged at the top of the display as described above, the user needs to hold his hand up to the top of the display for a gesture operation. As described above, when a large-scale operation is required for the gesture operation, other operations of the user may be hindered.

  In view of the above problems, an object of the present invention is to provide an information processing apparatus capable of performing a gesture operation with a simple operation.

  A main aspect of the present invention relates to an information processing apparatus. The information processing apparatus according to this aspect includes a projection unit that projects light of a predetermined wavelength onto a target region, an imaging unit that receives reflected light from the target region and images the target region, and an information input unit An information input surface, and a main body having the information input surface as an upper surface. The imaging unit captures the target area through a window disposed on the back side of the information input unit of the main body, and a light receiving optical axis of the imaging unit is predetermined with respect to the information input surface Tilt at an inclination angle of.

  ADVANTAGE OF THE INVENTION According to this invention, the information processing apparatus which can perform gesture operation by simple operation | movement can be provided.

  The effects and significance of the present invention will become more apparent from the following description of embodiments. However, the embodiment described below is merely an example when the present invention is implemented, and the present invention is not limited to the following embodiment.

It is a figure which shows the external appearance structure of the personal computer which incorporated the object detection part which concerns on embodiment. It is a figure which shows the structure of the information processing apparatus which concerns on embodiment. It is a figure which shows the structure of the information processing apparatus which concerns on embodiment. It is a figure which shows the structure of the information processing apparatus which concerns on embodiment. It is a figure explaining the gesture detection method which concerns on embodiment. It is a flowchart which shows the process of the gesture detection which concerns on embodiment. It is a figure for demonstrating the appearance of the hand according to the imaging direction which concerns on embodiment. It is a figure for demonstrating the conditions which detect the operation finger which concerns on embodiment appropriately. It is a graph explaining the conditions which detect the operation finger which concerns on embodiment appropriately. It is a figure for demonstrating the conditions which distinguish a rotation gesture and a swing gesture which concern on embodiment. It is a figure for demonstrating the conditions which distinguish a rotation gesture and a swing gesture which concern on embodiment. It is a graph which shows the conditions which distinguish the rotation gesture and swing gesture which concern on embodiment. It is a graph which shows the conditions which distinguish the rotation gesture and swing gesture which concern on embodiment. It is a figure which shows the structure of the information processing apparatus at the time of using the prism which concerns on the example of a change. It is a figure explaining the inclination-angle of the optical axis of the prism which concerns on the example of a change. It is a graph which shows the lower surface inclination angle of the prism which concerns on the example of a change, and the inclination angle of the optical axis of an imaging part. It is a graph which shows the lower surface inclination angle of the prism which concerns on the example of a change, and the inclination angle of the optical axis of an imaging part. It is a figure explaining the installation method of the prism which concerns on the example of a change. It is a figure which compares the height at the time of tilting the whole apparatus with the height at the time of using the prism which concerns on the example of a change. It is a graph which shows the apex angle of the prism which concerns on the example of a change, and the inclination angle of a lower surface. It is a graph which shows the apex angle and height of the prism which concerns on the example of a change. It is a figure explaining the structure which inclines an optical axis using HOE which concerns on the example of a change. It is a figure which shows the structure of the information processing apparatus which concerns on the example of a change. It is a figure which shows the sensitivity of the image sensor which concerns on the example of a change, and the waveform of the distance conversion function which prescribes | regulates the relationship between a luminance value and distance.

  Embodiments of the present invention will be described below with reference to the drawings.

  In the present embodiment, the present invention is applied to a notebook personal computer. In addition, the present invention can be applied to other devices as appropriate.

  FIG. 1A is a diagram showing a schematic configuration of a personal computer 1 according to the present embodiment. FIG. 1B is a partially enlarged view around the information acquisition unit 2. In FIG. 1B, the inside of the main body portion 11 is shown to be seen through.

  As shown in FIG. 1A, the personal computer 1 includes a main body unit 11 and a monitor unit 12. The main body 11 has a shape in which rectangular corners are rounded in plan view, and includes an information acquisition unit 2 and an information processing unit 3. In addition, the main body 11 includes a keyboard 4 and an operation pad 5 on the upper surface Pi. The monitor unit 12 includes a monitor 6. An upper surface Pi on which information input units such as the keyboard 4 and the operation pad 5 are arranged is referred to as an “information input surface”.

  The information acquisition unit 2 projects light (infrared light) in an infrared wavelength band longer than the visible light wavelength band over the entire target region, and receives the reflected light with a CMOS image sensor, thereby achieving the target. Imaging information of an object existing in the region is acquired. As shown in FIG. 1B, the information acquisition unit 2 is attached to the inside of the main body 11 with the front-rear direction tilted from the Z-axis direction to the in-plane direction of the YZ plane. The information acquisition unit 2 is disposed on the back side (Y-axis negative side) of the keyboard 4 of the main body 11.

  The information processing unit 3 detects a predetermined object existing in the target area based on the imaging information acquired by the information acquisition unit 2, and further detects the movement of the object. Then, the information processing unit 3 controls the function of the personal computer 1 according to the movement of the object.

  For example, when the user performs a predetermined gesture using his / her hand, imaging information corresponding to the gesture is transmitted from the information acquisition unit 2 to the information processing unit 3. Based on this information, the information processing unit 3 detects the user's hand as a detection target object, and functions associated with the movement of the hand (screen enlargement / reduction, screen brightness adjustment, page turning, etc.) Execute.

  FIG. 2 is a diagram showing the configuration of the information acquisition unit 2 and the information processing unit 3.

  The information acquisition unit 2 includes a projection unit 100 and an imaging unit 200 as the configuration of the optical unit. The projection unit 100 and the imaging unit 200 are arranged so as to be aligned in the X-axis direction.

  The projection unit 100 includes four light sources 110 that emit light in the infrared wavelength band. By using the four light sources 110 in this way, even if each of the light sources 110 has a low output, light can be emitted with a large light emission amount. Thereby, the temperature rise amount of the light source 110 can be suppressed, and the reliability of the light source 110 can be maintained.

  The imaging unit 200 includes an aperture 210, an imaging lens 220, a filter 230, and a CMOS image sensor 240. In addition, the information acquisition unit 2 includes a CPU (Central Processing Unit) 21, an infrared light source driving circuit 22, an imaging signal processing circuit 23, an input / output circuit 24, and a memory 25 as a circuit unit. Yes.

  Light projected from the four light sources 110 onto the target area is reflected by an object existing in the target area, and enters the imaging lens 220 via the aperture 210.

  The aperture 210 limits light from the outside so as to match the F number of the imaging lens 220. The imaging lens 220 collects the light incident through the aperture 210 on the CMOS image sensor 240. The filter 230 is a bandpass filter that transmits light in the wavelength band including the emission wavelength of the light source 110 and cuts light in the visible wavelength band.

  The CMOS image sensor 240 is a color image sensor having sensitivity to the wavelength band of visible light and the wavelength band of infrared light emitted from the light source 110. The CMOS image sensor 240 receives the light collected by the imaging lens 220 and outputs a signal corresponding to the amount of received light to the imaging signal processing circuit 23 for each pixel. Here, in the CMOS image sensor 240, the output speed of the signal is increased so that the signal of the pixel can be output to the imaging signal processing circuit 23 with high response from the light reception in each pixel.

  The CPU 21 controls each unit according to a control program stored in the memory 25. With this control program, the functions of the light source control unit 21a and the imaging information acquisition unit 21b are given to the CPU 21.

  The light source control unit 21 a controls the infrared light source driving circuit 22. The imaging information acquisition unit 21b acquires imaging information related to a detection target object such as luminance information based on a signal output from the CMOS image sensor 240.

  The infrared light source driving circuit 22 drives the four light sources 110 according to control signals from the CPU 21.

  The imaging signal processing circuit 23 drives the CMOS image sensor 240 under the control of the CPU 21, acquires a luminance signal from each signal output from the CMOS image sensor 240, and outputs the acquired signal to the CPU 21. . The imaging signal processing circuit 23 applies the exposure time set by the CPU 21 to each pixel of the CMOS image sensor 240, and further applies the gain set by the CPU 21 to the signal output from the CMOS image sensor 240. A luminance signal is acquired for each pixel.

  The input / output circuit 24 controls data communication with the information processing unit 3.

  The memory 25 is used not only as a control program executed by the CPU 21 but also as a work area during processing in the CPU 21.

  The information processing unit 3 includes a CPU 31, an input / output circuit 32, and a memory 33. In addition to the configuration shown in FIG. 2, the information processing unit 3 is provided with a configuration for driving and controlling each unit of the personal computer 1. For convenience, the configuration of these peripheral circuits is not shown.

  The CPU 31 controls each unit according to a control program stored in the memory 33. With this control program, the function of the function detection unit 31b for controlling the function of the personal computer 1 is given to the CPU 31 in accordance with the function of the object detection unit 31a and the signal from the object detection unit 31a.

  The object detection unit 31a extracts the shape of the object from the imaging information acquired by the imaging information acquisition unit 21b, and further detects the movement of the extracted object shape. The function control unit 31b determines whether the movement of the object detected by the object detection unit 31a matches a predetermined movement pattern. If the movement of the object matches the predetermined movement pattern, the movement pattern The control corresponding to is executed.

  FIG. 3 is a schematic diagram showing the configuration of the information acquisition unit 2.

  With reference to FIG. 3, the information acquisition unit 2 includes a projection unit 100, an imaging unit 200, a light shielding unit 300, a circuit board 400, and a circuit unit 500.

  The projection unit 100 includes the four light sources 110 as described above. The four light sources 110 are made up of light emitting diodes (LEDs). A light emitting element (not shown) that emits infrared light is accommodated in a housing. Infrared light emitted from the light emitting element is emitted to the outside at a predetermined radiation angle from the emission portion on the upper surface. As shown in FIG. 3, the four light sources 110 are mounted on the circuit board 400.

  The imaging unit 200 includes an aperture 210, a lens barrel 250 that houses the imaging lens 220, a filter 230, and an imaging lens holder 260 that houses the CMOS image sensor 240. The CMOS image sensor 240 is mounted on the circuit board 400. The imaging lens 220 is attached to the lens barrel 250, and the lens barrel 250 is attached to the imaging lens holder 260 while holding the imaging lens 220. The imaging lens holder 260 has a recess on the lower surface, and the filter 230 is attached to the recess. Thus, the imaging lens holder 260 is installed on the circuit board 400 so as to cover the CMOS image sensor 240 while holding the imaging lens 220 and the filter 230.

  The light shielding unit 300 is formed of a material having elasticity and light shielding properties. The light shielding unit 300 prevents stray light from the projection unit 100 from entering the imaging unit 200.

  In addition to the projection unit 100 and the imaging unit 200, the circuit unit 500 constituting the information acquisition unit 2 is mounted on the circuit board 400. The CPU 21, infrared light source driving circuit 22, imaging signal processing circuit 23, input / output circuit 24, and memory 25 shown in FIG. 2 are included in the circuit unit 500.

  FIG. 4A is a perspective view showing a state where the information acquisition unit 2 is assembled to the main body 11. FIGS. 4B and 4C are schematic diagrams illustrating examples of gestures for the information acquisition unit 2.

  As shown in FIG. 4A, the information acquisition unit 2 is attached to the main body 11 so that the front-rear direction is slightly inclined from the Z-axis direction to the in-plane direction of the YZ plane. An opening 11 a is formed in the main body 11 so as to cover the upper surfaces of the projection unit 100 and the imaging unit 200. A window portion 11b is fitted in the opening 11a. The window 11b is configured to cut visible light and transmit light in the wavelength band of infrared light emitted from the light source 110.

  When light is projected onto the upper portion of the information acquisition unit 2 by the four light sources 110, the light passes through the window portion 11b and is directed toward the upper periphery of the keyboard 4 as shown in FIGS. 4 (b) and 4 (c). Projected. The window part 11b is arrange | positioned in the information input surface Pi of the back | inner side (Y-axis negative side) rather than the keyboard 4, and the information acquisition unit 2 is attached diagonally with respect to the window part 11b. Thereby, the target area around the upper part of the keyboard 4 is imaged by the imaging unit 200. Therefore, the user can easily perform a gesture with a finger while placing his hand on the palm rest Pa.

  As the types of gestures, for example, as shown in FIG. 4 (b), a gesture that moves in the left-right direction with a finger raised, or along a circular shape with a finger raised as shown in FIG. 4 (c). Gesture that moves is assumed. A gesture that moves in the left-right direction as shown in FIG. 4B is called a “lateral gesture”, and a gesture that moves along a circular shape as shown in FIG. 4C is called a “rotation gesture”.

  5A to 5D are diagrams for explaining a gesture detection method. 5A is a schematic diagram illustrating a region (imaging region) captured by the imaging unit 200, and FIG. 5B is a schematic diagram illustrating an image (captured image) captured by the imaging unit 200. FIG. 5C is a schematic diagram showing a region (uniform region) having substantially uniform luminance values, and FIG. 5D is a schematic diagram showing a reference point (marker) for detecting the movement of the object. Note that the captured images in FIGS. 5B and 5D are shown to be brighter as the luminance value is higher and darker as the luminance value is lower.

  As shown in FIG. 5A, when the user raises his index finger and holds his hand over the imaging area with the other fingers folded, the CMOS image sensor 240 generates a captured image as shown in FIG. To be acquired. The luminance value acquired via the CMOS image sensor 240 decreases as the distance to the object increases, and increases as the distance to the object decreases. Therefore, in the captured image shown in FIG. 5B, the luminance value corresponding to the hand region is higher than the luminance values of the other regions.

  Such a captured image is transmitted from the information acquisition unit 2 to the information processing unit 3, and an object detection process is performed by the object detection unit 31 a of the information processing unit 3.

  As shown in FIGS. 5 (a) and 5 (b), when performing a gesture with an index finger raised, areas such as each finger part and palm part where the distance to the CMOS image sensor 240 is substantially equal are substantially uniform luminance. It is a value. In addition, the index finger that is the target of the gesture operation has a larger ratio of the vertical width to the horizontal width (aspect ratio) than the other fingers and palm portions. Therefore, it is possible to detect the finger to be operated by extracting a region having a substantially uniform luminance value and comparing the aspect ratio of this region. In this way, a finger that is an operation target of a gesture is referred to as an “operation finger”. A region where the extracted luminance values are substantially uniform is referred to as a “uniform region”.

  For example, as shown in FIG. 5C, when the uniform areas S1 to S5 along the shape of each finger and the uniform area S6 along the shape of the palm are extracted, the vertical width of the uniform areas S1 to S6 is extracted. L1 to L6 and lateral widths W1 to W6 are calculated, and the respective aspect ratios are calculated. For example, the vertical width L2 of the uniform region S2 corresponding to the index finger is significantly larger than the horizontal width W2, and the vertical width L4 of the uniform region S4 corresponding to the ring finger is slightly larger than the horizontal width W4. Further, the vertical width L6 of the uniform region S6 corresponding to the palm portion is smaller than the horizontal width W6. The aspect ratios of the uniform areas S1, S3 and S5 corresponding to the other fingers are substantially the same as the uniform area S4. As described above, the aspect ratio of the uniform region S2 corresponding to the index finger is significantly larger than those of the uniform regions S1 and S3 to S6 corresponding to the other fingers. Therefore, it is possible to detect that the uniform region S2 corresponding to the index finger is a uniform region corresponding to the operating finger by selecting the uniform region having the largest aspect ratio difference between the uniform regions and the largest aspect ratio. .

  When the uniform region corresponding to the operating finger is extracted in this way, a point serving as a reference for gesture detection is set at the tip of the operating finger. A point serving as a reference for gesture detection is referred to as a “marker”. For example, as shown in FIG. 5D, the marker M is set at the pixel of the coordinate located at the uppermost position of the uniform region S2 extracted as the operation finger.

  Similarly, the extraction of the operating finger and the setting of the marker M are performed on the captured images acquired every predetermined time. By acquiring the change over time of the coordinate position of the marker M, the movement (gesture) of the object can be detected.

  FIG. 6 is a flowchart showing a gesture detection process. 6 is executed by the function of the object detection unit 31a among the functions of the CPU 31 shown in FIG.

  When the target area is imaged by the information acquisition unit 2 and the captured image is acquired by the information processing unit 3 (S101: YES), the CPU 31 refers to the luminance value of each pixel in the captured image, and the difference in luminance value is predetermined. The uniform region Si within the range ΔB is extracted (S102). The CPU 31 calculates the aspect ratio Ai by dividing the extracted vertical width Li of the uniform region Si by the horizontal width Wi (S103). Then, the CPU 31 determines whether there is a combination of uniform regions Si in which the difference in aspect ratio Ai is equal to or greater than a predetermined threshold Sh (S104).

  If there is no combination of uniform areas Si in which the difference in aspect ratio Ai is equal to or greater than the predetermined threshold Sh (S104: NO), the CPU 31 returns the process to S101 and waits for the next captured image to be acquired. When there is a combination of uniform areas Si in which the difference in the aspect ratio Ai is equal to or greater than the predetermined threshold Sh (S104: YES), the CPU 31 sets the coordinate position of the tip of the uniform area Si with the largest aspect ratio Ai as the marker M. The coordinate position of the marker M is stored in the memory 33 (S105). Then, the CPU 31 calculates the displacement of the coordinate position of the marker M stored in the memory 33 (S106).

  The CPU 31 determines whether or not the calculated displacement of the coordinate position of the marker M matches a predetermined movement pattern (gesture) (S107). If the predetermined motion pattern is not met (S107: NO), the CPU 31 advances the process to S110. When matching with the predetermined movement pattern (S107: YES), the CPU 31 outputs a function control signal (S108). When receiving the function control signal, the function control unit 31b of the CPU 31 executes the functions of the personal computer 1 (screen enlargement / reduction, screen brightness adjustment, page feed, etc.) according to the signal.

  When the function corresponding to the gesture is executed, the CPU 31 resets the coordinate position of the marker M stored in the memory 33 (S109). Then, the CPU 31 determines whether or not the object detection is finished (S110). When the object detection operation has not ended (S110: NO), the CPU 31 returns the process to S101 and waits for the next captured image to be acquired. Then, when the next captured image is acquired (S101: YES), the CPU 31 executes processing subsequent to S102, and executes setting processing and motion detection processing of the marker M from the captured image (S102 to S110). When the object detection process ends (S110: YES), the CPU 31 completes the process.

  FIGS. 7A to 7D are diagrams illustrating how the hand and the gesture appear according to the imaging direction. FIG. 7A is a schematic diagram illustrating a direction in which the hand is imaged by the imaging unit 200. FIG. 7B is a schematic diagram illustrating an imaging region when a hand is imaged from the front direction V2. FIG. 7C is a schematic diagram illustrating an imaging region when a hand is imaged from the downward direction V3. FIG. 7D is a schematic diagram illustrating an imaging region when a hand is imaged from the oblique direction V1.

  As shown in FIG. 7B, when the hand is imaged from the front direction V2, the vertical width Li of the index finger serving as the operation finger is reduced, and the difference from the aspect ratio of the other fingers is reduced. There is a possibility that the operating finger cannot be detected.

  Further, as shown in FIG. 7C, when the hand is imaged from the lower direction V3, only the displacement of the marker M in the left-right direction can be mainly acquired from the imaging unit 200 in spite of the rotation gesture. There is a risk of false detection as a swing gesture.

  On the other hand, as shown in FIG. 7D, when the hand is imaged from the oblique direction V1, the difference between the aspect ratio of the index finger and the aspect ratio of the other finger is large, and the operating finger is detected appropriately. In addition, the displacement of the marker M in the vertical and horizontal directions can be acquired from the imaging unit 200, and it can be appropriately detected that the gesture is a rotation gesture.

  In the present embodiment, since the information acquisition unit 2 is tilted and assembled with respect to the main body 11 of the personal computer 1, the user can easily perform a gesture operation while operating the keyboard 4. . In addition, since the hand can be imaged from an oblique direction, the user can appropriately detect the operation finger and can easily position the hand at an angle at which the rotation gesture and the swing gesture can be distinguished. .

  Thus, in order to detect a gesture appropriately, at least the operating finger needs to be detected properly. Furthermore, in order to deal with a large number of gestures, it is desirable that the rotation gesture and the sideways gesture can be distinguished.

<Conditions for operating finger detection>
The conditions of the tilt angle of the imaging unit 200 that can be detected appropriately by the operating finger will be described.

FIG. 8A is a schematic diagram for defining a region E that is easily misrecognized as an operation finger of a hand. FIG. 8B is a schematic diagram for defining an aspect ratio _AF for detecting the operating finger. 8 (c) is a schematic view for defining the aspect ratio A _P for detecting prone area erroneously recognized. As shown in FIG. 4A, the Z-axis corresponds to a direction perpendicular to the information input surface Pi of the main body 11, the Y-axis is parallel to the information input surface Pi, and from the window 11b. This corresponds to the direction toward the front side of the main body 11 (direction parallel to the short side of the main body 11). The X axis corresponds to a direction perpendicular to both the Z axis and the Y axis (a direction parallel to the long side of the main body portion 11).

As described above, in order to detect the operating finger, the aspect ratio of a region with substantially uniform luminance is used. Therefore, first, definition and aspect ratio A _F of the operation fingers, the aspect ratio A _P detected easily region E erroneously operated finger. Note that the vertical direction of the operating finger corresponds to the YZ plane direction, and the horizontal direction corresponds to the XY plane direction.

As shown in FIG. 8A, when the vertical imaging field angle of the operating finger is Φ _FL and the horizontal imaging field angle is Φ _FW , the aspect ratio A _F of the operating finger is expressed by the following equation (1). It is.

As a part that is easily misrecognized as the aspect ratio _AF , a portion between the first joint and the second joint of the middle finger or the ring finger is assumed. This is because the vertical width of this part tends to be larger than the horizontal width.

The vertical imaging angle of misrecognition easily region E [Phi _PL, the next imaging angle of the [Phi _PW, the aspect ratio A _P misrecognition easily region E, represented by the following equation (2).

  That is, in order to distinguish the operation finger from the region E that is easily misrecognized, the following formula (3) needs to be satisfied.

At least, the aspect ratio A _F of the operation finger is greater than the aspect ratio A _P misrecognition easily region E, it is possible to distinguish the operation fingers with the other sites, it is possible to detect the proper operation finger It can be said.

Here, the aspect ratio _AF of the operating finger is organized based on the positional relationship and the hand structure of the imaging unit 200 and the hand.

As shown in FIG. 8B, when the angle formed by the straight line passing through the tip of the operating finger and the XY plane of the light receiving optical axis O of the imaging unit 200 is θ, the vertical imaging field angle Φ _FL of the operating finger. Is represented by the following equation (4).

Note that Φ _F0 is an angle formed between a line segment connecting the imaging point of the imaging unit 200 and the base part of the operating finger and the XY plane. θ corresponds to the inclination angle of the imaging unit 200.

The height in the Z-axis direction from the imaging unit 200 to the operating finger in the Z-axis direction is H, the distance in the Y-axis direction from the imaging unit 200 to the tip of the operating finger is D, and the length in the Y-axis direction of the operating finger is FL Then, the angle Φ _F0 formed between the line segment connecting the imaging point of the imaging unit 200 and the base part of the operating finger and the XY plane is expressed by the following equation (5).

Therefore, when arranging the equations (4) and (5), the vertical imaging angle of view Φ _FL of the operating finger is expressed by the following equation (6).

  Further, the height H in the Z-axis direction to the tip of the operating finger is expressed by the following equation (7).

The horizontal imaging field angle Φ _FW of the operating finger perpendicular to the vertical imaging field angle Φ _FL of the operating finger can be converted into the following equation (8), where the width in the X-axis direction of the finger is FW.

As described above, according to the above formulas (1) and (6) to (8), the aspect ratio _AF of the operating finger is determined by the inclination angle θ of the imaging unit 200, the length FL of the operating finger in the Y-axis direction, and the operation. Expressed by a relational expression of the width FW of the finger in the X-axis direction, the distance D in the Y-axis direction from the imaging unit 200 to the tip of the operating finger, or the height H in the Z-axis direction from the imaging unit 200 to the tip of the operating finger Can do.

Next, organized by the aspect ratio A _P misrecognition easily region E to the structure of the positional relationship and the hand of the hand and the imaging section 200.

  As shown in FIG. 8A, the tip of the region E that is easily misrecognized is positioned below the position of the second joint of the operating finger. That is, the distance EL in the Y-axis direction from the region E that is easily misrecognized to the tip of the operation finger corresponds to the length from the tip of the operation finger to the second joint.

As shown in FIG. 8C, the height in the Z-axis direction from the imaging unit 200 to the tip of the operating finger is H, the distance in the Y-axis direction from the imaging unit 200 to the tip of the operating finger is D, and the height of the operating finger If the length EL from the tip to the second joint of the operating finger and the length from the first joint to the second joint of the region E that is easily misrecognized are PL, the imaging field angle Φ _PL of the region E that is easily misrecognized is Is represented by the following equation (9).

  Further, the height H to the operation finger is expressed by the equation (10) as described above.

The horizontal imaging angle of view Φ _PW of the region E that is easy to misrecognize that is orthogonal to the vertical imaging angle of view Φ _PL of the region E that is easily misrecognized is PW as the width in the X-axis direction of the region E that is easily misrecognized It can convert into the following formula | equation (11).

Thus, the equation (2), (9) - (11), the aspect ratio A _P misrecognition easily region E, the inclination angle θ of the imaging unit 200, first from the tip of the operation finger of the operator finger Length EL up to two joints, length PL from the first joint to the second joint of the region E easily misrecognized, width PW of the region E easily misrecognized, and from the imaging unit 200 to the tip of the operating finger The distance D in the Y-axis direction or the height H in the Z-axis direction from the imaging unit 200 to the tip of the operating finger can be expressed by a relational expression.

  That is, the inclination angle θ of the imaging unit 200 for appropriately detecting the operating finger can be obtained by appropriately determining the following six parameters using the above formulas (1) to (11).

(1) Operating finger length FL
(2) FW width FW
(3) A distance D in the Y-axis direction from the imaging unit 200 to the tip of the operating finger or a height H in the Z-axis direction from the imaging unit 200 to the tip of the operating finger
(4) Length EL from the tip of the operation finger to the second joint of the operation finger
(5) Length PL from the first joint to the second joint of region E that is easily misrecognized
(6) Width PW of region E that is easily misrecognized
Thus, based on the positional relationship between the imaging unit 200, the hand, and the finger structure, the inclination angle θ of the imaging unit 200 for appropriately detecting the operating finger is obtained by using the equations (1) to (11). be able to.

  Here, generally, the length from the tip of the finger to the second joint of the finger is about 2/3 of the entire length of the finger. Therefore, the length EL from the tip of the operating finger to the second joint of the operating finger can be approximated by the following equation (12).

  In general, the length from the first joint to the second joint of the finger is about 1/3 of the entire length of the finger. Therefore, the length PL from the first joint to the second joint of the region E that is easily misrecognized can be approximated by the following equation (13).

  Further, in general, the widths of the index finger, the middle finger, and the ring finger are substantially the same. Therefore, the width PW of the region E that is easily misrecognized can be approximated by the following equation (14).

  Therefore, in consideration of the equations (12) to (14), the following three parameters may be determined in order to obtain the inclination angle θ of the imaging unit 200 for appropriately detecting the operating finger.

(1) Operating finger length FL
(2) FW width FW
(3) A distance D in the Y-axis direction from the imaging unit 200 to the tip of the operating finger or a height H in the Z-axis direction from the imaging unit 200 to the tip of the operating finger
Thus, based on the finger structure, the imaging unit for appropriately detecting the operating finger by approximating the relationship between the operating finger and the region E that is easily misrecognized using the equations (12) to (14). It is possible to reduce parameters for obtaining the inclination angle θ of 200. Thereby, the appropriate inclination angle θ of the imaging unit 200 can be easily obtained.

The inventors of the present application assume that the length of the operation finger is FL = 9 cm and the width of the operation finger is FW = 2 cm, and the distance D in the Y-axis direction from the imaging unit 200 to the tip of the operation finger is 3 cm, 5 cm, and 10 cm. In this case, the aspect ratios A _F and _AP and the inclination angle θ of the imaging unit 200 were calculated.

Figure 9 is a graph showing a calculation result example of the tilt angle θ of the aspect ratio A _P and the imaging unit 200 of the prone region E is erroneously recognized as the aspect ratio A _F of the operation the finger in a predetermined condition. 9, the horizontal axis is the inclination angle θ of the image pickup unit 200, the vertical axis represents the aspect ratio _{A F} or _{A P.}

Referring to FIG. 9, erroneous aspect ratio A _P recognized easily region E is the inclination angle θ of the imaging unit 200, and the parameter is changed in the Y-axis direction of the distance D from the imaging unit 200 to the distal end of the operating finger However, it is approximately 1.5. Thus, the aspect ratio A _P is the inclination angle θ of the imaging unit 200, and regardless of the distance D in the Y-axis direction from the imaging unit 200 to the distal end of the operating finger, it can be seen that a substantially constant.

The aspect ratio _AF of the operating finger increases as the tilt angle θ of the imaging unit 200 increases. This shows a similar tendency even when the distance D in the Y-axis direction from the imaging unit 200 to the tip of the operating finger increases. In addition, the aspect ratio _AF of the operating finger increases as the distance D in the Y-axis direction from the imaging unit 200 to the tip of the operating finger increases.

  Therefore, when D = 3 cm, which is the strictest condition, the condition of the inclination angle θ of the imaging unit 200 that satisfies the above formula (3) is the following formula (15).

  θ> 30 ° (15)

As in the above formula (15) is made larger than 30 ° angle of inclination θ of the imaging unit 200, the aspect ratio A _F of the operation finger becomes larger than the aspect ratio A _P misrecognition easily region E Therefore, it is possible to detect the operation finger properly without erroneous detection.

  Note that the possibility that the distance D in the Y-axis direction from the imaging unit 200 to the tip of the operating finger is set to be shorter than 3 cm is extremely low. Further, the length FL of the operation finger and the width FW of the operation finger usually do not vary greatly due to individual differences, and therefore, the inclination angle θ of the imaging unit 200 is set to be greater than 30 ° as in the above equation (15). By increasing the size, it is possible to properly detect the operation finger without erroneous detection in most situations.

  As shown in FIG. 9, from the viewpoint of preventing erroneous detection of the operating finger, it is desirable that the inclination angle θ of the imaging unit 200 is larger. However, as shown in FIG. 7, when the operation finger is imaged from the lower direction V <b> 3, it is not possible to distinguish between the rotation gesture and the sideways gesture.

<Conditions for distinguishing rotation gestures from side-to-side gestures>
A condition of the tilt angle θ of the imaging unit 200 that can distinguish between the rotation gesture and the sideways gesture will be described.

  FIG. 10A is a schematic diagram for defining the positional relationship between the rotation gesture and the hand. FIG. 10B is a schematic diagram for defining the positional relationship between the sideways gesture and the hand.

  As shown in FIG. 10A, when the hand is viewed obliquely from below, the locus of the rotation gesture looks like an ellipse. Also, as shown in FIG. 10B, when the hand is viewed obliquely from below, the trajectory of the sideways gesture looks like an arc shape. That is, the rotation gesture has a larger displacement in the vertical direction than the sideways gesture. Therefore, by making a difference between the aspect ratios, it is possible to distinguish the rotation gesture and the swing gesture.

For example, as shown in FIG. 10 (a), the vertical imaging angle of the rotation gesture [Phi _SV, when the lateral imaging angle of the [Phi _SH, the aspect ratio A _S of the rotation gesture, the following equation (16) Is represented by

Further, as shown in FIG. 10B, when the vertical imaging angle of view of the horizontal gesture is Φ _LV and the horizontal imaging angle of view is Φ _LH , the aspect ratio A _L of the horizontal gesture is expressed by the following formula ( 17).

  That is, in order to distinguish between the rotation gesture and the sideways gesture, the following formula (18) needs to be satisfied.

At least, if the aspect ratio A _S of the rotation gesture is smaller than the aspect ratio A _L of the horizontal gesture, it can be said that the rotation gesture and the horizontal gesture can be properly distinguished.

Here, organized on the basis of the aspect ratio A _S of the rotation gesture in the structure of the positional relationship and the hand of the hand and the imaging section 200.

11 (a) is a schematic view for defining the aspect ratio A _S of the rotation gesture. 11 (b) is a schematic view for defining the aspect ratio A _L of the oscillating gesture. As shown in FIG. 4A, the Z-axis corresponds to a direction perpendicular to the information input surface Pi of the main body 11, the Y-axis is parallel to the information input surface Pi, and from the window 11b. This corresponds to the direction toward the front side of the main body 11 (direction parallel to the short side of the main body 11). The X axis corresponds to a direction perpendicular to both the Z axis and the Y axis (a direction parallel to the long side of the main body portion 11). In addition, the vertical direction of the rotation gesture and the horizontal swing gesture shown in FIGS. 10A and 10B corresponds to the YZ plane direction, and the horizontal direction of the rotary gesture and the horizontal swing gesture is the XY plane direction. Correspond.

As shown in FIG. 11A, the vertical imaging field angle Φ _SV of the rotation gesture is represented by the following equation (19).

Note that Φ _SV1 is an angle formed between a line segment connecting a position where the tip of the operating finger is the lowest point and the imaging point of the imaging unit 200 during the rotation gesture and the XY plane, and Φ _SV2 is This is an angle formed between the line segment connecting the position where the tip of the operation finger is the highest point and the imaging point of the imaging unit 200 during the rotation gesture and the XY plane.

  Further, the height H of the operating finger in the Z-axis direction is expressed by the equation (20) as described above.

If the height in the Z-axis direction from the imaging unit 200 to the tip of the operating finger is H, the radius of the rotation gesture is R, and the distance in the Y-axis direction from the imaging unit 200 to the tip of the operating finger is D, the lower end of the rotation gesture The imaging angle of view Φ _{SV1 up to} is expressed by the following equation (21).

Further, assuming that the height in the Z-axis direction from the imaging unit 200 to the tip of the operating finger is H, the radius of the rotation gesture is R, and the distance in the Y-axis direction from the imaging unit 200 to the tip of the operating finger is D, the rotation gesture. The angle Φ _SV2 formed between the line segment connecting the position where the tip of the operating finger is the highest point and the imaging point of the imaging unit 200 and the XY plane is expressed by the following equation (22).

  Furthermore, the linear distance OL from the imaging unit 200 to the tip of the operating finger is represented by the following equation (23) from the three-square theorem.

The horizontal imaging field angle Φ _SH of the rotation gesture orthogonal to the vertical imaging field angle Φ _SV of the rotation gesture can be converted into the following equation (24).

Thus, the equation (16), (19) to (24), the aspect ratio _{A S} of the rotation gesture, the inclination angle θ of the imaging unit 200, and the radius R of the rotation gesture, manipulation finger from the imaging unit 200 Can be expressed by a relational expression of the distance D in the Y-axis direction or the height H in the Z-axis direction.

Next, organized by the aspect ratio A _L of the oscillating gesture on the structure of the positional relationship and the hand of the hand and the imaging section 200.

As shown in FIG. 11B, the vertical imaging field angle Φ _LV of the horizontal gesture is expressed by the following equation (25).

Note that Φ _LV1 is an angle formed between a line segment connecting a position where the tip of the operating finger is farthest from the imaging unit and the imaging point of the imaging unit 200 and the XY plane during a sideways gesture.

  Further, the height H in the Z-axis direction up to the tip of the operating finger is expressed by the equation (26) as described above.

The height in the Z-axis direction from the imaging unit 200 to the tip of the operating finger is H, the amount of movement of the finger in the Y-axis direction during a sideways gesture is P, and the distance in the Y-axis direction from the imaging unit 200 to the tip of the operating finger Is D, an angle Φ _LV1 formed between a line segment connecting the position where the tip of the operating finger is farthest from the imaging unit and the imaging point of the imaging unit 200 during a sideways gesture and the XY plane is as follows: (27)

  Here, as shown in FIG. 10 (b), when the swing angle of the side gesture around the base of the operation finger is 2Γ and the length of the operation finger is FL, the finger Y-axis direction during the side gesture Is represented by the following equation (28).

The horizontal imaging angle of view Φ _LH of the horizontal gesture orthogonal to the vertical imaging angle of view Φ _LV of the horizontal gesture can be converted into the following equation (29).

Thus, the equation (17) and (25) to (29), the aspect ratio _{A L} of the distributor gesture, the inclination angle θ of the imaging unit 200, and a half swing angle of the oscillating gesture gamma, the distributor According to the relational expression of the movement amount P of the finger in the Y-axis direction at the time of the gesture, the length FL of the operation finger, the distance D in the Y-axis direction from the imaging unit 200 to the tip of the operation finger, or the height H in the Z-axis direction. Can be represented.

  That is, the inclination angle θ of the imaging unit 200 for appropriately distinguishing between the rotation gesture and the sideways gesture can be obtained by appropriately determining the following five parameters from the above equations (16) to (29). .

(1) Operating finger length FL
(2) Radius R of the rotation gesture
(3) Half swing angle Γ of the sideways gesture
(4) The movement amount P of the finger in the Y-axis direction during a sideways gesture
(5) Y-axis direction distance D or Z-axis direction height H from the imaging unit 200 to the tip of the operating finger
Note that the movement amount P of the finger in the Y-axis direction at the time of the sideways gesture can be expressed by the length FL of the operating finger and the half-swing angle Γ of the sideways gesture according to the equation (28), and is omitted. Can do.

  As described above, based on the positional relationship between the imaging unit 200 and the hand and the structure of the finger, the tilt of the imaging unit 200 for appropriately distinguishing the rotation gesture and the sideways gesture by using the equations (16) to (29). The angle θ can be obtained.

The inventors of the present application have a length FL of the operating finger FL = 9 cm, a radius R of the rotation gesture R = 1 cm, a half swing angle Γ = 45 ° of the side swing gesture, and the Y axis direction from the imaging unit 200 to the tip of the operating finger. When the distance D was 5 cm, the aspect ratios A _S and A _L and the inclination angle θ of the imaging unit 200 were calculated.

Figure 12 is a graph showing a calculation result example of the tilt angle θ of the aspect ratio A _L and the imaging unit 200 of the aspect ratio A _S and the distributor gesture rotation gesture in a predetermined condition. 12, the horizontal axis is the inclination angle θ of the image pickup unit 200, the vertical axis represents the aspect ratio _{A S} or _{A L.}

Referring to FIG. 12, the aspect ratio A _S of the rotation gesture in accordance with the inclination angle θ of the imaging section 200 is increased is larger. On the other hand, the aspect ratio A _L of the distributor gesture, according to the inclination angle θ of the image pickup unit 200 is increased, it is smaller. Therefore, if the inclination angle of the imaging unit 200 is set to an angle smaller than the intersection P0 of both curves according to the equation (18), the rotation gesture and the sideways gesture can be distinguished. In the case of this calculation example, the inclination angle θ of the intersection point P0 is 77 °.

13, the distance D between operations fingers when changing the length FL, the inclination angle θ of the imaging unit 200 having an aspect ratio A _L aspect ratio A _S and the distributor gesture rotation gesture matches calculation result example It is a graph which shows.

Referring to FIG. 13, 5 cm length FL of the operating finger, 7 cm, 9cm, 11cm and the distance D 3 cm, 5 cm, be varied and 10 cm, inclination angle aspect ratio _{A S} and the aspect ratio AP matches θ Is substantially constant. Therefore, among the above-mentioned four parameters, the length FL of the operating finger and the distance D in the Y-axis direction from the imaging unit 200 to the tip of the operating finger can be used to distinguish the rotation gesture and the swing gesture. It can be seen that the inclination angle θ of the portion 200 is not significantly affected.

  Therefore, the condition of the inclination angle θ of the imaging unit 200 that satisfies the above equation (18) is the following equation (30).

  θ <77 ° (30)

As in the above formula (30), the inclination angle θ of the imaging unit 200 is made smaller than 77 °, the aspect ratio A _S of the rotation gesture becomes smaller than the aspect ratio A _L of the oscillating gesture, rotation gesture Can be properly distinguished from the sideways gesture.

  As shown in FIG. 13, the influence of the length FL of the operation finger and the distance D in the Y-axis direction to the imaging unit 200 on the inclination angle θ of the imaging unit 200 is low. In addition, since the radius R of the rotation gesture and the half swing angle Γ of the horizontal swing gesture are not usually changed greatly by individual differences, the inclination angle θ of the imaging unit 200 is set to 77 as shown in the above equation (30). By making it smaller than °, in most situations, it is possible to properly distinguish between a rotation gesture and a swing gesture.

  Therefore, from the above formulas (15) and (30), the condition that the operating finger can be detected properly and the rotation gesture and the swing gesture can be distinguished is the following formula (31).

  30 ° <θ <77 ° (31)

  By setting the inclination angle θ of the imaging unit 200 to be larger than 30 ° and smaller than 77 °, it is possible to properly detect the operation finger without erroneous detection, and to perform the rotation gesture and the lateral movement. A swing gesture can be distinguished.

<Effect of embodiment>
As described above, according to the present embodiment, since the information acquisition unit 2 is assembled with being inclined with respect to the upper surface of the main body 11 of the personal computer 1, the user can easily perform a gesture while operating the keyboard 4. The action can be performed. In addition, since the hand can be imaged from an oblique direction, the user can appropriately detect the operation finger and can easily position the hand at an angle at which the rotation gesture and the swing gesture can be distinguished. .

  Further, according to the present embodiment, by using the above formulas (1) to (11), it is possible to easily calculate the inclination angle θ of the imaging unit 200 that can properly detect the operating finger without erroneous detection. be able to.

  Further, according to the present embodiment, the inclination angle θ of the imaging unit 200 is set so that the above expressions (12) to (14) are satisfied in addition to the conditions of the above expressions (1) to (11). In addition, the appropriate inclination angle θ of the imaging unit 200 can be obtained more easily.

  Further, according to the present embodiment, as shown in the above equation (15), the inclination angle θ of the imaging unit 200 is set to be larger than 30 °, so that the operation finger can be appropriately operated without erroneous detection. Can be detected.

  Further, according to the present embodiment, by using the above formulas (16) to (29), the inclination angle θ of the imaging unit 200 that can appropriately distinguish between the rotation gesture and the sideways gesture is easily calculated. be able to.

  In addition, according to the present embodiment, as shown in the above equation (30), the inclination angle θ of the imaging unit 200 is set to be smaller than 77 °, so that the rotation gesture and the swing gesture can be appropriately performed. Can be distinguished.

  In addition, according to the present embodiment, since the window portion 11b is arranged on the upper surface of the main body portion 11 on which the keyboard 4 is arranged, the user can easily place his / her finger on the palm rest Pa with his / her finger. Can make gestures.

<Example of change>
While the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications can be made to the configuration example of the present invention.

  For example, in the above embodiment, the light receiving optical axis O of the imaging unit 200 is tilted by tilting the information acquisition unit 2 and mounting the information acquisition unit 2 on the personal computer 1. The light receiving optical axis O may be tilted.

  FIG. 14 is a schematic diagram illustrating a configuration of the information acquisition unit 2 according to the modification.

  Referring to FIG. 14, in the case of this modification, the information acquisition unit 2 is not tilted with respect to the main body 11, and a prism 600 is provided between the imaging unit 200 and the main body 11 of the personal computer 1. The prism 600 is disposed so as to straddle the projection unit 100 and the imaging unit 200.

FIG. 15 is a schematic diagram for defining the apex angle α _p of the prism 600. In the example of FIG. 15, a positive sign is attached to the angle in the clockwise direction. Further, the incident optical axis in FIG. 15 corresponds to the light receiving optical axis O of the imaging unit 200.

As shown in FIG. 15, the refractive index of the prism 600 is n, the inclination angle of the lower surface is α ₁ , the inclination angle of the upper surface is α ₂ , the apex angle of the prism 600 is α _p (= α ₁ −α ₂ ), and the outgoing light. When the axis inclination angle is α (= 90−β), the following equations (32) and (33) are established by Snell's method.

FIG. 16 is a graph showing the optical axis tilt angle α of the outgoing optical axis when the refractive index n of the prism 600 is 1.51, the apex angle α _p is a predetermined angle, and the tilt of the entire prism 600 is changed. . FIG. 17 is a graph showing the optical axis tilt angle α of the outgoing optical axis when the refractive index of the prism 600 is 1.88, the apex angle α _p is a predetermined angle, and the entire tilt of the prism 600 is changed. . 16 and 17, the horizontal axis is the lower surface inclination angle α ₁ , and the vertical axis is the inclination angle α of the outgoing optical axis. 16 and 17, the range of the above formula (33) is indicated by an arrow.

Referring to FIG. 16, it can be seen that the optical axis tilt angle α in the range of the above equation (33) can be obtained by appropriately setting the apex angle α _p of the prism 600 and the lower surface tilt angle α ₁ . For example, when the optical axis tilt angle α is set to 60 °, there are a plurality of combinations of the apex angle α _p and the lower surface tilt angle α ₁ of the prism 600, and it can be seen that the degree of freedom in optical design of the prism 600 is high.

Referring to FIG. 17, it can be seen that the inclination angle α of the outgoing optical axis with respect to the apex angle α _p of the prism 600 is smaller than in the case of FIG. When the prism 600 shown in FIG. 17 is used, the light receiving optical axis O of the imaging unit 200 and the projection optical axis of the projection unit 100 can be freely tilted in the range of 30 ° to 77 ° shown in the above equation (33). I understand.

  As described above, by using the prism 600, the light receiving optical axis O of the imaging unit 200 can be tilted, so that the operation finger can be properly detected as in the above-described embodiment, and the rotation gesture and the swing gesture can be performed. Can be distinguished.

  FIG. 18 is a diagram illustrating a method for installing the prism 600.

  The prism 600 needs to be installed on the upper surface of the imaging unit 200 so as to cover at least the range of the angle of view of the imaging unit 200. In FIG. 18, when the prism 600 is brought into contact with the upper right corner of the imaging unit 200 and the prism 600 is changed to the postures A to E while the apex angle of the prism 600 is matched with the boundary of the left field angle of the imaging unit 200. The upper surface positions a to e of the prism 600 through which the boundary of the right angle of view passes are shown.

As shown in the figure, the position in the Z-axis direction of the intersection point where the boundary between the upper surface of the prism 600 and the angle of view passes is minimum when the posture is D, that is, when the prism 600 is substantially horizontal. When the prism 600 is tilted counterclockwise (minus direction) as in the posture E, the intersection in the boundary between the upper surface of the prism 600 and the angle of view becomes higher in the Z-axis direction. Therefore, the lower surface inclination angle alpha ₁ of the prism 600, 0 ° with respect to the upper surface (light receiving surface) of the imaging unit 200, or, desirably better to set slightly larger than 0 °. Thereby, the height of the information acquisition unit 2 in the Z-axis direction can be suppressed.

  18 illustrates an example in which the prism 600 is in contact with the upper surface of the imaging unit 200. However, if the lower surface of the prism 600 is parallel to the upper surface (light receiving surface) of the imaging unit 200, You may leave | separate from the upper surface of the imaging part 200. FIG.

  Next, a specific design example in which the thickness can be reduced when the prism 600 is used as compared with the case where the information acquisition unit 2 is inclined will be described.

  FIG. 19A is a schematic diagram for explaining the dimensions of the information acquisition unit 2 when the light receiving optical axis O of the imaging unit 200 is inclined by inclining the entire information acquisition unit 2 as in the above embodiment. It is. FIG. 19B is a schematic diagram for explaining the dimensions of the information acquisition unit 2 when the prism 600 is used as in this modification.

  Referring to FIG. 19A, when the width of the circuit board 400 is 8.0 mm and the height of the entire information acquisition unit 2 is 7.0 mm, the inclination angle of the light receiving optical axis O of the imaging unit 200 is 60 °. In this case, the height in the Z-axis direction increases by about 2.2 mm.

Referring to FIG. 19B, the position of the emission point of the prism 600 of the light ray passing through the right boundary of the angle of view when the apex angle α _p of the prism 600 is positioned on the left boundary of the angle of view of the imaging unit 200. Z _t is calculated. The width of the imaging unit 200 is 4.6 mmφ, the lens aperture of the imaging lens 220 (see FIG. 2) is 1.6 mmφ, and the angle of view required for the imaging unit 200 is ± 30 °. This position _{Z t,} high Satoshi prisms 600 in the case of using the prism 600, illustrating an example of calculation of height _{Z t} below.

FIG. 20 is a graph showing a calculation example of the apex angle α _p and the lower surface tilt angle α ₁ of the prism 600 at which the optical axis tilt angle α is 60 °. In FIG. 20, the horizontal axis represents the apex angle α _p of the prism 600, and the vertical axis represents the lower surface inclination angle α ₁ of the prism 600. FIG. 20 shows a calculation example in the case of BK7 (n = 1.51), polyethersulfone resin (n = 1.64), and SFS1 (n = 1.88).

Referring to FIG. 20, in the case of BK7, the apex angle α _p of the prism 600 at which the lower surface inclination angle α ₁ is approximately 0 ° is 38 °. In the case of the polyethersulfone resin, the apex angle α _p of the prism 600 at which the lower surface inclination angle α ₁ is approximately 0 ° is 33 °. For SFS1, the apex angle alpha _p of the prism 600 the underside inclination angle alpha ₁ is substantially 0 ° becomes 26 °.

FIG. 21 is a graph showing a calculation example of the apex angle α _p and the emission point height Z _t of the prism 600 in which the optical axis tilt angle α is 60 ° and the lower surface tilt angle α ₁ is approximately 0 °. In FIG. 21, the horizontal axis represents the apex angle α _p of the prism 600, and the vertical axis represents the height Z _t of the exit point of the prism 600. FIG. 21 shows a calculation example in the case of BK7 (n = 1.51), polyethersulfone resin (n = 1.64), and SFS1 (n = 1.88), as in FIG. ing.

With reference to FIG. 21, when the material of the prism 600 is BK7, the height Z _t of the emission point when the apex angle α _p of the prism 600 is 38 ° is 1.74 mm. When the material of the prism 600 is a polyethersulfone resin, the height Z _t of the emission point when the apex angle α _p of the prism 600 is 33 ° is 1.33 mm. Further, when the material of the prism 600 is SFS1, the height Z _t of the emission point when the apex angle α _p of the prism 600 is 26 ° is 0.94 mm.

  The above calculation results are summarized as shown in Table 1 below.

When the prism 600 is designed as shown in Table 1, the optical axis tilt angle α can be bent by 60 °, and the height Z _t of the emission point is increased when the information acquisition unit 2 is tilted. It can be seen that the amount can be smaller than 2.2 mm.

  Thus, by using the prism 600, the information acquisition unit 2 can be made thinner than when the entire information acquisition unit 2 is inclined.

  In the above modification, the light receiving optical axis O of the imaging unit 200 is tilted by the prism 600, but the light receiving optical axis O may be tilted by another optical element. For example, as shown in FIG. 22A, a HOE (Holographic Optical Element) 601 may be used.

  In this case, for example, by appropriately designing a lattice pattern as shown in FIG. 22B, the light receiving optical axis O of the imaging unit 200 can be inclined while further reducing the thickness as compared with the case where the prism 600 is used. it can. In addition, when using HOE601, in order to improve diffraction efficiency, as shown in FIG.22 (c), it is desirable to make the cross section into a blaze shape.

  In the above embodiment, the light receiving optical axis O of the imaging unit 200 is tilted by tilting the information acquisition unit 2. In the above modification, the imaging unit 200 is used using a bending element such as the prism 600 or the HOE 601. However, the light receiving optical axis O may be tilted by tilting the information acquisition unit 2 and using a bending element.

  Moreover, in the said embodiment and modification, although the output optical axis of the projection part 100 was tilted with the light-receiving optical axis O of the imaging part 200, the angle of view of the infrared light projected from the projection part 100 is enough. In such a case, only the light receiving optical axis O of the imaging unit 200 may be tilted. In addition, since the direction where the output optical axis of the projection unit 100 is tilted together with the light receiving optical axis O of the imaging unit 200 as in the above-described embodiment and modifications, infrared light can be projected onto the imaging region more. ,desirable.

  In the above embodiment, the imaging information is acquired by the information acquisition unit 2 and the shape and movement of the detection target object are detected by the information processing unit 3, but the distance to the detection target object is further detected by the information acquisition unit 2. Information may be acquired.

  FIG. 23 is a diagram illustrating a configuration of the information acquisition unit 2 and the information processing unit 3 according to the modification.

  In this modified example, the function of the distance acquisition unit 21c is given to the CPU 21 together with the function of the imaging information acquisition unit 21b.

  The distance acquisition unit 21c acquires distance information based on a signal output from the CMOS image sensor 240. The memory 25 holds a distance conversion function used for acquiring distance information.

  FIG. 24A is a diagram schematically showing the sensitivity of each pixel on the CMOS image sensor 240.

  In the present embodiment, a color sensor is used as the CMOS image sensor 240. Therefore, the CMOS image sensor 240 includes three types of pixels that detect red, green, and blue, respectively.

  In FIG. 24A, R, G, and B indicate the sensitivity of red, green, and blue pixels included in the CMOS image sensor 240, respectively. As shown in FIG. 24A, the sensitivities of the red, green, and blue pixels are substantially the same in the infrared wavelength band of 800 nm or more (the hatched portion in FIG. 24A is shown). reference). Therefore, when the wavelength band of visible light is removed by the filter 230 shown in FIG. 24B, the sensitivities of the red, green, and blue pixels of the CMOS image sensor 240 are substantially equal to each other. For this reason, when the same amount of infrared light is incident on the red, green, and blue pixels, the values of the signals output from the pixels of the respective colors are substantially equal. Therefore, there is no need to adjust the signal from each pixel between the pixels, and the signal from each pixel can be used as it is for obtaining distance information.

  FIG. 24B is a diagram schematically showing the waveform of the distance conversion function held in the memory 25.

  As shown in FIG. 24B, the distance conversion function defines the relationship between the luminance value acquired via the CMOS image sensor 240 and the distance corresponding to the luminance value. In general, the amount of light traveling straight is attenuated in inverse proportion to the square of the distance. Accordingly, the infrared light emitted from the projection unit 100 is attenuated to one-quarter of the distance obtained by adding the distance from the projection unit 100 to the target area and the distance from the target area to the imaging unit 200. The light is received by the imaging unit 200. For this reason, as shown in FIG. 24B, the luminance value acquired via the CMOS image sensor 240 decreases as the distance to the object increases, and increases as the distance to the object decreases. Therefore, the distance conversion function that defines the relationship between the distance and the luminance has a curved waveform as shown in FIG.

  The distance acquisition unit 21c converts a luminance value acquired for each pixel through the CMOS image sensor 240 into distance information using a distance conversion function. In this way, distance information from the information acquisition unit 2 to each part of the detection target object is acquired.

  In the case of this modified example, since distance information is acquired according to the luminance value, it is possible to accurately detect the movement in the depth direction as well as the vertical and horizontal movements of the object. As described above, in this modified example, since the motion of the object in the three-dimensional direction can be detected, the function of the personal computer 1 can be controlled according to various gestures.

  Moreover, in the said embodiment, although CPU21 had the function which acquires imaging information, acquisition of imaging information may be implement | achieved by the hardware process by a circuit.

  Furthermore, in the above-described embodiment, the CMOS image sensor 240 is used as the light receiving element, but a CCD image sensor can be used instead. Also, light in a wavelength band other than infrared can be used for distance acquisition.

  Moreover, in the said embodiment and modification, although the window part 11b was comprised by installing another member in the information input surface Pi of the main-body part 11, the information input surface Pi is formed with a translucent material. A window for imaging the target area may be formed by coloring the area excluding the window area.

  In addition, the embodiment of the present invention can be variously modified as appropriate within the scope of the technical idea shown in the claims.

1 ... Personal computer (information processing equipment)
4 ... Keyboard (information input part)
5 ... Operation pad (information input part)
DESCRIPTION OF SYMBOLS 11 ... Main-body part 11b ... Window part Pi ... Information input surface 2 ... Information acquisition unit (information processing apparatus)
DESCRIPTION OF SYMBOLS 100 ... Projection part 200 ... Imaging part

Claims (9)

A projection unit that projects light of a predetermined wavelength onto the target area;
An imaging unit that receives reflected light from the target area and images the target area;
An information input surface on which an information input unit is arranged; and
A main body having the information input surface as an upper surface,
The imaging unit captures the target area through a window disposed on the back side of the information input unit of the main body,
The light receiving optical axis of the imaging unit is inclined at a predetermined inclination angle with respect to the information input surface.
An information processing apparatus characterized by that. The information processing apparatus according to claim 1,
The inclination angle is set so that the conditions specified below are satisfied,
An information processing apparatus characterized by that.

However, in the above formula, the direction perpendicular to the information input surface is the Z axis, the direction parallel to the information input surface and the direction from the window portion toward the front side of the main body portion is the Y axis, the Z axis, and the Y axis. If the direction perpendicular to both is the X axis, each parameter in the above equation is defined as follows. A _F is an aspect ratio of the finger to be operated existing in the target area. Φ _FL is an imaging field angle of the operation target finger in the YZ plane direction. Φ _FW is an imaging field angle of the operation target finger in the XY plane direction. _AP is the aspect ratio of the finger area that is present in the target area and easily misrecognized. Φ _PL is an imaging field angle in the YZ plane direction of the finger region that is easily misrecognized. Φ _PW is an imaging angle of view in the XY plane direction of the finger region that is easily misrecognized. θ is the inclination angle of the imaging unit. H is the height in the Z-axis direction from the imaging unit to the operation target finger. D is a distance in the Y-axis direction from the imaging unit to the tip of the finger to be operated. FL is the length of the finger to be operated. FW is the width of the operation target finger. EL is the length from the tip of the finger to be operated to the second joint. PL is the length from the first joint to the second joint of the region E that is easily misrecognized. The information processing apparatus according to claim 2,
The tilt angle is set so that the conditions specified below are further satisfied,
An information processing apparatus characterized by that.

The information processing apparatus according to any one of claims 1 to 3,
The inclination angle is set so that the conditions specified below are satisfied,
An information processing apparatus characterized by that.

However, in the above formula, the direction perpendicular to the information input surface is the Z axis, the direction parallel to the information input surface and the direction from the window portion toward the front side of the main body portion is the Y axis, the Z axis, and the Y axis. If the direction perpendicular to both is the X axis, each parameter in the above equation is defined as follows. A _S is the aspect ratio of the rotation gesture. Φ _SV is an imaging angle of view of the rotation gesture in the YZ plane direction. R is the radius of the rotation gesture in the Z-axis direction. Φ _SH is an imaging angle of view of the rotation gesture in the XY plane direction. A _L is the aspect ratio of the oscillating gesture. Φ _LV is an imaging angle of view in the YZ plane direction of the sideways gesture. θ is the inclination angle of the imaging unit. H is the height in the Z-axis direction from the imaging unit to the operation target finger existing in the target area. D is a distance in the Y-axis direction from the imaging unit to the tip of the finger to be operated. P is the amount of movement of the finger in the Y-axis direction during a sideways gesture. Γ is the half swing angle of the sideways gesture. The information processing apparatus according to any one of claims 1 to 4,
The light receiving optical axis of the imaging unit is tilted by tilting the information acquisition device with respect to the information input surface.
An information processing apparatus characterized by that. The information processing apparatus according to any one of claims 1 to 5,
Comprising a bending element for bending the traveling direction of the reflected light,
The light receiving optical axis of the imaging unit is inclined by the bending element,
An information processing apparatus characterized by that. The information processing apparatus according to claim 6,
The bending element is a prism;
An information processing apparatus characterized by that. The information processing apparatus according to claim 7,
The prism is installed such that the lower surface is parallel to the light receiving surface of the imaging unit,
An information processing apparatus characterized by that. The information processing apparatus according to any one of claims 1 to 8,
An object detection unit for detecting an object present in the target region based on imaging information acquired by the imaging unit;
An information processing apparatus characterized by that.

Images