WO2013054664A1

WO2013054664A1 - Information processing device, information processing method, program, and electronic apparatus

Info

Publication number: WO2013054664A1
Application number: PCT/JP2012/075042
Authority: WO
Inventors: 諭司三谷; 信広西条
Original assignee: ソニー株式会社
Priority date: 2011-10-12
Filing date: 2012-09-28
Publication date: 2013-04-18
Also published as: JP2013084228A

Abstract

The present disclosures pertain to an information processing device, information processing method, program, and electronic apparatus that are able to precisely recognize the position, movement, and the like of an object that is considered to be skin. An LED unit has a first LED, which radiates light of a first wavelength, and a second LED, which radiates light of a second wavelength that differs from the first wavelength. A phase detector (PD) generates a first detection signal in response to having received reflected light from the object to which light of the first wavelength has been radiated, and generates a second detection signal in response to having received reflected light from the object to which light of the second wavelength has been radiated. Also, a processing unit detects whether the object is skin on the basis of the first and second detection signals, and generates recognition information for recognizing the position and/or motion of the object detected as skin on the basis of the first and/or second detection signals. The present disclosures can be applied, for example, to an electronic apparatus for recognizing gestures or the like of objects considered to be skin.

Description

Information processing apparatus, information processing method, program, and electronic apparatus

The present disclosure particularly relates to, for example, an information processing apparatus, an information processing method, a program, and an electronic device, and distinguishes between an object other than skin and an object so that the position and movement of the object as skin can be recognized. The present invention relates to an apparatus, an information processing method, a program, and an electronic device.

For example, there is a skin proximity switch that can be switched to one of an on state and an off state when an adjacent object is skin (see, for example, Patent Document 1).

This skin proximity switch detects the proximity of an object and determines whether the detected object is skin (for example, a human fingertip). The skin proximity switch is switched to either the on state or the off state in response to determining that the detected object is skin.

WO 2010/117006

However, with the above-described skin proximity switch, for example, although it is possible to determine whether or not an adjacent object is skin, it is difficult to detect the movement of the object determined as skin.

The present disclosure has been made in view of such a situation, and makes it possible to recognize the position and movement of an object as skin by distinguishing between the skin and an object other than the skin.

The information processing apparatus according to the first aspect of the present disclosure includes a first irradiation unit that irradiates light having a first wavelength, and second irradiation that irradiates light having a second wavelength different from the first wavelength. And generating a first detection signal in response to receiving the reflected light from the object irradiated with the light having the first wavelength and the light having the second wavelength. A light receiving unit that generates a second detection signal in response to receiving reflected light from the object irradiated with light, and the object is skinned based on the first and second detection signals. Recognition for recognizing at least one of the position or movement of the object detected as skin based on at least one of the first or second detection signal and the skin detection unit for detecting whether or not An information processing apparatus including a generation unit that generates information.

Another light receiving unit having the same configuration as the light receiving unit can be further provided, and the generation unit includes at least one of the first or second detection signals generated for each of the plurality of light receiving units. Based on this, the recognition information can be generated.

The first irradiation unit is arranged at the same distance from each of the plurality of light receiving units, and the generation unit is based on the first detection signal generated for each of the plurality of light receiving units. Thus, the recognition information can be generated.

The light receiving unit is disposed at the same distance from the first irradiation unit and the second irradiation unit, respectively, and the skin detection unit includes the first and second generated by the light receiving unit. Based on the detection signal, it can be detected whether or not the object is skin.

Another irradiation unit configured in the same manner as the irradiation unit may be further provided, and the first detection is performed for each of the irradiation units that irradiate the light of the first wavelength at different timings in the light receiving unit. And generating the second detection signal for each of the irradiation units that irradiate the light of the second wavelength at different timings, and generating the generated signal for each of the irradiation units. The recognition information can be generated based on at least one of the first or second detection signal.

When the interval between the first irradiation units in the first direction is longer than the interval between the second irradiation units, the generation unit generates the plurality of irradiation units by the light receiving unit. Based on the first detection signal, the recognition information for recognizing at least one of the position or movement of the object in a second direction perpendicular to the first direction can be generated.

A plurality of sensors having the irradiation unit and the light receiving unit, the sensor having the irradiation unit that irradiates a different irradiation range for each sensor may be further provided, and the skin detection unit includes the plurality of sensors. Based on the first and second detection signals generated for each sensor, it is detected whether the object is skin, and the generation unit generates the plurality of sensors. The recognition information can be generated based on at least one of the first and second detection signals.

A proximity detection unit that detects whether the object has entered a predetermined detection range based on the first detection signal can be further provided, and the skin detection unit includes the object Corresponding to the detection of having entered the detection range, it is possible to detect whether the object is skin based on the first and second detection signals.

In response to detecting that the object is skin, an object detection unit that detects whether or not the object exists within a predetermined detection range based on the first detection signal. Further, the information processing apparatus can handle the object as skin if it is detected that the object is within the detection range.

A signal generation unit that generates an output signal having a magnitude according to the position of the object can be further provided, and the generation unit can generate the recognition information based on the output signal.

The first wavelength λ1 and the second wavelength λ2 that is longer than the first wavelength λ1 are:
640nm ≤ λ1 ≤ 1000nm
900nm ≤ λ2 ≤ 1100nm
Can be met.

The first irradiation unit can be irradiated with invisible light having the first wavelength λ1, and the second irradiation unit can be irradiated with invisible light having the second wavelength λ2.

The light receiving unit may be provided with a visible light cut filter that blocks visible light incident on the light receiving unit.

An information processing method according to the first aspect of the present disclosure includes a first irradiation unit that irradiates light having a first wavelength, and a second irradiation that irradiates light having a second wavelength different from the first wavelength. And generating a first detection signal in response to receiving the reflected light from the object irradiated with the light having the first wavelength and the light having the second wavelength. An information processing method of an information processing apparatus including a light receiving unit that generates a second detection signal in response to reception of reflected light from the object that is irradiated by the information processing apparatus, Based on the first and second detection signals, the skin detection step for detecting whether or not the object is skin and the skin based on at least one of the first or second detection signals Recognition for recognizing at least one of the detected position or movement of the object An information processing method comprising: a generation step of generating a broadcast.

The program according to the first aspect of the present disclosure includes a first irradiation unit that irradiates light having a first wavelength, and a second irradiation unit that irradiates light having a second wavelength different from the first wavelength. The first detection signal is generated in response to receiving the reflected light from the irradiation unit having the irradiation unit and the object irradiated with the light of the first wavelength, and the light of the second wavelength is irradiated A computer of an information processing apparatus including a light receiving unit that generates a second detection signal in response to receiving reflected light from the object that is reflected on the basis of the first and second detection signals. Then, based on at least one of the skin detection unit that detects whether or not the object is skin, and at least one of the first or second detection signal, at least one of the position or movement of the object detected as skin Function as a generator that generates recognition information for recognizing Which is the program.

According to the first aspect of the present disclosure, it is detected whether the object is skin based on the first and second detection signals, and at least one of the first or second detection signals. Based on one, recognition information for recognizing at least one of the position or movement of the object detected as skin is generated.

An electronic apparatus according to a second aspect of the present disclosure includes a first irradiation unit that irradiates light having a first wavelength, and a second irradiation unit that emits light having a second wavelength different from the first wavelength. And generating a first detection signal in response to receiving the reflected light from the object irradiated with the light of the first wavelength, and the light of the second wavelength A light receiving unit that generates a second detection signal in response to receiving reflected light from the irradiated object, and the object is skinned based on the first and second detection signals. Recognition information for recognizing at least one of the position or movement of the object detected as skin based on at least one of the skin detection unit for detecting whether or not there is the first or second detection signal And a corresponding process according to the recognition result based on the recognition information An electronic device comprising a processing unit that performs.

According to the second aspect of the present disclosure, it is detected whether the object is skin based on the first and second detection signals, and at least one of the first or second detection signals. Based on one, recognition information for recognizing at least one of the position or movement of the object detected as skin is generated, and corresponding processing is performed according to the recognition result based on the recognition information.

According to the present disclosure, it is possible to accurately recognize the position and movement of an object as skin.

It is a figure which shows the structural example of the digital photo frame which is 1st Embodiment. It is a 1st figure for demonstrating the recognition method which recognizes the position and motion of an object. It is a 2nd figure for demonstrating the recognition method which recognizes the position and motion of an object. It is a figure which shows the 1st example of a mode when a digital photo frame is seen from the lower side in FIG. FIG. 5 is a diagram illustrating an example of an output result output from a sensor when an object moves as illustrated in FIG. 4. FIG. 5 is a diagram showing a first example of a skin detection signal obtained from an output result of a sensor when an object moves as shown in FIG. 4. It is a figure which shows the 2nd example of a mode when a digital photo frame is seen from the lower side in FIG. It is a figure which shows an example of the output result output from a sensor, when an object moves as shown in FIG. It is a figure which shows the 2nd example of the skin detection signal obtained from the output result of a sensor, when an object moves as shown in FIG. It is a block diagram which shows the detailed structural example of the digital photo frame of FIG. It is a block diagram which shows the detailed structural example of the control part of FIG. It is a figure which shows the spectral reflection characteristic with respect to human skin. It is a figure which shows an example of the irradiation timing in each sensor. It is a figure which shows the structural example of the digital photo frame which has three sensors arrange | positioned at triangle shape. It is a figure which shows the structural example of the digital photo frame which has three sensors arrange | positioned at L shape. It is a flowchart for demonstrating the 1st gesture recognition process which the digital photo frame of FIG. 1 performs. It is a flowchart for _{demonstrating} the detail of the V ( _{lambda) 1} acquisition process which an attention sensor performs. It is a flowchart for _{demonstrating} the detail of the V ( _{lambda) off} acquisition process which an attention sensor performs. It is a flowchart for demonstrating the detail of the skin discrimination | determination process which the process part of an attention sensor performs. It is a flowchart for demonstrating the 2nd gesture recognition process which the digital photo frame of FIG. 1 performs. 3 is a flowchart for explaining proximity object detection processing performed by the digital photo frame of FIG. 1. It is a figure which shows the structural example of the digital photo frame which is 2nd Embodiment. It is a figure which shows an example when a digital photo frame is seen from the lower side in FIG. FIG. 24 is a diagram illustrating an example of an output result output from a PD when an object moves as illustrated in FIG. It is a block diagram which shows the detailed structural example of the digital photo frame of FIG. It is a block diagram which shows the detailed structural example of the control part of FIG. It is a flowchart for demonstrating the 3rd gesture recognition process which the digital photo frame of FIG. 22 performs. It is the 1st figure which shows an example of the LED unit which exists on the normal line perpendicular | vertical to a display screen which passes along the center of the line segment which connects two PD. It is the 2nd figure which shows an example of the LED unit which exists on the normal line perpendicular | vertical to a display screen which passes along the center of the line segment which connects two PD. It is a figure which shows an example at the time of providing 3 PD in a digital photo frame. It is a figure which shows an example at the time of providing four PD in a digital photo frame. It is a figure which shows an example at the time of providing 3 PD and 2 LED units in a digital photo frame. It is a figure which shows the structural example of the digital photo frame which is 3rd Embodiment. It is a 1st figure which shows an example of the positional relationship of PD and two LED units. It is a 2nd figure which shows an example of the positional relationship of PD and two LED units. In FIG. 35, it is a figure which shows an example of the output result of PD when an object moves to the right direction from the left in the figure. It is a block diagram which shows the detailed structural example of the digital photo frame of FIG. It is a block diagram which shows the detailed structural example of the control part of FIG. It is a flowchart for demonstrating the 4th gesture recognition process which the digital photo frame of FIG. 33 performs. It is a 1st figure which shows an example of the outline | summary of the process which each sensor of FIG. 11 performs. It is a 2nd figure which shows an example of the outline | summary of the process which each sensor of FIG. 11 performs. It is a figure which shows an example of a mode that the internal state of PD changes. It is a figure which shows an example of the outline | summary of the process which the control part of FIG. 26 performs. It is a figure which shows an example of the outline | summary of the process which the control part of FIG. 38 performs. It is a 1st figure for demonstrating the distance between two sensors shown by FIG. FIG. 4 is a second diagram for explaining a distance between two sensors shown in FIG. 1. In FIG. 22, it is a figure which shows an example of a mode that the digital photo frame was seen from the lower side in the figure. In FIG. 33, it is a figure which shows an example of a mode that the digital photo frame was seen from the lower side in the figure. It is a 1st figure for demonstrating adjustment of the output of LED. It is a 2nd figure for demonstrating adjustment of the output of LED. It is a 1st figure for demonstrating the calculation method which calculates the position of the object as skin. It is a 2nd figure for demonstrating the calculation method which calculates the position of the object as skin. It is a 3rd figure for demonstrating the calculation method which calculates the position of the object as skin. It is a figure which shows an example of a mode that a user performs click operation | movement. It is a figure for demonstrating an example of the method of recognizing click operation | movement according to the change of Lsum. It is a figure for demonstrating that a user's recognition differs from an actual hand movement. It is another figure for demonstrating an example of the method of recognizing click action.

Hereinafter, embodiments of the present disclosure (hereinafter referred to as embodiments) will be described. The description will be given in the following order.
1. First embodiment (an example in the case of having a plurality of sensors including PD and LED unit)
2. Second embodiment (an example with one LED unit and multiple PDs)
3. Third embodiment (an example in the case of having a plurality of LED units and one PD)
4). Modification 5 Other

<1. First Embodiment>
[Configuration example of digital photo frame 1]
FIG. 1 shows a configuration example of a digital photo frame 1 according to the first embodiment.

The digital photo frame 1 has a display screen 1a for displaying a still image (for example, an image taken as a photograph) or a moving image.

In the digital photo frame 1, as shown in FIG. 1, a sensor for recognizing the position and movement (gesture) of a user's hand or the like in the left-right direction (hereinafter also referred to as the X direction) of the display screen 1a. 21 ₁ and 21 ₂ are provided, respectively.

In the present disclosure, the user's hand or the like is described as a recognition target for recognizing the position or movement, but the recognition target is not limited to the user's hand or the like, and any human skin portion may be used.

The digital photo frame 1 uses the

sensors

21 ₁ and 21 ₂ to recognize the position and movement of the user's hand, etc., and changes the content of still images and moving images displayed on the display screen 1a based on the recognition result, for example. Let

The

sensors

21 ₁ and 21 ₂ determine whether or not the object close to the digital photo frame 1 is human skin, and only the object determined to be human skin is subject to position or movement. Used to recognize at least one of

In the following, when it is not necessary to distinguish between the sensor 21 ₁ and the sensor 21 ₂ , the

sensor

21 ₁ or 21 ₂ is simply referred to as the sensor 21.

Next, an example of a recognition method in which the digital photo frame 1 recognizes the position and movement of the object 41 in the Z direction based on the output result from the sensor 21 will be described with reference to FIGS. The Z direction refers to the normal direction of the display screen 1a in FIG.

FIG. 2 shows an example of an output result output from the sensor 21 when the object 41 moves so as to approach the sensor 21.

2A, when the object 41 moves so as to approach the sensor 21, the output V from the sensor 21 increases exponentially as the object 41 approaches the sensor 21.

In FIG. 2A, the fan-shaped figure surrounding the object 41 indicates the detection range of the sensor 21. In FIG. 2B, the horizontal axis represents time t, and the vertical axis represents the output result V from the sensor 21. The same applies to A in FIG. 3 and B in FIG. 3 described later.

FIG. 3 shows an example of an output result output from the sensor 21 when the object 41 moves away from the sensor 21.

As shown in FIG. 3A, when the object 41 moves away from the sensor 21, the output V from the sensor 21 decreases exponentially as the object 41 moves away from the sensor 21.

The digital photo frame 1 recognizes the position and movement of the object 41 in the Z direction on the basis of the output results from the sensor 21 as shown in FIGS. 2 and 3, and according to the recognition result, the display screen 1a. Change the display contents.

Next, an example of a recognition method in which the digital photo frame 1 recognizes the position and movement of the object 41 in the X direction based on the output result from the sensor 21 will be described with reference to FIGS.

FIG. 4 shows an example when the digital photo frame 1 is viewed from the lower side in FIG.

For example, when the object 41 moves from left to right in FIG. 4, that is, when the object 41 moves on the sensor 21 in the order of the sensor 21 ₁ and the sensor 21 ₂ , the sensor 21 ₁ and Based on the output result from 21 ₂ , the motion of the object 41 is recognized.

Next, FIG. 5 shows an example of output results respectively output from the sensor 21 ₁ and the sensor 21 ₂ when the object 41 moves as shown in FIG.

FIG. 5A shows an output result from the sensor 21 ₁ . In FIG. 5B, the output result from the sensor 21 ₂ is shown. 5A and 5B, the horizontal axis represents time t, and the vertical axis represents the output result V from the sensor 21. When the object 41 does not exist within the detection range of the sensor 21, a relatively low constant value is output from the sensor 21.

Incidentally, the object 41, as shown in FIG. 4, approaching from the left side of the sensor 21 _1, passes through the vicinity directly above the sensor 21 _1, away from the sensor 21 ₁ is present on the right side of the sensor 21 ₁ Move toward sensor 21 ₂ .

In this case, in the sensor 21 ₁ , as shown in FIG. 5A, as the object 41 approaches, the output result from the sensor 21 ₁ increases, and when the object 41 passes near the sensor 21 _1. The output result is maximized (maximum). Then, when the object 41 is moved away through the sensor 21 _1, the output result from the sensor 21 ₁ is decreased.

Object 41, as shown in FIG. 4, after passing through the per directly above the sensor 21 _1, approaching from the left side of the sensor 21 _2, and passes through the vicinity directly above the sensor 21 _2, away from the sensor 21 ₂ , Move to the right side of the sensor 21 ₂ .

In this case, in the sensor 21 ₂ , as shown in FIG. 5B, the output result from the sensor 21 ₂ increases as the object 41 approaches, and when the object 41 passes near the sensor 21 _2. The output result is maximized (maximum). Then, when the object 41 is moved away through the sensor 21 _2, then the output from the sensor 21 ₂ decreases.

That is, the object 41, when the motion as shown in FIG. 4, as shown in B of A and 5 in FIG. 5, as the output result, the convex lobes above, the sensor 21 ₁ and the sensor In the order of 21 ₂ .

For this reason, in the digital photo frame 1, for example, the object 41 is output in accordance with the timing when the maximum portion is obtained as the output result from the sensor 21 ₁ and the timing when the maximum portion is obtained as the output result from the sensor 21 ₂ . Can recognize movement.

Further, in the digital photo frame 1, it is also determined whether or not the object 41 within the detection range of the sensor 21 is human skin based on the output result from the sensor 21, and the determination result obtained by the determination Is generated.

In the digital photo frame 1, when it is detected that the object 41 is skin based on the generated skin detection signal, the position of the object 41 is determined based on the output results from the

sensors

21 ₁ and 21 _2. Recognize movement.

The skin detection signal generation method will be described in detail with reference to FIG.

Next, FIG. 6 shows an example of a skin detection signal generated in the digital photo frame 1 when the object 41 moves as shown in FIG.

Skin detection signal shown in A of FIG. 6 represents whether the skin is detected within the detection range of the sensor 21 _1. Further, the skin detection signal shown in B of FIG. 5 indicates whether or not the skin is detected within the detection range of the sensor 21 ₂ .

Note that the skin detection signal is ON (for example, 1) when an object 41 as human skin exists within the detection range of the sensor 21, and the object 41 as human skin within the detection range of the sensor 21. Is set to OFF (for example, 0) when no exists.

In FIG. 6A and FIG. 6B, the horizontal axis represents time t, and the vertical axis represents whether skin has been detected or not.

As described above, the object 41, as shown in FIG. 4, after passing through the detection range of the sensor 21 _1, passes through the detection range of the sensor 21 _2.

Therefore, the skin detection signal is turned ON in the order of the skin detection signal shown in A of FIG. 6 and the skin detection signal shown in B of FIG. *

For this reason, in the digital photo frame 1, instead of the output results from the sensor 21 ₁ and the sensor 21 ₂ , the position of the object 41 or the like based on the skin detection signal as shown in A of FIG. 6 and B of FIG. You may make it recognize a motion etc.

That is, for example, in the digital photo frame 1, the object 41 is turned on according to the timing when turned on in the skin detection signal shown in A of FIG. 6 and the timing when turned on in the skin detection signal shown in B of FIG. Can recognize the movement.

In addition, for example, in the digital photo frame 1, based on the output results from the

sensors

21 ₁ and 21 ₂ and the skin detection signals as shown in FIG. 6A and FIG. You may make it judge (recognize) movement etc. comprehensively.

FIG. 7 shows another example when the digital photo frame 1 is viewed from the lower side in FIG.

For example, when the object 41 moves from the right to the left in FIG. 7, that is, when the object 41 moves on the sensor 21 in the order of the sensor 21 ₂ and the sensor 21 ₁ , the sensor 21 ₁ and Based on the output result from 21 ₂ , the motion of the object 41 is recognized.

Next, FIG. 8 shows an example of output results respectively output from the sensor 21 ₁ and the sensor 21 ₂ when the object 41 moves as shown in FIG.

FIG. 8A shows the output result from the sensor 21 ₁ . 8B shows the output result from the sensor 21 ₂ . 8A and 8B, the horizontal axis represents the time t, and the vertical axis represents the output result V from the sensor 21.

Incidentally, the object 41, as shown in FIG. 7, after passing through the per directly above the sensor 21 ₂ approaches from the right side of the sensor 21 _1, passes through the vicinity directly above the sensor 21 _1, away from the sensor 21 ₁ Thus, the sensor 21 ₁ moves in the left direction.

In this case, in the sensor 21 ₁ , as shown in FIG. 8A, the output result from the sensor 21 ₁ increases as the object 41 approaches the sensor 21 ₁ after passing right above the sensor 21 ₂ . When the object 41 passes in the vicinity of just above the sensor 21 ₁ , the output result becomes maximum (maximum). Then, when the object 41 is moved away through the sensor 21 _1, the output result from the sensor 21 ₁ is decreased.

Object 41, as shown in FIG. 7, approaches from the right side of the sensor 21 _2, and passes through the vicinity directly above the sensor 21 _2, away from the sensor 21 _2, sensor 21 present in the left side of the sensor 21 ₂ Move towards ₁ .

In this case, in the sensor 21 ₂ , as shown in FIG. 8B, as the object 41 approaches, the output result from the sensor 21 ₂ increases, and when the object 41 passes near the sensor 21 _2. The output result is maximized (maximum). Then, when the object 41 is moved away through the sensor 21 _2, then the output from the sensor 21 ₂ decreases.

That is, the object 41, when the motion as shown in FIG. 7, as shown in B of A and 8 in FIG. 8, as an output result, the convex lobes above, the sensor 21 ₂ and the sensor In the order of 21 ₁ .

For this reason, in the digital photo frame 1, the movement of the object 41 is recognized according to the timing at which the maximum portion is obtained as the output result from the sensor 21 ₁ and the timing at which the maximum portion is obtained as the output result from the sensor 21 _2. be able to.

Even when the object 41 moves as shown in FIG. 7, the movement of the object 41 can be recognized from the skin detection signal in the same manner as in the case described with reference to FIG.

Next, FIG. 9 shows an example of a skin detection signal obtained from the output result of the sensor 21 when the object 41 moves as shown in FIG.

Note that A in FIG. 9 and B in FIG. 9 are configured similarly to A in FIG. 6 and B in FIG. That is, the skin detection signal shown in A of FIG. 9 indicates whether or not skin is detected within the detection range of the sensor 21 ₁ . Further, the skin detection signal shown in FIG. 9B indicates whether or not the skin is detected within the detection range of the sensor 21 ₂ .

As described above, the object 41 passes through the detection range of the sensor 21 ₁ after passing through the detection range of the sensor 21 ₂ , as shown in FIG.

Therefore, the skin detection signal is turned ON in the order of the skin detection signal shown in B of FIG. 9 and the skin detection signal shown in A of FIG.

Therefore, in the digital photo frame 1, instead of the output results from the

sensors

21 ₁ and 21 ₂ , the position of the object 41 or the like based on the skin detection signal as shown in A of FIG. 9 and B of FIG. You may make it recognize a motion etc.

That is, for example, in the digital photo frame 1, the object 41 is turned on according to the timing when turned on in the skin detection signal shown in A of FIG. 9 and the timing when turned on in the skin detection signal shown in B of FIG. Can recognize the movement.

sensors

21 ₁ and 21 ₂ and the skin detection signals as shown in FIG. 9A and FIG. You may make it judge (recognize) movement etc. comprehensively.

[Detailed configuration example of digital photo frame 1]
Next, FIG. 10 shows a detailed configuration example of the digital photo frame 1.

The digital photo frame 1 includes a CPU (Central Processing Unit) 61, a ROM (Read Only Memory) 62, a RAM (Random Access Memory) 63, a bus 64, an input / output interface 65, and a plurality of sensors 21 _{1 to} 21 _N. A display unit 67 having a display screen 1a, a storage unit 68, and a drive 69.

In the digital photo frame 1 shown in FIG. 1, two

sensors

21 ₁ and 21 ₂ are provided. However, as shown in FIG. 10, three or more sensors 21 _{1 to} 21 _N are provided. You may do it.

The CPU 61 performs various processes by executing programs stored in the ROM 62 and the storage unit 68, for example.

That is, for example, the CPU 61 detects whether or not the object 41 close to the digital photo frame 1 is skin based on the skin detection signal supplied from the control unit 66 via the input / output interface 65 and the bus 64. .

Further, when the CPU 61 detects that the object 41 is skin, the position and movement of the object 41 as skin based on the gesture recognition information supplied from the control unit 66 via the input / output interface 65 and the bus 64. Recognize etc.

The gesture recognition information represents information for recognizing the position and movement of the object 41. Therefore, as the gesture recognition information, for example, output results from the

sensors

21 ₁ and 21 ₂ , skin detection signals, and the like are employed. This is the same in the second and third embodiments described later.

Further, for example, the CPU 61 performs corresponding processing according to the recognition result based on the gesture recognition information.

Here, the CPU 61 reads out the plurality of still images held in the storage unit 68 via the display 64 and the input / output interface 65, for example, and sequentially displays the read out plurality of still images in a predetermined order. Is displayed on the display screen 1a.

In this case, for example, when the CPU 61 recognizes the movement of the object 41 as shown in FIG. 2, the CPU 61 controls the display unit 67 via the bus 64 and the input / output interface 65, and displays a display among a plurality of still images. The still image inside is enlarged and displayed on the display screen 1a.

Further, for example, when the CPU 61 recognizes the movement of the object 41 as shown in FIG. 3, the CPU 61 controls the display unit 67 via the bus 64 and the input / output interface 65 to enlarge and display a still image being displayed. The image is reduced to the original size and displayed on the display screen 1a.

Further, for example, when the CPU 61 recognizes the movement of the object 41 as illustrated in FIG. 4, the CPU 61 controls the display unit 67 via the bus 64 and the input / output interface 65. A still image to be displayed is displayed on the display screen 1a.

For example, when the CPU 61 recognizes the movement of the object 41 as shown in FIG. 7, the CPU 61 controls the display unit 67 via the bus 64 and the input / output interface 65, and immediately before the plurality of still images. The displayed still image is displayed on the display screen 1a.

Further, the CPU 61 controls the control unit 66, the display unit 67, the drive 69, and the like.

The ROM 62 holds (stores) programs executed by the CPU 61 and other data in advance.

The RAM 63 is, for example, a working memory (working memory) used for processing performed by the CPU 61, holds data instructed by the CPU 61, and supplies data instructed to be read from the CPU 61 to the CPU 61.

The bus 64 is connected to the CPU 61, the ROM 62, the RAM 63, and the input / output interface 65, and relays data exchange. The input / output interface 65 is connected to the bus 64, the control unit 66, the display unit 67, the storage unit 68, and the drive 69, and relays data exchange.

The control unit 66 includes each sensor 21 _n , generates a skin detection signal and gesture recognition information for each sensor 21 _n based on the output result from the sensor 21 _n , and passes through the input / output interface 65 and the bus 64. To the CPU 61. Details of the control unit 66 will be described in detail with reference to FIG.

The display unit 67 displays, for example, a still image supplied from the CPU 61 via the bus 64 and the input / output interface 65 on the display screen 1a.

The storage unit 68 includes, for example, a hard disk, and stores programs executed by the CPU 61 and various data.

The drive 69 drives a removable medium 70 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and acquires programs, data, and the like recorded therein. The acquired program and data are transferred to and stored in the storage unit 68 as necessary.

As shown in FIG. 10, a recording medium for recording (storing) a program that is installed in a computer and can be executed by the computer includes a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc- Removable media 70, which is a package media made up of a read-only memory, DVD (digital versatile disc), a magneto-optical disk (including MD (mini-disc)), or a semiconductor memory, or a program is temporarily or It is composed of a ROM 62 that is permanently stored, a hard disk that constitutes the storage unit 68, and the like.

The recording of the program on the recording medium uses a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting through the connected interface by connecting an interface such as a router or a modem as necessary. Can be done.

[Detailed Configuration Example of Control Unit 66]
Next, FIG. 11 shows a detailed configuration of the control unit 66.

In addition to the sensor 21n (n = 1, 2,..., N), the control unit 66 includes a processing unit 91, a current control unit 92n, a timing control unit 93n, a gain control unit 94n, and an AD (Analog / Digital) conversion unit 95n. Consists of

The sensor 21n includes an LED (Light Emitting Diode) driver 111n, an LED 112an, an LED 112bn, a lens 113an, a lens 113bn, a PD (Phase Detector) 114n, and a lens 115n.

In the sensor 21n, the number of the LEDs 112an and the number of the LEDs 112bn are not limited to one each, and can be plural.

The processing unit 91 controls the current control unit 92n to instruct the current control unit 92n to supply current to the LED 112an and the LED 112bn. The processing unit 91 also controls the timing control unit 93n to instruct the timing control unit 93n to turn on and off the LEDs 112an and turn on and off the LEDs 112bn.

On the other hand, the current control unit 92n controls the LED driver 111n so that the current instructed from the processing unit 91 flows. In addition, the timing control unit 93n controls the LED driver 111n so as to turn on and off at the timing instructed by the processing unit 91.

The LED driver 111n repeats turning on only the LED 112an, turning on only the LED 112bn, and turning off the LED 112an and the LED 112bn according to control from the current control unit 92n and the timing control unit 93n.

Note that the timing of turning on and off each sensor 21n will be described in detail with reference to FIG.

Further, the processing unit 91 controls the gain control unit 94n. Thereby, the degree of gain adjustment by the gain control process performed in the PD 114n is adjusted.

The processing unit 91 is supplied with a luminance signal V _λ1 , a luminance signal V _λ2 , and a luminance signal V _λoff from the PD 114n of each sensor 21n via the AD conversion unit 95n. Processing unit 91, for example, a luminance signal V _.lambda.1 from AD conversion unit 95n, a luminance signal V _.lambda.2, and based on the luminance signal _{V? OFF,} skin detection signal indicating whether skin exists in the detection range of the sensor 21n Is generated.

Also, the processing unit 91 generates gesture recognition information based on the luminance signal V _λ1 from the AD conversion unit 95n, for example.

The processing unit 91 supplies the generated skin detection signal and gesture recognition information to the CPU 61 via the input / output interface 65 and the bus 64 of FIG.

Note that, as the gesture recognition information, the received light intensity of the reflected light generated based on the luminance signal V _λ1 is adopted, but for example, a skin detection signal can be adopted. This is the same in the second and third embodiments described later.

By the way, for example, the processing unit 91 determines whether or not the object 41 as skin exists in any detection range of each sensor 21n based on the generated skin detection signal, and the object 41 as skin exists. Only when it is determined, the gesture recognition information may be supplied to the CPU 61.

At this time, the processing unit 91 may supply only the gesture recognition information to the CPU 61. In this case, the CPU 61 performs a corresponding process according to the gesture recognized based on the gesture recognition information from the processing unit 91. The same applies to the second and third embodiments.

Further, for example, the processing unit 91 recognizes the movement of the object 41 based on the generated gesture recognition information, and supplies recognition result information representing the recognition result to the CPU 61 instead of the gesture recognition information. May be.

Here, as the recognition result information, for example, “1” is displayed when the object 41 moves closer to the sensor 21n, and “2” is displayed when the object 41 moves away from the sensor 21n. In FIG. 1, “3” is adopted when moving from left to right, and “4” is adopted when moving from right to left in FIG. .

Further, as the recognition result information, the position of the user's hand or the like calculated based on the output result from each sensor 21n may be adopted. In this case, the processing unit 91 calculates the position of an object (for example, a user's hand) as skin based on the output result from each sensor 21n.

When the processing unit 91 supplies the recognition result information to the CPU 61, the CPU 61 performs a process according to the recognition result information from the processing unit 91. This is the same in the second and third embodiments.

In addition, the processing unit 91 detects only the OR signal of the skin detection signal generated for each sensor 21n (for example, when at least one skin detection signal indicating that the skin is detected exists) May be supplied to the CPU 61. This is the same in the second and third embodiments described later.

The gain control unit 94n controls the PD 114n and adjusts parameters used for gain control processing performed by the PD 114n. This parameter represents how much the gain of the light reception luminance V obtained by the light reception of the PD 114n is adjusted.

This is because the closer the object 41 is to the PD 114n, the greater the received light intensity (received light amount) of the reflected light from the object 41 received by the PD 114n, and the greater the luminance signal V obtained by receiving the reflected light.

That is, the gain is adjusted so that the luminance signal V decreases when the luminance signal V is large, and the received light luminance V increases when the luminance signal V is small.

As a result, the situation where the luminance signal V is saturated can be prevented, so that the situation where the gradation of the luminance signal V is lost due to the saturation of the luminance signal V can be prevented. As a result, a more accurate skin detection signal and gesture can be prevented. Recognition information can be generated.

AD conversion unit 95n is output from PD114n V (e.g., luminance signal V _.lambda.1 and luminance signal V _.lambda.2, luminance signal _{V? OFF)} the AD conversion, and supplies the output V after the AD conversion processing unit 91.

The LED driver 111n controls lighting and extinguishing of the LED 112an and lighting and extinguishing of the LED 112bn according to an instruction from the timing control unit 93n.

The LED driver 111n controls the current flowing to the LED 112an and the current flowing to the LED 112bn in accordance with an instruction from the current control unit 92n.

A lens 113an is provided in front of the LED 112an. In addition, the LED 112an irradiates light of wavelength λ1 (for example, infrared light of 870 [nm]) within the detection range of the sensor 21n according to control from the LED 111n driver.

That is, for example, the LED 112an is turned on (irradiated with light of wavelength λ1) and turned off when a current instructed by the current control unit 92n is caused to flow according to the timing instructed by the timing control unit 93n. Done.

A lens 113bn is provided on the front surface of the LED 112bn. In addition, the LED 112bn irradiates light having a wavelength λ2 that is longer than the wavelength λ1 (for example, infrared of 950 [nm]) within the detection range of the sensor 21n in accordance with control from the LED 111n driver.

The LED 112an and the LED 112bn are provided with a lens 113an and a lens 113bn, respectively. Therefore, the LED 112an and the LED 112bn can irradiate the irradiation light uniformly within the detection range of the sensor 21n without causing uneven irradiation.

Note that the combination (λ1, λ2) of the wavelength λ1 and the wavelength λ2 is determined in advance based on, for example, the spectral reflection characteristics with respect to human skin. The spectral reflection characteristics with respect to human skin will be described in detail with reference to FIG.

That is, for example, the LED 112bn is repeatedly lit and extinguished by the current instructed by the current controller 92n flowing in accordance with the timing instructed by the timing controller 93n. When the LED 112bn is turned on, light having a wavelength λ2 is emitted from the LED 112bn.

A lens 115n is provided on the front surface of the PD 114n. The PD 114n receives reflected light from an object within the detection range of the sensor 21n when the LED 112an is turned on.

That is, for example, when the object 41 exists within the detection range of the sensor 21n, the PD 114n receives the reflected light from the object 41 irradiated with the light of the wavelength λ1 when the LED 112an is turned on.

Then, the PD 114n performs gain control processing on the light reception luminance V _λ1 obtained by the light reception, and outputs the light reception luminance V _λ1 after processing to the AD conversion unit 95n.

Also, for example, when the object 41 exists within the detection range of the sensor 21n, the PD 114n receives the reflected light from the object 41 irradiated with light of wavelength λ2 when the LED 112bn is turned on.

Then, the PD 114n performs gain control processing on the light reception luminance V _λ2 obtained by the light reception, and outputs the light reception luminance V _λ2 after processing to the AD conversion unit 95n.

Further, for example, when the object 41 exists within the detection range of the sensor 21n, the PD 114n receives reflected light from the object 41 irradiated with external light other than the irradiation light when the LED 112an and the LED 112bn are turned off.

Then, the PD 114n performs gain control processing on the light reception luminance Vλoff obtained by the light reception, and outputs the light reception luminance _Vλoff after the processing to the AD conversion unit 95n.

FIG. 12 shows spectral reflection characteristics with respect to human skin.

It should be noted that this spectral reflection characteristic is general regardless of the difference in human skin color (difference in race) and state (sunburn, etc.).

12, the horizontal axis indicates the wavelength of the irradiation light irradiated on the human skin, and the vertical axis indicates the reflectance of the irradiation light irradiated on the human skin.

It is known that the reflectance of reflected light radiated on human skin decreases sharply from around 900 [nm], peaking at around 800 [nm], and rises again around 1000 [nm] as a minimum. ing.

Specifically, for example, as shown in FIG. 12, the reflectance of reflected light obtained by irradiating human skin with light of 870 [nm] as infrared rays is about 63%. Moreover, the reflectance of the reflected light obtained by irradiating 950 [nm] light as infrared rays is about 50 percent.

This is peculiar to human skin. In an object other than human skin (for example, clothes), the change in reflectance is moderate in the vicinity of 800 to 1000 [nm]. In addition, as the frequency increases, the reflectance often increases little by little.

In the present disclosure, for example, the combination (λ1, λ2) = (870,950). This combination is a combination in which the reflectance when the human skin is irradiated with the light with the wavelength λ1 is larger than the reflectance when the light with the wavelength λ2 is irradiated.

Therefore, the luminance value represented by the luminance signal V _λ1 obtained by the reflected light from the object 41 as skin becomes a relatively large value, and the luminance value represented by the luminance signal V _λ2 obtained from the reflected light from the object 41 as skin. The value is a relatively small value.

For this reason, the difference value represented by the normalized difference signal Rdiff (= 100 × (V _λ1 −V _λ2 ) / (V _λ1 V _λoff )) is a relatively large positive value α1.

Note that the luminance signal V _λoff is used to remove the influence of external light other than the irradiation light from the LED 112an and the LED 112bn, thereby improving the accuracy of skin detection.

When the influence of external light is slight, the luminance signal V _λoff is omitted and the normalized difference signal Rdiff (= 100 × (V _λ1 −V _λ2 ) / V _λ1 ) is calculated. Good.

If a visible light cut filter that cuts (blocks) visible light is provided on the front surface of the PD 114n, the influence of visible light as external light can be removed, and the accuracy of the skin detection signal is further improved. Can be made. The same applies to PDs described in the second and third embodiments.

Further, in the combination (λ1, λ2) = (870,950), the reflectance when irradiating light of wavelength λ1 is almost the same as the reflectance when irradiating light of wavelength λ2 to things other than human skin. Combinations that are the same.

For this reason, the difference value represented by the normalized difference signal Rdiff is a relatively small positive or negative value β1.

Therefore, the processing unit 91 calculates the normalized difference signal Rdiff based on the luminance signal V _λ1 , the luminance signal V _λ2, and V _λoff from the AD conversion unit 95n. Then, the processing unit 91 determines whether the calculated normalized difference signal Rdiff is equal to or greater than a predetermined threshold value (for example, a threshold value that is smaller than α1 and larger than β1). A detection signal is generated.

Here, the combination (λ1, λ2) is not limited to (λ1, λ2) = (870,950), and may be any combination as long as the difference in reflectance is sufficiently large (λ1, λ2). .

For accurate skin detection, the wavelength λ1 is generally in the range of 640 [nm] to 1000 [nm], and the wavelength λ2 is in the range of 900 [nm] to 1100 [nm]. Thus, it is known from experiments previously conducted by the present inventor that it is desirable to set each of them.

However, when the wavelength λ1 is a wavelength in the visible light region, the value of the wavelength λ1 is caused because it makes the user feel dazzling or affects the color tone that the user feels when viewing the image on the display screen 1a. Is preferably 800 [nm] or more in the invisible light region.

That is, for example, within the above-mentioned range, the value of wavelength λ1 is a value in the invisible light region of 800 [nm] or more and less than 900 [nm], and the value of wavelength λ2 is the invisible light region of 900 [nm] or more. Is desirable.

Next, FIG. 13 shows an example of irradiation timing in each sensor 21n.

FIG. 13 shows an example of irradiation timings of the _three sensors 21 _{1 to} 21 ₃ in order to avoid the drawing from becoming complicated.

13A to 13C show the irradiation timings of the sensors 21 _{1 to} 21 ₃ , respectively. In FIG. 13A to FIG. 13C, the horizontal axis represents time t.

Further, in FIG. 13A to FIG. 13C, “LED λ1” indicates a lighting period in which only the LED 112an is lit (period in which only light of wavelength λ1 is irradiated). Further, “LED λ2” indicates a lighting period in which only the LED 112bn is lit (a period in which only light of wavelength λ2 is irradiated).

“LED「 off ”indicates a light extinguishing period in which the LED 112an and the LED 112bn are extinguished (period in which neither the light with the wavelength λ1 nor the light with the wavelength λ2 is irradiated).

The digital photo frame 1, when the sensor 21 ₁ and the sensor 21 ₂ as shown in FIG. 1 are provided, the sensor 21 ₁ and the sensor 21 _2, as shown in B in A and 13 in FIG. 13 Repeat irradiation.

That is, for example, the sensor 21 _1, as shown in A of FIG. 13, illuminates only LEDs 112a ₁ in the lighting period "LED .lambda.1" lit only LED112b ₁ in the lighting period "LED .lambda.2". Then, the

LEDs

112a ₁ and 112b ₁ are turned off during the turn-off period “LED off”.

Further, for example, as shown in FIG. 13B, the sensor 21 ₂ lights only the LED 112a _{2 in the} lighting period “LED λ1” immediately after the extinguishing period “LED off” shown in FIG. Only the LED 112b ₂ is lit in the lighting period “LED λ2”. Then, the LED 112a ₂ and the LED 112b ₂ are turned off during the turn-off period “LED off”.

After the extinguishing period “LED off” shown in FIG. 13B, the

sensors

21 ₁ and 21 ₂ wait for a certain interval (time), and the processing described with reference to FIG. 13A and FIG. 13B repeat. Note that, at the fixed interval (not shown), for example, the processing unit 91 of the control unit 66 generates a skin detection signal and gesture recognition information, outputs it to the CPU 61, and the like.

Further, for example, when the digital photo frame 1 is provided with _three sensors 21 _{1 to} 21 ₃ , the sensor 21 ₁ and the sensor 21 ₂ are respectively described with reference to A of FIG. 13 and B of FIG. Perform proper processing.

Then, as shown in FIG. 13C, the sensor 21 ₃ turns on only the LED 112a _{3 in the} lighting period “LED λ1” immediately after the extinguishing period “LED off” shown in FIG. “LED λ2” turns on only LED 112b ₃ . In addition, the sensor 21 ₃ turns off the

LEDs

112a ₃ and 112b ₃ during the turn-off period “LED off”.

After the extinguishing period “LED off” shown in FIG. 13C, the sensors 21 _{1 to} 21 ₃ waited for a certain interval I, for example, and have been described with reference to FIGS. 13A to 13C. Repeat the process. Note that, at the fixed interval I, for example, the processing unit 91 of the control unit 66 generates a skin detection signal and gesture recognition information, outputs it to the CPU 61, and the like.

Next, an example of a digital photo frame provided with _three sensors 21 _{1 to} 21 ₃ will be described with reference to FIGS.

FIG. 14 shows a configuration example of a digital photo frame 131 having _three sensors 21 _{1 to} 21 ₃ arranged in a triangle shape.

As in the case of FIG. 1, the digital photo frame 131 is provided with

sensors

21 ₁ and 21 _{2 in} the left-right direction of the display screen 1a in the drawing, and a sensor 21 _{3 in} the lower direction of the display screen 1a. Is provided.

The digital photo frame 131 can recognize the movement in the X direction (left and right direction) based on the output results from the

sensors

21 ₁ and 21 ₂ . Similarly, the digital photo frame 131 can recognize the movement in the Y direction (vertical direction) and the like based on the output results from the

sensors

21 ₁ and 21 ₃ .

When recognizing the movement in the Y direction or the like, for example, output results from the

sensors

21 ₂ and 21 ₃ can be used instead of the output results from the

sensors

21 ₁ and 21 ₃ .

Next, FIG. 15 shows a configuration example of a digital photo frame 151 having _three sensors 21 _{1 to} 21 ₃ arranged in an L shape.

The digital photo frame 151 is provided with a sensor 21 _{1 at the} upper left corner, a sensor 21 _{2 at the} lower left corner, and a sensor 21 _{3 at the} lower right corner.

The digital photo frame 151 can recognize the movement in the X direction (left and right direction) based on the output results from the

sensors

21 ₂ and 21 _3, and based on the output results from the

sensors

21 ₁ and 21 ₂ It is possible to recognize movement in the (vertical direction).

As described above, FIG. 1 illustrates the case where _two

sensors

21 ₁ and 21 ₂ are provided, and FIGS. 14 and 15 illustrate the case where three sensors 21 _{1 to} 21 ₃ are provided. The number of sensors 21n is not limited to this.

That is, for example, a new sensor 21 ₄ may be provided between the sensor 21 ₁ and the sensor 21 ₂ in the digital photo frame 151 of FIG.

In this case, in the digital photo frame 151, for example, the movement in the Y direction can be recognized based on the output results from the

sensors

21 ₁ , 21 _2, and 21 _4, so that the movement in the Y direction can be more accurately detected. Can be recognized.

Also, the digital photo frame may be provided with a distance sensor (for example, a PD or a capacitance sensor) that outputs different output results depending on the distance to the object 41, for example.

In this case, the digital photo frame is provided with a mixture of sensors 21n and distance sensors. Note that the output from the distance sensor is supplied to the processing unit 91 and used to generate gesture recognition information. This is the same in the second and third embodiments described later.

When the sensor 21n and the distance sensor are mixed and provided in the digital photo frame, it is not necessary to generate the skin detection signal in the processing unit 91 by the amount replaced with the distance sensor. Can reduce the burden required.

Further, since the burden on the processing unit 91 can be reduced, the DSP functioning as the processing unit 91 can be an inexpensive DSP (Digital Signal Processor) with a relatively low processing speed, and the digital photo frame 1 can be manufactured. Costs can be reduced.

[Details of the first gesture recognition process]
Next, the first gesture recognition process performed by the digital photo frame 1 will be described with reference to FIG.

This first gesture recognition process is started, for example, when the digital photo frame 1 is powered on.

In step S1, the processing unit 91 pays attention to a predetermined sensor 21 _n among the plurality of sensors 21 _{1 to} 21 _{N and} sets it as the attention sensor 21 _n .

In step S2, the processing unit 91 controls the sensor of interest 21 _n via the current control unit 92 _n , the timing control unit 93 _{n, the} gain control unit 94 _{n, and the} like, generates a luminance signal V _λ1 and AD V _λ1 acquisition processing to be output to the conversion unit 95 _n is performed. In addition, the AD conversion unit 95 _n performs AD conversion on the luminance signal V _λ1 from the sensor of interest 21 _n and supplies the luminance signal V _λ1 after AD conversion to the processing unit 91.

In step S3, the processing unit 91 controls the sensor of interest 21 _n via the current control unit 92 _n , the timing control unit 93 _{n, the} gain control unit 94 _n, etc., and generates a luminance signal V _λ2 to generate an AD conversion unit. V _λ2 acquisition processing to be output to 95 _n is performed. Further, the AD conversion unit 95 _n performs AD conversion on the luminance signal V _λ2 from the sensor of interest 21 _n and supplies the luminance signal V _λ2 after AD conversion to the processing unit 91.

Details of the V _λ1 acquisition process and the V _λ2 acquisition process performed by the sensor of interest 21 _n will be described in detail with reference to FIG.

In step S4, the processing unit 91 controls the sensor of interest 21 _n via the current control unit 92 _n , the timing control unit 93 _{n, the} gain control unit 94 _{n, and the} like to generate the luminance signal V _λoff and generate the AD conversion unit. The V _λoff acquisition process for outputting to 95 _n is performed. In addition, the AD conversion unit 95 _n performs AD conversion on the luminance signal V _λoff from the sensor of interest 21 _n and supplies the luminance signal V _λoff after AD conversion to the processing unit 91.

Details of the V _λoff acquisition process performed by the sensor of interest 21 _n will be described in detail with reference to FIG.

In step S5, the processing unit 91, attention sensor 21 the luminance signal supplied via the AD converter 95 _n from _n V _.lambda.1, luminance signal V _.lambda.2, and based on the raw brightness signal _{V? OFF,} an object of the skin Skin discrimination processing is performed for generating a skin detection signal indicating whether or not the target sensor 21 _n exists within the detection range. Details of the skin discrimination processing performed by the processing unit 91 will be described in detail with reference to FIG.

In step S6, the processing unit 91 generates gesture recognition information based on the luminance signal V _λ1 supplied from the sensor of interest 21 _n via the AD conversion unit 95 _n .

Here, among the processes of Steps S2 to S6 performed in each sensor 21 _n to be noted, the processes of Step S5 and Step S6 may be performed collectively when proceeding from Step S7 to Step S8.

In this case, since the time difference at which the luminance signal is acquired by each sensor 21 _n can be shortened, a more accurate skin detection signal and gesture recognition information can be generated. The same applies to other gesture recognition processes (for example, a fourth gesture recognition process) described later.

As the gesture recognition information, the luminance signal V _λ1 representing the received light intensity of the reflected light received by the PD 114n can be used as it is.

Further, for example, the square of the distance from the sensor of interest 21 _n to the object is proportional to the luminance signal V _λ1 as the received light intensity of the reflected light from the object, and therefore the luminance signal V _λ1 as the received light intensity of the reflected light. You may make it employ | adopt square root as gesture recognition information.

Further, for example, an average of the luminance signal V _λ1 (represented by the luminance value) and the luminance signal V _λ2 (represented by the luminance value) may be employed as the gesture recognition information.

Further, the processing unit 91 can employ the skin detection signal generated in step S5 as gesture recognition information. Further, the processing unit 91 generates gesture recognition information based on the luminance signal V _λ2 supplied from the sensor of interest 21 _n via the AD conversion unit 95 _n as in the case of the luminance signal V _λ2. Also good.

The same can be said for the gesture recognition information in the second and third embodiments.

The processing unit 91 supplies gesture recognition information generated based on at least one of the luminance signal V _{λ1 and the} luminance signal V _λ2 together with the generated skin detection signal to the CPU 61 via the input / output interface 65 and the bus 64.

In step S7, when the processing unit 91 determines whether or not attention to all of the plurality of sensors 21 ₁ to 21 _N, it was determined not to be focused on all of the plurality of sensors 21 ₁ to 21 _N, the processing To step S1.

In step S1, the processing unit 91 sets a sensor 21 _n that has not been focused on among the plurality of sensors 21 _{1 to} 21 _N as a new focused sensor 21 _n, and thereafter the same processing is performed.

In step S7, if the processing unit 91 determines that all of the plurality of sensors 21 _{1 to} 21 _N are focused, the process proceeds to step S8.

Thus the process of steps S1 to S7 described, the CPU 61, skin output interface 65 and the bus 64 from the target by the sensor 21 ₁ through 21 _N has been generated in the sensor 21 ₁ to each 21 _N Detection signals and gesture recognition information are supplied.

In step S8, the CPU 61 determines that the object 41 as skin is one of the sensors based on the skin detection signal supplied from the sensors 21 _{1 to} 21 _N of the control unit 66 via the input / output interface 65 and the bus 64. It is determined whether or not it has been detected within a detection range of 21n.

In step S8, if the CPU 61 determines that the object 41 as skin has not been detected, the process returns to step S1, and thereafter the same process is performed.

In step S8, if the CPU 61 determines that the object 41 as skin has been detected, the process proceeds to step S9. In step S9, the CPU 61 determines the position and movement of the object 41 as the skin based on the gesture recognition information supplied from the sensors 21 _{1 to} 21 _N of the control unit 66 via the input / output interface 65 and the bus 64. Recognize (detect).

In step S10, the CPU 61 performs corresponding processing according to the recognition result based on the gesture recognition information.

That is, for example, when the CPU 61 recognizes the movement of the object 41 as shown in FIG. 2, the CPU 61 controls the display unit 67 via the bus 64 and the input / output interface 65, and is currently displaying among a plurality of still images. The still image is enlarged and displayed on the display screen 1a.

After the completion of step S10, the process returns to step S1, and thereafter the same process is repeated. Note that the first gesture recognition process is ended when, for example, the digital photo frame 1 is powered off.

[Details of V _λ1 acquisition processing]
Next, details of the V _λ1 acquisition process performed by the sensor of interest 21 _n in step S2 of FIG. 16 will be described with reference to the flowchart of FIG.

In step S31, LEDs 112a _n, under the control from the LED driver 111 _n, the light of wavelength .lambda.1, irradiates the detection range of the target sensor 21 _n. In this case, it is assumed that the LED 112b _n is turned off in accordance with the control from the LED driver 111 _n .

In step S32, PD 114 _n is, reflected light of light of wavelength λ1 emitted from the LEDs 112a _n (e.g., if the object 41 is present in the detection range of the target sensor 21 _n, the light of the wavelength λ1 emitted to the object 41 Receives reflected light.

In step S33, the PD 114 _n performs photoelectric conversion on the reflected light received in the process of step S32, and supplies the luminance signal V _λ1 obtained as a result to the AD conversion unit 95 _n . The process is performed in step S2 of FIG. Returning to step S3, the process proceeds to step S3. Incidentally, the AD conversion unit 95 _n has a luminance signal V _.lambda.1 from PD 114 _n AD conversion, and supplies the processing unit 91 the luminance signal V _.lambda.1 after AD conversion.

[Details of V _λ2 acquisition processing]
In step S3 of FIG. 16, the sensor of interest 21 _n performs a V _λ2 acquisition process in the same manner as the V _λ1 acquisition process.

In other words, this V _λ2 acquisition process includes step S31 ′ to step S33 ′. In step S31 ′, the LED 112b _n detects the light of wavelength λ2 according to the control from the LED driver 111 _n and detects the sensor 21 _n . Irradiate the area. In this case, LEDs 112a _n is assumed to be off according to the control from the LED driver 111 _n.

In step S32 ′, the PD 114 _n reflects the reflected light of the wavelength λ2 emitted from the LED 112b _n (for example, if the object 41 exists in the detection range of the sensor of interest 21 _n , the light of the wavelength λ2 emitted to the object 41). (Reflected light).

In step S33 ′, the PD 114 _n photoelectrically converts the reflected light received in the process of step S32 ′ and supplies the resulting luminance signal V _λ2 to the AD converter 95 _n . Returning to step S3, the process proceeds to step S4. Incidentally, the AD conversion unit 95 _n has a luminance signal V _.lambda.2 from PD 114 _n AD conversion, and supplies the processing unit 91 the luminance signal V _.lambda.2 after AD conversion.

[Details of V _λoff acquisition processing]
Next, details of the V _λoff acquisition process performed by the sensor of interest 21 _n in step S4 of FIG. 16 will be described with reference to the flowchart of FIG.

Incidentally, LED driver 111 _n controls the LEDs 112a _n and LED112b _n, none of the LEDs 112a _n and LED112b _n assumed that is turned off. Therefore, the detection range of the target sensor 21 _n, only the external light other than light emitted from the LEDs 112a _n and LED112b _n is irradiated.

In step S51, the PD 114 _n receives reflected light of outside light (for example, reflected light of outside light irradiated on the object 41 when the object 41 exists in the detection range of the sensor of interest 21 _n ).

In step S52, the PD 114 _n photoelectrically converts the reflected light received in the process of step S51, supplies the luminance signal V _λoff obtained as a result to the AD conversion unit 95 _n , and the process is performed in step S4 of FIG. Returning to step S5, the process proceeds to step S5. Incidentally, the AD conversion unit 95 _n has a luminance signal _{V? OFF} from the PD 114 _n AD conversion, and supplies the luminance signal _{V? OFF} after AD conversion to the processing unit 91.

[Details of skin discrimination processing]
Next, with reference to the flowchart of FIG. 19, the detail of the skin discrimination | determination process which the process part 91 of the attention sensor 21 _n performs in step S5 of FIG.

In step S71, the processing unit 91, based on the luminance signal V _.lambda.1 and the luminance signal V _.lambda.2 from AD conversion unit 95 _n, and calculates the difference signal _{_{Vdif (= V λ1 -V λ2)}} .

In step S72, the processing section 91, the difference signal Vdif (= _{_V} λ1 -V λ2) and on at least one value based on the luminance signal V _.lambda.1 or luminance signal V _.lambda.2, i.e., for example, a value ₍₌ _V λ1 -V λoff ) To normalize (divide).

Then, the difference signal after normalization, for example by multiplying by 100, to calculate a normalized difference signal Rdif (= 100 × Vdif / ( V λ1 -V λoff)).

In step S73, the processing unit 91 determines whether or not the object 41 as skin exists within the detection range of the sensor of interest 21 _n based on whether or not the normalized difference signal Rdif is greater than or equal to a predetermined threshold value. Is determined.

In step S74, when the normalized difference signal Rdif is greater than or equal to a predetermined threshold value, the processing unit 91 determines that the object 41 as skin exists within the detection range of the sensor of interest 21 _n , and determines the determination result. Generate a skin detection signal to represent.

Further, when the normalized difference signal Rdif is not greater than or equal to a predetermined threshold value, the processing unit 91 determines that the object 41 as skin does not exist within the detection range of the sensor of interest 21 _n and represents the determination result. A skin detection signal is generated.

After the completion of step S74, the process returns to step S5 in FIG. 16, and the subsequent processes are performed.

As described above, according to the first gesture recognition process, when the object 41 as skin exists within the detection range of at least one sensor 21n, the position and movement of the object 41 as skin are recognized. I tried to do it.

Therefore, when the object 41 is something other than the skin, it is possible to prevent a situation in which the position or movement of the object 41 is erroneously recognized and processing according to the recognition result is performed.

In the first gesture recognition process, if no skin is detected in step S8, the process may return to step S1 after waiting for a predetermined time.

In this case, in the first gesture recognition process, the interval (for example, corresponding to the interval I shown in FIG. 13) in which the processes in steps S1 to S7 are performed is determined until the skin is detected in step S8. Can be longer than the interval after detection.

Therefore, it is possible to reduce the load on the control unit 66 by increasing the interval at which the processing from step S1 to step S7 is performed until skin is detected. Further, after the skin is detected, the interval can be shortened, and the detected skin position and movement can be recognized at a shorter interval (time).

By the way, in the first gesture recognition processing, V _λ1 acquisition processing, V _λ2 acquisition processing, V _λoff acquisition processing, and skin discrimination are performed as processing for detecting the object 41 as skin from the detection range of the sensor of interest 21 _n. The process was repeated.

However, when the object 41 as skin is detected, the second gesture recognition process is performed to simplify the process for detecting the object 41 as skin from the detection range of the sensor of interest 21 _n. Also good.

In the second gesture recognition process, when the object 41 as skin is detected, for example, only the V _λ1 acquisition process is performed, and the detection of the attention sensor 21 _n is performed based on the luminance signal V _λ1 obtained by the V _λ1 acquisition process. It detects whether an object exists within the range.

Then, when it is detected that an object exists within the detection range of the sensor of interest 21 _n , the processing is simplified by treating the object 41 as skin as having been detected.

[Second gesture recognition process]
Next, details of the second gesture recognition process performed by the digital photo frame 1 will be described with reference to the flowchart of FIG.

This second gesture recognition process is started, for example, when the digital photo frame 1 is turned on.

In steps S91 to S100, the same processes as in steps S1 to S10 in FIG. 16 are performed.

In step S101, the processing unit 91 pays attention to a predetermined sensor 21 _n among the plurality of sensors 21 _{1 to} 21 _{N and} sets it as the attention sensor 21 _n .

In step S102, the processing unit 91 controls the sensor of interest 21 _n via the current control unit 92 _n , the timing control unit 93 _{n, the} gain control unit 94 _{n, and the} like to perform the V _λ1 acquisition process. In addition, the AD conversion unit 95 _n performs AD conversion on the luminance signal V _λ1 from the sensor of interest 21 _n and supplies the luminance signal V _λ1 after AD conversion to the processing unit 91.

In step S103, the processing unit 91 generates gesture recognition information based on the luminance signal V _λ1 supplied from the sensor of interest 21 _n via the AD conversion unit 95 _n, and together with the luminance signal V _λ1 , input / output interface 65. The data is supplied to the CPU 61 via the bus 64.

If the gesture recognition information is the luminance signal V _λ1 in step S103, the processing unit 91 supplies only the gesture recognition information as the luminance signal V _λ1 to the CPU 61 via the input / output interface 65 and the bus 64. Will be.

In step S104, if the processor 91 determines whether attention to all of the plurality of sensors 21 ₁ to 21 _N, it was determined not to be focused on all of the plurality of sensors 21 ₁ to 21 _N, The process returns to step S101.

In step S101, the processing unit 91 sets a sensor 21 _n that has not been noticed among the plurality of sensors 21 _{1 to} 21 _N as a new sensor of interest 21 _n, and thereafter the same processing is performed.

In step S104, when the processing unit 91 determines that all of the plurality of sensors 21 _{1 to} 21 _N are focused, the process proceeds to step S105.

Thus the process of steps S101 through S104 described, the CPU 61, via the input-output interface 65 and the bus 64 from the target by the sensor 21 ₁ through 21 _N has been generated in the sensor 21 ₁ to each 21 _N gesture Recognition information and a luminance signal V _λ1 are supplied.

In step S105, the CPU 61 determines which of the sensors 21 _n is based on whether or not each luminance signal V _λ1 supplied from the control unit 66 via the input / output interface 65 and the bus 64 is _equal to or greater than a predetermined threshold. It is determined whether an object is detected within the detection range.

In step S105, the CPU 61 may determine whether an object is detected within the detection range of the sensor of interest 21 _n based on whether the luminance signal V _λ2 is _equal to or greater than a threshold value. In this case, in step S102, V _λ2 acquisition processing is performed.

In step S105, when the CPU 61 determines that an object has been detected, the CPU 61 treats the object 41 as skin as having been detected, returns the process to step S99, and thereafter repeats the same process.

In step S105, if the CPU 61 determines that no object is detected, it treats that the object 41 as skin has not been detected, returns the process to step S91, and thereafter repeats the same process.

Note that this second gesture recognition process is terminated when, for example, the digital photo frame 1 is powered off.

As described above, according to the second gesture recognition process, after an object as skin is detected within the detection range of the sensor 21n, it is detected whether or not the object exists within the detection range of the sensor 21n. When an object is detected, it is handled as if the object as skin was detected.

Therefore, for example, the processing unit 91 is compared with the case where the V _λ1 acquisition process, the V _λ2 acquisition process, the V _λoff acquisition process, and the skin determination process are repeatedly performed regardless of whether an object as skin is detected. It becomes possible to reduce the burden.

In the second gesture recognition process, if no skin is detected in step S98 and no object is detected in step S105, the process returns to step S91 after waiting for a predetermined time. May be.

In this case, in the second gesture recognition process, the skin detects the interval (for example, corresponding to the interval I in FIG. 13) in which the processes in steps S91 to S97 are performed until the skin is detected in step S98. The interval after being made can be longer.

Therefore, it is possible to reduce the load on the control unit 66 by increasing the interval at which the processing from step S91 to step S97 is performed until skin is detected. Further, after the skin is detected, the interval can be shortened, and the detected skin position and movement can be recognized at a shorter interval.

In the first embodiment, for example, the first gesture recognition process or the second gesture recognition process is performed regardless of whether or not an object exists within the detection range of the sensors 21 _{1 to} 21 _N. did.

However, for example, when it is determined whether or not an object exists in the detection range of the sensors 21 _{1 to} 21 _N and it is determined that an object exists in the detection range, the first gesture recognition process or the first The proximity object detection process for performing the gesture recognition process 2 may be performed.

[Nearby object detection processing performed by digital photo frame 1]
Next, details of the proximity object detection process performed by the digital photo frame 1 will be described with reference to the flowchart of FIG.

This proximity object detection process is started, for example, when the digital photo frame 1 is turned on.

In step S121, the processing unit 91 pays attention to a predetermined sensor 21 _n among the plurality of sensors 21 _{1 to} 21 _{N and} sets it as the attention sensor 21 _n .

In step S122, the processing unit 91 controls the sensor of interest 21 _n via the current control unit 92 _n , the timing control unit 93 _{n, the} gain control unit 94 _{n, and the} like to perform the V _λ1 acquisition process. In addition, the AD conversion unit 95 _n performs AD conversion on the luminance signal V _λ1 from the sensor of interest 21 _n and supplies the luminance signal V _λ1 after AD conversion to the processing unit 91.

In step S123, the processing unit 91 determines whether or not an object has entered the detection range of the target sensor 21 _n based on the luminance signal V _λ1 supplied from the target sensor 21 _n via the AD conversion unit 95 _n. judge.

That is, for example, the processing unit 91 determines whether the luminance value represented by the luminance signal V _λ1 supplied from the sensor of interest 21 _n via the AD conversion unit 95 _n is _equal to or greater than a predetermined threshold value. It is determined whether an object has entered the detection range of the sensor of interest 21 _n .

If the processing unit 91 does not detect the entry of an object into the detection range of the sensor of interest 21 _n based on the determination result, the processing unit 91 returns the process to step S121.

In step S121, the processing unit 91 sets the sensor 21 _n that has not been noticed among the plurality of sensors 21 _{1 to} 21 _N as a new attention sensor 21 _n, and thereafter, the same processing is performed.

In addition, when all of the plurality of sensors 21 _{1 to} 21 _N are noticed in step S121 and the process of step S121 is further performed, none of the plurality of sensors 21 _{1 to} 21 _N has been noticed yet. As a result, the process of step S121 is performed.

Further, in step S123, processing unit 123 determines based on the result, when detecting an object intrusion for the detection range of the target sensor 21 _n, processing proceeds to step S124, the first gesture recognition processing or the second Gesture recognition processing is performed.

In step S124, when the first gesture recognition process is performed, the first gesture recognition process is terminated as described below, and the proximity object detection process is also terminated.

That is, for example, in step S8 of the first gesture recognition process, when the CPU 61 determines that the object 41 as skin is not detected, in other words, the object 41 that has entered the detection range is not skin. When it is determined that, the first gesture recognition process is terminated. Then, the proximity object detection process is terminated, and a proximity object detection process is newly started.

In step S124, when the second gesture recognition process is performed, the second gesture recognition process is ended as follows, and the proximity object detection process is also ended.

That is, for example, when the CPU 61 determines in step S98 of the second gesture recognition process that the object 41 as skin is not detected, in other words, the object 41 that has entered the detection range is not skin. Is determined, the second gesture recognition process is terminated. Then, the proximity object detection process is terminated, and a proximity object detection process is newly started.

In addition, for example, in step S105 of the second gesture recognition process, when the CPU 61 determines that no object is detected, it is determined that the object 41 that has entered the detection range does not already exist in the detection range. Then, the second gesture recognition process is terminated. Then, the proximity object detection process is terminated, and a proximity object detection process is newly started.

In the newly started proximity object detection process, in steps S121 to S123, it is determined whether or not a new object has entered the detection range of any of the plurality of sensors 21 _{1 to} 21 _N.

Then, when it is detected that an object has newly entered the detection range of any of the plurality of sensors 21 _{1 to} 21 _N based on the determination result by the determination, in step S124, a new first The gesture recognition process or the second gesture recognition process is performed.

As described above, according to the proximity object detection process, it is determined whether or not an object has entered one of the detection ranges of the sensor 21n. Then, based on the determination result, the first or second gesture recognition process is performed when it is detected that an object has entered one of the detection ranges of the sensor 21n.

Therefore, the burden on the processing unit 91 can be reduced as compared with the case where the first or second gesture recognition process is performed regardless of whether an object has entered the detection range of the sensor 21n. It becomes.

Further, in the proximity object detection process, attention is sequentially paid to each sensor 21 _n in step S121, and whether or not an object is detected in step S123 each time the luminance signal V _λ1 is acquired from the attention sensor 21 _n in step S122. Judgment was made.

However, for example, in step S121 and step S122, the luminance signal V _λ1 may be acquired for each of the sensors 21 _{1 to} 21 _N.

Then, in step S123, based on the luminance signal V _.lambda.1 acquired at each sensor 21 ₁ to each 21 _N, determine whether the object has entered into any of the detection ranges of the sensors 21 ₁ to 21 _N You may make it do.

If it is determined in step S123 that the object has not entered any of the detection ranges of the respective sensors 21 _{1 to} 21 _N , the process waits for a predetermined time and the process returns to step S121. It may be.

In this case, it is possible to reduce the load caused by the processing in steps S121 to S123 for determining whether or not an object has entered the detection range of any one of the sensors 21 _{1 to} 21 _N.

<2. Second Embodiment>
[Configuration example of digital photo frame 171]
Next, FIG. 22 shows a configuration example of a digital photo frame 171 according to the second embodiment.

The digital photo frame 171 is provided with a PD 191 ₁ and a PD 191 ₂ in place of the sensor 21 ₁ and the sensor 21 ₂ of the digital photo frame 1 according to the first embodiment.

Also, the digital photo frame 171 is provided with an LED unit 192 having an LED 112a (FIG. 26) that emits light of wavelength λ1 and an LED 112b (FIG. 26) that emits light of wavelength λ2.

In the sensor 21n in the first embodiment, the built-in LED 112a and LED 112b irradiate the detection range of the sensor 21n.

On the other hand, the LED unit 192 in the second embodiment irradiates a range in which the user is supposed to perform a gesture, that is, a range composed of detection ranges of the plurality of sensors 21 _{1 to} 21 _N , for example. I am doing so. This range is a detection range for detecting an object.

Other than that, the configuration is the same as that of the digital photo frame 1 (FIG. 1).

Incidentally, LED unit 192, the distance from the LEDs 112a (FIG. 26) to PD191 _1, the distance from the LEDs 112a (FIG. 26) to PD191 _2, the distance from LED112b (Figure 26) to PD191 _1, and from LED112b (Figure 26) the distance to the PD191 ₂ is arranged so either the same desirable.

To this arrangement, the LED unit 192, passes through the center of a line connecting the PD191 ₁ and PD191 _2, must be present on the display screen 1a perpendicular on the normal line. This will be described in detail with reference to FIGS.

Next, referring to FIG. 23 and FIG. 24, the digital photo frame 171 is based on the output results from the PD 191 ₁ and PD 191 _{2 in} the X direction (in FIG. 22, the left and right directions where the PD 191 ₁ and PD 191 ₂ exist). A recognition method for recognizing the position and movement of the object 41 in FIG.

Note that the recognition method for recognizing the position and movement of the object 41 in the Z direction in the PD 191 ₁ and the PD 191 ₂ is the same as that described with reference to FIGS.

FIG. 23 shows an example of a state when the digital photo frame 171 is viewed from the lower side in FIG.

In addition, as shown in FIG. 23, the LED unit 192 irradiates a range in which the user is supposed to perform a gesture or the like on the front surface of the digital photo frame 171. For example, the LED unit 192 repeatedly turns on the LED 112a, turns on the LED 112b, and turns off the LED 112a and the LED 112b, similarly to the case shown in FIG. 13A.

23, for example, if the object is, in the figure, when moved from the left center, and to the right, i.e., the object has moved to the vicinity just above the PD191 ₂ from the vicinity just above the PD191 _{_1,} PD191 ₁ and based on the output results from the PD191 _2, movement of the object is recognized.

Next, FIG. 24, the object is, when the motion as shown in FIG. 23, the PD191 ₁ and PD191 _2, shows an example of an output result output respectively.

In the C of A to 24 in FIG. 24, so that the lobes obtained as output from the PD191 ₁ and PD191 _2, described in a simplified manner.

FIG. 24A shows an example of an output result obtained when the object exists on the left side in FIG. That is, the output result of the A to the left PD191 ₁ in FIG. 24, the A center of FIG. 24 are shown PD191 ₂ output results.

Incidentally, in the A left side of FIG. 24, the horizontal axis represents the time t, the vertical axis represents the output V from the PD191 _1. The same applies to the left side of B in FIG. 24 and the left side of C in FIG.

Further, in A center of FIG. 24, the horizontal axis represents the time t, the vertical axis represents the output V from the PD191 _2. The same applies to the center B in FIG. 24 and the center C in FIG.

In addition, the A right side of FIG. 24, PD191 ₁ of an output result from the PD191 ₂ of output (A left side of FIG. 24) is the difference obtained by subtracting the (A center of FIG. 24) is shown.

FIG. 24B shows an example of the output result obtained when the object exists in the center in FIG. That is, output of B on the left side PD191 ₁ in FIG. 24, the B middle of Figure 24 is shown PD191 ₂ output results.

Further, in the B right side of FIG. 24, the difference obtained by subtracting the PD191 ₁ of output results (Fig. 241B left) from PD191 ₂ of output (B middle of FIG. 24) is shown.

FIG. 24C shows an example of an output result obtained when the object exists on the right side in FIG. That is, the output result of the C to the left PD191 ₁ in FIG. 24, the C center of FIG. 24 are shown PD191 ₂ output results.

In addition, the C right side of FIG. 24, the difference obtained by subtracting the PD191 ₁ of an output result (C center of FIG. 24) from the PD191 ₂ of an output result (C left side in FIG. 24) is shown.

For example, as shown in FIG. 23, when an object is present on the left side, as shown in A left and the center of FIG. 24, PD191 ₁ of output becomes large, PD191 ₂ output result becomes small. Therefore, the difference is a positive value as shown on the right side of FIG.

Further, as shown in FIG. 23, when an object is present in the center, as shown in B left and the center of FIG. 24, and the _first output result and PD191, PD191 ₂ output result and (almost) the same . Accordingly, the difference is 0 as shown on the right side of FIG.

Furthermore, as shown in FIG. 23, when an object is present on the right side, as shown in C the left and the center of FIG. 24, PD191 ₁ of an output result small becomes, PD191 ₂ of output is large. Therefore, as shown on the right side of FIG. 24C, the difference is a negative value.

That is, when the object moves as shown in FIG. 23, the difference is determined according to the movement of the object, as shown on the right side of FIG. 24, the right side of FIG. 24B, and the right side of FIG. It will decrease.

For this reason, the digital photo frame 171 can recognize the movement of the object according to the change in the difference.

[Detailed configuration example of the digital photo frame 171]
Next, FIG. 25 shows a detailed configuration example of the digital photo frame 171.

In the digital photo frame 171, the same reference numerals are given to the same parts as those of the digital photo frame 1 shown in FIG.

That is, the digital photo frame 171 is provided with a control unit 211 having a plurality of PDs 191 _{1 to} 191 _{N in place} of the control unit 66 having a plurality of sensors 21 _{1 to} 21 _N (FIG. 10). The configuration is the same as that of the photo frame 1.

Note that the control unit 211 of the digital photo frame 171 in FIG. 22 includes PDs 191 ₁ and 191 ₂ , but the number of PDs 191 n is not limited to two.

[Detailed configuration example of the control unit 211]
FIG. 26 shows a detailed configuration example of the control unit 211.

In addition to the PD 191n (n = 1, 2,..., N), the control unit 211 includes a processing unit 231, a current control unit 92, a timing control unit 93, a gain control unit 94n, an LED unit 192, and an AD conversion unit 95n. Composed. A lens 232n similar to the lens 115n is provided on the front surface of the PD 191n.

The current control unit 92 performs the same processing as the current control unit 92n, and the timing control unit 93 performs the same processing as the timing control unit 93n. In FIG. 26, the gain control unit 94n and the AD conversion unit 95n perform the same processing as the gain control unit 94n and the AD conversion unit 95n in FIG. 11, respectively.

Further, the LED unit 192 includes an LED driver 111, an LED 112a, an LED 112b, a lens 113a, and a lens 113b that are configured in the same manner as the LED driver 111n, LED 112an, LED 112bn, lens 113an, and lens 113bn in FIG.

The PD 191n receives the reflected light of the light having the wavelength λ1 emitted from the LED 112a (for example, the reflected light from the object 41 irradiated with the light having the wavelength λ1) when the LED 112a is turned on, similarly to the PD 114n.

Then, the PD 191n performs gain control processing on the received light brightness V _λ1 obtained by the light reception, and outputs the processed received light brightness V _λ1 to the AD conversion unit 95n.

Further, when the LED 112b is turned on, the PD 191n receives the reflected light of the wavelength λ2 emitted from the LED 112b (for example, the reflected light from the object 41 irradiated with the light of wavelength λ2).

Then, PD191n is the gain control processing on the received light intensity V _.lambda.2 obtained by the light receiving outputs the receiving intensity V _.lambda.2 after processing to the AD conversion unit 95n.

Furthermore, when the LED 112a and the LED 112b are turned off, the PD 191n receives reflected light of external light other than the irradiated light (for example, reflected light from the object 41 irradiated with the external light).

Then, the PD _191n performs gain control processing on the light reception luminance V _λoff obtained by the light reception, and outputs the processed light reception luminance V _λoff to the AD conversion unit 95n.

The processing unit 231 controls the current control unit 92, the timing control unit 93, and the gain control unit 94n in the same manner as the processing unit 91.

Further, the luminance signal V _λ1 , the luminance signal V _λ2 , and the luminance signal V _λoff are supplied to the processing unit 231 from each PD 191n via the AD conversion unit 95n.

The processing unit 231 is similar to the processing unit 91, for example, based on the luminance signal V _λ1 , luminance signal V _λ2 , and luminance signal V _λoff from the AD conversion unit 95n, the irradiation range (detection range) of the LED unit 192. A skin detection signal indicating whether or not skin is present is generated.

Further, the processing unit 231 generates gesture recognition information based on the luminance signal V _λ1 from the AD conversion unit 95n, for example. Note that the processing unit 231 can generate the skin detection signal as gesture recognition information or generate the skin detection signal based on the luminance signal V _λ2 in the same manner as the processing unit 91 in the first embodiment.

The processing unit 231 supplies the generated skin detection signal and gesture recognition information to the CPU 61 via the input / output interface 65 and the bus 64 of FIG.

[Third gesture recognition processing performed by the digital photo frame 171]
Next, the third gesture recognition process performed by the digital photo frame 171 will be described with reference to the flowchart of FIG.

This third gesture recognition process is started when the digital photo frame 171 is powered on, for example.

In step S141, the processing unit 231, a current control unit 92, via the timing control unit 93 and the gain control unit 94 _n, and it controls the PD191n and LED unit 192.

Then, the processing unit 231 performs a V _λ1 acquisition process of generating a luminance signal V _λ1 and outputting it to the AD conversion unit 95 _n for each PD 191n.

That is, for example, the processing unit 231 instructs the current control unit 92 to supply a current to the LED 112a and the LED 112b, and instructs the timing control unit 93 to turn on and off the

LEDs

112a and 112b.

In contrast, the current control unit 92 and the timing control unit 93 control the LED driver 111 in accordance with an instruction from the processing unit 231.

The LED driver 111 irradiates light of wavelength λ1 by turning on only the LED 112a according to the control from the current control unit 92 and the timing control unit 93.

At this time, each PD191n, respectively, receives reflected light obtained by the irradiation of light of wavelength .lambda.1, a luminance signal V _.lambda.1 obtained by photoelectrically converting the received reflected light, and outputs the AD conversion unit 95 _n.

Further, the AD conversion unit 95 _n, respectively, the luminance signal V _.lambda.1 from PD191 _n AD conversion, a luminance signal V _.lambda.1 after AD conversion, and supplies to the processing unit 231.

In step S142, the processing unit 231, a current control unit 92, via the timing control unit 93 and the gain control unit 94 _n, and it controls the PD191n and LED unit 192.

Then, the processing unit 231 performs a V _λ2 acquisition process for generating a luminance signal V _λ2 and outputting it to the AD conversion unit 95 _n for each PD 191n.

LEDs

112a and 112b.

The LED driver 111 irradiates light of wavelength λ2 by turning on only the LED 112b according to control from the current control unit 92 and the timing control unit 93.

At this time, each PD191n, respectively, receives reflected light obtained by the irradiation of light of wavelength .lambda.2, a luminance signal V _.lambda.2 obtained by photoelectrically converting the received reflected light, and outputs the AD conversion unit 95 _n.

Further, the AD conversion unit 95 _n, respectively, the luminance signal V _.lambda.2 from PD191 _n AD conversion, a luminance signal V _.lambda.2 after AD conversion, and supplies to the processing unit 231.

In step S143, the processing unit 231, a current control unit 92, via the timing control unit 93 and the gain control unit 94 _n, and it controls the PD191n and LED unit 192.

Then, the processing unit 231 performs a V _λoff acquisition process of generating a luminance signal V _λoff and outputting it to the AD conversion unit 95 _n for each _{PD 191n} .

LEDs

112a and 112b.

The LED driver 111 turns off both the LED 112a and the LED 112b according to the control from the current control unit 92 and the timing control unit 93.

At this time, each PD191n, respectively, receive the outside light reflected light and outputs the reflected light received luminance signal _{V? OFF} obtained by photoelectrically converting, the AD conversion unit 95 _n.

Further, the AD conversion unit 95 _n, respectively, the luminance signal _{V? OFF} from the PD191 _n AD conversion, a luminance signal _{V? OFF} after AD conversion, and supplies to the processing unit 231.

The luminance signal combinations (V _λ1 , V _λ2 , V _λoff ) _n generated by the _PD _191n are supplied to the processing unit 231 via the AD conversion unit 95n by the processing in steps S141 to S143 described above.

In step S144, the processing unit 231, a combination of the luminance signal supplied via the AD converter 95n from _{_{PD191n (V λ1, V λ2,}} V λoff) based on _n, the same skin determination processing and processing unit 91 Do. In this skin discrimination process, a skin detection signal Dn is generated for each combination (V _λ1 , V _λ2 , V _λoff ) _n .

In step S145, for example, the processing unit 231 generates the gesture recognition information Jn based on the luminance signal V _λ1 of the combination of luminance signals (V _λ1 , V _λ2 , V _λoff ) _n .

The processing unit 231 supplies the generated skin detection signal Dn and gesture recognition information Jn to the CPU 61 via the input / output interface 65 and the bus 64.

In steps S146 through S148, the same processing as in steps S8 through S10 in FIG. 16 is performed.

Note that the third gesture recognition process ends when the digital photo frame 171 is powered off, for example.

As described above, according to the third gesture recognition process, when the object 41 as skin exists in the irradiation range (detection range) of the LED unit 192, the position, movement, and the like of the object 41 as skin are determined. It was made to recognize.

Note that the third gesture recognition process is obtained by replacing steps S1 to S6 in the first gesture recognition process with steps S141 to S145.

Therefore, for example, in the third gesture recognition process, the same deformation as in the case of the first gesture recognition process can be performed.

That is, for example, in the third gesture recognition process, if no skin is detected in step S146, the process can return to step S141 after waiting for a predetermined time.

In the third gesture recognition process, V _λ1 acquisition process, V _λ2 acquisition process, V _λoff acquisition process, and skin discrimination process are performed as processes for detecting an object as skin from the irradiation range of the LED unit 192. Repeatedly performed.

However, if an object as skin is detected in step S146, the process for detecting the object as skin from the irradiation range of the LED unit 192 is simplified as in the second gesture recognition process. You may do it.

In this case, in the third gesture recognition process, a V _λ1 acquisition process similar to that in step S141 is performed as a process corresponding to steps S101 to S104 in FIG. 20 after the end of step S148, and is generated by the V _λ1 acquisition process. Based on the luminance signal V _λ1 that has been performed, the processing unit 231 generates gesture recognition information.

Further, the processing unit 231 supplies the luminance signal V _λ1 and gesture recognition information generated for each PD 191n to the CPU 61 via the input / output interface 65 and the bus 64.

As the processing corresponding to step S105 of FIG. 20, CPU 61, based on the luminance signal V _.lambda.1 for each PD191n, determines whether or not the object is detected within the irradiation range of the LED unit 192.

When the CPU 61 determines that an object is detected within the irradiation range of the LED unit 192, the CPU 61 returns the process to step S147, and thereafter the same process is performed.

Further, when the CPU 61 determines that an object is not detected within the irradiation range of the LED unit 192, the process returns to step S141, and thereafter the same process is performed.

Furthermore, in the second embodiment, a process corresponding to the proximity object detection process of FIG. 21 can be performed before the third gesture recognition process.

That is, for example, V _λ1 acquisition processing in step S141 in FIG. 27 is performed as processing corresponding to step S121 and step S122 in FIG. As a result, the luminance signal V _{λ1 for} each PD 191n is supplied to the processing unit 231.

Next, as the processing corresponding to step S123 of FIG. 21, the processing unit 231, based on the luminance signal V _.lambda.1 per PD191n, determines whether or not the object has entered into the irradiation range of the LED unit 192.

That is, for example, the processing unit 231 determines that the object within the irradiation range of the LED unit 192 is based on whether at least one of the luminance values represented by the luminance signal V _λ1 for each PD 191n is equal to or greater than a predetermined threshold. Determine whether or not.

If the processing unit 231 does not detect the intrusion of an object into the irradiation range of the LED unit 192 based on the determination result, the processing unit 231 returns the processing to the processing corresponding to step S121 and step S122, and thereafter the same processing is performed. .

In addition, when the processing unit 123 detects the intrusion of an object into the irradiation range of the LED unit 192 based on the determination result, the processing unit 123 proceeds with the process corresponding to step S124 in FIG. 21, and the third gesture recognition process is performed. Done.

When the third gesture recognition process is performed as the process corresponding to step S124, the third gesture recognition process is terminated as follows, and the process corresponding to the proximity object detection process of FIG. 21 is also terminated. The

That is, for example, in step S146 of the third gesture recognition process, when the CPU 61 determines that the object 41 as skin is not detected, in other words, the object 41 that has entered the detection range is not skin. Is determined, the third gesture recognition process is terminated. Then, the process corresponding to the proximity object detection process in FIG. 21 is terminated, and a process corresponding to the proximity object detection process is newly started.

Similarly to the case of the first embodiment, as a process corresponding to step S123, when it is determined that an object has not entered the irradiation range of the LED unit 192, it waits for a predetermined time, You may make it return a process to the process corresponded to step S121 and step S122.

[Arrangement of LED unit 192]
28, through the center of a line connecting the PD191 ₁ and PD191 _2, shows an example of an LED unit 192 present in the display screen 1a perpendicular on the normal line.

As shown in FIG. 28, the LED unit 192 is preferably arranged so that the

LEDs

112a and 112b are arranged in the vertical direction in the figure. This is due to the position of LED112a and LED112b, in order to prevent the deviation occurs in the amount of light received by the PD191 ₁ and PD191 _2.

In Figure 28, the distance from LED112a to PD191 _1, the distance from LED112a to PD191 ₂ becomes the same.

Thus, for example, the object is, when present in the center of a line connecting the PD191 ₁ and PD191 _2, PD191 ₁ and PD191 ₂ are both (almost) the same amount of received light, reflected light of light of wavelength λ1 from the object Can be received.

Therefore, the same output result (luminance signal V _λ1 ) as shown on the left side and the center of FIG. 24B can be obtained from PD 191 ₁ and PD 191 ₂ , so that it is possible to recognize gestures and the like with high accuracy. Become.

Further, the LED unit 192, as shown in FIG. 28, the distance from LED112b to PD191 _1, the distance from LED112b to PD191 ₂ becomes the same.

Thus, for example, the object is, when present in the center of a line connecting the PD191 ₁ and PD191 _2, PD191 ₁ and PD191 ₂ are both (almost) the same amount of received light, reflected light of light of wavelength λ2 from the object Can be received.

Therefore, the same output result (luminance signal V _λ2 ) as shown on the left side and the center of FIG. 24B can be obtained from PD 191 ₁ and PD 191 ₂ . Even when it is used, it is possible to recognize a gesture or the like with high accuracy.

Furthermore, the LED unit 192, as shown in FIG. 28, the distance from LED112a to PD191 _1, the distance from LED112b to PD191 ₁ becomes the same.

Thus, for example, if an object is present in the center of a line connecting the PD191 ₁ and PD191 _2, PD191 ₁ is a both (almost) the same amount of received light, and the reflected light of the light of wavelength λ1 from the object, the wavelength The reflected light of the light of λ2 can be received.

In such a situation, the luminance signal V _λ1 and the luminance signal V _λ2 can be generated in the _PD 191 ₁ , so that the skin can be discriminated with high accuracy.

Further, the LED unit 192, as shown in FIG. 28, since the distance from LED112a to PD191 _2, the distance from LED112b to PD191 ₂ becomes the same, for PD191 ₂ also can be said similar to PD191 ₁ .

Next, FIG. 29, through the center of a line connecting the PD191 ₁ and PD191 _2, shows another example of the LED units 192 present in the display screen 1a perpendicular on the normal line.

The LED unit 192 shown in FIG. 29 is arranged so that the

LEDs

112a and 112b are arranged in the left-right direction in the drawing.

In this case, unlike the case shown in FIG. 28, for example, the distance from the LEDs 112a to PD191 _1, and the distance to the PD191 ₂ is different from the LEDs 112a.

Thus, for example, the object is, when present in the center of a line connecting the PD191 ₁ and PD191 _2, PD191 ₁ and PD191 _2, respectively, in different amount of light received by receiving reflected light of light of wavelength λ1 from the object Become.

In this case, the PD191 ₁ and PD191 _2, the desired output result, as shown in B left and the center of FIG. 24 (a luminance signal V _.lambda.1) can not be obtained.

Therefore, the LED unit 192, when placed as shown in FIG. 29, the gain control processing performed respectively PD191 ₁ and PD191 _2, from PD191 ₁ and PD191 _2, shown in B left and the center of FIG. 24 It is desirable to adjust so as to obtain a desired output result.

[Configuration with 3 PDs]
Next, FIG. 30 shows an example in which _three PDs 191 _{1 to} 191 ₃ are provided in the digital photo frame 171.

In the configuration shown in FIG. 30, it can be based on the output results from the PD191 ₁ and PD191 _2, as shown in C of A to 24 in FIG. 24, recognizes and lateral direction of the gesture in the drawing .

Further, it is possible on the basis of the output result from the PD191 ₂ and PD191 _3, in the same manner as in the case of using the output from the PD191 ₁ and PD191 _2, to recognize and vertical gesture in FIG.

In the case of using the output from the PD191 ₂ and PD191 _3, and the output result output by receiving the reflected light of the object irradiated with light of the wavelength λ2 from LED112b it is used.

This is because the distance from LED112b to PD191 _2, the distance from LED112b to PD191 ₃ are identical. Accordingly, desired output results as shown in A of FIG. 24 to C of FIG. 24 can be obtained from the PD 191 ₂ and the PD 191 ₃ .

When the skin detection signal is generated, an output result (luminance signals V _λ1 , V _λ2 , V _λoff ) from the PD 191 ₁ (or PD 191 ₂ ) in which the distance to the LED 112a is the same as the distance to the _{LED 112b} is used. desirable.

[Configuration with 4 PDs]
Next, FIG. 31 shows an example in which _four PDs 191 _{1 to} 191 ₄ are provided in the digital photo frame 171.

In the configuration shown in FIG. 31, based on the output results from PD 191 ₁ and PD 191 ₂ , as shown in A to C of FIG. .

Incidentally, in FIG. 31, the distance of the distance from LED112a to PD191 _1, from LED112a to PD191 ₂ are the same. The distance between the distance from LED112b to PD191 _1, from LED112b to PD191 ₂ are the same.

Therefore, when using an output from the PD191 ₁ and PD191 _2, the output result output by the light of the wavelength λ1 from LED112a to receive the reflected light of the object being irradiated, or light of wavelength λ2 from LED112b Any of the output results output by receiving the reflected light of the irradiated object may be used.

This is also true in the case of recognizing a gesture in the horizontal direction in the figure as shown in A to C of FIG. 24 based on the output results from PD 191 ₃ and PD 191 ₄ in FIG. It is the same.

Further, in FIG. 31, based on the output results from PD 191 ₂ and PD 191 _3, a gesture in the vertical direction in the figure can be recognized in the same manner as when the output results from PD 191 ₁ and PD 191 ₂ are used.

Further, in FIG. 31, based on the output result from the PD191 ₁ and PD191 _4, as shown in C of A to 24 in FIG. 24, it may be recognized and gestures in the vertical direction in the drawing .

In FIG. 31, any of PD191 ₁ to 191 ₄ is also the distance to the LEDs 112a, the distance to LED112b different.

Therefore, when generation of skin detection signal, treats and PD191 ₁ and PD191 ₄ as one of the first PD, to treat and PD191 ₂ and PD191 ₃ as one second PD.

Then, the output from the PD191 _1, the sum of the output from the PD191 _4, the output from the first PD, and outputs the result from the PD191 _2, the sum of the output from the PD191 _3, Treated as the output result from the second PD.

In this way, the first PD and the second PD can be considered as in the case of PD191 ₁ and PD191 ₂ shown in FIG. 28.

[Configuration with 3 PDs and 2 LED units]
Next, FIG. 32 shows an example in which three PDs 191 _{1 to} 191 ₃ are provided in the digital photo frame 171 and two

LED units

192 and 271 are provided.

32, the LED unit 192 irradiates a first irradiation range, and the LED unit 271 irradiates a second irradiation range different from the first irradiation range. Note that the first irradiation range and the second irradiation range may partially overlap.

When configured as shown in FIG. 32, the combination of the PD 191 ₁ , PD 191 ₂ , and the LED unit 192 having the

LEDs

112a and 112b determines whether or not the object in the first irradiation range is skin, In the irradiation range, a gesture in the horizontal direction in the figure is recognized.

Further, the combination of the PD 191 ₂ , the PD 191 ₃ , and the LED unit 271 having the LED 291a and the LED 291b determines whether or not the object in the second irradiation range is skin, Recognize middle and up / down gestures.

<3. Third Embodiment>
[Configuration example of digital photo frame 331]
Next, FIG. 33 shows a configuration example of a digital photo frame 331 according to the third embodiment.

The digital photo frame 331 has a display screen 1a. A PD 351 is provided on the upper side of the display screen 1a. An LED unit 371 ₁ and an LED unit 371 ₂ are provided in the horizontal direction of the PD 351 in the drawing.

The PD 351 is configured in the same manner as the PD 191n (eg, PD 191 ₁ ) in FIG. Further, the LED unit 371 ₁ and the LED unit 371 ₂ are configured in the same manner as the LED unit 192 of FIG.

Note that the LED unit 371 ₁ and the LED unit 371 ₂ each irradiate, for example, an assumed range in which a user's gesture is performed in front of the digital photo frame 331 as an irradiation range.

Next, FIG. 34 shows an example of the positional relationship between the PD 351, the LED unit 371 _1, and the LED unit 371 ₂ .

The LED unit 371 ₁ includes an LED 391a ₁ that emits light having a wavelength λ1 and an LED 391b ₁ that emits light having a wavelength λ2.

The LED unit 371 ₂ includes an LED 391a ₂ that emits light having a wavelength λ1, and an LED 391b ₂ that emits light having a wavelength λ2.

PD351 and the LED unit 371 _1, as shown in FIG. 34, the distance from PD351 to LED391a _1, the distance from the PD351 to LED391b ₁ are arranged to have the same.

Thus, the luminance signal V _.lambda.1 generated by PD351 during lighting of LED391a _1, the luminance signal V _.lambda.2 generated by PD351 during lighting of LED391b _1, and a luminance signal V generated by PD351 when turning off the LED391a ₁ and LED391b ₁ _A relatively accurate skin detection signal can be generated based on _λoff .

Furthermore, PD351 and the LED unit 371 _2, as shown in FIG. 34, the distance from PD351 to LED391a _2, the distance from the PD351 to LED391b ₂ are arranged to have the same.

Thus, the luminance signal V _.lambda.1 generated by PD351 during lighting of LED391a _2, the luminance signal V _.lambda.2 generated by PD351 during lighting of LED391b _2, and the luminance signal V generated by PD351 when turning off the LED391a ₂ and LED391b ₂ _A relatively accurate skin detection signal can be generated based on _λoff .

In FIG. 34, by comparing the output result output from the PD 351 when the LED 391a ₁ is lit and the output result output from the PD 351 when the LED 391a ₂ is lit, it is possible to recognize the movement in the horizontal direction in the figure. Note that, when the LED 391b ₁ is lit and when the LED 391b ₂ is lit, the output results output from the PD 351 may be compared to recognize the movement in the horizontal direction in the figure.

That is, for example, if an object in the vicinity directly above the LED unit 371 ₁ is present as the output result output from the PD351 during lighting of LED391a _1, is output as shown in A left side of FIG. 24, the LED391a ₂ As an output result output from the PD 351 at the time of lighting, an output result as shown in the center A of FIG. 24 is obtained.

Further, for example, if there is an object in the vicinity just above the PD351, as an output result output from the PD351 during lighting of LED391a _1, the output result as shown B on the left side of FIG. 24, when the lighting of LED391a ₂ PD351 As an output result output from, an output result as shown in the center B of FIG. 24 is obtained.

Furthermore, for example, if an object in the vicinity directly above the LED unit 371 ₂ is present as the output result output from the PD351 during lighting of LED391a _1, is output as shown in C the left side of FIG. 24, the LED391a ₂ As an output result output from the PD 351 at the time of lighting, an output result as shown in the center C of FIG. 24 is obtained.

The same applies to the case where the LEDs 391b ₁ and 391b ₂ that emit light of wavelength λ2 are turned on instead of the LEDs 391a ₁ and 391a ₂ that emit light of wavelength λ1.

As shown in FIG. 35, if the LED unit 371 ₂ is arranged on the lower side of the PD 351, in addition to the gesture in the horizontal direction in the figure, the gesture in the vertical direction in the figure can be recognized.

In FIG. 35, when recognizing a gesture in the left-right direction in the figure, the output result of the PD 351 when the LED 391b ₁ is lit and the output result of the PD 351 when the LED 391b ₂ is lit are used.

In FIG. 35, when recognizing a vertical gesture in the figure, the output result of the PD 351 when the LED 391a ₁ is lit and the output result of the PD 351 when the LED 391a ₂ is lit are used.

In FIG. 35, different LED combinations are used for the case of recognizing the left-right direction gesture and the case of recognizing the vertical direction gesture for the following reason. Next, the reason will be described with reference to FIG.

FIG. 36 shows an example of the output result of the PD 351 when the object moves from left to right in FIG.

In the drawing, a graph indicated by a solid line shows an example of an output result obtained from the PD 351 when the LED 391b ₁ is turned on. This graph has a maximum value at time t1.

In the figure, a graph indicated by a dotted line shows an example of an output result obtained from the PD 351 when the LED 391b ₂ is turned on. This graph has a maximum value at time t2.

In FIG. 35, in the figure, the difference between the distance from the object moving from the left to the right to the LED 391b ₁ and the distance from the object to the LED 391b ₂ is relatively small.

Therefore, as shown in FIG. 36, there is a time difference | t1-t2 | between the output result obtained from the PD 351 when the LED 391b ₁ is lit and the output result obtained from the PD 351 when the LED 391b ₂ is lit. It is relatively short.

For this reason, for example, depending on the detection result of the PD 351, an output result in which a maximum value occurs at approximately the same time may be obtained, and the movement of the object may not be accurately recognized.

Therefore, in the figure, when recognizing a gesture of an object moving from left to right, a combination of LED 391a ₁ and LED 391a ₂ is used. This is because the difference between the distance from the object to the LED 391a ₁ and the distance from the object to the LED 391a ₂ is relatively large compared to the combination of the LED 391b ₁ and the LED 391b ₂ .

[Detailed configuration example of the digital photo frame 331]
Next, FIG. 37 shows a detailed configuration example of the digital photo frame 331.

In the digital photo frame 331, the same reference numerals are given to the same parts as those of the digital photo frame 1 shown in FIG.

That is, the digital photo frame 331 is provided with a control unit 411 having a plurality of LED units 371 _{1 to} 371 _N instead of the control unit 66 (FIG. 10) having the plurality of sensors 21 _{1 to} 21 _N. The digital photo frame 1 is configured similarly.

[Detailed Configuration Example of Control Unit 411]
FIG. 38 shows a detailed configuration example of the control unit 411.

The control unit 411 includes an LED unit 371n (n = 1, 2,..., N), a current control unit 92n, a timing control unit 93n, a gain control unit 94, an AD conversion unit 95, a PD 351, and a processing unit 431. Composed. A lens 352 is provided on the front surface of the PD 351.

In addition, the current control unit 92n, the timing control unit 93n, and the LED driver 111n in FIG. 38 are configured similarly to the current control unit 92n, the timing control unit 93n, and the LED driver 111n in FIG. The code | symbol is attached | subjected.

Furthermore, the gain control unit 94 and the AD conversion unit 95 in FIG. 38 are configured similarly to the gain control unit 94n and the AD conversion unit 95n in FIG. 11, respectively. Further, the PD 351 in FIG. 38 is configured similarly to the PD 114n in FIG.

The LED 391an, LED 391bn, lens 392an, and lens 392bn are configured similarly to the LED 112an, LED 112bn, lens 113an, and lens 113bn of FIG.

The processing unit 431 controls the current control unit 92n, the timing control unit 93n, and the gain control unit 94 in the same manner as the processing unit 91 in FIG.

The LED unit 371n turns on and off the LED 391an and turns on and off the LED 391bn in the same manner as the LED 112an and LED 112bn of the sensor 21n described with reference to FIG.

[Fourth Gesture Recognition Process Performed by Digital Photo Frame 331]
Next, the fourth gesture recognition process performed by the digital photo frame 331 will be described with reference to the flowchart in FIG.

This fourth gesture recognition process is started, for example, when the digital photo frame 331 is turned on.

In step S161, the processing unit 431 pays attention to a predetermined LED unit 371 _n among the plurality of LED units 371 _{1 to} 371 _{N and} sets it as the target LED unit 371 _n .

In step S162, the processing unit 431 uses the target LED unit 371 _n and the PD 351 to perform a V _λ1 acquisition process that generates a luminance signal V _λ1 and outputs the luminance signal V _λ1 to the AD conversion unit 95.

That is, for example, the processing unit 431 instructs the current control unit 92n to supply a current to the LED 391an and the LED 391bn, and instructs the timing control unit 93n to turn on and off the LED 391an and the LED 391bn.

In contrast, the current control unit 92n and the timing control unit 93n control the LED driver 111n according to an instruction from the processing unit 431.

The LED driver 111n irradiates light of wavelength λ1 by turning on only the LED 391an according to the control from the current control unit 92n and the timing control unit 93n.

At this time, the PD 351 receives reflected light obtained by irradiation with light of wavelength λ1, and outputs a luminance signal V _λ1 obtained by photoelectrically converting the received reflected light to the AD converter 95.

AD conversion unit 95, a luminance signal V _.lambda.1 from PD351 AD conversion, a luminance signal V _.lambda.1 after AD conversion, and supplies to the processing unit 431.

In step S163, the processing unit 431 uses the target LED unit 371 _n and the PD 351 to perform a V _λ2 acquisition process that generates a luminance signal V _λ2 and outputs the luminance signal V _λ2 to the AD conversion unit 95.

The LED driver 111n irradiates light of wavelength λ2 by turning on only the LED 391bn according to the control from the current control unit 92n and the timing control unit 93n.

At this time, the PD 351 receives reflected light obtained by irradiation with light of wavelength λ2, and outputs a luminance signal V _λ2 obtained by photoelectrically converting the received reflected light to the AD conversion unit 95.

AD conversion unit 95, a luminance signal V _.lambda.2 from PD351 AD conversion, a luminance signal V _.lambda.2 after AD conversion, and supplies to the processing unit 431.

In step S164, the processing unit 431 uses the target LED unit 371 _n and the PD 351 to _perform a V _λoff acquisition process that generates the luminance signal V _λoff and outputs the luminance signal V _λoff to the AD conversion unit 95.

The LED driver 111n turns off the LED 391an and the LED 391bn according to the control from the current control unit 92n and the timing control unit 93n.

At this time, the PD 351 receives reflected light of external light, and outputs a luminance signal V _λoff obtained by photoelectrically converting the received reflected light to the AD conversion unit 95.

AD conversion unit 95, a luminance signal _{V? OFF} from the PD351 AD conversion, a luminance signal _{V? OFF} after AD conversion, and supplies to the processing unit 431.

Through the processing of step S162 to step S164 described above, the combination of luminance signals (V _λ1 , V _λ2 , V _λoff ) _n is supplied from the _PD ₃₅₁ to the processing unit 431 via the AD conversion unit 95. The subscript n of the combination (V _λ1 , V _λ2 , V _λoff ) n corresponds to the subscript n of the target LED unit 371n.

In step S165, the processing unit 431, a combination of the luminance signal from the AD converter _{_{95 (V λ1, V λ2,}} V λoff) based on _n, perform the same skin discrimination processing and the processing unit 91. In this skin discrimination process, a skin detection signal Dn is generated.

In step S166, the processing unit 431, for example, a combination of the luminance signal _{_{(V λ1, V λ2, V}} λoff) based on the luminance signal V _.lambda.1 of _n, and generates a gesture recognition information Jn.

The processing unit 431 supplies the generated skin detection signal and gesture recognition information to the CPU 61 via the input / output interface 65 and the bus 64.

In step S167, if the processing unit 431 determines whether the attention to all of the plurality of LED units 371 ₁ to 371 _N, was determined not to be focused on all of the plurality of LED units 371 ₁ to 371 _N The process returns to step S161.

In step S161, the processing unit 431 sets the LED unit 371 _n that has not been noticed among the plurality of LED units 371 _{1 to} 371 _N as a new noticed LED unit 371 _n, and thereafter, the same processing is performed. Done.

In step S167, when the processing unit 431 determines that all of the plurality of LED units 371 _{1 to} 371 _N are focused, the process proceeds to step S168.

Through the processing in steps S161 to S167 described above, the CPU 61 receives the skin detection signal and gesture recognition from the PD 351 via the input / output interface 65 and the bus 64 each time the LED units 371 _{1 to} 371 _N are noticed. Information is supplied.

In steps S168 through S170, the same processing as in steps S8 through S10 in FIG. 16 is performed.

Note that the fourth gesture recognition process ends when the digital photo frame 331 is powered off, for example.

As described above, according to the fourth gesture recognition process, when an object as skin exists within the detection range of the PD 351 (the same irradiation range irradiated by each LED unit 371n), the object as skin Recognize the position, movement, etc.

Therefore, when the object is something other than the skin, it is possible to prevent a situation in which the position or movement of the object is erroneously recognized and processing according to the recognition result is performed.

It should be noted that the fourth gesture recognition process can be modified in the same manner as the first gesture recognition process.

For example, when the fourth gesture recognition process is modified like the second gesture recognition process shown in FIG. 20, in the processes corresponding to steps S91 and S101 in FIG. Attention is made to 371n.

Further, in the processing corresponding to step S97 and step S104 in FIG. 20, the processing unit 431 determines whether or not all the LED units 371n are noticed. Other than that, the same processing as the second gesture recognition processing shown in FIG. 20 is performed.

Further, for example, a process corresponding to the proximity object detection process shown in FIG. 21 is performed, and a fourth gesture recognition process is performed in response to the object having entered the detection range of the PD 351. Also good.

In this case, V _λ1 acquisition processing by a predetermined LED unit 371n and PD 351 is performed as processing corresponding to step S121 and step S122 of FIG. Then, as a process corresponding to step S123 in FIG. 21, the processing unit 431 determines whether an object with respect to the detection range of the PD 351 has entered based on the luminance signal V _λ1 obtained from the V _λ1 acquisition process.

As processing corresponding to step S123 in FIG. 21, when it is detected that an object with respect to the detection range of the PD 351 has not entered based on the determination result, the processing returns to processing corresponding to step S121 and step S122 in FIG. , V _λ1 acquisition processing is performed.

In addition, as a process corresponding to step S123 in FIG. 21, when it is detected that an object with respect to the detection range of the PD 351 has entered based on the determination result, a process corresponding to step S124 in FIG. The gesture recognition process is performed.

<4. Modification>
By the way, the above-described series of processing can be executed by hardware or can be executed by software. Further, in the present disclosure, the steps describing the series of processes described above are executed in parallel or individually even if they are not necessarily processed in time series, as well as processes performed in time series in the described order. The processing to be performed is also included.

Furthermore, the embodiments in the present disclosure are not limited to the first to third embodiments described above, and various modifications can be made without departing from the gist of the present disclosure.

In the present disclosure, a digital photo frame that distinguishes whether an object is skin and recognizes the position and movement of the object as skin has been described. However, for other electronic devices such as tablet PCs and mobile phones, for example, it is possible to distinguish whether an object is skin and to perform processing for recognizing the position and movement of the object as skin.

In the first embodiment, the digital photo frame 1 is provided with a control unit 66 that outputs a skin detection signal, gesture recognition information, and the like, and the CPU 61 uses the output result from the control unit 66 as a skin. Recognize the movement of objects.

However, the control unit 66 that outputs a skin detection signal, gesture recognition information, and the like can also be configured as one gesture output device.

In this case, a gesture output device is connected to a digital photo frame or the like that does not have the control unit 66. In such a digital photo frame, the contents of the display screen, etc., according to the output result from the connected gesture output device To change. This also applies to the second and third embodiments.

In addition, this technique can also take the following structures.
(1)
A first irradiation unit that irradiates light of a first wavelength;
An irradiation unit including: a second irradiation unit configured to irradiate light having a second wavelength different from the first wavelength;
In response to receiving reflected light from an object irradiated with light of the first wavelength, a first detection signal is generated,
A light receiving unit that generates a second detection signal in response to receiving reflected light from the object irradiated with light of the second wavelength;
A skin detection unit that detects whether or not the object is skin based on the first and second detection signals;
An information processing apparatus comprising: a generation unit configured to generate recognition information for recognizing at least one of the position or movement of the object detected as skin based on at least one of the first or second detection signals.
(2)
It further includes another light receiving part configured similarly to the light receiving part,
The information processing apparatus according to (1), wherein the generation unit generates the recognition information based on at least one of the first or second detection signals generated for each of the plurality of light receiving units.
(3)
The first irradiation unit is arranged at the same distance from each of the plurality of light receiving units,
The information processing apparatus according to (2), wherein the generation unit generates the recognition information based on the first detection signal generated for each of the plurality of light receiving units.
(4)
The light receiving unit is disposed at the same distance from the first irradiation unit and the second irradiation unit, respectively.
The information processing apparatus according to (2), wherein the skin detection unit detects whether the object is skin based on the first and second detection signals generated by the light receiving unit.
(5)
It further includes another irradiation unit configured similarly to the irradiation unit,
The light receiving unit is
For each of the irradiation units that irradiate the light of the first wavelength at different timings, the first detection signal is generated,
For each of the irradiation units that irradiate the light of the second wavelength at different timings, the second detection signal is generated,
The information processing apparatus according to (1), wherein the generation unit generates the recognition information based on at least one of the first or second detection signal generated for each of the irradiation units.
(6)
The generator is generated for each of the plurality of irradiation units by the light receiving unit when the interval between the first irradiation units in the first direction is longer than the interval between the second irradiation units. The recognition information for recognizing at least one of the position or movement of the object in a second direction perpendicular to the first direction is generated based on the first detection signal. Information processing device.
(7)
A plurality of sensors having the irradiation unit and the light receiving unit, further including the sensor having the irradiation unit that irradiates a different irradiation range for each sensor;
The skin detection unit detects whether the object is skin based on the first and second detection signals generated for each of the plurality of sensors,
The information processing apparatus according to (1), wherein the generation unit generates the recognition information based on at least one of the first or second detection signal generated for each of the plurality of sensors.
(8)
A proximity detector for detecting whether the object has entered a predetermined detection range based on the first detection signal;
In response to detecting that the object has entered the detection range, the skin detection unit determines whether the object is skin based on the first and second detection signals. The information processing apparatus according to (1) to (7).
(9)
In response to detecting that the object is skin, an object detection unit that detects whether or not the object exists within a predetermined detection range based on the first detection signal. In addition,
The information processing apparatus according to any one of (1) to (8), wherein the information processing apparatus treats the object as skin when it is detected that the object exists within the detection range.
(10)
A signal generation unit that generates an output signal having a magnitude according to the position of the object;
The information processing apparatus according to (1) to (9), wherein the generation unit generates the recognition information based on the output signal.
(11)
The first wavelength λ1 and the second wavelength λ2 that is longer than the first wavelength λ1 are:
640nm ≤ λ1 ≤ 1000nm
900nm ≤ λ2 ≤ 1100nm
The information processing apparatus according to any one of (1) to (10), wherein:
(12)
The first irradiation unit irradiates invisible light having the first wavelength λ1,
The information processing apparatus according to (11), wherein the second irradiation unit irradiates invisible light having the second wavelength λ2.
(13)
The information processing apparatus according to any one of (1) to (9), wherein the light receiving unit is provided with a visible light cut filter that blocks visible light incident on the light receiving unit.

<5. Other>
By the way, in the digital photo frame 1 (FIG. 1) which is 1st Embodiment, as FIG. 40 shows, a process is performed by each sensor 21n.

[About PD saturation]
Next, FIG. 40 shows an outline of processing performed by each sensor 21n.

For example, the sensor 21 _1, as shown in A of FIG. 40, and LEDs 112a ₁ in the lighting period "LED .lambda.1" is lit at the lighting period "LED .lambda.2" LED112b ₁ is lit, with light-off period "LED off" The LED 112a ₁ and the LED 112b ₁ are turned off.

At this time, it is assumed that the other sensors 21 _{2 to} 21 _N are turned off during any period of “LED λ1”, “LED λ2”, and “LED off” shown in FIG.

Correspondingly, in the sensor 21 ₁ , as shown in the upper side of FIG. 40C, the PD 114 ₁ is obtained by receiving reflected light from an object irradiated with light of wavelength λ ₁ by the LED 112 a _1. The luminance signal Lum # 1_λ1 is output.

Further, the sensor 21 _1, as shown in C upper side of FIG. 40, PD 114 _1, due LED112b _1, the luminance signal obtained by receiving the reflected light from an object light of the wavelength λ2 is irradiated Lum # 1_λ2 is output.

Furthermore, for example, the sensor 21 _2, as shown in B of FIG. 40, and LEDs 112a ₂ in the lighting period "LED .lambda.1" lights, LED112b ₂ is turned in the lighting period "LED .lambda.2" off period "LED off The LED 112a ₂ and the LED 112b ₂ are turned off.

At this time, the

other sensors

21 ₁ and 21 _{3 to} 21 _N are turned off during any of the periods “LED λ1,” “LED λ2,” and “LED off” shown in FIG. To do.

Correspondingly, the sensor 21 _2, as shown in C under side of FIG. 40, PD 114 _2, due LEDs 112a _2, receives reflected light from an object light of the wavelength λ1 is irradiated to give Output luminance signal Lum # 2_λ1.

Further, the sensor 21 _2, as shown in C under side of FIG. 40, PD 114 _2, due LED112b _2, the luminance signal obtained by receiving the reflected light from an object light of the wavelength λ2 is irradiated Lum Output # 2_λ2.

Then, the processing unit 91, as shown in D in FIG. 40, based on the PD 114 ₁ of the sensor 21 ₁ into a luminance signal Lum # 1_λ1 and luminance signal Lum # 1_λ2 like is outputted through the AD converter 95 ₁ Generate a skin detection signal.

The processing unit 91, as shown in D in FIG. 40, based on the luminance signal Lum # 2_λ1 and luminance signal Lum # 2_λ2 like output from PD 114 ₂ sensors 21 ₂ via the AD converter 95 ₂ Generate a skin detection signal.

Incidentally, for example, the sensor 21 ₁ and moved toward the hand of the user, at a distance, as shown in C upper side of FIG. 41, the luminance signal Lum as output from PD 114 ₁ of the sensor 21 ₁ It can happen that # 1_λ1 is saturated.

In FIG. 41, the upper side of FIG. 41C is different from the case of FIG. 40, but the other points are the same.

As shown in the upper side of FIG. 41, when the luminance signal Lum # 1_λ1 is saturated, the difference between the luminance signal Lum # 1_λ1 and the luminance signal Lum # 1_λ2 becomes small.

For this reason, in the processing unit 91, when generating a skin detection signal based on the saturated luminance signal Lum # 1_λ1 and the luminance signal Lum # 1_λ2, etc., an erroneous skin detection signal (for example, the object is skin, It may occur that a skin detection signal indicating that no skin is detected is generated.

In this regard, for example, when a user holds a hand in front of the digital photo frame 1 and performs a gesture operation, the user adjusts the position of the hand when the hand is first held, and the hand is unconsciously accurately positioned. There is a tendency to search for a detected position.

Therefore, for example, as shown in the upper side of FIG. 41, it can be said that the situation where the luminance signal Lum # 1_λ1 is saturated hardly occurs.

However, when such a situation occurs during the operation, the digital photo frame 1 may not be processed according to the movement of the user's hand or the like, and thus the user is prevented from performing the operation by the gesture. It will fall into the sense.

Therefore, for example, in the processing unit 91, it is desirable to hold the internal state of each PD 141n in a built-in memory (not shown) and determine the skin detection state according to the transition of the internal state.

Next, FIG. 42 shows an example of how the internal state (information representing) of the PD 141n transitions.

42, the internal state “NO_SKIN” represents a state in which no skin part is detected. When the internal state of the PD 141n is “NO_SKIN”, the processing unit 91 outputs Sensor # n Detect = FALSE, that is, a skin detection signal (a skin detection signal turned OFF) indicating that no skin is detected. .

Further, in FIG. 42, the internal state “SKIN_DETECT” represents a state in which a skin part is detected. When the internal state of the PD 141n is “SKIN_DETECT”, the processing unit 91 outputs Sensor # n Detect = TRUE, that is, a skin detection signal (a skin detection signal turned ON) indicating that the skin is detected.

Based on the luminance signal Lum # n_λ1 and the luminance signal Lum # n_λ2 (#n corresponds to the subscript n of the PD 141n) supplied from the PD 141n via the AD conversion unit 95n, the processing unit 91 {(Lum # n_λ1 -Lum # n_λ2) × 100 / Lum # n_λ1} is calculated. Note that Lum # n_λ1 and Lum # n_λ2 indicate the luminance values represented by the luminance signal Lum # n_λ1 and the luminance signal Lum # n_λ2, respectively.

Then, when the calculated {(Lum # n_λ1-Lum # n_λ2) × 100 / Lum # n_λ1} exceeds a predetermined threshold (for example, 10), the processing unit 91 displays “skin detection” shown in FIG. And the internal state of the PD 141n is changed from “NO_SKIN” to “SKIN_DETECT”.

If the calculated {(Lum # n_λ1-Lum # n_λ2) × 100 / Lum # n_λ1} does not exceed the predetermined threshold, the processing unit 91 does not change the internal state of the PD 141n and remains “NO_SKIN”. And

Further, the processing unit 91 changes the internal state of the PD 141n from “SKIN_DETECT” to “NO_SKIN” based on at least one of Lum # n_λ1, Lum # n_λ2, or (Lum # n_λ1 + Lum # n_λ2) as the luminance value. Whether or not to make a transition is determined, and “SKIN_DETECT” is not changed to “NO_SKIN” based on the determination by the skin determination process.

Specifically, for example, as illustrated in FIG. 42, the processing unit 91 changes the internal state of the PD 141n from “SKIN_DETECT” to “NO_SKIN” when Lum # n_λ1 as a luminance value is less than a certain threshold value. Transition.

Note that, for example, when the luminance value Lum # n_λ1 is not less than a certain threshold, the processing unit 91 does not change the internal state of the PD 141n and remains “SKIN_DETECT”.

For example, as described above, the processing unit 91 determines the internal state of the PD 141n based on the luminance signal supplied from the PD 141n via the AD conversion unit 95n. Then, the processing unit 91 outputs a skin detection signal corresponding to the determined internal state of the PD 141n.

That is, for example, when the internal state of the PD 141n is “NO_SKIN”, the processing unit 91 has Sensor # n Detect = FALSE, that is, a skin detection signal indicating that no skin is detected (a skin detection signal that is turned OFF) ) Is output.

Further, for example, when the internal state of the PD 141n is “SKIN_DETECT”, the processing unit 91 has Sensor # n Detect = TRUE, that is, a skin detection signal (a skin detection signal turned ON) indicating that the skin has been detected. Is output.

As described above, since the internal state of the PD 141n is held in the processing unit 91, an operation error due to the saturation of the PD 141n during the operation of the sensor 21n can be prevented.

The same applies to the digital photo frame 171 according to the second embodiment and the digital photo frame 331 according to the third embodiment.

Next, FIG. 43 shows an outline of processing performed by the control unit 211 of the digital photo frame 171 according to the second embodiment.

For example, in the LED unit 192 of the control unit 211, as shown in FIG. 43A, the LED 112a is turned on in the lighting period “LED λ1”, the LED 112b is turned on in the lighting period “LED λ2”, The LED 112a and the LED 112b are turned off.

Correspondingly, in the control unit 211, as shown in FIG. 43B, the PD 191 ₁ receives the reflected light from the object irradiated with the light of the wavelength λ1 by the LED 112a. Lum # 1_λ1 is output.

Further, in the control unit 211, as shown in FIG. 43B, the PD 114 ₁ receives a luminance signal Lum # 1_λ2 obtained by receiving reflected light from an object irradiated with light of wavelength λ2 by the LED 112b. Output.

Further, the control unit 211, as shown in C of FIG. 43, PD 114 _2, due LEDs 112a, the luminance signal Lum # 2_λ1 obtained by receiving the reflected light from an object light of the wavelength λ1 is irradiated Output.

In the control unit 211, as shown in C of FIG. 43, PD 114 _2, due LED112b, the luminance signal Lum # 2_λ2 obtained by receiving the reflected light from an object light of the wavelength λ2 is irradiated Output.

Then, the processing unit 231, as shown in C of FIG. 43, based on the luminance signal Lum # 1_λ1 and luminance signal Lum # 1_λ2 like is outputted through the AD conversion unit 95 ₁ from PD 114 ₁ of the control unit 211 Generate a skin detection signal.

Further, the processing unit 231, as shown in C of FIG. 43, based on the luminance signal Lum # 2_λ1 and luminance signal Lum # 2_λ2 like is outputted through the AD converter 95 ₂ from the PD 114 ₂ of the controller 211 Generate a skin detection signal.

Whether the processing unit 231 keeps the internal state of each PD 191n in a built-in memory (not shown) as in the processing unit 91, and adopts judgment based on the skin detection signal according to the transition of the internal state You can decide whether or not.

Note that the method for transitioning the internal state of the PD 191n is performed by the processing unit 231 as described with reference to FIG. Thereby, an operation error due to saturation of the PD 191n during the operation of the control unit 211 can be prevented.

Next, FIG. 44 shows an outline of processing performed by the control unit 411 of the digital photo frame 331 according to the third embodiment.

For example, the LED unit 371 ₁ of the control unit 411, as shown in A of FIG. 44, and LED391a ₁ at the lighting period "LED .lambda.1" lights, LED391b ₁ is turned in the lighting period "LED .lambda.2" off period “LED off” turns off the LEDs 391a ₁ and 391b ₁ .

At this time, it is assumed that the other LED units 371 _{2 to} 371 _N are turned off during any of the periods “LED λ1”, “LED λ2”, and “LED off” shown in FIG.

Correspondingly, in the control unit 411, as shown in FIG. 44C, the PD 351 receives the reflected light from the object irradiated with the light of the wavelength λ1 by the LED 391a ₁ and obtains the luminance signal. Lum # 1_λ1 is output.

In the control unit 411, as shown in C of FIG. 44, PD351, due LED391b _1, a luminance signal Lum # 1_λ2 obtained by receiving the reflected light from an object light of the wavelength λ2 is irradiated Output.

Furthermore, for example, in the LED unit 371 _2, as shown in B of FIG. 44, and LED391a ₂ in the lighting period "LED .lambda.1" lights, LED391b ₂ is turned in the lighting period "LED .lambda.2" off period "LED When “off”, the LED 391a ₂ and the LED 391b ₂ are turned off.

At this time, the other LED units 371 ₁ and 371 _{3 to} 371 _N are turned off during any of the periods “LED λ1,” “LED λ2,” and “LED off” shown in FIG. And

Correspondingly, in the control unit 411, as shown in FIG. 44C, the PD 351 receives the reflected light from the object irradiated with the light of the wavelength λ1 by the LED 391a ₂ and obtains the luminance signal. Lum # 2_λ1 is output.

In the control unit 411, as shown in C of FIG. 44, PD351, due LED391b _2, a luminance signal Lum # 2_λ2 obtained by receiving the reflected light from an object light of the wavelength λ2 is irradiated Output.

Then, as shown in FIG. 44C, the processing unit 431 determines the skin based on the luminance signal Lum # 1_λ1 and the luminance signal Lum # 1_λ2 output from the PD 351 of the control unit 211 via the AD conversion unit 95. A detection signal is generated.

Further, as shown in FIG. 43C, the processing unit 431 determines the skin based on the luminance signal Lum # 2_λ1 and the luminance signal Lum # 2_λ2 output from the PD 351 of the control unit 211 via the AD conversion unit 95. A detection signal is generated.

In the processing unit 431, as in the processing unit 91, the internal state of each PD 351 at the time of irradiation of the LED unit 371n is held in a built-in memory (not shown) or the like, and skin detection is performed according to the transition of the internal state It is possible to decide whether or not to adopt judgment based on signals.

In addition, the transition method of each internal state of PD351 at the time of irradiation of LED unit 371n is performed by the process part 431 as demonstrated with reference to FIG. Thereby, an operation error due to saturation of the PD 351 during the operation of the control unit 411 can be prevented.

[About the arrangement of each part]
Next, with reference to FIGS. 45 and 46, the distance between the sensor 21 ₁ and the sensor 21 ₂ in the digital photo frame 1 according to the first embodiment will be described.

45 and 46 each show an example of a state when the digital photo frame 1 is viewed from the lower side in FIG.

By the way, the shortest usage distance l is determined in advance when the digital photo frame 1 is manufactured or the like based on the feeling of use by the user's gesture operation.

For example, when the user holds his / her hand or the like in front of the digital photo frame 1 to perform a gesture operation or the like, the shortest use distance l can continuously recognize the position or movement of the user's hand or the like. The shortest distance.

For this reason, when the user performs a gesture operation or the like within a range less than the shortest usable distance l from the digital photo frame 1, the position or movement of the user's hand or the like may not be recognized.

Further, for example, when the sensor 21 ₁ and the sensor 21 ₂ are arranged at the positions as shown in FIG. 45, the position or movement of the user's hand or the like is partially within the range of the minimum use distance l from the digital photo frame 1. Such a range (so-called dead zone) in which it cannot be recognized occurs.

Therefore, as shown in FIG. 46, the positions of the

sensors

21 ₁ and 21 ₂ are within the range (area) of the minimum use distance l from the digital photo frame _1, and the detection ranges of the

sensors

21 ₁ and 21 ₂ are respectively. The position can be covered.

In FIG. 46, the analog output possible area indicated by hatching represents an area where the position and movement of the user's hand and the like can be continuously recognized reliably by the

sensors

21 ₁ and 21 ₂ .

In FIG. 46, the distance d between the sensor 21 ₁ and the sensor 21 ₂ is based on the shortest use distance l and the half field angle θ (degrees) of the irradiation range (detection range) in the sensor 21n ( 1).
d = 2 × l / tan (90-θ) (1)

In the digital photo frame 171 according to the second embodiment, the distance d between the PD 191 ₁ and the PD 191 ₂ is also obtained using the above-described equation (1).

Next, FIG. 47 shows an example of a state in which the digital photo frame 171 is viewed from the lower side in FIG.

In the digital photo frame 171, as shown in FIG. 47, the half angle of view of the detection range of the PD 191n is θ. Then, the PD 191 ₁ and the PD 191 ₂ are separated from each other by a distance d obtained by the equation (1).

In FIG. 47, the portion (most) of the irradiation range of the LED unit 192 that is separated by a distance equal to or longer than the shortest usable distance l is an analog output possible region.

Further, in the digital photo frame 331 according to the third embodiment, the distance d between the LED unit 371 ₁ and the LED unit 371 ₂ is also obtained using the above-described equation (1).

Next, FIG. 48 shows an example of the digital photo frame 331 seen from the lower side in FIG.

In the digital photo frame 331, as shown in FIG. 48, the half angle of view of the irradiation range of the LED unit 371n is θ. Then, the LED unit 371 ₁ and the LED unit 371 ₂ are separated from each other by a distance d obtained by the equation (1).

In FIG. 48, a portion (most of) of the detection range of the PD 351 that is separated by a distance equal to or longer than the shortest usable distance l is an analog output possible region.

[LED adjustment]
Next, with reference to FIG. 49, an example of output adjustment by the LEDs 112an and LEDs 112bn of the sensor 21n provided in the digital photo frame 1 according to the first embodiment will be described. This adjustment is performed, for example, when the digital photo frame 1 is manufactured.

49 shows an example of the digital photo frame 1 viewed from the lower side in FIG.

First, a material 501 having the same reflectivity for the wavelength λ1 and the reflectivity for the wavelength λ2 is disposed in front of the

sensors

21 ₁ and 21 ₂ . As the material 501, for example, a gray sheet or a mirror surface of a mirror is used.

In the sensor 21 ₁ and the sensor 21 _2, as shown in Figure 49, the front surface of the sensor 21 ₁ and the sensor 21 ₂ in the state in which the material 501, sensor 21 ₁ and the sensor 21 ₂ output of each LED is adjusted The

Next, FIG. 50, based on the luminance signal outputted from the sensor 21 ₁ and the sensor 21 ₂ shows an example of when adjusting the output of the sensor 21 ₁ and the sensor 21 ₂ each the LED.

In the lighting period “LED λ1” shown in FIG. 50A, the sensor 21 ₁ irradiates the material 501 with light of wavelength λ1, and receives the reflected light from the material 501 irradiated with light of wavelength λ1. To do. The sensor 21 ₁ generates a luminance signal Lum # 1_λ1 according to the received light, and outputs to the processing unit 91 via the AD converter 95 _1.

Further, the sensor 21 ₁ irradiates the material 501 with light of wavelength λ2 during the lighting period “LED λ2” shown in FIG. 50A, and reflects light from the material 501 irradiated with light of wavelength λ2. Is received. The sensor 21 ₁ generates a luminance signal Lum # 1_λ2 according to the received light, and outputs to the processing unit 91 via the AD converter 95 _1.

Sensor 21 _2, the sensor 21 ₁ in the same manner as to generate a luminance signal Lum # 2_λ1 and luminance signal Lum # 2_λ2, and outputs to the processing unit 91 via the AD converter 95 _2.

That is, for example, the sensor 21 ₂ irradiates the material 501 with light of the wavelength λ1 during the lighting period “LED λ1” shown in FIG. 50B, and the light from the material 501 irradiated with the light of the wavelength λ1. Receives reflected light. The sensor 21 ₂ generates a luminance signal Lum # 2_λ1 according to the received light, and outputs to the processing unit 91 via the AD converter 95 _2.

In addition, the sensor 21 ₂ irradiates the material 501 with light of wavelength λ2 during the lighting period “LED λ2” shown in FIG. 50B, and reflects light from the material 501 irradiated with light of wavelength λ2. Is received. The sensor 21 ₂ generates a luminance signal Lum # 2_λ2 according to the received light, and outputs to the processing unit 91 via the AD converter 95 _2.

The processing unit 91, for example, based on the luminance signal Lum # 1_λ1 and the luminance signal Lum # 1_λ2 from the sensor 21 ₁ and the luminance signal Lum # 2_λ1 and the luminance signal Lum # 2_λ2 from the sensor 21 ₂ , as shown in D in FIG. 50, Lum # 1_λ1 as luminance values, Lum # 1_λ2, Lum # 2_λ1 , to equal any of Lum # 2_λ2, adjusts the sensor 21 ₁ and the sensor 21 _2.

That is, for example, processor 91, LEDs 112a ₁ and LED112b ₁ of the sensor 21 _1, and adjusts the output of the irradiation of the sensor 21 _{and second} LEDs 112a ₂ and LED112b _2. As an output adjustment method by LED, for example, adjustment of current to LED by variable resistor connected to LED, PWM (Pulse Width Modulation) output adjustment for current control, correction by program, etc. are adopted. it can.

It should be noted that the output adjustment by the LED is similarly performed for the digital photo frame 171 according to the second embodiment and the digital photo frame 331 according to the third embodiment.

[Calculation of the position of an object as skin]
Next, a calculation method for calculating the position of an object as skin will be described with reference to FIGS.

FIG. 51 shows an example when an object as skin moves in the left-right direction.

For example, using the sensor 21 ₁ and the sensor 21 ₂ of the digital photo frame 1, the position of an object as a skin (indicated by a double circle in FIG. 51) is calculated within the range from X1 to X2 shown in FIG. Think about what to do.

It should be noted that the range from X1 to X2 is, for example, the analog output possible area shown in FIG. For example, X1 is set to 0 and X2 is set to 639.

In the digital photo frame 1, the processing unit 91, for example, sensor 21 ₁ from PD 114 ₁ the luminance signal Lum # 1_λ1 supplied via the AD converter 95 _1, sensor 21 _second PD 114 ₂ from the AD conversion unit 95 ₂ The position X of the object as skin can be calculated (calculated) on the basis of the luminance signal Lum # 2_λ1 supplied via.

That is, for example, if Lum # 1_λ1 as the luminance value is L1 and Lum # 2_λ1 as the luminance value is L2, the processing unit 91 calculates the position X of the object as the skin by the following equation (2). be able to.
X = {X1 × L1 / (L1 + L2)} + {X2 × L2 / (L1 + L2)} (2)

In this case, for example, the processing unit 91 outputs the position X to the CPU 61 as gesture recognition information. In addition, when the CPU 61 acquires the luminance signal Lum # 1_λ1 and the luminance signal Lum # 2_λ1 as the gesture recognition information from the processing unit 91, based on the acquired gesture recognition information, the CPU 61 obtains an object as skin. You may make it recognize by calculating the position X of.

This also applies to the second and third embodiments.

In the digital photo frame 1, as shown in FIG. 52, the position X of the object as the skin can be calculated in the same manner even when _three sensors 21 _{1 to} 21 ₃ are provided.

Next, FIG. 53 shows an example in which an object as skin moves in the left-right direction.

For example, using the sensors 21 _{1 to} 21 ₃ of the digital photo frame 1, the position of an object as a skin (indicated by a double circle in FIG. 53) is calculated within the range from X1 to X3 shown in FIG. Think about it.

Note that the range from X1 to X3 is, for example, a region where analog output is possible when configured as shown in FIG. For example, X1 is set to 0, X2 is set to 320, and X3 is set to 639.

In this case, the luminance signal Lum # 3_λ1 supplied to the processing unit 91 via the AD converter 95 ₃ PD 114 ₃ sensors 21 _3, if the Lum # 3_λ1 as luminance value L3, the processing unit 91, The position X of the object as the skin can be calculated by the following equation (3).
X = {X1 × L1 / (L1 + L2 + L3)} + {X2 × L2 / (L1 + L2 + L3)} + {X3 × L3 / (L1 + L2 + L3)} (3)

This also applies to the second and third embodiments.

[Click behavior]
Next, FIG. 54 shows an example of how the user performs a click operation on the digital photo frame 1.

For example, as shown in FIG. 54, the user performs a click operation of bringing his / her hand close to the digital photo frame 1 and returning it to the original position.

Correspondingly, if the digital photo frame 1 recognizes the user's click motion and performs processing according to the recognized click motion, a more intuitive gesture operation is performed on the digital photo frame 1. It can be performed.

Next, a recognition method in which the processing unit 91 recognizes the user's click operation based on the luminance signal Lum # n_λ1 supplied from each sensor 21n via the AD conversion unit 95n will be described.

Note that when the CPU 61 acquires the luminance signal Lum # n_λ1 as the gesture recognition information from the processing unit 91, the same recognition method is used when the user's click operation is recognized based on the gesture recognition information. It is done.

That is, for example, the processing unit 91 calculates Lsum by the following equation (4) based on the luminance signal Lum # n_λ1 supplied from each sensor 21n via the AD conversion unit 95n.
Lsum = Σ (Lum # n_λ1) (4)

In the case shown in FIG. 54, the digital photo frame 1 is provided with _two

sensors

21 ₁ and 21 ₂ . Therefore, the luminance signal Lum # 1_λ1 is supplied from the sensor 21 ₁ to the processing unit 91 via the AD conversion unit 95 ₁ , and the luminance signal Lum # 2_λ1 is supplied from the sensor 21 ₂ to the processing unit 91 via the AD conversion unit 95 _2. .

For this reason, the processing unit 91 calculates Lsum (= Lum # 1_λ1 + Lum # 2_λ1) by Equation (4) based on the luminance signal Lum # 1_λ1 and the luminance signal Lum # 2_λ1.

Then, the processing unit 91 recognizes (detects) the click operation based on the calculated change in Lsum.

Next, an example of a method in which the processing unit 91 recognizes a click operation according to a change in Lsum will be described with reference to FIG.

In FIG. 55, a graph indicated by a solid line represents Lsum. A graph indicated by a dotted line represents d (Lsum) obtained by differentiating Lsum.

For example, the processing unit 91 differentiates the calculated Lsum, and when the graph of d (Lsum) obtained as a result crosses zero, that is, as shown in FIG. 55, d (Lsum) divides the value 0. In this case, it is recognized that a click operation by the user has been performed.

By the way, for example, in FIG. 56, in general, even though the hand is intended to move in the left-right direction in the figure, the user's hand actually has a trajectory as shown in FIG. It may draw a trajectory similar to the trajectory.

For this reason, the processing unit 91 may erroneously detect (recognize) the user's click operation.

In general, humans tend to stop movement in the X direction and the Y direction before performing a certain operation such as a click operation. Here, the X direction is a direction perpendicular to the Z direction, which is the normal direction of the display screen 1a, and is a direction in which the sensor 21 ₁ and the sensor 21 _{2 in} FIG. 1 exist (the left-right direction in FIG. 1). Say. The Y direction is a direction perpendicular to the Z direction and the X direction (the vertical direction in FIG. 1).

Therefore, consider using such a tendency to recognize the click motion more accurately.

Next, FIG. 57 is a diagram for explaining a method for more accurately recognizing a user's click operation using the above-described human tendency.

57A, the graph indicated by the solid line represents the position X calculated by the processing unit 91. A graph indicated by a dotted line represents whether or not to recognize a click operation by d (Lsum).

57A, the horizontal axis represents time, and the left vertical axis in the figure represents the position X as a value of a graph indicated by a solid line. In addition, the vertical axis on the right side in the figure represents the value gate of the graph indicated by the dotted line.

57B, a graph indicated by a solid line represents d (Lsum) calculated by the processing unit 91. In FIG. 57B, the horizontal axis represents time, and the vertical axis represents d (Lsum) as a value of a graph indicated by a solid line.

For example, in the processing unit 91, as shown in A of FIG. 57, based on the luminance signal (for example, Lum # n_λ1) from each sensor 21n using the above-described equations (2) and (3), A position X of an object (such as a user's hand) as skin is calculated.

Then, based on the calculated position X, the processing unit 91 calculates a dotted line graph (value gate) shown in A of FIG.

That is, for example, when the calculated position X (the value of the solid line graph shown in A of FIG. 57) does not change, the processing unit 91 recognizes the click operation using d (Lsum) for the corresponding value gate. High (= 1) representing

Note that the processing unit 91 also handles a case where a very small change in the position X (for example, a change within 1 pix) has occurred, assuming that the position X does not change.

Further, for example, when the calculated position X (the value of the solid line graph shown in A of FIG. 57) changes, the processing unit 91 does not recognize the click operation using d (Lsum) for the corresponding value gate. Low (= 0) representing

For example, when the graph indicated by a dotted line in FIG. 57A is Low (= 0) in FIG. 57A, the processing unit 91 recognizes the click operation by d (Lsum) as shown in FIG. Do not do.

Further, for example, when the graph indicated by the dotted line in FIG. 57A is High (= 1) in FIG. 57A, the processing unit 91 performs a click operation by d (Lsum) as shown in FIG. Recognition.

Thereby, in the processing unit 91, when the value gate of the dotted line graph shown in A of FIG. 57 is Low, the click operation by d (Lsum) is not recognized, and the dotted line shown in A of FIG. When the value gate of the graph in (5) is High, the click motion is recognized by d (Lsum).

For this reason, the processing unit 91 can recognize the click operation more accurately. The same can be said for the second and third embodiments.

1 digital photo frame, 1a display screen, 21 _{1 to} 21 _N sensor, 61 CPU, 62 ROM, 63 RAM, 64 bus, 65 I / O interface, 66 control unit, 67 display unit, 68 storage unit, 69 drive, 91 processing Unit, 92 current control unit, 93 timing control unit, 94 gain control unit, 95 AD conversion unit, 111 LED driver, 112a, 112b LED, 113a, 113b lens, 114n PD, 115n lens, 131, 151, 171 digital photo frame , 191 _{1 to} 191 _N PD, 192 LED unit, 211 control unit, 231 processing unit, 232 lens, 331 digital photo frame, 351 PD, 352 lens, 371 _{1 to} 371 _N LED unit, 391a, 391b LED, 392a, 392b Lens, 411 control unit, 431 processing unit

Claims

A first irradiation unit that irradiates light of a first wavelength;
An irradiation unit including: a second irradiation unit configured to irradiate light having a second wavelength different from the first wavelength;
In response to receiving reflected light from an object irradiated with light of the first wavelength, a first detection signal is generated,
A light receiving unit that generates a second detection signal in response to receiving reflected light from the object irradiated with light of the second wavelength;
A skin detection unit that detects whether or not the object is skin based on the first and second detection signals;
An information processing apparatus comprising: a generation unit configured to generate recognition information for recognizing at least one of the position or movement of the object detected as skin based on at least one of the first or second detection signals.
It further includes another light receiving part configured similarly to the light receiving part,
The information processing apparatus according to claim 1, wherein the generation unit generates the recognition information based on at least one of the first or second detection signal generated for each of the plurality of light receiving units.
The first irradiation unit is arranged at the same distance from each of the plurality of light receiving units,
The information processing apparatus according to claim 2, wherein the generation unit generates the recognition information based on the first detection signal generated for each of the plurality of light receiving units.
The light receiving unit is disposed at the same distance from the first irradiation unit and the second irradiation unit, respectively.
The information processing apparatus according to claim 2, wherein the skin detection unit detects whether or not the object is skin based on the first and second detection signals generated by the light receiving unit.
It further includes another irradiation unit configured similarly to the irradiation unit,
The light receiving unit is
For each of the irradiation units that irradiate the light of the first wavelength at different timings, the first detection signal is generated,
For each of the irradiation units that irradiate the light of the second wavelength at different timings, the second detection signal is generated,
The information processing apparatus according to claim 1, wherein the generation unit generates the recognition information based on at least one of the first or second detection signal generated for each irradiation unit.
The generator is generated for each of the plurality of irradiation units by the light receiving unit when the interval between the first irradiation units in the first direction is longer than the interval between the second irradiation units. The recognition information for recognizing at least one of the position or movement of the object in a second direction perpendicular to the first direction is generated based on the first detection signal. Information processing device.
A plurality of sensors having the irradiation unit and the light receiving unit, further including the sensor having the irradiation unit that irradiates a different irradiation range for each sensor;
The skin detection unit detects whether the object is skin based on the first and second detection signals generated for each of the plurality of sensors,
The information processing apparatus according to claim 1, wherein the generation unit generates the recognition information based on at least one of the first or second detection signal generated for each of the plurality of sensors.
A proximity detector for detecting whether the object has entered a predetermined detection range based on the first detection signal;
In response to detecting that the object has entered the detection range, the skin detection unit determines whether the object is skin based on the first and second detection signals. The information processing apparatus according to claim 1 to detect.
In response to detecting that the object is skin, an object detection unit that detects whether or not the object exists within a predetermined detection range based on the first detection signal. In addition,
The information processing apparatus according to claim 1, wherein the information processing apparatus treats the object as skin when it is detected that the object exists within the detection range.
A signal generation unit that generates an output signal having a magnitude according to the position of the object;
The information processing apparatus according to claim 1, wherein the generation unit generates the recognition information based on the output signal.
The first wavelength λ1 and the second wavelength λ2 that is longer than the first wavelength λ1 are:
640nm ≤ λ1 ≤ 1000nm
900nm ≤ λ2 ≤ 1100nm
The information processing apparatus according to claim 1, wherein:
The first irradiation unit irradiates invisible light having the first wavelength λ1,
The information processing apparatus according to claim 11, wherein the second irradiation unit emits invisible light having the second wavelength λ2.
The information processing apparatus according to claim 1, wherein the light receiving unit is provided with a visible light cut filter that blocks visible light incident on the light receiving unit.
A first irradiation unit that irradiates light of a first wavelength;
An irradiation unit including: a second irradiation unit configured to irradiate light having a second wavelength different from the first wavelength;
In response to receiving reflected light from an object irradiated with light of the first wavelength, a first detection signal is generated,
In an information processing method for an information processing apparatus, comprising: a light receiving unit that generates a second detection signal in response to receiving reflected light from the object irradiated with light of the second wavelength;
According to the information processing apparatus,
A skin detection step of detecting whether the object is skin based on the first and second detection signals;
An information processing method comprising: generating recognition information for recognizing at least one of the position or movement of the object detected as skin based on at least one of the first or second detection signals.
A first irradiation unit that irradiates light of a first wavelength;
An irradiation unit including: a second irradiation unit configured to irradiate light having a second wavelength different from the first wavelength;
In response to receiving reflected light from an object irradiated with light of the first wavelength, a first detection signal is generated,
A computer of an information processing apparatus including: a light receiving unit that generates a second detection signal in response to receiving reflected light from the object irradiated with light of the second wavelength;
A skin detection unit that detects whether or not the object is skin based on the first and second detection signals;
Based on at least one of the first and second detection signals, the function is to function as a generation unit that generates recognition information for recognizing at least one of the position or movement of the object detected as skin. program.
A first irradiation unit that irradiates light of a first wavelength;
An irradiation unit including: a second irradiation unit configured to irradiate light having a second wavelength different from the first wavelength;
In response to receiving reflected light from an object irradiated with light of the first wavelength, a first detection signal is generated,
A light receiving unit that generates a second detection signal in response to receiving reflected light from the object irradiated with light of the second wavelength;
A skin detection unit that detects whether or not the object is skin based on the first and second detection signals;
A generating unit that generates recognition information for recognizing at least one of the position or movement of the object detected as skin based on at least one of the first or second detection signals;
And a processing unit that performs a corresponding process according to a recognition result based on the recognition information.