JP5182202B2 - Information processing apparatus, information processing method, and information processing program - Google Patents

Abstract

An information processing apparatus include: a control detection block configured to detect a control in a predetermined detection space; a position detection block configured to detect a three-dimensional position of a control detected by the control detection block; a threshold value setting block configured, if the control has approached the control detection block beyond a threshold value set to a predetermined distance through the control detection block on the basis of a three-dimensional position detected by the position detection block, to set the threshold value farther from the control detection block than the predetermined distance; a setting change block configured, if the control has exceeded the threshold value set by the threshold value setting block, to change setting values for predetermined processing; and a processing execution block configured to execute the processing by use of the setting values set by the setting change block.

Description

  The present invention relates to an information processing apparatus, an information processing method, and an information processing program, and is suitably applied to, for example, a television receiver.

  Conventionally, in a television receiver, a signal corresponding to a user operation is received from a remote controller (hereinafter also referred to as a remote controller), and processing corresponding to the signal is executed.

  However, in such a television receiver, the user is forced to perform a complicated operation such as searching for a button corresponding to a process desired by the user from among a large number of operation buttons.

  Thus, some display devices provided in television receivers and the like are provided with a camera in front of the display device and execute processing corresponding to, for example, the three-dimensional movement of the user's hand imaged by the camera. Has been proposed (see, for example, Patent Document 1).

  JP 2006-209563 A

  By the way, in the display device described above, since the user can only grasp the distance to the display only roughly, in the case where the processing is executed by setting different setting values according to the distance from the display to the user's hand, There is a problem in that the process is executed with a setting value that is not intended by the user, resulting in poor usability.

  The present invention has been made in consideration of the above points, and intends to propose an information processing apparatus, an information processing method, and an information processing program capable of improving usability.

  In order to solve such a problem, in the present invention, an operation element detection unit that detects an operation element existing in a predetermined detection space, and a position detection unit that detects a three-dimensional position of the operation element detected by the operation element detection unit, Based on the three-dimensional position detected by the position detector, when the operator approaches the operator detector beyond the threshold set at a predetermined distance from the operation detector, the threshold is operated for the predetermined distance. The threshold setting unit that is set to be far from the child detection unit, and the setting change unit that changes the setting value for a predetermined process when the operator exceeds the threshold set by the threshold setting unit. A processing execution unit that executes processing using the set value is provided.

  In the present invention, the position detecting step for detecting the three-dimensional position of the manipulator detected by the manipulator detecting unit for detecting the manipulator in the predetermined detection space, and the manipulator detected by the manipulator detecting step are provided. A position detection step for detecting a three-dimensional position, and the operation element is detected by the operation element exceeding a threshold set at a predetermined distance from the operation detection unit based on the three-dimensional position detected by the position detection step. A threshold setting step for setting the threshold to be far from the operation element detection unit with respect to the predetermined distance, and the operation element exceeds the threshold value set by the threshold setting step. A setting change step for changing a set value for a predetermined process, and the process is executed using the set value set by the setting change step. It was provided a physical execution step.

  Furthermore, in the present invention, a position detecting step for detecting a three-dimensional position of the operating element detected by an operating element detecting unit for detecting an operating element in a predetermined detection space with respect to the computer, and detection by the above-described operating element detecting step. A position detecting step for detecting a three-dimensional position of the operated operator, and the operator exceeding a threshold set at a predetermined distance from the operation detecting unit based on the three-dimensional position detected by the position detecting step. When the control unit approaches the control unit detection unit, a threshold setting step for setting the threshold value to be far from the control unit detection unit with respect to the predetermined distance, and the threshold value set by the threshold setting step is used for the operation. When the number of children exceeds, the setting change step for changing the setting value for the predetermined process and the setting value set by the setting changing step are There are a so as to execute a process execution step for executing the process.

  As a result, when the user moves the operation element over the threshold and approaches the operation element detection unit, the threshold is moved away from the operation detection unit, so when the operation element exceeds the threshold value once, the operation element again exceeds the threshold and returns. It is difficult to prevent the set value from being easily changed.

  As described above, according to the present invention, when the user moves the operation element over the threshold value and approaches the operation element detection unit, the threshold value is moved away from the operation detection unit. It is possible to realize an information processing apparatus, an information processing method, and an information processing program that are difficult to return again beyond the threshold value, can prevent the setting value from being easily changed, and thus can improve usability.

It is a basic diagram which shows the external appearance structure of a television receiver. It is a basic diagram which shows the circuit structure of a television receiver. It is a basic diagram which shows a list display screen. It is a basic diagram which shows the structure of the display screen in a different zoom rate. It is a basic diagram which shows the mode of selection of a center area | region. It is a basic diagram which shows the threshold value pattern of a zoom rate. It is a basic diagram which shows the mode of a scroll display. It is a flowchart with which it uses for description of the screen display processing procedure in 1st Embodiment. It is a basic diagram which shows the functional structure of a television receiver. It is a basic diagram which shows the threshold value pattern of scroll speed. It is a flowchart with which it uses for description of the screen display processing procedure in 2nd Embodiment. It is a basic diagram which shows the display screen in other embodiment.

Hereinafter, modes for carrying out the invention (hereinafter referred to as embodiments) will be described.
The description will be given in the following order.
1. First Embodiment 2. FIG. Second Embodiment 3. FIG. Other embodiments

<1. First Embodiment>
[1-1. Appearance of television receiver]
As shown in FIG. 1, a television receiver 1 as an information processing apparatus of the present invention includes a display 2 made up of an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence), and the like for displaying video and the display. A speaker 3 is provided below 2.

  The television receiver 1 is provided with a stereo camera 4 including cameras 4A and 4B above the display 2 so that the front space of the display 2 can be photographed by the stereo camera 4.

[1-2. Circuit configuration of television receiver]
As shown in FIG. 2, in the television receiver 1, a CPU (Central Processing Unit) 11 reads a basic program stored in a nonvolatile memory 12 and develops it in a RAM (Random Access Memory) 13. Thus, the CPU 11 performs overall control over the bus 20 in accordance with the basic program.

  The CPU 11 reads various application programs stored in the nonvolatile memory 12 to the RAM 13 and executes them to realize various functions.

  The CPU 11 causes the tuner unit 15 to receive a broadcast signal of digital terrestrial broadcast received via the antenna 14 when executing reception display processing of television broadcast.

  The tuner unit 15 extracts a television channel selection signal corresponding to a predetermined broadcast channel from the received broadcast signal, and sends the extracted television channel selection signal to the decoding unit 16.

  The decoding unit 16 obtains audio data and video data by decoding the television channel selection signal supplied from the tuner unit 15, sends the video data to the display control unit 17, and sends the audio data to the audio control unit 18. Send it out.

  The display control unit 17 displays a video corresponding to the video data supplied from the decoding unit 16 on the display 2. The audio control unit 18 outputs audio corresponding to the audio data supplied from the decoding unit 16 via the speaker 3.

  In addition, the television receiver 1 is provided with an interface unit 19. When image data is supplied to a digital still camera or the like connected to the interface unit 19 via a predetermined communication path, the image data is stored in a nonvolatile manner. Store in memory 12.

  Then, the CPU 11 executes an image display process to be described later in detail in response to an operation for displaying the image data stored in the nonvolatile memory 12, and reads the image data from the nonvolatile memory 12. It transmits to the display control part 17. The display control unit 17 displays an image based on the image data supplied from the CPU 11 on the display 2.

  Incidentally, the image data conforms to the EXIF (Exchangeable Image File Format) standard, and shooting date and time, thumbnail images, and the like are recorded as additional information. Therefore, the television receiver 1 can display the image capturing date and time of the image displayed on the display 2 together with the image in accordance with, for example, a user operation.

  By the way, the stereo camera 4 images the front space of the display 2 at predetermined intervals by the cameras 4A and 4B, and sends the resulting video data to the CPU 11.

  The CPU 11 detects the movement of the user's hand (hereinafter also referred to as a gesture) from the video data supplied by the stereo camera 4 and executes processing corresponding to the gesture.

  Specifically, the CPU 11 acquires video data captured by the cameras 4A and 4B of the stereo camera 4 at predetermined timings as time passes.

  And CPU11 performs a skin color detection process with respect to the video data imaged with the camera 4A among the video data acquired from the stereo camera 4, for example. In this skin color detection process, it is determined whether or not the skin color is based on the hue of each pixel of the video data, thereby extracting the skin color portion displayed in the video data.

  Incidentally, the CPU 11 determines that the user is not performing the gesture operation when the skin color portion cannot be detected as a result of performing the skin color detection process on the video data.

  Next, when the skin color portion exists in the video data, the CPU 11 extracts the pixel having the highest luminance level from the pixels corresponding to the skin color portion as an input point.

  Here, for example, when the user performs a gesture with the index finger pointing toward the display 2, the CPU 11 extracts the pixel having the highest luminance level from the skin color portion, thereby the pixel corresponding to the fingertip of the index finger closest to the display 2. Are extracted as input points.

  Subsequently, the CPU 11 can detect the position of the input point on a plane parallel to the display 2 by detecting the planar position of the input point from the image range of the video data imaged by the camera 4A. Yes.

  Further, the CPU 11 calculates the distance in the direction perpendicular to the display 2 from the stereo camera 4 to the input point by using, for example, the stereo method using the video data captured by the cameras 4A and 4B. At this time, the CPU 11 can calculate the distance from the stereo camera 4 to the input point in a detection range from about 80 [cm] to about 120 [cm], for example, according to the performance of the stereo camera 4.

  At this time, the CPU 11 divides the detection range into, for example, 256 steps (0 to 255), and detects the distance from the stereo camera 4 detected by the stereo method to the input point in any of 256 steps. Incidentally, in the 256 steps, the position closest to the stereo camera 4 is defined as “255”, and the position farthest from the stereo camera 4 is defined as “0”.

  Therefore, the CPU 11 can detect the three-dimensional position of the input point by detecting the position of the input point in a plane parallel to the display 2 and the distance from the stereo camera 4.

  The CPU 11 detects the input point each time the video data captured by the cameras 4A and 4B of the stereo camera 4 is acquired, detects the three-dimensional position of the input point, and changes the three-dimensional position. Detect as a gesture. Then, the CPU 11 is configured to execute processing according to the detected gesture.

  Incidentally, based on the three-dimensional position of the input point, the CPU 11 displays the position of the display 2 pointed to by the user's hand, for example, with a semi-transparent circular pointer PT (FIGS. 5 and 7). It can be visually confirmed.

[1-3. Image display processing]
Next, an image display process for displaying the image data stored in the nonvolatile memory 12 on the display 2 according to the gesture will be described.

  When executing the image display process, the CPU 11 reads the image data stored in the nonvolatile memory 12. Then, the CPU 11 separates the images P1 to P10 based on, for example, 10 pieces of image data among the read image data from the left to the right in the order of the shooting date and time as shown in FIG. A list display screen G0 arranged in a row is generated. Incidentally, when the images P1 to P10 are not particularly distinguished, they are also simply referred to as images P.

  The CPU 11 sets the display area HR1 on the list display screen G0 so as to display the entire image P5, for example, and displays the display screen G1 corresponding to the display area HR1 on the display 2 as shown in FIG. To do.

  The CPU 11 performs the skin color detection process as described above every time the video data captured by the cameras 4A and 4B of the stereo camera 4 is acquired, and the brightness level is the highest among the skin color portions obtained as a result. A pixel is detected as an input point.

  Further, the CPU 11 detects the position of the detected input point on a plane parallel to the display 2 and the distance from the stereo camera 4 to the input point as a three-dimensional position.

  At this time, as shown in FIG. 5, when the user points near the center of the display 2, that is, when the pointer PT is located in the central area CA, the CPU 11 displays the list display image G0 in three different zoom rates. The zoom display to be displayed on the display 2 is performed.

  Specifically, when the CPU 11 determines that the pointer PT is located in the central area CA based on the three-dimensional position of the input point, the CPU 11 obtains a difference in the distance between the input points detected continuously before and after, It is determined whether the input point is approaching or moving away from the stereo camera 4.

  When the CPU 11 determines that the input point is approaching the stereo camera 4, as shown in FIG. 6A, the CPU 11 sets the first threshold value L1 and the second threshold value L2 to change the zoom rate, for example, “150”. And “220”. Incidentally, the first threshold value L1 and the second threshold value L2 are stored in the nonvolatile memory 12, and the CPU 11 reads out and sets them from the nonvolatile memory 12.

  When the input point exceeds “150”, which is the first threshold L1, and approaches the stereo camera 4, the CPU 11 sets the display area HR2 zoomed out from the display area HR1 on the list display screen G0 (FIG. 3). .

  Then, the CPU 11 displays a display screen G2 corresponding to the display area HR2 on the display 2, as shown in FIG. On the display screen G2, for example, the date when the image P is captured is displayed in the margin.

  Further, when the input point exceeds “220”, which is the second threshold L2, and approaches the stereo camera 4, the CPU 11 sets the display area HR3 further zoomed out from the display area HR2 on the list display screen G0.

  Then, the CPU 11 displays a display screen G3 corresponding to the display area HR3 on the display 2, as shown in FIG. In the display screen G3, for example, the year and month when the image P is captured is displayed in the margin.

  As described above, when the user's hand approaches the stereo camera 4 and exceeds the first threshold value L1 or the second threshold value L2, the CPU 11 switches from the display screen G1 to the display screens G2 and G3, so that a large number of images from one image P can be obtained. Zoom out to display P.

  On the other hand, when the CPU 11 determines that the input point is moving away from the stereo camera 4, as shown in FIG. 6B, the CPU 11 sets the first threshold value L1 and the second threshold value L2 for changing the zoom rate, for example, “80”. ”And“ 170 ”.

  When the input point exceeds “170”, which is the second threshold L2, and moves away from the stereo camera 4, the CPU 11 sets the display area HR2 zoomed in from the display area HR3 on the list display screen G0 (FIG. 3). Then, the CPU 11 displays a display screen G2 (FIG. 4B) corresponding to the display area HR2 on the display 2.

  Further, when the input point exceeds “80” that is the first threshold L1 and moves away from the stereo camera 4, the CPU 11 sets the display area HR1 further zoomed in from the display area HR2 on the list display screen G0. Then, the CPU 11 displays a display screen G1 (FIG. 4A) corresponding to the display area HR1 on the display 2.

  As described above, when the user's hand moves away from the display 2 and exceeds the second threshold value L2 or the first threshold value L1, the CPU 11 switches from the display screen G3 to the display screens G2 and G1, and changes the number of images P to one image P. Zoom in to display.

  Incidentally, when the input point approaches, for example, “210” and then moves away, the CPU 11 does not exceed “220” set as the second threshold L2 when the input point approaches the stereo camera 4. Therefore, the display screen G2 is displayed on the display 2. When the CPU 11 determines that the input point is moving away, the CPU 11 sets the second threshold L2 to “170”, but at that time, the display 2 continues to display the display screen G2.

  As described above, the CPU 11 switches the display screen G1, G2, or G3 displayed on the display 2 only when the input point exceeds the first threshold value L1 or the second threshold value L2.

  On the other hand, as shown in FIG. 7A, for example, when the display screen G2 is displayed on the display 2 and the user is pointing to the right side portion of the display 2, the CPU 11 points to the right side of the central area CA. Detect that PT is located.

  At this time, the CPU 11 displays the position pointed to by the user with the pointer PT and moves the display area HR2 on the list display screen G0 to the right, thereby moving the image P displayed on the display screen G2 from right to left. Scroll to move.

  As shown in FIG. 7B, for example, when the display screen G2 is displayed on the display 2 and the user's hand is pointing to the left side of the display 2, the CPU 11 displays the left side of the central area CA. It is detected that the pointer PT is located.

  At this time, the CPU 11 displays the position pointed to by the user with the pointer PT and moves the display area HR2 on the list display screen G0 to the left, thereby moving the image P displayed on the display screen G2 from left to right. Scroll to move.

  By the way, in the television receiver 1, as described above, the image P is displayed on the display 2 at three different zoom rates according to the distance from the stereo camera 4 to the input point.

  At this time, when the user wants to see the image P carefully, for example, the user may set the display screen G1 on which the entire image P5 is displayed. In such a case, if the scroll speed is increased, the image P5 cannot be shown to the user. Therefore, the CPU 11 scrolls the image P at a low speed when the user points to the right or left side of the central area CA while the display screen G1 is displayed on the display 2.

  On the other hand, when the user wants to see the image P as a whole, the user may set the display screen G2 or G3 on which many images P are displayed at once. In such a case, if the scroll speed is slow, it takes a lot of time to grasp a large number of images P as a whole.

  Therefore, the CPU 11 displays the display screen G2 on the display 2, and when the user points to the right or left side of the central area CA, the CPU 11 is at a medium speed faster than when the display screen G1 is displayed. Scroll the image P.

  Further, the CPU 11 displays the display screen G3 on the display 2, and when the user points to the right or left side of the central area CA, the CPU 11 is faster and faster than when the display screen G2 is displayed. Scroll the image P.

  As described above, when the right side or left side of the display 2 is pointed to by the user, the CPU 11 scrolls the image P displayed on the display 2 to the left and right while changing the scroll speed in accordance with the zoom rate.

[1-4. Image display processing procedure]
Next, the above-described image display processing procedure will be described in detail with reference to the flowchart shown in FIG. In practice, the CPU 11 enters from the start step of the routine RT1 and proceeds to the next step SP1.

  In step SP1, for example, the CPU 11 sets the display area HR1 on the list display screen G0 so as to display the entire image P5 corresponding to the reference image data, and displays the display screen G1 corresponding to the display area HR1 (FIG. 4A). )) Is displayed on the display 2.

  Then, the CPU 11 determines whether or not the user's hand has been detected by performing a skin color extraction process on the video data respectively captured by the camera 4A of the stereo camera 4.

  If a negative result is obtained here, this means that the user's hand is not detected, which means that the user is not making a gesture. At this time, the CPU 11 returns to step SP1 to detect the user's hand. Wait until.

  On the other hand, if a positive result is obtained in step SP1, this means that the user is making a gesture. At this time, the CPU 11 proceeds to the next step SP2.

  In step SP2, the CPU 11 determines whether or not the image P is scroll-displayed. If a positive result is obtained, the process proceeds to step SP4. If a negative result is obtained, the process proceeds to the next step SP3.

  In step SP3, the CPU 11 detects the input point from the video data respectively captured by the camera 4A of the stereo camera 4, and detects the three-dimensional position of the input point. Then, the CPU 11 determines whether or not the input point is at a position corresponding to the central area CA of the display 2 based on the detected three-dimensional position of the input point.

  If a negative result is obtained here, this means that the input point is located in either the left direction or the right direction with respect to the central area CA of the display 2, and the user points to either the left or right side of the display 2. At this time, the CPU 11 proceeds to step SP4.

  In step SP4, the CPU 11 scrolls the image P displayed on the display 2 left and right according to the position of the input point while changing the scroll speed according to the zoom rate, and returns to step SP1.

  On the other hand, if a positive result is obtained in step SP3, this means that the user is pointing to the central area CA of the display 2, and the CPU 11 proceeds to the next step SP5.

  In step SP5, the CPU 11 obtains a positive result by determining whether or not the input point is approaching the stereo camera 4 by obtaining a difference in distance from the stereo camera 4 continuously detected before and after the input point. If so, the process proceeds to the next step SP6.

  In step SP6, the CPU 11 sets the first threshold value L1 and the second threshold value L2 to “150” and “220” that are pattern 1, respectively, and has the input point approached beyond the first threshold value L1 or the second threshold value L2? Judge whether or not.

  If a positive result is obtained here, this means that the input point has approached beyond the first threshold value L1 or the second threshold value L2, and the CPU 11 moves to the next step SP7.

  In step SP7, when the CPU 11 recognizes that the first threshold value L1 has been exceeded, the CPU 11 performs zoom-out display for switching the display screen G1 to the display screen G2. When the CPU 11 recognizes that the second threshold value L2 has been exceeded, the CPU 11 performs zoom-out display for switching the display screen G2 to the display screen G3. Then, the CPU 11 returns to step SP1.

  On the other hand, if a negative result is obtained in step SP5, this means that the input point has moved away from the stereo camera 4, and at this time, the CPU 11 proceeds to step SP8.

  In step SP8, the CPU 11 sets the first threshold value L1 and the second threshold value L2 to “80” and “170”, which are pattern 2, respectively, and has the input point moved far beyond the first threshold value L1 or the second threshold value L2? Judge whether or not.

  If a positive result is obtained here, this means that the input point has moved far beyond the first threshold L1 or the second threshold L2, and at this time, the CPU 11 proceeds to the next step SP9.

  In step SP9, when the CPU 11 recognizes that the first threshold value L1 has been exceeded, the CPU 11 performs zoom-in display for switching the display screen G2 to the display screen G1. When the CPU 11 recognizes that the second threshold value L2 has been exceeded, the CPU 11 performs zoom-in display for switching the display screen G3 to the display screen G2. Then, the CPU 11 returns to step SP1.

  On the other hand, if a negative result is obtained in step SP6 and step SP8, this means that the input point has not moved beyond the first threshold L1 and the second threshold L2, and at this time the CPU 11 Control goes to step SP10.

  In step SP10, the CPU 11 continues to display the display screens G1, G2, and G3 without switching, and returns to step SP1.

[1-5. Operation and effect]
In the above configuration, the television receiver 1 detects, from the video data captured by the stereo camera 4, a pixel having the highest luminance level of the flesh-colored part corresponding to the user's hand as an input point, and 3 Detect dimension position.

  When the television receiver 1 determines that the input point is at a position corresponding to the central area CA and the input point is approaching, the television receiver 1 sets the first threshold value L1 and the second threshold value L2 to the pattern 1. .

  When the input point approaches the first threshold value L1 or the second threshold value L2, the television receiver 1 switches from the display screen G1 to the display screen G2 or from the display screen G2 to the display screen G3 and zooms out. To do.

  When the television receiver 1 determines that the position of the input point is within the central area CA and that the input point is far away, the television receiver 1 changes to the pattern 2 that is set farther from the stereo camera 4 than the pattern 1. A first threshold value L1 and a second threshold value L2 are set.

  When the input point moves away beyond the first threshold value L1 or the second threshold value L2, the television receiver 1 switches from the display screen G2 to the display screen G1, or from the display screen G3 to the display screen G2, and zooms in on the display. .

  Therefore, when the input point approaches the first threshold L1 or the second threshold L2, the television receiver 1 sets the first threshold L1 or the second threshold L2 so as to be far from the stereo camera 4. Thus, when the input point exceeds the first threshold value L1 or the second threshold value L2, the television receiver 1 can make it difficult for the input point to exceed the first threshold value L1 or the second threshold value L2 again.

  Here, when the user approaches his hand and exceeds the first threshold value L1 or the second threshold value L2, the user may be surprised at the fact that the display screen G1, G2 or G3 to be displayed on the display 2 is switched, and may slightly withdraw his hand. Conceivable.

  Even in such a case, since the television receiver 1 sets the first threshold value L1 or the second threshold value L2 far from the stereo camera 4, the display screen G1, G2, or G3 is switched again according to the position of the retracted hand. This can be prevented.

  Thus, since the television receiver 1 prevents the display screen G1, G2, or G3 from being switched by an operation that is not intended by the user, the usability can be improved.

  When the television receiver 1 determines that the position of the input point is either left or right with respect to the central area CA, the television receiver 1 does not set the first threshold value L1 and the second threshold value L2, and displays the display screens G1, G2. Alternatively, the image P displayed on G3 is scroll-displayed.

  Accordingly, the television receiver 1 does not switch the display screen G1, G2, or G3 during the scroll display, and thus avoids confusion for the user by changing the zoom rate during the scroll display. be able to.

  According to the above configuration, the television receiver 1 detects the three-dimensional position of the input point corresponding to the user's hand from the video data captured by the stereo camera 4. When the television receiver 1 determines that the input point has approached beyond the first threshold value L1 or the second threshold value L2 set in the pattern 1, the first threshold value L1 is set to the pattern 2 set farther than the pattern 1. Alternatively, the second threshold L2 is set.

  Thereby, the television receiver 1 can prevent the display screen G1, G2 or G3 displayed when the input point exceeds the first threshold value L1 or the second threshold value L2 from being easily switched, and thus is easy to use. Can be improved.

[1-6. Functional configuration of television receiver]
Here, a functional configuration of the television receiver 1 according to the first embodiment will be described. As illustrated in FIG. 9, the television receiver 1 functions as an operation element detection unit 31, a position detection unit 32, a threshold setting unit 33, a setting change unit 34, and a process execution unit 35.

  In the television receiver 1, the stereo camera 4 functions as the operation element detection unit 31, and the CPU 11 functions as the position detection unit 32, the threshold setting unit 33, the setting change unit 34, and the process execution unit 35.

  Therefore, the television receiver 1 is configured to execute the above-described image display processing with such a functional configuration.

<2. Second Embodiment>
[2-1. Configuration of television receiver]
In the second embodiment, unlike the first embodiment, when detecting a gesture, the input point is not detected from the video data captured by the stereo camera 4, but the shape of the user's hand is used. recognize. Since the configuration of the television receiver 1 is the same as that of the first embodiment, the description thereof is omitted.

  Specifically, when the CPU 11 acquires video data captured by the cameras 4A and 4B of the stereo camera 4 at predetermined timings as time passes, for example, the CPU 11 performs skin color detection processing on the video data captured by the camera 4A. Apply.

  The CPU 11 detects the flesh color part obtained by performing the flesh color detection process as an input part, and detects the position of the input part in a plane parallel to the display 2 and the distance from the stereo camera 4 as a three-dimensional position. To do.

  In addition to this, when there is an input portion in the video data, the CPU 11 performs pattern matching between the shape of the input portion and a plurality of shapes stored in advance in the nonvolatile memory 12.

  At this time, if the shape of the input portion does not match any of the plurality of shapes stored in the nonvolatile memory 12 as a result of pattern matching, the CPU 11 determines that the user is not making a gesture.

  On the other hand, as a result of pattern matching, the CPU 11 determines that the user is making a gesture when the shape of the input portion matches any of a plurality of shapes stored in the nonvolatile memory 12.

  The CPU 11 detects the shape and three-dimensional position of the input part each time it acquires video data captured by the cameras 4A and 4B of the stereo camera 4, and gestures the change in the shape and three-dimensional position of the input part. Detect as. Then, the CPU 11 is configured to execute processing according to the detected gesture.

[2-2. Image display processing]
Next, processing according to a gesture when displaying the image data stored in the nonvolatile memory 12 on the display 2 will be described.

  When executing the image display process, the CPU 11 reads the image data stored in the nonvolatile memory 12 as in the first embodiment. Then, based on the shooting date and time added to the image data, the CPU 11 displays, for example, a list display screen G0 in which images P1 to P10 based on 10 pieces of image data are arranged in a line at predetermined intervals from left to right in the order of shooting date and time. FIG. 3) is generated.

  Then, the CPU 11 sets the display area HR1 to the list display screen G0 so as to display the entire image P5, for example, and displays the display screen G1 (FIG. 4A) corresponding to the display area HR1 on the display 2.

  The CPU 11 obtains an input part by performing skin color detection processing each time video data captured by the cameras 4A and 4B of the stereo camera 4 is acquired, and detects the three-dimensional position of the input part.

  In addition, the CPU 11 forms the shape of a hand with only the index finger extended (hereinafter also referred to as an instruction shape) and the shape of an open hand (hereinafter referred to as an open shape) with respect to an input portion obtained by performing skin color detection processing. Pattern matching).

  When the input portion matches the indicated shape as a result of pattern matching, the CPU 11 displays the list display image G0 on the display 2 at three different zoom rates according to the distance from the stereo camera 4 to the input portion. I do.

  Specifically, the CPU 11 determines whether the input portion is approaching or moving away from the stereo camera 4 by obtaining a difference in the distance from the stereo camera 4 detected in succession to the input portion.

  When the CPU 11 determines that the input portion is approaching the stereo camera 4, the first threshold value L1 and the second threshold value L2 for changing the zoom rate are pattern 1 (FIG. 6A), for example, “150. "And" 220 ".

  Then, as in the first embodiment, the CPU 11 moves from the display screen G1 to the display screen G2 (FIG. 4B) when the input portion exceeds the first threshold L1 “150” and approaches the stereo camera 4. ) To display on the display 2.

  When the input part exceeds “220”, which is the second threshold value L2, and approaches the stereo camera 4, the CPU 11 switches the display screen G2 to the display screen G3 (FIG. 4C) and displays it on the display 2.

  On the other hand, when the CPU 11 determines that the input portion is moving away from the stereo camera 4, the first threshold value L1 and the second threshold value L2 for changing the zoom rate are pattern 2 (FIG. 5B). Set to “80” and “170”.

  As in the first embodiment, the CPU 11 switches from the display screen G3 to the display screen G2 and switches to the display 2 when the input portion exceeds “170” that is the second threshold value L2 and moves away from the stereo camera 4. indicate.

  Further, when the input portion exceeds “80” which is the first threshold L1 and moves away from the stereo camera 4, the CPU 11 switches from the display screen G2 to the display screen G1 and displays it on the display 2.

  On the other hand, when the input portion matches the open shape as a result of pattern matching, the CPU 11 scrolls the image P displayed on the display 2 at three different scroll speeds according to the distance from the stereo camera 4 to the input portion. I do.

  Specifically, the CPU 11 determines whether the input portion is approaching or moving away from the stereo camera 4 by obtaining a difference in the distance from the stereo camera 4 detected in succession to the input portion. The CPU 11 also determines which side of the stereo camera 4 is located on the right or left side.

  When the CPU 11 determines that the input portion is approaching the stereo camera 4, the third threshold value L3 and the fourth threshold value L4 for changing the scroll speed are pattern 3, as shown in FIG. For example, “150” and “220” are set.

  When the input portion does not exceed “150” that is the third threshold value L3, the CPU 11 sets the scroll speed to a low speed. Then, the CPU 11 scrolls and displays the image P displayed on the display screen G1, G2, or G3 (FIG. 4) in the right direction or the left direction at a low speed according to the direction in which the input portion is positioned.

  Further, when the input portion exceeds “150” that is the third threshold value L3 and approaches the stereo camera 4, the CPU 11 sets the scroll speed to the medium speed. Then, the CPU 11 scrolls and displays the image P displayed on the display screen G1, G2, or G3 (FIG. 4) in the right direction or the left direction at a medium speed according to the direction in which the input portion is positioned.

  Further, the CPU 11 sets the scroll speed to a high speed when the input portion exceeds the fourth threshold value L4 “220” and approaches the stereo camera 4. Then, the CPU 11 scrolls and displays the image P displayed on the display screen G1, G2 or G3 (FIG. 4) in the right direction or the left direction at a high speed according to the direction in which the input portion is located.

  On the other hand, when the CPU 11 determines that the input portion is away from the stereo camera 4, the pattern 4 sets the third threshold value L3 and the fourth threshold value L4 for changing the scroll speed as shown in FIG. For example, “80” and “170” are set.

  Then, when the input portion exceeds “170” which is the fourth threshold value L4 and moves away from the stereo camera 4, the CPU 11 sets the scroll speed to the medium speed and displays the image P displayed on the display screen G1, G2 or G3. Scroll display at medium speed according to the direction of the input part.

  Further, when the input portion exceeds “80” which is the third threshold L3 and moves away from the stereo camera 4, the CPU 11 sets the scroll speed to a low speed and inputs the image P displayed on the display screen G1, G2 or G3. Scroll display at low speed according to the direction of the part.

  As described above, the CPU 11 displays the image P while changing the zoom rate and the scroll speed according to the shape and three-dimensional position of the user's hand.

[2-3. Image display processing procedure]
Next, the above-described image display processing procedure will be described in detail with reference to the flowchart shown in FIG. In practice, the CPU 11 enters from the start step of the routine RT2 and proceeds to the next step SP21.

  In step SP21, for example, the CPU 11 sets the display area HR1 on the list display screen G0 so as to display the entire image P5, and displays the display screen G1 (FIG. 4A) corresponding to the display area HR1 on the display 2. .

  Then, the CPU 11 performs a skin color extraction process on the video data captured by the camera 4 </ b> A of the stereo camera 4, thereby determining whether or not the user's hand has been detected based on whether or not the skin color portion exists.

  If a negative result is obtained here, this means that the user's hand is not detected, which means that the user is not making a gesture. At this time, the CPU 11 returns to step SP21 to detect the user's hand. Wait until.

  On the other hand, if a positive result is obtained in step SP21, this means that the user's hand has been detected. At this time, the CPU 11 proceeds to the next step SP22.

  In step SP22, the CPU 11 performs pattern matching between the input portion obtained by performing the skin color detection process and the indication shape stored in the nonvolatile memory 12, and determines whether or not the input portion matches the indication shape. .

  If an affirmative result is obtained here, it means that the user performs an operation for changing the zoom rate. At this time, the CPU 11 proceeds to the next step SP23.

  In step SP23, the CPU 11 detects the three-dimensional position of the input portion based on the video data captured by the cameras 4A and 4B of the stereo camera 4, respectively.

  Then, the CPU 11 determines whether or not the input portion is approaching the stereo camera 4 by obtaining a difference in the distance from the stereo camera 4 continuously detected before and after to the input portion, and when a positive result is obtained. Control goes to the next step SP24.

  In step SP24, the CPU 11 sets the first threshold value L1 and the second threshold value L2 to “150” and “220” that are pattern 1, respectively, and whether the input part has approached beyond the first threshold value L1 or the second threshold value L2. Judge whether or not.

  If a negative result is obtained here, it means that the input portion has not moved beyond the first threshold value L1 and the second threshold value L2, and the CPU 11 proceeds to step SP29.

  On the other hand, if a positive result is obtained in step SP24, this means that the input portion has approached beyond the first threshold L1 or the second threshold L2, and at this time, the CPU 11 proceeds to the next step SP25.

  In step SP25, when the CPU 11 recognizes that the input portion has exceeded the first threshold value L1, the CPU 11 performs zoom-out display for switching the display screen G1 to the display screen G2. When the CPU 11 recognizes that the second threshold value L2 has been exceeded, the CPU 11 performs zoom-out display for switching the display screen G2 to the display screen G3. Then, the CPU 11 returns to step SP21.

  On the other hand, if a negative result is obtained in step SP23, this means that the input portion is moving away from the stereo camera 4, and at this time, the CPU 11 proceeds to step SP26.

  In step SP26, the CPU 11 sets the first threshold value L1 and the second threshold value L2 to “80” and “170”, which are pattern 2, respectively, and has the input part moved far beyond the first threshold value L1 or the second threshold value L2? Judge whether or not.

  If a negative result is obtained here, this means that the input portion has not moved exceeding the first threshold value L1 and the second threshold value L2, and at this time, the CPU 11 proceeds to step SP29.

  On the other hand, if a positive result is obtained in step SP26, this means that the input point has moved far beyond the first threshold L1 or the second threshold L2, and at this time, the CPU 11 proceeds to the next step SP27.

  In step SP27, when the CPU 11 recognizes that the input part has exceeded the first threshold value L1, the CPU 11 performs zoom-in display for switching the display screen G2 to the display screen G1. When the CPU 11 recognizes that the second threshold value L2 has been exceeded, the CPU 11 performs zoom-in display for switching the display screen G3 to the display screen G2. Then, the CPU 11 returns to step SP21.

  On the other hand, if a negative result is obtained in step SP22, the CPU 11 proceeds to step SP28. In step SP28, the CPU 11 performs pattern matching between the input portion obtained by performing the skin color detection process and the open shape stored in the nonvolatile memory 12, and determines whether or not the input portion matches the open shape. .

  If a negative result is obtained here, this means that the input part obtained by performing the skin color detection process does not match the indicated shape and the open shape, and at this time, the CPU 11 proceeds to step SP29.

  In step SP29, the CPU 11 continues to display the display screen G1, G2 or G3 displayed on the display 2 as it is without being changed.

  On the other hand, if a positive result is obtained in step SP28, this means that the user is performing an operation for scrolling the image P. At this time, the CPU 11 proceeds to the next step SP30.

  In step SP30, the CPU 11 detects the three-dimensional position of the input portion based on the video data captured by the cameras 4A and 4B of the stereo camera 4, respectively.

  Then, the CPU 11 determines whether or not the input portion is approaching the stereo camera 4 by obtaining a difference in the distance from the stereo camera 4 continuously detected before and after to the input portion, and when a positive result is obtained. Control goes to the next step SP31.

  In step SP31, the CPU 11 sets the third threshold value L3 and the fourth threshold value L4 to “150” and “220” which are pattern 3, respectively, and whether the input portion has approached beyond the third threshold value L3 or the fourth threshold value L4. Judge whether or not.

  If a positive result is obtained here, this means that the input portion has approached beyond the third threshold value L3 or the fourth threshold value L4. At this time, the CPU 11 proceeds to step SP33. On the other hand, if a negative result is obtained, this means that the input portion has not moved beyond the third threshold value L3 and the fourth threshold value L4. At this time, the CPU 11 proceeds to step SP34.

  On the other hand, if a negative result is obtained in step SP30, this means that the input point has moved away from the stereo camera 4. At this time, the CPU 11 proceeds to step SP32.

  In step SP32, the CPU 11 sets the third threshold value L3 and the fourth threshold value L4 to “80” and “170” that are the patterns 4, respectively, and has the input part approached beyond the third threshold value L3 or the fourth threshold value L4? Judge whether or not.

  If a positive result is obtained here, this means that the input portion has moved far beyond the third threshold L3 or the fourth threshold L4, and at this time, the CPU 11 proceeds to step SP33. On the other hand, if a negative result is obtained, this means that the input portion has not moved beyond the third threshold value L3 and the fourth threshold value L4. At this time, the CPU 11 proceeds to step SP34.

  In step SP33, the CPU 11 changes to the scroll speed corresponding to the case where the third threshold L3 or the fourth threshold L4 is exceeded, and proceeds to the next step SP35. On the other hand, in step SP34, the CPU 11 maintains the scroll speed without changing, and proceeds to the next step SP35.

  In step SP35, the CPU 11 scrolls and displays the image P displayed on the display screen G1, G2 or G3 in the right or left direction at the scroll speed set in step SP34 or SP35 according to the position of the input portion, and step SP21. Move on.

[2-4. Operation and effect]
In the above configuration, the television receiver 1 detects the user's hand as an input part from the video data captured by the stereo camera 4, and detects the shape and three-dimensional position of the detected input part.

  The television receiver 1 sets the first threshold value L1 and the second threshold value L2 to the pattern 1 when the shape of the input portion is, for example, an instruction shape and the input portion is approaching.

  The television receiver 1 performs zoom-out display for switching from the display screen G1 to the display screen G2 or from the display screen G2 to the display screen G3 when the input portion approaches the first threshold value L1 or the second threshold value L2. .

  In addition, when the shape of the input portion is, for example, an instruction shape, and the input portion is away from the television receiver 1, the television receiver 1 has a first pattern 2 set at a position farther from the stereo camera 4 than the pattern 1. A threshold value L1 and a second threshold value L2 are set.

  The television receiver 1 performs zoom-in display to switch from the display screen G2 to the display screen G1 or from the display screen G3 to the display screen G2 when the input portion moves away beyond the first threshold value L1 or the second threshold value L2.

  Therefore, the television receiver 1 sets the first threshold value L1 or the second threshold value L2 so as to be far from the stereo camera 4 when the input portion approaches the first threshold value L1 or the second threshold value L2. Accordingly, when the input portion exceeds the first threshold L1 or the second threshold L2 once, the television receiver 1 can prevent the input portion from exceeding the first threshold L1 or the second threshold L2 again.

  The television receiver 1 sets the third threshold value L3 and the fourth threshold value L4 to the pattern 3 when the shape of the input portion is, for example, an open shape and when it is determined that the input portion is approaching. To do.

  When the input portion approaches the third threshold value L3 or the fourth threshold value L4, the television receiver 1 displays the image P displayed on the display screen G1, G2, or G3 according to the position of the input portion. The scroll display is switched to increase the scroll speed in the direction or left direction.

  In addition, when the shape of the input portion is, for example, an open shape, and the television receiver 1 determines that the input portion is moving away from the stereo camera 4, the pattern is set to a position farther from the stereo camera 4. The third threshold value L3 and the fourth threshold value L4 are set to 4.

  When the input portion moves away beyond the third threshold value L3 or the fourth threshold value L4, the television receiver 1 displays the image P displayed on the display screens G1, G2, or G3 according to the position of the input portion. The display is scrolled by switching so that the scroll speed becomes slower in the direction or left direction.

  Accordingly, the television receiver 1 sets the third threshold value L3 or the fourth threshold value L4 so as to be far from the stereo camera 4 when the input portion approaches the third threshold value L3 or the fourth threshold value L4. Accordingly, when the input portion exceeds the third threshold L3 or the fourth threshold L4 once, the television receiver 1 can make it difficult for the input portion to return again beyond the third threshold L3 or the fourth threshold L4.

  Therefore, the television receiver 1 can easily continue the display form displayed when the input portion exceeds the first threshold value L1, the second threshold value L2, the third threshold value L3, or the fourth threshold value L4.

  Further, the television receiver 1 changes the first threshold value L1 and the second threshold value L2, and the third threshold value L3 and the fourth threshold value L4 according to the shape of the input portion, for example, zoom display and the like. The threshold can be set at a different distance from the scroll display.

  According to the above configuration, the television receiver 1 detects the shape and three-dimensional position of the input portion corresponding to the user's hand from the video data captured by the stereo camera 4. Then, when the input part approaches the threshold value set in pattern 1 or pattern 3 according to the shape of the input part, the television receiver 1 sets pattern 2 or pattern 3 farther than pattern 1 or pattern 3 A threshold is set for pattern 4.

  Thereby, the television receiver 1 can prevent the display form displayed when the input part exceeds the threshold value from being easily switched, and thus can improve the usability.

<3. Other embodiments>
[3-1. Other Embodiment 1]
In the first and second embodiments described above, the case where the three-dimensional position of the user's hand is detected from the video data captured by the stereo camera 4 has been described.

  However, the present invention is not limited to this, and the three-dimensional position of the user's hand may be detected using a proximity sensor such as an induction type, a capacitance type, an ultrasonic type, an electromagnetic wave type, or an infrared type.

[3-2. Other Embodiment 2]
In the first and second embodiments described above, the case where the three-dimensional position of the user's hand is detected has been described. However, the present invention is not limited to this. For example, the three-dimensional position of a remote controller or the like is used. You may make it detect.

[3-3. Other Embodiment 3]
Further, in the first and second embodiments described above, the case where the image P is zoomed in or zoomed out when the first threshold value L1 or the second threshold value L2 is exceeded has been described. However, the present invention is not limited to this. If the first threshold value L1 or the second threshold value L2 is exceeded, for example, if the setting value for a predetermined process such as changing the volume or switching the channel is changed, Processing does not matter.

  Similarly, in the first and second embodiments, when the right or left side of the display 2 is pointed or when the shape of the input portion is an open shape, the image P displayed on the display 2 is displayed. The case where scrolling is displayed to the left and right has been described. However, the present invention is not limited to this, and the process is not limited as long as the setting value for a predetermined process is changed.

[3-4. Other Embodiment 4]
Further, in the above-described second embodiment, when the shape of the input portion is an instruction shape, the first threshold value L1 and the second threshold value L2 are used, and when the shape of the input portion is an open shape, The case where the threshold value L3 and the fourth threshold value L4 are used has been described.

  However, the present invention is not limited to this. For example, the first threshold value L1 and the second threshold value L2 are the same threshold values when the shape of the input portion is an instruction shape and when the shape of the input portion is an open shape. May be used.

[3-5. Other Embodiment 5]
Furthermore, in the first and second embodiments described above, a case has been described in which the first threshold value L1 and the second threshold value L2 are provided so that the zoom ratio can be changed in three stages, for example.

  However, the present invention is not limited to this, and when the zoom rate is changed in five stages, four threshold values set to different values may be provided, and the number of threshold values is not limited.

[3-6. Other Embodiment 6]
Further, in the above-described first and second embodiments, the case where the display screen G3 is displayed on the display 2 when the user's hand approaches the second threshold value L2 has been described.

  However, the present invention is not limited to this, and when the user's hand approaches beyond the second threshold L2, an image G4 may be displayed on the display 2 as shown in FIG.

  The image G4 is displayed in the vertical direction of the images P3 to P7 on the display screen G2, for example, so that the images close to the dates of the images P3 to P7 or images taken in the same area are vertically transparent. Is done.

[3-7. Other Embodiment 7]
Further, in the first and second embodiments described above, the case where the display screen G3 is displayed on the display 2 when the input point or the input portion approaches the second threshold value L2 has been described.

  However, the present invention is not limited to this, and when the input point or the input portion approaches the second threshold L2, the image G5 or the screen G6 is displayed on the display 2 as shown in FIGS. You may make it do.

  This image G5 displays a larger number of images P than the display screen G3. Further, the image G6 is displayed in the vertical direction of the image P displayed in the image G5 so that, for example, an image having a date close to the image P or an image taken in the same area is increased in the vertical direction. . Further, the image G7 is displayed in a downward direction of the image P displayed in the image G5 so that, for example, an image having a date close to the image P or an image taken in the same region is downwardly transparent. .

  Since the images G5, G6, and G7 are further zoomed out than the image G3, for example, the year when the image P was captured is displayed in the margin.

[3-8. Other Embodiment 8]
Further, in the first and second embodiments described above, when the input point or input portion approaches, for example, exceeding the first threshold value L1, the first threshold value L1 is set as a pattern when the input point or input portion moves away. The case of setting from 1 to pattern 2 has been described.

  However, the present invention is not limited to this, and when the input point or the input portion approaches, for example, exceeding the first threshold L1, the first threshold L1 is set from the pattern 1 to the pattern 2 as soon as the first threshold L1 is exceeded. It may be.

[3-9. Other Embodiment 9]
Furthermore, in the first and second embodiments described above, for example, the case where “150” is set in pattern 1 and “70” is set in pattern 2 has been described.

  However, the present invention is not limited to this, and the first threshold L1 is surprising that at least the user has switched the display screens G1, G2, or G3 when the input point or the input portion moves away from the stereo camera 4 as compared with the approach. It is only necessary to set the position farther than the distance that the hand is retracted. The same applies to the second threshold L2, the third threshold L3, and the fourth threshold L4.

[3-10. Other Embodiment 10]
Further, in the first and second embodiments described above, the case where the CPU 11 performs the above-described image display processing according to the image display processing program stored in the nonvolatile memory 12 has been described. However, the present invention is not limited to this, and the above-described image display processing may be performed according to an image display processing program installed from a storage medium or downloaded from the Internet. Further, the above-described image display processing may be performed according to an image display processing program installed by various other routes.

[3-11. Other Embodiment 11]
Further, in the first and second embodiments described above, the case where the stereo camera 4 is provided as an operation element detection unit has been described. However, the present invention may be provided with a position detection unit having various other configurations.

  Further, in the above-described first and second embodiments, the case where the CPU 11 is provided as the position detection unit has been described. However, the present invention may be provided with a position detection unit having various other configurations.

  Further, in the first and second embodiments described above, the case where the CPU 11 is provided as the threshold setting unit has been described. However, in the present invention, a threshold setting unit having various other configurations may be provided.

  Further, in the first and second embodiments described above, the case where the CPU 11 is provided as the setting change unit has been described. However, the present invention may be provided with a setting change unit having various other configurations.

  Furthermore, in the above-described first and second embodiments, the case where the CPU 11 is provided as the processing execution unit has been described. However, in the present invention, a processing execution unit having various other configurations may be provided.

  The present invention can be used for an information processing apparatus such as a mobile phone in addition to a television receiver.

  DESCRIPTION OF SYMBOLS 1 ... Television receiver, 2 ... Display, 3 ... Speaker, 4 ... Stereo camera, 4A, 4B ... Camera, 11 ... CPU, 12 ... Non-volatile memory, 13 ... ROM, 14 ... ... Antenna, 15 ... Tuner, 16 ... Decode, 17 ... Display control, 18 ... Voice control, 19 ... Interface, 20 ... Bus.

Claims (6)

An operation element detection unit for detecting an operation element in a predetermined detection space;
A position detection unit that detects a three-dimensional position of the operation unit detected by the operation unit detection unit;
Based on the three-dimensional position detected by the position detector, when the operator approaches the operator detector beyond the threshold set at a predetermined distance from the operation detector, the threshold is set to the predetermined value. A threshold setting unit that sets the distance from the operation unit detection unit with respect to the distance;
A setting changing unit that changes a setting value for a predetermined process when the operator exceeds the threshold set by the threshold setting unit;
An information processing apparatus comprising: a process execution unit that executes the process using the set value set by the setting change unit. The threshold setting unit
When the manipulator approaches the threshold exceeding the predetermined distance and the manipulator moves away from the manipulator detector, the threshold is far from the manipulator detector with respect to the predetermined distance. The information processing device according to claim 1. The execution processing unit executes a process according to a three-dimensional position of the operation element detected by the position detection unit from a plurality of processes.
The threshold setting unit
The information processing apparatus according to claim 2, wherein the threshold value is set for each process executed by the process execution unit. A shape detection unit for detecting the shape of the operation unit detected by the operation unit detection unit;
The process execution unit
The information processing apparatus according to claim 3, wherein processing according to the shape detected by the shape detection unit is executed. A position detecting step for detecting a three-dimensional position of the manipulator detected by the manipulator detecting unit for detecting the manipulator in a predetermined detection space;
A position detecting step for detecting a three-dimensional position of the manipulator detected by the manipulator detecting step;
Based on the three-dimensional position detected by the position detection step, when the operation element approaches the operation element detection unit beyond a threshold set at a predetermined distance from the operation detection unit, the threshold value is set to the predetermined value. A threshold setting step for setting the distance to the distance from the operation element detection unit,
A setting change step for changing a setting value for a predetermined process when the operator exceeds the threshold set by the threshold setting step;
An information processing method comprising: a process execution step of executing the process using the set value set in the setting change step. Against the computer,
A position detecting step for detecting a three-dimensional position of the manipulator detected by the manipulator detecting unit for detecting the manipulator in a predetermined detection space;
A position detecting step for detecting a three-dimensional position of the manipulator detected by the manipulator detecting step;
Based on the three-dimensional position detected by the position detection step, when the operation element approaches the operation element detection unit beyond a threshold set at a predetermined distance from the operation detection unit, the threshold value is set to the predetermined value. A threshold setting step for setting the distance to the distance from the operation element detection unit,
A setting change step for changing a setting value for a predetermined process when the operator exceeds the threshold set by the threshold setting step;
A process execution step of executing the process using the set value set in the setting change step.