WO2022019085A1

WO2022019085A1 - Information processing device and information processing method

Info

Publication number: WO2022019085A1
Application number: PCT/JP2021/025072
Authority: WO
Inventors: 惇一清水; 慧高橋
Original assignee: ソニーグループ株式会社
Priority date: 2020-07-20
Filing date: 2021-07-02
Publication date: 2022-01-27

Abstract

This information processing device is provided with an acquisition unit which acquires information relating to the input speed of a user's gestures performed in the detection region of a detection unit which detects objects, and an output control unit which, on the basis of the information relating to the input speed, performs output control relating to feedback to the user.

Description

Information processing equipment and information processing method

This disclosure relates to an information processing device and an information processing method.

Various methods are being studied as device operation methods. For example, in recent years, devices that can be operated by gestures have been developed.

International Publication No. 2009/118183

At present, devices that can be operated by gestures do not necessarily have high usability. For example, in the case of the current device, even if the user performs an operation by a gesture, the user may not know whether the operation is correctly detected by the device, and the user may take time to operate the device.

Therefore, in this disclosure, we propose an information processing device and an information processing method that can realize a gesture operation function with high usability.

In order to solve the above-mentioned problems, the information processing apparatus of one form according to the present disclosure includes an acquisition unit for acquiring information regarding an input speed of a user's gesture performed in the detection area of the detection unit for detecting an object, and the input unit. An output control unit that controls output regarding feedback to the user based on information regarding speed is provided.

It is a figure which shows a mode that a user performs a gesture. It is a figure which shows a mode that a user performs a gesture. It is a figure for demonstrating the detectable range of a gesture. It is a figure for demonstrating the change of feedback based on the information of the movement speed of the hand of the user U. It is a figure for demonstrating the change of feedback based on the information of the movement speed of the hand of the user U. It is a figure which shows the structural example of the information processing apparatus which concerns on embodiment of this disclosure. It is a figure which shows the structural example of the input detection part. It is a figure which showed the correspondence relationship between the function which an information processing apparatus has, and a gesture. It is a figure for demonstrating a pinch operation. It is a figure for demonstrating the hold operation. It is a figure for demonstrating the left-right swipe. It is a figure for demonstrating the left-right swipe. It is a figure for demonstrating the up and down swipe. It is a figure for demonstrating the up and down swipe. It is a figure for demonstrating the operation of holding a hand. It is a figure for demonstrating the operation of holding a hand. It is a figure for demonstrating a touch operation. It is a figure for demonstrating the operation which keeps a hand away. It is a flowchart which shows the command execution process which concerns on this embodiment. It is a figure for demonstrating the detectable range divided into a plurality of areas. It is a figure for demonstrating the change of the feedback threshold value based on the information of the position of a user's hand. It is a figure for demonstrating the change of the feedback threshold value based on the information of the position of a user's hand. It is a flowchart which shows the command execution process which concerns on this embodiment. It is a figure which shows the configuration example of an information processing system. It is a figure which shows the structural example of the output device which concerns on embodiment of this disclosure. It is a figure which shows the structural example of the terminal apparatus which concerns on embodiment of this disclosure.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each of the following embodiments, the same parts are designated by the same reference numerals, so that overlapping description will be omitted.

Further, in the present specification and the drawings, a plurality of components having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numerals. For example, a plurality of elements having substantially the same functional configuration are distinguished as needed, such as

output devices

20A and 20B. However, if it is not necessary to distinguish each of a plurality of elements having substantially the same functional configuration, only the same reference numerals are given. For example, when it is not necessary to distinguish between the

output devices

20A and 20B, the

output devices

20A and 20B are simply referred to as output devices 20.

In addition, the present disclosure will be described according to the order of items shown below.
1. 1. Outline of the present disclosure 1-1. Issues 1-2. Solution 2. Embodiment 1
2-1. Configuration of information processing device 2-2. Gestures that can be detected by the information processing device 2-3. Operation of information processing device 3. Embodiment 2
3-1. Operation of information processing device 4. Embodiment 3
4-1. Information processing system configuration 4-2. Output device configuration 4-3. Configuration of terminal equipment 4-4. Operation of information processing system 5. Modification example 6. Conclusion

<< 1. Summary of the present disclosure >>
First, the outline of the present disclosure will be described.

<1-1. Challenges>
In recent years, technologies that enable gesture-based device operation have been developed. For example, in recent years, a technique has been developed that enables a user to perform a command input operation (for example, Next / Prev) to a device that can be worn by the user, such as headphones and earphones, using a gesture.

Many devices capable of gesture detection are equipped with a detection unit (for example, a proximity sensor) that can detect an object in a non-contact manner, and detect a user's gesture based on the detection result (for example, a sensor value) of the detection unit. In the following description, a device capable of gesture detection may be simply referred to as an information processing device.

1 and 2 are diagrams showing how the user makes a gesture. FIG. 1 shows headphones 10A as an example of the information processing apparatus of the present embodiment. Further, FIG. 2 shows an earphone 10B as an example of the information processing apparatus of the present embodiment. The device operation by the gesture is performed by the user performing a predetermined gesture in the space near the information processing device. In the examples of FIGS. 1 and 2, the headphones 10A and the earphones 10B are attached to the user's ears, and the user U makes a gesture for operating the device in the space near his / her ears. In the example of FIG. 1, the user U makes a gesture of moving the hand H from the front to the back, and in the example of FIG. 2, the user U makes a gesture of moving the hand H from the back to the front.

In the present embodiment, the motion of moving the hand includes the motion of moving the finger. The description of "hand" appearing in the following explanation can be replaced with "finger" as appropriate.

Also, in the following explanation, the XYZ coordinate system may be used for the explanation in order to facilitate understanding. Here, the X-axis direction, the Y-axis direction, and the Z-axis direction are all directions determined with reference to the user. The X-axis plus direction is the front direction of the user U, and the X-axis minus direction is the back direction of the user U. Further, the Y-axis plus direction is the left-hand side direction of the user U, and the Y-axis minus direction is the right-hand side direction of the user U. Further, the Z-axis plus direction is the upward direction, and the Z-axis minus direction is the downward direction. In the present embodiment, the user U is assumed to be in a standing or sitting position, the X-axis and the Y-axis are in the horizontal direction, and the Z-axis is in the vertical direction (gravity direction). The X-axis direction, Y-axis direction, and Z-axis direction appearing in the following description may be appropriately read according to the posture of the user. For example, when the user is lying on his back, the X-axis direction is the vertical direction, and the Y-axis and the X-axis directions are the horizontal direction.

Further, in the following explanation, the gesture in which the user U moves the hand H in the horizontal direction (X-axis direction) may be referred to as a left / right swipe. Further, in the following description, the gesture in which the user U moves the hand H in the vertical direction (Z-axis direction) may be referred to as a vertical swipe.

As described above, the information processing device detects the user's gesture based on the detection result of the object in the detection unit. When the information processing apparatus detects a gesture, it executes a function corresponding to the gesture (for example, Next / Prev or Vol + / Vol−).

While device operation by gesture has the advantage that the user can easily operate the device, there is a problem that it is difficult for the user to confirm the success or failure of the operation by gesture.

For example, it is assumed that the information processing device is a device worn in the user's ear such as headphones 10A and earphones 10B. In this case, as shown in FIGS. 1 and 2, the operation on the information processing apparatus is executed in a place that cannot be visually recognized by the user, so that the user has his / her own hand located within the detectable range of the gesture. It is difficult to know whether or not it is. In particular, when the gesture is performed in the air, it is difficult for the user to know at which position in the air the gesture is performed because the user does not touch the information processing device. In that case, it is difficult for the user to grasp whether or not the gesture being executed is executed as intended.

Also, if the operation related to the user's gesture is extremely fast or extremely slow, the information processing device cannot correctly detect the user's gesture. In this case as well, it is difficult for the user to grasp whether his / her operation is fast or slow, and therefore it is difficult to grasp whether or not the gesture being executed is executed as intended.

In that case, even if the user makes a gesture, the gesture may not be detected by the information processing device. In addition, a gesture different from the gesture intended by the user may be detected by the information processing apparatus, and a function different from the function intended by the user may be executed by the information processing apparatus. In this case, the user will notice that the gesture was not correctly detected by the information processing apparatus after a while after performing the gesture or when a function other than the intended function is executed.

<1-2. Solution>
Therefore, in the present embodiment, the above-mentioned problem is solved by the means shown below.

Before explaining the outline of the solution, the detectable range of the gesture will be explained. FIG. 3 is a diagram for explaining the detectable range of the gesture. In the example of FIG. 3, when the user U is viewed from the Y-axis plus direction, the detection region OR of the detection unit is formed in a certain range around the information processing apparatus 10. The information processing device 10 may be headphones 10A or earphones 10B.

In the example of FIG. 3, a part of the detection area OR is the gesture detectable range AR. Specifically, the detectable range AR is a quadrangular range within the detection area OR. The shape of the detectable range AR is not limited to a quadrangle when viewed from the Y-axis direction, and may be, for example, a circle or an ellipse. Further, in the example of FIG. 3, the detectable range AR is a part of the detection area OR, but the detectable range AR may be the entire range of the detection area OR. Further, the detectable range AR may be variable. For example, at least one of the position, size, and shape of the detectable range AR may be changed based on the information from the sensor included in the information processing apparatus 10.

Hereinafter, the outline of the solution will be described by taking the detectable range AR shown in FIG. 3 as an example.

First, the information processing device 10 acquires information indicating the position of the hand of the user U performing the gesture. Then, the information processing apparatus 10 constantly provides feedback while the user U's hand is within the detectable range AR. At this time, the feedback may be the sound output from the earphones or headphones. The information processing apparatus 10 does not have to provide feedback when the user U's hand is not within the detectable range AR. As a result, the user U can know whether or not his / her hand is within the detectable range AR.

Further, the information processing apparatus 10 may acquire information regarding the input speed of the user's gesture performed in the detection area OR. Then, the information processing apparatus 10 performs output control regarding feedback to the user U based on the information regarding the input speed. For example, the information processing apparatus 10 acquires information on the movement speed of the hand of the user U, and performs output control regarding feedback based on the information on the movement speed.

4A and 4B are diagrams for explaining changes in feedback based on information on the movement speed of the user U's hand. In the example of FIG. 4A, the hand H of the user U is moving at the moving speed V ₁₁ , and in the example of FIG. 4B, the hand H of the user U is moving at the moving speed V ₁₂ _{faster than the moving speed V 11} .

In the examples of FIGS. 4A and 4B, the information processing apparatus 10 is configured to provide feedback at all times and in real time. Here, the real-time feedback means feedback without delay or feedback with a certain range of delay. Then, the information processing apparatus 10 changes the feedback to the user U according to the moving speed of the hand H of the user U. For example, the information processing apparatus 10 changes the feedback depending on whether or not the moving speed of the hand H of the user U exceeds a predetermined threshold value (hereinafter, referred to as a threshold value _Vth).

For example, it _{is assumed that the threshold value V th} _{is larger than the moving speed V 11} shown in FIG. 4A and smaller than the _{moving speed V 12} shown in FIG. 4B. In the example of FIG. 4A, since the hand H of the user U is moving at a moving speed V ₁₁ _{slower than the threshold value V th} , the information processing apparatus 10 provides the first feedback. The first feedback may be feedback to inform the user that the gesture has been input normally. Further, the first feedback may be zero feedback.

Here, zero feedback means feedback without output, that is, the information processing apparatus 10 does not output as feedback. In the present embodiment, not outputting is also regarded as a kind of feedback if it informs the user that the gesture is input normally or is not input normally, for example. Can be done.

On the other hand, in the example of FIG. 4B, since the hand H of the user U is moving at a movement speed V ₁₂ _{faster than the threshold value V th} , the information processing apparatus 10 provides a second feedback different from the first feedback. .. The second feedback is, at this time, the second feedback may be a sound having a higher pitch (frequency) than the first feedback. For example, the second feedback may be a sound with a higher frequency than the first feedback. If the first feedback is not zero feedback, the second feedback may be zero feedback.

It should be noted that the information processing apparatus 10 does not necessarily have to always provide feedback. For example, the information processing apparatus 10 does not have to give feedback to the user when the moving speed of the user's hand H _{does not exceed the threshold value Vth.} Then, the information processing apparatus 10 may provide feedback when the _{moving speed exceeds the threshold value Vth.} This makes it possible to inform the user U that the gesture input speed is high.

Also, the threshold value is not limited to one and may be multiple. In this case, in addition to the first feedback and the second feedback, there may be a plurality of further feedbacks (for example, a fourth feedback, a fifth feedback, etc.). Of course, the information processing apparatus 10 may continuously change the feedback according to the moving speed of the hand H of the user U. For example, the frequency of the sound may be gradually changed according to the change in the moving speed of the hand H of the user U.

According to the present solution, since the information processing apparatus 10 provides feedback according to the position of the hand H of the user U, even if the detectable range AR is in a position where the user U cannot see, the user U can use the feedback. While performing the gesture, it is possible to know the appropriate position (the position of the detectable range AR) for performing the gesture. Further, since the information processing apparatus 10 changes the feedback according to the moving speed of the hand H of the user U, the user U can know the appropriate input speed of the gesture while performing the gesture. As a result, the user will perform the gesture at an appropriate position or speed, and the accuracy of the gesture detection by the information processing apparatus 10 will be high. As a result, the user can use the information processing apparatus 10 without feeling much stress, so that the usability of the information processing apparatus 10 is improved.

<< 2. Embodiment 1 >>
The outline of the present embodiment has been described above, but the information processing apparatus 10 according to the first embodiment will be described below.

<2-1. Information processing device configuration>
First, the configuration of the information processing apparatus 10 will be described.

The information processing device 10 is an information processing terminal that includes a detection unit that detects an object and executes various functions based on a user's input operation. For example, the information processing apparatus 10 is a device capable of outputting sound, which is attached to a portion of the body of the user U that cannot be visually recognized by the user U. For example, the information processing device 10 is an acoustic output device that can be worn by a user such as earphones and headphones. The information processing device 10 may be a display device such as an AR (Augmented Reality) glass or an MR (Mixed Reality) glass that can be worn by a user.

In the present embodiment, the information processing apparatus 10 is a device that can be worn by the user U, and is provided with a predetermined portion located at least in the ear of the user U when the information processing device 10 is worn. If the information processing device 10 is an earphone or a headphone, the predetermined portion is a speaker and a housing for storing the speaker. Then, it is assumed that at least a detection unit for detecting an object is arranged in this predetermined portion. The information processing apparatus 10 is configured to be able to detect a user's gesture, and executes a function such as music playback based on the user's gesture.

FIG. 5 is a diagram showing a configuration example of the information processing apparatus 10 according to the embodiment of the present disclosure. The information processing apparatus 10 includes an input detection unit 11, a state detection unit 12, an output unit 13, a communication unit 14, a storage unit 15, and a control unit 16. The configuration shown in FIG. 5 is a functional configuration, and the hardware configuration may be different from this. Further, the functions of the information processing apparatus 10 may be distributed and implemented in a plurality of physically separated configurations.

The input detection unit 11 is a detection unit that detects a user's input operation. For example, the input detection unit 11 is a non-contact type detection unit that detects an object in a non-contact manner. The input detection unit 11 includes one or a plurality of proximity sensors (also referred to as non-contact sensors), and detects an object located in the detection area. The proximity sensor may be an optical sensor or a capacitance type sensor. An optical proximity sensor is a sensor that detects the light reflected by an object. The capacitance type proximity sensor is a sensor that detects a change in capacitance that occurs between an object and the sensor.

When the input detection unit 11 is a non-contact type, the input detection unit 11 may be a 2D sensor or a 3D sensor. When the input detection unit 11 is a 2D sensor, the detection area formed by the input detection unit 11 is a two-dimensional area, and when the input detection unit 11 is a 3D sensor, the detection area formed by the input detection unit 11 is a three-dimensional area. Will be.

The input detection unit 11 is not limited to the non-contact type. The input detection unit 11 may be a contact type detection unit. In this case, the input detection unit 11 includes one or a plurality of touch sensors, and detects an object that comes into contact with a predetermined place of the information processing apparatus 10. If the information processing device 10 is a headphone type device, the predetermined location is, for example, the side surface of the headphones (opposite the surface of the speaker). If the information processing device 10 is an earphone type device, the predetermined location is, for example, the side surface of the earphone (opposite the surface of the speaker). In the following description, the side surface of the headphones or the side surface of the earphones may be referred to as the housing surface.

FIG. 6 is a diagram showing a configuration example of the input detection unit 11. FIG. 6 shows a state in which the headphone-type information processing apparatus 10 is viewed from the side surface of the headphones. The configuration shown in FIG. 6 is merely an example, and the configuration of the input detection unit 11 is not limited to the configuration shown in FIG.

In the example of FIG. 6, the input detection unit 11 includes an infrared light emitter ID and four photo sensors PD1, PD2, PD3, and PD4 as non-contact sensors. The infrared emitter ID is arranged in the center of the housing surface, and the four photosensors PD1, PD2, PD3, and PD4 are arranged at equal intervals in the circumferential direction so as to surround the infrared emitter ID. The input detection unit 11 detects an object by detecting the infrared light emitted from the infrared emitter ID and reflected on the surface of the object by the four photosensors PD1, PD2, PD3, and PD4.

Further, the input detection unit 11 is provided with a touch pad TP as a contact type sensor. The touch pad TP is composed of a plurality of touch sensors arranged in a plane. The infrared emitter ID is arranged on the housing surface. The input detection unit 11 detects an object in contact with the surface of the touch pad TP.

The state detection unit 12 is a sensor unit that detects the state of the information processing device 10. The state detection unit 12 is composed of one or a plurality of sensors that detect the state of the information processing device 10. The state detection unit 12 includes, for example, one or a plurality of acceleration sensors. Further, the state detection unit 12 may include one or a plurality of gyro sensors. Further, the state detection unit 12 may include one or a plurality of geomagnetic sensors. The state detection unit 12 may include a motion sensor in which these plurality of types of sensors are combined.

The state detection unit 12 detects the state of the information processing apparatus 10 based on the detection results of these sensors. For example, the state detection unit 12 detects the direction of gravity based on the sensor values of these sensors. For example, since the information processing device 10 is constantly subjected to gravitational acceleration, the information processing device 10 can detect the gravitational direction by averaging the directions of the accelerations detected by the acceleration sensor for a certain period of time. ..

The output unit 13 is an output interface that outputs information to the user. For example, the output unit 13 may be an acoustic device such as a speaker or a buzzer, or may be a vibration device such as a vibration motor. Further, the output unit 13 may be a display device such as a liquid crystal display (Liquid Crystal Display) or an organic EL display (Organic Electroluminescence Display), or may be a lighting device such as an LED (Light Emitting Diode) lamp. .. The output unit 13 functions as an output means of the information processing apparatus 10. The output unit 13 outputs various information to the user according to the control of the control unit 16.

The communication unit 14 is a communication interface for communicating with other devices. The communication unit 14 may be a network interface or a device connection interface. Further, the communication unit 14 may be a wired interface or a wireless interface. The communication unit 14 functions as a communication means of the information processing device 10. The communication unit 14 communicates with other devices according to the control of the control unit 16. Other devices are, for example, terminal devices such as music players and smartphones.

The storage unit 15 is a storage device capable of reading and writing data such as a DRAM (Dynamic Random Access Memory), a SRAM (Static Random Access Memory), a flash memory, and a hard disk. The storage unit 15 functions as a storage means for the information processing device 10. The storage unit 15 stores, for example, the settings related to the detectable range AR of the gesture.

The control unit 16 is a controller that controls each unit of the information processing device 10. The control unit 16 is realized by, for example, a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). For example, the control unit 16 is realized by the processor executing various programs stored in the storage device inside the information processing device 10 using a RAM (Random Access Memory) or the like as a work area. The control unit 16 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The CPU, MPU, ASIC, and FPGA can all be regarded as controllers.

As shown in FIG. 5, the control unit 16 includes an acquisition unit 161, a gesture detection unit 162, a command execution unit 163, an output control unit 164, and a guessing unit 165. Each block (acquisition unit 161 to guessing unit 165) constituting the control unit 16 is a functional block indicating the function of the control unit 16. These functional blocks may be software blocks or hardware blocks. For example, each of the above-mentioned functional blocks may be one software module realized by software (including a microprogram), or may be one circuit block on a semiconductor chip (die). Of course, each functional block may be one processor or one integrated circuit. The method of configuring the functional block is arbitrary.

The control unit 16 may be configured in a functional unit different from the above-mentioned functional block. Further, another device may perform a part or all of the operations of each block (acquisition unit 161 to estimation unit 165) constituting the control unit 16. For example, a terminal device such as a music player or a smartphone may perform some or all operations of each block constituting the control unit 16. The operation of each block constituting the control unit 16 will be described later.

<2-2. Gestures that can be detected by information processing equipment>
The configuration of the information processing apparatus 10 has been described above, but before the operation of the information processing apparatus 10 according to the present embodiment is described in detail, the gestures that can be detected by the information processing apparatus 10 will be described.

FIG. 7 is a diagram showing the correspondence between the functions of the information processing apparatus 10 and the gestures. The information processing device 10 has a function related to answering a telephone in addition to a function related to playing music. For example, the information processing apparatus 10 has the functions shown in the following (1) to (7). In addition, "function" can be paraphrased as "command".
(1) Play / Pause
(2) AnswerCall / End
(3) Next / Prev
(4) Vol + / Vol-
(5) Candle
(6) Quick Attention
(7) Ambient Control

Hereinafter, the functions of (1) to (7) and the gestures associated with each of (1) to (7) will be described. The user's actions constituting one gesture may include a first action that triggers the start of the gesture and a second action following the first action. The first operation is, for example, a swing-up operation of the hand H of the user U, and the second operation is, for example, an operation such as a swipe following the first operation. It is also possible to regard each of the first motion and the second motion as one gesture.

The functions and gestures described here are just examples. The functions and gestures of the information processing apparatus 10 are not limited to the functions and gestures shown below. The first operation and the second operation are not limited to the operations shown below. Further, the combination of the function and the gesture is not limited to the combination shown below.

In the following description, the information processing device 10 is assumed to be a headphone-type device worn on the user's ear, but the information processing device 10 is not limited to the headphone-type device. For example, the information processing device 10 may be an earphone type device. Further, the information processing apparatus 10 may have a predetermined portion to be attached to the user's ear and other portions. Further, in the following description, it is assumed that the information processing apparatus 10 is attached to the user's ear, but the apparatus attached to the user's ear may be a predetermined device other than the information processing apparatus 10. The predetermined device is, for example, an output device (for example, headphones or earphones) connected to the information processing device 10 wirelessly or by wire. If the information processing device 10 is worn on the user's ear, the predetermined device is the information processing device 10 itself. A predetermined device can be paraphrased as a predetermined device.

Hereinafter, the functions of the information processing apparatus 10 and the gestures associated with the functions will be described with reference to FIG. 7.

(1) Play / Pause
"Play" is a function for playing a song, and "Pause" is a function for pausing the playback of a song. The "Play / Pause" is associated with the swing-up motion of the hand H as the first motion, and is associated with the pinch motion as the second motion. FIG. 8 is a diagram for explaining a pinch operation. As shown in FIG. 8, the pinch operation is an operation of picking an object with a finger. The information processing apparatus 10 can detect that the user U has performed a pinch operation even if the user U has not actually picked up an object (for example, the information processing apparatus 10).

(2) Answer Call / End
"Answer Call" is a function for answering a telephone call, and "Answer End" is a function for ending a telephone call. The "Answer Call / End" is associated with a swing-up motion of the hand H as a first motion, and a pinch motion or a hold motion as a second motion. FIG. 9 is a diagram for explaining the hold operation. As shown in FIG. 9, the hold operation is an operation of grasping an object with the hand H. The information processing apparatus 10 can detect that the user U has performed the hold operation even if the user U does not actually grasp an object (for example, the information processing apparatus 10).

(3) Next / Prev
"Next" is a function for cueing the next song, and "Prev" is a function for cueing the previous song or the song being played. The "Next / Prev" is associated with the swing-up motion of the hand H as the first motion, and is associated with the left / right swipe as the second motion. Here, "Next" is associated with the left swipe (front swipe) of the left and right swipes as the second operation, and "Prev" is associated with the right swipe of the left and right swipes as the second operation (prev). After swipe) is associated. It should be noted that "Next / Prev" may be associated with a gesture that performs the second operation without the first operation.

10A and 10B are diagrams for explaining a left-right swipe. FIG. 10A is a left swipe and FIG. 10B is a right swipe. The left / right swipe is an operation (gesture) involving a movement width, unlike the pinch operation and the hold operation. Here, the left swipe is an operation in which the user U slides the hand H in the forward direction (X-axis plus direction) by a predetermined movement width W1 as shown in FIG. 10A. Further, the right swipe is an operation in which the user U slides the hand H in the backward direction (X-axis minus direction) by a predetermined movement width W2 as shown in FIG. 10B.

Note that FIGS. 10A and 10B are both views showing how the user U is performing a gesture near the left ear. Unlike the examples of FIGS. 10A and 10B, when the user U makes a gesture near the right ear, the right swipe is the action of sliding the hand H forward, and the left swipe is the action of sliding the hand H backward. So be careful. In this case, "Next" is associated with, for example, a right swipe (front swipe) as a second action, and "Prev" is associated with, for example, a left swipe (back swipe) as a second action.

(4) Vol + / Vol-
"Vol +" is a function to raise the volume, and "Vol-" is a function to lower the volume. "Vol + / Vol-" is associated with the swinging motion of the hand H as the first motion, and is associated with the up / down swipe as the second motion. Here, "Vol +" is associated with the up swipe of the up and down swipes as the second action, and "Vol-" is associated with the down swipe of the up and down swipes as the second action. There is. It should be noted that "Vol + / Vol-" may be associated with a gesture that performs the second operation without the first operation.

11A and 11B are diagrams for explaining the up / down swipe. FIG. 11A is a left swipe and FIG. 11B is a right swipe. The up / down swipe is an operation (gesture) involving a movement width, unlike the pinch operation and the hold operation. Here, the upper swipe is an operation in which the user U slides the hand H upward (Z-axis plus direction) by a predetermined movement width W3, as shown in FIG. 11A. Further, the lower swipe is an operation in which the user U slides the hand H downward (Z-axis minus direction) by a predetermined movement width W4, as shown in FIG. 11B.

Note that "Vol + / Vol-" is a function for adjusting the volume. Therefore, in order to execute this function, the information processing apparatus 10 can acquire not only the information on raising and lowering the sound but also the information on the amount of raising and lowering sound (the amount of raising or lowering the sound) from the user U. desirable. Therefore, in the present embodiment, "Vol + / Vol-" is assumed to be a function accompanied by an operation amount (in the case of this function, an amount of raising or lowering the sound). In this function, for example, the movement amount or movement speed of the hand H when swiping up and down is associated with the operation amount of "Vol + / Vol-". By configuring the information processing apparatus 10 so as to raise or lower a certain amount of sound with one input operation, it is possible to make this function a function without an operation amount.

(5) Candle
"Cancel" is a function of canceling the operation performed by the user U. The "Cancel" is associated with the swinging motion of the hand H as the first motion, and is associated with the motion of holding the hand as the second motion. 12A and 12B are diagrams for explaining the operation of holding the hand H. 12A is a view of the user U from the left side, and FIG. 12B is a view of the user U from the front. As shown in FIGS. 12A and 12B, the operation of holding the hand H is an operation in which the user U holds the spread hand H toward the information processing apparatus 10.

(6) Quick Attention
"Quick Attention" is a function for the user U to quickly hear the surrounding sound. Specifically, "Quick Attention" is a function that quickly lowers the volume of the sound being output (for example, music, call voice, or ringtone) to make it easier to hear the surrounding sound. The "Quick Attention" is associated with the swinging motion of the hand H as the first motion, and is associated with the touch motion as the second motion. FIG. 13 is a diagram for explaining the touch operation. As shown in FIG. 13, the touch operation is an operation in which the user U touches a part of the information processing apparatus 10 (for example, the housing surface).

(7) Ambient Control
The "Ambient Control" is a function for the user U to listen to music while checking the surrounding sounds. Specifically, "Ambient Control" is a function of capturing external sounds during music reproduction. The "Ambient Control" is associated with a swing-up motion of the hand H as a first motion, and is associated with a motion of moving the hand H away as a second motion. FIG. 14 is a diagram for explaining an operation of moving the hand H away. The motion of moving the hand H away is a motion (gesture) with a movement width, unlike the pinch motion, the hold motion, the touch motion, and the motion of holding the hand. Here, as shown in FIG. 14, the operation of moving the hand H away is such that after the user U holds the hand H over the information processing apparatus 10, the hand H is moved in a predetermined separation direction by a predetermined movement width W4. In the example of FIG. 14, it is an operation of moving in the Y-axis plus direction).

<2-3. Information processing device operation>
The gestures that can be detected by the information processing apparatus 10 have been described above. Next, the operation of the information processing apparatus 10 that can detect such gestures will be described.

FIG. 15 is a flowchart showing a command execution process according to the present embodiment. The command execution process is a process in which the information processing apparatus 10 executes a command input by the user U using a gesture. Here, the "command" is a command from the inside or the outside of the device for causing the information processing device 10 to execute a function. It is also possible to regard the "command" as a word indicating the function itself of the information processing apparatus 10, such as Play / Pause. The description of "command" appearing in the following explanation can be replaced with "function".

The command execution process is executed by the control unit 16 of the information processing device 10. The command execution process is started, for example, when the information processing apparatus 10 is turned on.

First, the acquisition unit 161 of the control unit 16 acquires the sensor value from the input detection unit 11 and the state detection unit 12 (step S101). For example, the acquisition unit 161 acquires information about an object in the detection region OR from a non-contact type sensor such as a proximity sensor. Further, the acquisition unit 161 acquires information regarding contact with the housing surface from a contact-type sensor such as a touch sensor. Further, the acquisition unit 161 may acquire information regarding the state of the information processing device 10 from sensors such as an acceleration sensor, a gyro sensor, and a geomagnetic sensor.

Subsequently, the acquisition unit 161 acquires information regarding the input speed of the gesture of the user U performed in the detection area OR based on the sensor value acquired in step S101 (step S102). For example, the acquisition unit 161 acquires information on the movement speed of the user U's hand in the detection area OR based on the sensor value from the input detection unit 11. In addition to the information regarding the input speed, the acquisition unit 161 may acquire information indicating the position of the hand H of the user U who is performing the gesture in the detection area OR.

Note that the control unit 16 may change at least one of the position, size, and shape of the detectable range AR so that the user U can perform an appropriate input operation when acquiring information on the input speed. For example, the control unit 16 may change the position, size, and shape of the detectable range AR based on the information acquired from the input detection unit 11 or the state detection unit 12.

Next, the output control unit 164 of the control unit 16 performs output control regarding feedback to the user U (step S103). The output control of the output control unit 164 is roughly classified into the following (1) to (4).
(1) Feedback based on speed information (2) Feedback based on position information (3) Feedback based on speed information and position information (4) Feedback based on estimation results

Hereinafter, (1) to (4) will be described respectively. The output control unit 164 can execute a plurality of processes selected from the output control processes shown in the following (1) to (4) in parallel or in combination.

(1) Feedback based on speed information The output control unit 164 controls the output related to feedback to the user U based on the information related to the input speed. For example, the output control unit 164 performs output control regarding feedback to the user U based on the information on the movement speed of the hand H of the user U. The feedback may be sound or vibration. Further, the output control unit 164 may provide feedback in real time while the user U is performing the gesture. For example, the output control unit 164 may provide feedback corresponding to the movement speed of the user U's hand without delay after acquiring the movement speed information.

When the feedback is performed in real time, the output control unit 164 may change the feedback to the user U according to the moving speed of the hand H of the user U. For example, the information processing apparatus 10 may change the feedback depending on whether or not the moving speed of the hand H of the user U _{exceeds a predetermined threshold value Vth.} For example, when the hand H of the user U _{is moving at a speed slower than the predetermined threshold value Vth} , the output control unit 164 provides the first feedback. On the other hand, when the hand H of the user U _{is moving at a speed faster than the predetermined threshold value Vth} , the output control unit 164 provides a second feedback different from the first feedback. As a result, the output control unit 164 can inform the user U of the appropriate movement speed of the hand H.

In addition, either one of the first feedback and the second feedback may be zero feedback. For example, when the user's hand H is _{moving at a speed slower than the predetermined threshold value Vth} , the output control unit 164 does not give feedback to the user, and the user's hand H is slower than the _{predetermined threshold value Vth.} If you are moving at speed, you may give feedback.

It should be noted that there may be a plurality of threshold values for changing the feedback. For example, as the threshold value for changing the feedback, a first threshold value V _th11 and a second threshold value V _th12 larger than the first threshold value V _th11 may exist. In the present embodiment, as an example, it _{is assumed that the speed between the first threshold value V th11} and the second threshold value V _th12 is an appropriate movement speed of the user U's hand H assumed by the device developer. In addition, any one of the first threshold value V _th11 and the second threshold value V _th12 may be regarded as the above-mentioned predetermined threshold value V _th.

At this time, if the moving speed of the hand H of the user U _{does not exceed the first threshold value V th11} , the output control unit 164 provides the first feedback as feedback. Further, the output control section 164, the moving speed of the hand H of the user U exceeds the first threshold value _{V th11,} if not exceed the second threshold value _{V th12} is different second and first feedback Give feedback. Further, when the moving speed of the hand H of the user U _{exceeds the second threshold value V th12} , the output control unit 164 provides a third feedback different from the second feedback. The first feedback and the third feedback may be different or the same. As a result, the output control unit 164 can inform the user U of an appropriate movement speed of the hand H, which is neither fast nor slow.

As mentioned above, the feedback may be sound. That is, the output control unit 164 may perform sound output control as output control related to feedback. In this case, the output control unit 164 may change the sound output mode based on the information regarding the input speed. More specifically, the output control unit 164 may change the sound as feedback according to the moving speed of the hand H of the user U.

When the output control unit 164 changes the output mode of the sound, the sound element changed by the output control unit 164 may be a volume, a frequency, or an output pattern. Frequency can be rephrased as pitch. Further, if the sound to be fed back is a voice, the element of the sound may be the intonation of the voice. The first feedback, the second feedback, and the third feedback described above may be sounds having different volumes, frequencies, output patterns, or intonations. Of course, if the user U can recognize different sounds, the sound elements changed by the output control unit 164 are not limited to the volume, frequency, output pattern, and intonation. Further, when the feedback is changed, the output control unit 164 may change the combination of a plurality of sound elements.

(2) Feedback based on position information The output control unit 164 may provide feedback according to the position of the hand H of the user U. For example, the output control unit 164 may provide feedback at all times while the position of the user U's hand is within the detectable range AR. When the feedback is sound, the output control unit 164 may always output sound while the user U's hand H is within the detectable range AR. Then, the output control unit 164 may not output the sound as feedback when the user U's hand H is not within the detectable range AR. As a result, the user U can know whether or not his / her hand is within the detectable range AR.

(3) Feedback based on speed information and position information The output control unit 164 may provide feedback according to the moving speed of the hand H of the user U and its position. At this time, the output control unit 164 may change _{the threshold value Vth} according to the position of the user's hand in the detection area OR. _{For example, the output control unit 164 may change a predetermined threshold Vth} for changing the feedback according to the position of the user's hand in the detectable range AR. At this time, the output control unit 164 may divide the detectable range AR into a plurality of areas for processing. FIG. 16 is a diagram for explaining a detectable range AR divided into a plurality of regions. In the example of FIG. 16, the detectable range AR is divided into a central region AR1 that occupies a certain range in the center of the detectable range AR and an inner edge region AR2 that occupies a certain range inward from the edge of the detectable range AR. There is.

_{Then, the output control unit 164 may change a predetermined threshold value Vth} for changing the feedback depending on whether the user U's hand H is in the central region AR1 or the inner edge region AR2. _{For example, the output control unit 164 sets a predetermined threshold value V th} as the threshold _{value V th 21} when the hand H of the user U is in the central region AR1, and a predetermined threshold value when the hand H of the user U is in the inner edge region AR 2. Let V _th be a threshold value V _th22 smaller than the threshold _{value V th 21} . In the present embodiment _{, both the threshold value V th21} and the threshold value V _th22 are assumed to be a kind of a predetermined threshold value V _th.

17A and 17B are diagrams for explaining the change in the _{feedback threshold value Vth} based on the information on the position of the hand H of the user U. In the example of FIG. 17A, the hand H of the user U is moving at the moving speed V ₂₁ in the central region AR1, and in the example of FIG. 17B, the hand H of the user U is moving at the moving speed V _{21 in the inner edge region AR2.} It is moving at a slower moving speed V _22.

Here, it is assumed that the moving speed V ₂₁ _{is slower than the threshold value V th} 21 in the central region AR1 and the moving speed V ₂₂ is faster than _{the threshold value V th} 22 in the in-rim region AR 2. Then, when the movement speed of the hand H of the user U is slower than the predetermined threshold value Vth, the output control unit 164 gives first feedback to the user U, and the movement speed of the hand H of the user U is higher than the predetermined threshold value Vth. If it is fast, a second feedback different from the first feedback shall be given to the user U.

In the case of FIG. 17A, the moving speed V ₂₁ _{of the hand H of the user U is faster than the moving speed V 22} shown in FIG. 17B, but slower than the _{threshold value V th 21} associated with the central region AR1. Therefore, the output control unit 164 uses the feedback to the user U as the first feedback. On the other hand, in the case of FIG. 17B, the moving speed V ₂₁ _{of the hand H of the user U is slower than the moving speed V 22} shown in FIG. 17A, but faster than the _{threshold value V th2} associated with the inner edge region AR2. Therefore, the output control unit 164 uses the feedback to the user U as the second feedback.

As a result, the information processing apparatus 10 can reduce excessive feedback to the gesture in the region where a high moving speed is allowed (for example, the central region AR1). On the other hand, the information processing apparatus 10 can provide highly sensitive feedback to the gesture in the region where a high moving speed is not allowed (for example, the inner edge region AR2). As a result, the information processing apparatus 10 can reduce the possibility that the gesture is performed outside the detectable range AR without giving the user stress due to excessive feedback.

(4) Feedback based on estimation result The output control unit 164 may provide feedback based on the estimation result of whether or not the gesture will be performed outside the detectable range AR. For example, the guessing unit 165 of the control unit 16 determines that the input operation of the gesture of the user U is outside the detectable range AR based on the information on the position of the hand H of the user U performing the gesture and the information on the moving speed of the hand H. Guess if it will be done in.

For example, assume that the gesture that user U is trying to input is a swipe. At this time, the guessing unit 165 estimates whether or not the swipe end position is outside the detectable range AR from the swipe start position and the movement speed of the user's hand H. Then, when it is presumed that the input operation of the gesture will be performed outside the detectable range AR, the output control unit 164 gives predetermined feedback to the user U for warning. The predetermined feedback may be performed independently of the feedback based on the speed information or the position information described in the above (1) to (3).

By giving feedback to the user based on the estimation result, the possibility that the gesture is performed outside the detectable range AR is further reduced.

Next, the gesture detection unit 162 of the control unit 16 determines whether or not the gesture has been detected (step S104). For example, the gesture detection unit 162 determines whether or not the first operation is detected in the detectable range AR and then the second operation is detected in the detectable range AR. In addition, "detection" in the detection of a gesture is a "detection" in a broad sense including recognition of a gesture. When the gesture is not detected (step S104: No), the gesture detection unit 162 returns the process to step S101.

On the other hand, when a gesture is detected (step S104: Yes), the command execution unit 163 of the control unit 16 executes a command corresponding to the detected gesture (step S105). For example, the command execution unit 163 executes the function of the information processing apparatus 10 associated with the detected gesture.

When the command execution is completed, the control unit 16 returns the process to step S101 and executes the processes of steps S101 to S105 again.

According to this embodiment, since feedback is given to the user U based on the information of the gesture input speed, the user U can improve the gesture input accuracy based on the feedback. As a result, the gesture detection accuracy of the information processing apparatus 10 becomes high, so that the information processing apparatus 10 can realize high usability.

<< 3. Embodiment 2 >>
In the first embodiment, the gesture input to the information processing apparatus 10 is one gesture at a time, but the information processing apparatus 10 may be configured to be capable of continuously inputting gestures. For example, the information processing apparatus 10 may be configured so that the user can continuously input the second operation after executing the first operation. For example, to explain the gesture related to "Vol +" as an example, the information processing apparatus 10 may be configured so that the user can continuously input the upper swipe after executing the swing-up operation.

In the following description, the gesture that can be continuously input is a gesture associated with a function with an operation amount (for example, a sound raising amount or a sound lowering amount) such as "Vol + / Vol-". Then, it is assumed that the operation amount of the function is associated with the moving speed of the hand H of the user U who performs the gesture.

Hereinafter, the information processing apparatus 10 of the second embodiment will be described. Since the functional block configuration of the information processing apparatus 10 of the second embodiment is the same as that of the first embodiment, the description thereof will be omitted.

<3-1. Information processing device operation>
Hereinafter, the operation of the information processing apparatus 10 according to the second embodiment will be described.

FIG. 18 is a flowchart showing a command execution process according to the present embodiment. The command execution process is executed by the control unit 16 of the information processing apparatus 10. The command execution process is started, for example, when the information processing apparatus 10 is turned on.

First, the acquisition unit 161 of the control unit 16 acquires the sensor value from the input detection unit 11 and the state detection unit 12 (step S201). For example, the acquisition unit 161 may acquire information about an object in the detection region OR from a non-contact type sensor such as a proximity sensor. Further, the acquisition unit 161 may acquire information regarding contact with the housing surface from a contact-type sensor such as a touch sensor. Further, the acquisition unit 161 may acquire information regarding the state of the information processing device 10 from sensors such as an acceleration sensor, a gyro sensor, and a geomagnetic sensor.

Subsequently, the acquisition unit 161 acquires the information of the first moving speed based on the sensor value acquired in step S201 (step S202). The information of the first movement speed is the information of the movement speed of the hand H of the user U performing the first gesture (second operation) of the continuous input of the gesture that can be continuously input. The first movement speed information may be information on the movement speed of the hand H of the user U who is performing a gesture that cannot be continuously input. Here, the output control unit 164 of the control unit 16 may provide feedback to the user U based on the information of the first movement speed.

Next, the gesture detection unit 162 of the control unit 16 determines whether or not the gesture has been detected (step S203). For example, the gesture detection unit 162 determines whether or not the first operation is detected in the detectable range AR and then the second operation is detected in the detectable range AR. When the gesture is not detected (step S203: No), the gesture detection unit 162 returns the process to step S201.

On the other hand, when a gesture is detected (step S203: Yes), the command execution unit 163 of the control unit 16 executes a command corresponding to the detected gesture (step S204). For example, the command execution unit 163 executes the function of the information processing apparatus 10 associated with the detected gesture.

Next, the command execution unit 163 determines whether or not the conditions for accepting continuous input of gestures are satisfied (step S205). For example, the gesture detection unit 162 determines whether the gesture detected in step S203 is a gesture capable of continuous input. Alternatively, if the gesture capable of continuous input has a predetermined number of continuous inputs, the gesture detection unit 162 determines whether the number of continuous inputs of the user U's gesture exceeds the predetermined number of continuous inputs.

The acceptance condition may be based on the estimation result of whether or not the gesture input operation after the second continuous input is performed outside the detectable range. For example, the guessing unit 165 of the control unit 16 inputs the predetermined gesture for the second continuous input based on the information of the position and the movement speed of the hand of the user U performing the predetermined gesture for the first continuous input. Guess whether the action will be performed outside the gesture's detectable range AR. Then, when it is presumed that the input operation of the gesture for the second continuous input is performed outside the detectable range AR, the command execution unit 163 determines that the reception condition is not satisfied, and the continuous input 2 The command related to the second gesture may not be executed. As a result, it is possible to prevent erroneous detection of an operation that is not intended for continuous input as continuous input.

If the reception condition is not satisfied (step S205: No), the gesture detection unit 162 returns the process to step S201.

On the other hand, when the reception condition is satisfied (step S205: Yes), the acquisition unit 161 acquires the sensor value from the input detection unit 11 and the state detection unit 12 (step S206). Then, the acquisition unit 161 acquires the information of the second moving speed based on the sensor value acquired in step S205 (step S207). The information on the second movement speed is the information on the movement speed of the hand H of the user U who is performing the gesture (second operation) after the second continuous input of the gesture that can be continuously input.

Next, the output control unit 164 performs output control regarding feedback when the second and subsequent gestures of continuous input are performed based on the information of the first movement speed and the information of the second movement speed (step). S208). For example, the output control unit 164 performs output control regarding feedback when the second and subsequent gestures of continuous input are performed based on the comparison result between the first movement speed and the second movement speed. More specifically, when the second movement speed is separated from the first movement speed by a predetermined speed or more, the output control unit 164 gives feedback to the second gesture of continuous input to the first gesture of continuous input. Change from feedback to. The feedback may be sound or vibration.

Next, the gesture detection unit 162 determines whether or not the gesture has been detected (step S209). For example, the gesture detection unit 162 determines whether or not the first operation is detected in the detectable range AR and then the second operation is detected in the detectable range AR. When the gesture is not detected (step S209: No), the gesture detection unit 162 returns the process to step S205.

On the other hand, when a gesture is detected (step S209: Yes), the command execution unit 163 of the control unit 16 executes a command corresponding to the detected gesture (step S210). For example, the command execution unit 163 executes the function of the information processing apparatus 10 associated with the detected gesture.

When the command execution is completed, the control unit 16 returns the process to step S205.

According to the present embodiment, the information processing apparatus 10 performs output control regarding feedback based on the comparison result between the first moving speed and the second moving speed, so that the user can perform the second and subsequent continuous inputs. It is easy to understand how much the input speed of the gesture of is faster or slower than the input speed of the first continuous input gesture. When the operation amount of the function is associated with the movement speed, the user U can grasp the input speed of the second and subsequent gestures corresponding to the desired operation amount from the comparison with the first time. As a result, the user U can perform a desired input with a small number of continuous operations, such as being able to raise the volume at once.

<< 4. Embodiment 3 >>
In the first and second embodiments, the information processing apparatus 10 detects the movement of the user's hand H and executes a command. However, the device for detecting the movement of the user's hand H and the device for executing the command may be performed by different devices. Hereinafter, the information processing system 1 of the third embodiment will be described.

<4-1. Information processing system configuration>
FIG. 19 is a diagram showing a configuration example of the information processing system 1. The information processing system 1 is a system that executes various functions based on the gesture of the user. As shown in FIG. 19, the information processing system 1 includes an output device 20 and a terminal device 30. In the example of FIG. 19, the information processing system 1 includes an output device 20A and an output device 20B. In the example of FIG. 19, the output device 20 and the terminal device 30 are wirelessly connected, but the output device 20 and the terminal device 30 may be configured to be connectable by wire.

The information processing system 1 may be provided with only one output device 20 or may be provided with a plurality of output devices 20. For example, assuming that the output device 20 is an earphone, the information processing system 1 may include a pair of output devices 20 that are wirelessly connected to the terminal device 30 and are attached to the left and right ears of the user U, respectively. As an example, the output device 20A is an earphone worn on the left ear of the user U, and the output device 20B is an earphone worn on the right ear of the user U.

Note that one output device 20 does not necessarily have to be one integrated device. It is also possible to regard a plurality of separate devices that are functionally or practically related as one output device 20. For example, a pair of left and right earphones worn on the left and right ears of the user U may be regarded as one output device 20. Of course, one output device 20 may be one integrated earphone worn on one ear of the user U, or one integrated headphone worn on the left and right ears of the user U. good.

<4-2. Output device configuration>
First, the configuration of the output device 20 will be described.

The output device 20 is an acoustic output device that can be worn by a user such as earphones and headphones. The information processing device 10 may be a display device such as AR glass or MR glass that can be worn by the user. In the present embodiment, the output device 20 is a device that can be worn by the user U, and is provided with a portion located at least in the ear of the user U when worn. Then, at least a detection unit for detecting an object is arranged in this portion. Here, the detection unit is a functional block corresponding to the input detection unit 11 when the first embodiment is described as an example. If there are two left and right parts located in the ears of the user U, each of both parts may have a detection unit, or only one part may have a detection part.

FIG. 20 is a diagram showing a configuration example of the output device 20 according to the embodiment of the present disclosure. The output device 20 includes an input detection unit 21, a state detection unit 22, an output unit 23, a communication unit 24, and a control unit 26. The configuration shown in FIG. 20 is a functional configuration, and the hardware configuration may be different from this. Further, the functions of the output device 20 may be distributed and implemented in a plurality of physically separated configurations.

The input detection unit 21 is a detection unit that detects a user's input operation. The state detection unit 22 is a sensor unit that detects the state of the output device 20. The output unit 23 is an output interface that outputs information to the user. The communication unit 24 is a communication interface for communicating with other devices such as the terminal device 30. The control unit 26 is a controller that controls each unit of the output device 20.

In addition, the input detection unit 21, the state detection unit 22, the output unit 23, the communication unit 24, and the control unit 26 are configured by the input detection unit 11, the state detection unit 12, the output unit 13, and the communication unit included in the information processing device 10. The configuration is the same as that of the control unit 16 and the control unit 16. In this case, the description of the information processing device 10 may be replaced with the output device 20 as appropriate.

<4-3. Terminal device configuration>
Next, the configuration of the terminal device 30 will be described.

The terminal device 30 is an information processing terminal capable of communicating with the output device 20. The terminal device 30 is a kind of information processing device of the present embodiment. The terminal device 30 is, for example, a mobile phone, a smart device (smartphone or tablet), a PDA (Personal Digital Assistant), or a personal computer. Further, the terminal device 30 may be a device such as a commercial camera equipped with a communication function, or may be a mobile body equipped with a communication device such as an FPU (Field Pickup Unit). Further, the terminal device 30 may be an M2M (Machine to Machine) device or an IoT (Internet of Things) device. The terminal device 30 controls the output device 20 from the outside of the output device 20 via a wire or wirelessly.

FIG. 21 is a diagram showing a configuration example of the terminal device 30 according to the embodiment of the present disclosure. The terminal device 30 includes an input unit 31, a state detection unit 32, an output unit 33, a communication unit 34, a storage unit 35, and a control unit 36. The configuration shown in FIG. 21 is a functional configuration, and the hardware configuration may be different from this. Further, the functions of the terminal device 30 may be distributed and implemented in a plurality of physically separated configurations.

The input unit 31 is an input interface that accepts user input operations. For example, the input unit 31 is a button or a touch panel. The state detection unit 32 is a sensor unit that detects the state of the terminal device 30. The output unit 33 is an output interface that outputs information to the user. The communication unit 34 is a communication interface for communicating with other devices such as the output device 20. The storage unit 35 is a storage device capable of reading and writing data. The storage unit 35 stores, for example, information about the detectable range AR of the gesture. The control unit 36 is a controller that controls each unit of the terminal device 30. The control unit 36 includes an acquisition unit 361, a gesture detection unit 362, a command execution unit 363, an output control unit 364, and a guessing unit 365.

In addition, the input detection unit 21, the state detection unit 22, the output unit 23, the communication unit 24, and the control unit 26 are configured by the input detection unit 11, the state detection unit 12, the output unit 13, and the communication unit included in the information processing device 10. The configuration is the same as that of the control unit 16 and the control unit 16. Further, in the configuration of the acquisition unit 361, the gesture detection unit 362, the command execution unit 363, the output control unit 364, and the guessing unit 365, the acquisition unit 361 acquires information from the input detection unit 21 and the state detection unit 22 via communication. The configuration is the same as that of the acquisition unit 161, the gesture detection unit 162, the command execution unit 163, the output control unit 164, and the guessing unit 165 included in the control unit 16 of the information processing apparatus 10. In this case, the description of the information processing device 10 may be appropriately replaced with the output device 20 or the terminal device 30.

<4-4. Information processing system operation>
The configuration of the information processing system 1 has been described above, but next, the operation of the information processing apparatus 10 having such a configuration will be described.

(Command execution process 1)
The information processing system 1 can execute a command execution process in the same manner as the information processing apparatus 10 of the first embodiment. The command execution process of the information processing system 1 is the same as the command execution process of the first embodiment except that the terminal device 30 acquires the sensor value from the output device 20 via communication. Hereinafter, as in the first embodiment, the command execution process will be described with reference to FIG.

FIG. 15 is a flowchart showing a command execution process according to the present embodiment. The command execution process is executed by the control unit 36 of the terminal device 30. The command execution process is executed, for example, when the terminal device 30 establishes communication with the output device 20.

First, the acquisition unit 361 of the control unit 36 acquires the sensor value from the input detection unit 21 and the state detection unit 22 of the output device 20 via the communication unit 34 (step S101). For example, the acquisition unit 361 acquires information about an object in the detection region OR from a non-contact type sensor such as a proximity sensor. Further, the acquisition unit 361 acquires information regarding contact with the housing surface from a contact-type sensor such as a touch sensor. Further, the acquisition unit 361 may acquire information regarding the state of the output device 20 from sensors such as an acceleration sensor, a gyro sensor, and a geomagnetic sensor.

Subsequently, the acquisition unit 361 acquires information regarding the input speed of the user's gesture performed in the detection area OR based on the sensor value acquired in step S101 (step S102). For example, the acquisition unit 361 acquires information on the movement speed of the user U's hand in the detection area OR based on the sensor value from the input detection unit 11. In addition to the information regarding the input speed, the acquisition unit 361 may acquire information indicating the position of the hand H of the user U who is performing the gesture in the detection area OR.

Note that the control unit 36 may change at least one of the position, size, and shape of the detectable range AR so that the user U can perform an appropriate input operation when acquiring information on the input speed. For example, the control unit 36 may change the position, size, and shape of the detectable range AR based on the information acquired from the input detection unit 21 or the state detection unit 22.

The output control unit 364 of the control unit 36 performs output control regarding feedback to the user U (step S103). For example, the output control unit 164 performs output control regarding feedback to the user U based on the information regarding the input speed. The feedback may be sound or vibration.

Here, the output control unit 364 may control the output unit 33 included in the terminal device 30 to provide feedback, or may control the output unit 23 included in the output device 20 to provide feedback. The concept of output control also includes control that causes another device to output a predetermined output via communication.

Further, the output control unit 164 may provide feedback according to the position of the hand H of the user U. Further, the output control unit 164 may provide feedback according to the moving speed of the hand H of the user U and its position. Further, the output control unit 164 may provide feedback based on the estimation result of whether or not the gesture will be performed outside the detectable range AR.

Next, the gesture detection unit 362 of the control unit 36 determines whether or not the gesture has been detected (step S104). When the gesture is not detected (step S104: No), the gesture detection unit 362 returns the process to step S101.

On the other hand, when a gesture is detected (step S104: Yes), the command execution unit 363 of the control unit 36 executes a command corresponding to the detected gesture (step S105). For example, the command execution unit 363 executes the function of the output device 20 associated with the detected gesture.

When the command execution is completed, the control unit 36 returns the process to step S101 and executes the processes of steps S101 to S105 again.

Also in this embodiment, since feedback is given to the user U based on the gesture input speed, the user U can improve the gesture input accuracy based on the feedback. As a result, the gesture detection accuracy of the terminal device 30 is increased, so that the information processing system 1 can realize high usability.

(Command execution process 2)
The information processing system 1 can also execute the command execution process of the second embodiment. The command execution process of the information processing system 1 is the same as the command execution process of the second embodiment except that the terminal device 30 acquires the sensor value from the output device 20 via communication. Hereinafter, as in the second embodiment, the command execution process will be described with reference to FIG.

FIG. 18 is a flowchart showing a command execution process according to the present embodiment. The command execution process is executed by the control unit 36 of the terminal device 30. The command execution process is executed, for example, when the terminal device 30 establishes communication with the output device 20.

First, the acquisition unit 361 of the control unit 36 acquires the sensor value from the input detection unit 11 and the state detection unit 12 (step S201). For example, the acquisition unit 361 may acquire information about an object in the detection region OR from a non-contact type sensor such as a proximity sensor. Further, the acquisition unit 361 may acquire information regarding contact with the housing surface from a contact-type sensor such as a touch sensor. Further, the acquisition unit 361 may acquire information regarding the state of the output device 20 from sensors such as an acceleration sensor, a gyro sensor, and a geomagnetic sensor.

Subsequently, the acquisition unit 361 acquires the information of the first moving speed based on the sensor value acquired in step S201 (step S202). Here, the output control unit 364 of the control unit 36 may provide feedback to the user U based on the information of the first movement speed.

Next, the gesture detection unit 362 of the control unit 36 determines whether or not the gesture has been detected (step S203). When the gesture is not detected (step S203: No), the gesture detection unit 362 returns the process to step S201.

On the other hand, when a gesture is detected (step S203: Yes), the command execution unit 363 of the control unit 36 executes the command corresponding to the detected gesture (step S204). For example, the command execution unit 363 executes the function of the output device 20 associated with the detected gesture.

Next, the command execution unit 363 determines whether or not the conditions for accepting continuous input of gestures are satisfied (step S205). Here, the acceptance condition may be based on the estimation result of whether or not the gesture input operation after the second continuous input is performed outside the detectable range.

If the reception condition is not satisfied (step S205: No), the gesture detection unit 362 returns the process to step S201.

On the other hand, when the reception condition is satisfied (step S205: Yes), the acquisition unit 361 acquires the sensor value from the input detection unit 11 and the state detection unit 12 (step S206). Then, the acquisition unit 361 acquires the information of the second moving speed based on the sensor value acquired in step S205 (step S207).

Next, the output control unit 364 performs output control regarding feedback when the second and subsequent gestures of continuous input are performed based on the information of the first movement speed and the information of the second movement speed (step). S209). For example, the output control unit 364 controls the output regarding the feedback when the gesture after the second continuous input is performed, based on the comparison result between the first movement speed and the second movement speed.

The output control unit 364 may control the output unit 33 included in the terminal device 30 or the output unit 23 included in the output device 20 when giving feedback. The feedback may be sound or vibration.

Next, the gesture detection unit 362 determines whether or not the gesture has been detected (step S209). When the gesture is not detected (step S209: No), the gesture detection unit 362 returns the process to step S205.

On the other hand, when a gesture is detected (step S209: Yes), the command execution unit 363 of the control unit 36 executes a command corresponding to the detected gesture (step S210). For example, the command execution unit 363 executes the function of the output device 20 associated with the detected gesture.

When the command execution is completed, the control unit 36 returns the process to step S205.

According to the present embodiment, since the terminal device 30 performs output control regarding feedback based on the comparison result between the first moving speed and the second moving speed, the user U raises the volume at once. It becomes possible to perform desired input with a small number of continuous operations.

<< 5. Modification example >>
Each of the above embodiments shows an example, and various modifications and applications are possible.

(Variation example of feedback processing)
In the above-described embodiment, the information regarding the input speed of the gesture of the user U is assumed to be the information of the moving speed of the hand H of the user U performing the gesture. However, the information regarding the input speed is not limited to the information on the movement speed of the hand H of the user U. For example, the information regarding the input speed may be the time required for the user U to input the gesture.

For example, suppose one gesture consists of a first movement and a subsequent second movement. In this case, the information processing apparatus 10 according to the first and second embodiments may acquire information on the time required from the detection of the first operation to the end of the second operation as information on the input speed. .. Then, the information processing apparatus 10 may perform output control regarding feedback to the user U based on this time information. In this case, the information processing apparatus 10 may give feedback immediately after the gesture of the user U is completed (that is, immediately after the second operation is completed).

Similarly, the terminal device 30 according to the third embodiment may acquire information on the time required from the detection of the first operation to the end of the second operation as information on the input speed. Then, the terminal device 30 may perform output control regarding feedback to the user U based on this time information. In this case, the terminal device 30 may give feedback immediately after the gesture of the user U is completed (that is, immediately after the second operation is completed).

Even in this modification, the user U can improve the gesture input accuracy based on the feedback. As a result, the gesture detection accuracy of the information processing apparatus 10 becomes high, so that the information processing apparatus 10 can realize high usability.

(Modified example of feedback means)
In the first and second embodiments, the feedback provided by the information processing apparatus 10 to the user U is sound or vibration, but the feedback is not limited to sound. The feedback may be an output to a display device or an output to a blinking device. At this time, the information processing device 10 may output the feedback by itself, or may have another device connected via communication perform the feedback output.

Further, in the third embodiment, the feedback provided by the terminal device 30 to the user U is sound or vibration, but the feedback is not limited to sound. The feedback may be an output to a display device or an output to a blinking device. At this time, the device that outputs the feedback may be the terminal device 30, or the output device 20 connected to the terminal device 30. The terminal device 30 may cause a device other than the terminal device 30 and the output device 20 to perform feedback output.

(Variation example of changing feedback)
In the above embodiment, as an example, the detectable range AR is divided into two regions, a central region AR1 and an inner edge region AR2. However, the detectable range AR may be divided into more than two regions. For example, the detectable range AR is divided into a region located near the center of the detectable range AR and a plurality of regions stacked toward the edge of the detectable range AR so as to surround the central region. You may. Then, the information processing apparatus 10 or the terminal apparatus 30 may set a predetermined threshold value _Vth for changing the feedback to a different value in each of the plurality of regions including the central region. Specifically, the information processing apparatus 10 or the terminal apparatus 30 may have a value in which the _{predetermined threshold value Vth becomes smaller toward the outer region.} This allows for more detailed feedback.

(Modification example related to operation amount)
The functions of the information processing apparatus 10 of the first and second embodiments may include a predetermined function accompanied by an operation amount. At this time, the predetermined function accompanied by the operation amount may be a function related to the volume operation (Vol + / Vol−) or a function related to the reproduction speed. Further, the predetermined function accompanied by the operation amount is not limited to these, and may be, for example, a function related to fast forward, rewind, and slow playback. A gesture with a movement width, such as a swipe, may be associated with a predetermined function. Then, the information processing apparatus 10 may determine the operation amount of a predetermined function (for example, the amount of sound to be raised or lowered) based on the information of the movement speed of the hand H of the user U when inputting the gesture.

Similarly, the function of the terminal device 30 of the third embodiment may include a predetermined function accompanied by an operation amount. Then, a gesture with a movement width such as a swipe may be associated with the predetermined function. Then, the terminal device 30 may determine the operation amount (for example, the amount of raising / lowering sound) of a predetermined function based on the information of the movement speed of the hand H of the user U when inputting the gesture.

This makes it possible to input the operation amount with one gesture, so that the usability of the information processing device 10 or the terminal device 30 is improved.

(Modified example of device mode)
In the above-described embodiment, the information processing device 10 and the output device 20 are devices that can be worn by the user (wearable devices), but are not necessarily wearable devices. For example, the information processing device 10 and the output device 20 may be devices installed and used in a structure or a moving body such as a television, a car navigation system, a driver's cab, and various operation panels. Further, the information processing device 10 and the output device 20 may be the mobile body itself.

Here, the mobile body may be a mobile terminal such as a smartphone, a mobile phone, a personal computer, a music player, or a portable TV, or may be a remote controller for operating a device. Further, the moving body may be a moving body moving on land (for example, a vehicle such as a car, a bicycle, a bus, a truck, a motorcycle, a train, a linear motor car, etc.) or in the ground (for example, in a tunnel). It may be a moving body (for example, a subway) that moves around. Further, the moving body may be a moving body moving on the water (for example, a ship such as a passenger ship, a cargo ship, a hovercraft, etc.), or a moving body moving underwater (for example, a submersible, a submarine, an unmanned submarine, etc.). It may be a submarine). Further, the moving body may be a moving body moving in the atmosphere (for example, an aircraft such as an airplane, an airship, or a drone), or a moving body moving outside the atmosphere (for example, an artificial celestial body such as a space station). There may be.

The structure is, for example, a high-rise building, a house, a steel tower, a station facility, an airport facility, a port facility, a stadium, or the like. The concept of structure includes not only buildings but also structures such as tunnels, bridges, dams, walls and iron pillars, and equipment such as cranes, gates and windmills. Further, the concept of a structure includes not only a structure on land or in the ground, but also a structure on water such as a pier and a mega float, and a structure underwater such as an ocean observation facility.

(Other variants)
In the above-described embodiment, the information processing device 10 and the output device 20 are devices that can be worn by the user (wearable devices), but are not necessarily wearable devices. For example, the information processing device 10 may be a device installed and used in a structure or a moving body.

Further, the control device for controlling the information processing device 10, the output device 20, or the terminal device 30 of the present embodiment may be realized by a dedicated computer system or a general-purpose computer system.

For example, a communication program for executing the above operation is stored and distributed in a computer-readable recording medium such as an optical disk, a semiconductor memory, a magnetic tape, or a flexible disk. Then, for example, the control device is configured by installing the program in a computer and executing the above-mentioned processing. At this time, the control device may be an information processing device 10, an output device 20, or an external device (for example, a personal computer) of the terminal device 30. Further, the control device may be an internal device (for example, control unit 16, control unit 26, or control unit 36) of the information processing device 10, the output device 20, or the terminal device 30.

Further, the above communication program may be stored in a disk device provided in a server device on a network such as the Internet so that it can be downloaded to a computer or the like. Further, the above-mentioned functions may be realized by the collaboration between the OS (Operating System) and the application software. In this case, the part other than the OS may be stored in a medium and distributed, or the part other than the OS may be stored in the server device so that it can be downloaded to a computer or the like.

Further, among the processes described in the above-described embodiment, all or a part of the processes described as being automatically performed can be manually performed, or the processes described as being manually performed can be performed. All or part of it can be done automatically by a known method. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown in the figure.

Further, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of them may be functionally or physically distributed / physically in arbitrary units according to various loads and usage conditions. Can be integrated and configured.

Further, the above-described embodiments can be appropriately combined in a region where the processing contents do not contradict each other. Further, the order of each step shown in the flowchart of the above-described embodiment can be changed as appropriate.

Further, for example, the present embodiment includes a device or any configuration constituting the system, for example, a processor as a system LSI (Large Scale Integration), a module using a plurality of processors, a unit using a plurality of modules, and a unit. It can also be implemented as a set or the like with other functions added (that is, a configuration of a part of the device).

In the present embodiment, the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a device in which a plurality of modules are housed in one housing are both systems. ..

Further, for example, the present embodiment can have a cloud computing configuration in which one function is shared by a plurality of devices via a network and jointly processed.

<< 6. Conclusion >>
As described above, according to one embodiment of the present disclosure, the information processing device 10 or the terminal device 30 provides feedback to the user U based on the input speed of the gesture of the user U. Therefore, the user U can improve the input accuracy of the gesture based on the feedback. As a result, the gesture detection accuracy of the information processing apparatus 10 becomes high, so that the information processing apparatus 10 can realize high usability.

Although each embodiment of the present disclosure has been described above, the technical scope of the present disclosure is not limited to the above-mentioned embodiments as they are, and various changes can be made without departing from the gist of the present disclosure. be. In addition, components spanning different embodiments and modifications may be combined as appropriate.

Further, the effects in each embodiment described in the present specification are merely examples and are not limited, and other effects may be obtained.

The present technology can also have the following configurations.
(1)
An acquisition unit that acquires information about the input speed of the user's gesture performed in the detection area of the detection unit that detects an object, and an acquisition unit.
An output control unit that controls output related to feedback to the user based on the information related to the input speed.
Information processing device equipped with.
(2)
The acquisition unit acquires information on the movement speed of the hand of the user performing the gesture, and obtains information on the movement speed of the user's hand.
The output control unit performs output control related to the feedback based on the information of the movement speed.
The information processing apparatus according to (1) above.
(3)
The output control unit provides the feedback in real time.
The information processing device according to (2) above.
(4)
The output control unit changes the feedback to the user according to the moving speed of the user's hand.
The information processing apparatus according to (2) or (3) above.
(5)
The output control unit changes the feedback depending on whether or not the moving speed exceeds a predetermined threshold value.
The information processing apparatus according to (4) above.
(6)
The output control unit provides first feedback as the feedback when the movement speed does not exceed the predetermined threshold value, and when the movement speed exceeds the predetermined threshold value, the first feedback is performed. Give a second feedback that is different from the first feedback,
The information processing apparatus according to (5) above.
(7)
The output control unit does not give the feedback when the moving speed does not exceed the predetermined threshold value, and gives the feedback when the moving speed exceeds the predetermined threshold value.
The information processing apparatus according to (5) above.
(8)
The output control unit
When the moving speed does not exceed the first threshold value as the predetermined threshold value, the first feedback is given as the feedback.
When the moving speed exceeds the first threshold value and does not exceed the second threshold value larger than the first threshold value, a second feedback different from the first feedback is performed.
When the moving speed exceeds the second threshold value, a third feedback different from the second feedback is given.
The information processing apparatus according to (5) above.
(9)
The acquisition unit acquires information indicating the position of the hand of the user performing the gesture, and obtains information indicating the position of the hand of the user.
The output control unit changes the predetermined threshold value according to the position of the user's hand.
The information processing apparatus according to any one of (5) to (8).
(10)
The output control unit changes the predetermined threshold value depending on whether the position of the user's hand is in the central region of the detectable range of the gesture or in the inner edge region of the detectable range.
The information processing apparatus according to (9) above.
(11)
A guessing unit that estimates whether or not the input operation of the gesture of the user will be performed outside the detectable range of the gesture based on the information of the position and the moving speed of the hand of the user performing the gesture. Equipped with
The output control unit provides predetermined feedback to the user when it is presumed that the input operation of the gesture of the user will be performed outside the detectable range.
The information processing apparatus according to any one of (1) to (10).
(12)
The gesture includes a predetermined gesture that can be continuously input.
The acquisition unit performs information on a first movement speed indicating the movement speed of the user's hand performing the predetermined gesture for the first continuous input, and the predetermined gesture for the second continuous input. The information of the second movement speed indicating the movement speed of the user's hand and the information of the second movement speed are acquired respectively.
The output control unit performs output control regarding feedback when the predetermined gesture of the second continuous input is performed, based on the comparison result between the second moving speed and the first moving speed.
The information processing apparatus according to any one of (1) to (11).
(13)
When the second moving speed is separated from the first moving speed by a predetermined speed or more, the output control unit gives feedback to the predetermined gesture of the second continuous input for the first continuous input. Change from the feedback for the given gesture,
The information processing apparatus according to (12) above.
(14)
When the gesture is detected, an execution unit that executes a function associated with the gesture, and an execution unit.
Based on the information on the position and movement speed of the user's hand performing the predetermined gesture of the first continuous input, the input operation of the predetermined gesture of the second continuous input is outside the detectable range of the gesture. Equipped with a guessing part to guess whether or not it will be done,
When it is presumed that the input operation of the predetermined gesture for the second continuous input is performed outside the detectable range, the execution unit performs the function related to the predetermined gesture for the second continuous input. Do not execute
The information processing apparatus according to (12) or (13).
(15)
The acquisition unit acquires information indicating the position of the hand of the user performing the gesture, and obtains information indicating the position of the hand of the user.
The output control unit constantly provides the feedback while the position of the user's hand performing the gesture is within the detectable range of the gesture.
The information processing apparatus according to any one of (1) to (14).
(16)
The predetermined device including the detection unit is a device capable of outputting sound, which is attached to a portion of the user's body that cannot be visually recognized by the user.
The output control unit controls the sound output of the predetermined device as the output control related to the feedback.
The information processing apparatus according to any one of (1) to (15).
(17)
The output control unit changes the output mode of the sound based on the information regarding the input speed.
The information processing apparatus according to (16) above.
(18)
The device for detecting the gesture is a headphone or an earphone.
The information processing apparatus according to (16) or (17).
(19)
The information processing device is a predetermined device provided with the detection unit, or a device that controls the predetermined device from the outside of the predetermined device via wire or wirelessly.
The information processing apparatus according to any one of (1) to (18).
(20)
Acquires information about the input speed of the user's gesture performed in the detection area of the detection unit that detects the object.
Output control regarding feedback to the user is performed based on the information regarding the input speed.
Information processing method.
(21)
Computer,
An acquisition unit that acquires information about the input speed of the user's gesture performed in the detection area of the detection unit that detects an object,
An output control unit that controls output regarding feedback to the user based on the information regarding the input speed.
An information processing program to function as.

1 Information processing system 10 Information processing device 10A Headphone 10B Earphone 11, 21

Input detection unit

12, 22, 32

State detection unit

13, 23, 33 Output unit 14, 24, 34 Communication unit 15, 35

Storage unit

16, 26, 36

Control unit

20, 20A, 20B Output device 30 Terminal device 31 Input unit 161, 361

Acquisition unit

162, 362

Gesture detection unit

163, 363 Command execution unit 164, 364

Output control unit

165, 365 Guessing unit OR Detection area AR Detectable range AR1 central area AR2 inner edge area U user H hand

Claims

An acquisition unit that acquires information about the input speed of the user's gesture performed in the detection area of the detection unit that detects an object, and an acquisition unit.
An output control unit that controls output related to feedback to the user based on the information related to the input speed.
Information processing device equipped with.
The acquisition unit acquires information on the movement speed of the hand of the user performing the gesture, and obtains information on the movement speed of the user's hand.
The output control unit performs output control related to the feedback based on the information of the movement speed.
The information processing apparatus according to claim 1.
The output control unit provides the feedback in real time.
The information processing apparatus according to claim 2.
The output control unit changes the feedback to the user according to the moving speed of the user's hand.
The information processing apparatus according to claim 2.
The output control unit changes the feedback depending on whether or not the moving speed exceeds a predetermined threshold value.
The information processing apparatus according to claim 4.
The output control unit provides first feedback as the feedback when the movement speed does not exceed the predetermined threshold value, and when the movement speed exceeds the predetermined threshold value, the first feedback is performed. Give a second feedback that is different from the first feedback,
The information processing apparatus according to claim 5.
The output control unit does not give the feedback when the moving speed does not exceed the predetermined threshold value, and gives the feedback when the moving speed exceeds the predetermined threshold value.
The information processing apparatus according to claim 5.
The output control unit
When the moving speed does not exceed the first threshold value as the predetermined threshold value, the first feedback is given as the feedback.
When the moving speed exceeds the first threshold value and does not exceed the second threshold value larger than the first threshold value, a second feedback different from the first feedback is performed.
When the moving speed exceeds the second threshold value, a third feedback different from the second feedback is given.
The information processing apparatus according to claim 5.
The acquisition unit acquires information indicating the position of the hand of the user performing the gesture, and obtains information indicating the position of the hand of the user.
The output control unit changes the predetermined threshold value according to the position of the user's hand.
The information processing apparatus according to claim 5.
The output control unit changes the predetermined threshold value depending on whether the position of the user's hand is in the central region of the detectable range of the gesture or in the inner edge region of the detectable range.
The information processing apparatus according to claim 9.
A guessing unit that estimates whether or not the input operation of the gesture of the user will be performed outside the detectable range of the gesture based on the information of the position and the moving speed of the hand of the user performing the gesture. Equipped with
The output control unit provides predetermined feedback to the user when it is presumed that the input operation of the gesture of the user will be performed outside the detectable range.
The information processing apparatus according to claim 1.
The gesture includes a predetermined gesture that can be continuously input.
The acquisition unit performs information on a first movement speed indicating the movement speed of the user's hand performing the predetermined gesture for the first continuous input, and the predetermined gesture for the second continuous input. The information of the second movement speed indicating the movement speed of the user's hand and the information of the second movement speed are acquired respectively.
The output control unit performs output control regarding feedback when the predetermined gesture of the second continuous input is performed, based on the comparison result between the second moving speed and the first moving speed.
The information processing apparatus according to claim 1.
When the second moving speed is separated from the first moving speed by a predetermined speed or more, the output control unit gives feedback to the predetermined gesture of the second continuous input for the first continuous input. Change from the feedback for the given gesture,
The information processing apparatus according to claim 12.
When the gesture is detected, an execution unit that executes a function associated with the gesture, and an execution unit.
Based on the information on the position and movement speed of the user's hand performing the predetermined gesture of the first continuous input, the input operation of the predetermined gesture of the second continuous input is outside the detectable range of the gesture. Equipped with a guessing part to guess whether or not it will be done,
When it is presumed that the input operation of the predetermined gesture for the second continuous input is performed outside the detectable range, the execution unit performs the function related to the predetermined gesture for the second continuous input. Do not execute
The information processing apparatus according to claim 12.
The acquisition unit acquires information indicating the position of the hand of the user performing the gesture, and obtains information indicating the position of the hand of the user.
The output control unit constantly provides the feedback while the position of the user's hand performing the gesture is within the detectable range of the gesture.
The information processing apparatus according to claim 1.
The predetermined device including the detection unit is a device capable of outputting sound, which is attached to a portion of the user's body that cannot be visually recognized by the user.
The output control unit controls the sound output of the predetermined device as the output control related to the feedback.
The information processing apparatus according to claim 1.
The output control unit changes the output mode of the sound based on the information regarding the input speed.
The information processing apparatus according to claim 16.
The device for detecting the gesture is a headphone or an earphone.
The information processing apparatus according to claim 16.
The information processing device is a predetermined device provided with the detection unit, or a device that controls the predetermined device from the outside of the predetermined device via wire or wirelessly.
The information processing apparatus according to claim 1.
Acquires information about the input speed of the user's gesture performed in the detection area of the detection unit that detects the object.
Output control regarding feedback to the user is performed based on the information regarding the input speed.
Information processing method.