JP2017138698A - Information processing device, information processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique capable of improving the flexibility of an input for executing a command.SOLUTION: In an information processing device, a control part 120 includes a first command acquisition part 124 for acquiring a first command corresponding to the position of an operation body, a second command acquisition part 125 for acquiring a second command corresponding to a voice recognition processing result obtained by voice recognition processing to voice information, and an execution control part 127 for controlling execution by a first control object device of the first command in the case that the first command is acquired, and controlling execution by a second control object device of the second command in the case that the second command is acquired.SELECTED DRAWING: Figure 3

Description

  The present disclosure relates to an information processing apparatus, an information processing method, and a program.

  In recent years, there is an information processing apparatus that performs a desired operation using two types of inputs (see, for example, Patent Document 1). In such an information processing apparatus, input of sound information and input of the position of the operating tool are used as two types of inputs. In such an information processing apparatus, the sound is recognized from the sound information, the position of the operating body is recognized from the image, and the control target device is caused to execute a desired operation by a combination of the sound and the position of the operating body. A command is generated.

JP 2012-103840 A

  However, some commands are suitable to be executed by inputting sound information, and others are suitable to be executed by inputting the position of the operating body. Therefore, it is desired to provide a technique capable of improving the flexibility of input for executing a command.

  According to the present disclosure, the first command acquisition unit that acquires the first command corresponding to the position of the operating tool, and the second command that corresponds to the voice recognition processing result obtained by the voice recognition processing for the sound information. When the second command acquisition unit to acquire and the first command are acquired, the execution of the first command by the first device to be controlled is controlled, and when the second command is acquired, And an execution control unit that controls execution of the second command by a second device to be controlled.

  According to the present disclosure, the first command corresponding to the position of the operating tool is acquired by the computer, and the second command corresponding to the voice recognition processing result obtained by the voice recognition processing for the sound information is acquired. When the first command is acquired, the execution of the first command by the first device to be controlled is controlled, and when the second command is acquired, the second of the second command is controlled. An information processing method is provided, including controlling execution by a device to be controlled.

  According to the present disclosure, the computer uses the first command acquisition unit that acquires the first command according to the position of the operating tool, and the second according to the voice recognition processing result obtained by the voice recognition processing for the sound information. A second command acquisition unit for acquiring the first command, and when the first command is acquired, execution of the first command by the first control target device is controlled, and the second command is acquired. In this case, there is provided a program for causing an information processing apparatus to include an execution control unit that controls execution of the second command by the second control target device.

  As described above, according to the present disclosure, a technique capable of improving the flexibility of input for executing a command is provided. Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

2 is a diagram illustrating a configuration example of a communication system according to an embodiment of the present disclosure. FIG. It is a block diagram which shows the function structural example of the communication system which concerns on the same embodiment. It is a block diagram which shows the detailed functional structural example of a control part. FIG. 25 is a diagram for describing an example of an operation for turning on the television apparatus. FIG. 25 is a diagram for describing an example of an operation for turning on the television apparatus. It is a figure for demonstrating the example of the operation | movement which reproduces | regenerates the program currently recorded on the recorder. It is a figure for demonstrating the example of the operation | movement which reproduces | regenerates the program currently recorded on the recorder. It is a figure for demonstrating the example of the operation | movement which reproduces | regenerates the program currently recorded on the recorder. It is a figure for demonstrating the example of the operation | movement which reproduces | regenerates the program currently recorded on the recorder. It is a figure for demonstrating the example of the operation | movement which reproduces | regenerates the program currently recorded on the recorder. It is a figure for demonstrating the example of the operation | movement which controls an air conditioner. It is a figure for demonstrating the example of the operation | movement which controls an air conditioner. It is a figure for demonstrating the example of the operation | movement which controls an air conditioner. It is a figure for demonstrating the example of the operation | movement which controls an air conditioner. It is a figure for demonstrating the example of the operation | movement which controls a control object apparatus. It is a figure for demonstrating the example of the operation | movement which controls a control object apparatus. It is a figure for demonstrating the example of the operation | movement which controls a control object apparatus. It is a figure for demonstrating the example of the operation | movement which controls the display of a weather forecast. It is a figure for demonstrating the example of the operation | movement which controls the display of a weather forecast. It is a figure for demonstrating the example of the operation | movement which controls the display of a weather forecast. It is a figure for demonstrating the example of the operation | movement which controls the display of a weather forecast. It is a figure for demonstrating the example of the operation | movement which controls the display of a weather forecast. It is a figure for demonstrating the example of the operation | movement which controls the display of a weather forecast. It is a figure for demonstrating the example of the operation | movement which controls the display of the photograph of Kinkakuji. It is a figure for demonstrating the example of the operation | movement which controls the display of the photograph of Kinkakuji. It is a figure for demonstrating the example of the operation | movement which controls the display of the photograph of Kinkakuji. It is a figure for demonstrating the example of the operation | movement which controls the display of a schedule. It is a figure for demonstrating the example of the operation | movement which controls the display of a schedule. It is a figure for demonstrating the example of the operation | movement which controls the display of a schedule. It is a flowchart which shows the flow of operation | movement of information processing apparatus. It is a flowchart which shows the flow of operation | movement of information processing apparatus. It is a block diagram which shows the hardware structural example of information processing apparatus.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  In the present specification and drawings, a plurality of components having substantially the same functional configuration may be distinguished by adding different numerals after the same reference numerals. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given.

The description will be made in the following order.
1. Embodiment of the present disclosure 1.1. System configuration example 1.2. Functional configuration example 1.3. Functional details of communication system 1.4. 1. Hardware configuration example Conclusion

<1. Embodiment of the present disclosure>
[1.1. System configuration example]
First, a configuration example of a communication system according to an embodiment of the present disclosure will be described with reference to the drawings. FIG. 1 is a diagram illustrating a configuration example of a communication system according to an embodiment of the present disclosure. As illustrated in FIG. 1, the communication system according to the present embodiment includes an information processing apparatus 10 and a control target device 20 (control target devices 20-1 to 20-4). The information processing apparatus 10 includes a sound output unit 111, a sound collection unit 151, an imaging unit 112, a distance detection unit 113, and a display unit 161 (a first display unit 161-1 and a second display unit 161-2). ing.

  The information processing apparatus 10 and the control target device 20 can communicate with each other via a communication network. In the information processing apparatus 10, the sound output unit 111, the sound collection unit 151, the imaging unit 112, the distance detection unit 113, and the display unit 161 (the first display unit 161-1 and the second display unit 161-2) Although provided on the same surface in the information processing device 10, the positions where these are provided are not limited (for example, they may be provided on different surfaces in the information processing device 10).

  In FIG. 1, as an example of the control target device 20, a control target device (television device) 20-1, a control target device (recorder) 20-2, a control target device (air conditioner) 20-3, and a control target Although the device (coffee maker) 20-4 is shown, the type and number of the control target devices 20 are not limited. For example, the control target device 20 may be a device that can receive a command from the outside and execute the command.

  In FIG. 1, two projectors are shown as examples of the display unit 161, but the type and number of the display units 161 are not limited. For example, the display unit 161 may be a display capable of performing display visible to the user 80. In the present embodiment, the first display unit 161-1 performs display on a relatively high position (for example, a wall, a television device, etc.), whereas the second display unit 161-2 has a relatively high level. Although an example in which display is performed at a low position (for example, a user's hand) will be described, the position at which the display unit 161 performs display is not limited.

  Further, in the following description, voice (voice or speech) and sound are used separately. That is, the voice (voice or speech) mainly indicates the utterance of the user 80 among the sounds collected by the sound collecting unit 151, whereas the sound (sound) includes the utterance of the user 80, a sound, etc. including.

  The configuration example of the communication system according to the present embodiment has been described above.

[1.2. Functional configuration example]
Subsequently, a functional configuration example of the communication system according to the present embodiment will be described. FIG. 2 is a block diagram illustrating a functional configuration example of the communication system according to the present embodiment. As illustrated in FIG. 2, the communication system includes the information processing apparatus 10, the control target device 20, the external network 30, and a third storage unit 330.

  The external network 30 is configured by the Internet, for example. The third storage unit 330 includes a magnetic storage device, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like. As described above, the control target device 20 may be an air conditioner, a television device, a recorder, and a coffee maker. Further, as illustrated in FIG. 2, the control target device 20 may include a second storage unit 230. The second storage unit 230 includes a magnetic storage device, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.

  The information processing apparatus 10 includes the sound output unit 111, the sound collection unit 151, the imaging unit 112, the distance detection unit 113, and the display unit 161 (the first display unit 161-1 and the second display unit 161-2). In addition, the communication unit 140, the control unit 120, and the first storage unit 130 are provided.

  The sound output unit 111 has a function of outputting sound. For example, the sound output unit 111 includes a speaker and outputs sound through the speaker. The number of speakers included in the sound output unit 111 is not particularly limited as long as it is one or more. And the position where each of the one or more speakers included in the sound output unit 111 is provided is not particularly limited. Note that the sound output unit 111 may include a sound output device other than a speaker as long as it has a function of outputting sound information.

  The sound collection unit 151 has a function of obtaining sound information by collecting sound. For example, the sound collection unit 151 includes a microphone and collects sound information using the microphone. The number of microphones included in the sound collection unit 151 is not particularly limited as long as it is one or more. And the position where each of the one or more microphones included in the sound collection unit 151 is provided is not particularly limited. Note that the sound collection unit 151 may include a sound collection device other than a microphone as long as it has a function of collecting sound information.

  The imaging unit 112 has a function of inputting an image by imaging. For example, the imaging unit 112 includes a camera and inputs an image captured by the camera. The number of cameras included in the imaging unit 112 is not particularly limited as long as it is one or more. Further, the position where each of the one or more cameras included in the imaging unit 112 is provided is not particularly limited. The one or more cameras may include a monocular camera or a stereo camera.

  The distance detection unit 113 has a function of detecting the distance to the user 80. For example, the distance detection unit 113 includes a distance measuring sensor, and acquires the distance to the user 80 detected by the distance measuring sensor. The position where the distance measuring sensor is provided is not particularly limited. Further, the type of distance measuring sensor is not particularly limited. For example, the distance sensor may be an infrared distance sensor or an ultrasonic distance sensor.

  The communication unit 140 has a function of acquiring data from the third storage unit 330 and writing data to the third storage unit 330 via the external network 30. For example, the communication unit 140 is configured by a communication interface. Note that the communication unit 140 may be able to communicate with an apparatus different from the third storage unit 330 via the external network 30 in addition to the third storage unit 330.

  The first storage unit 130 stores a program executed by the control unit 120 and stores data necessary for executing the program. The first storage unit 130 temporarily stores data for calculation by the control unit 120. The first storage unit 130 includes a magnetic storage device, a semiconductor storage device, an optical storage device, a magneto-optical storage device, or the like.

  The display unit 161 (the first display unit 161-1 and the second display unit 161-2) has a function of displaying a screen. For example, the display unit 161 (the first display unit 161-1 and the second display unit 161-2) may be a projector or a liquid crystal display as shown in FIG. An organic EL (Electro-Luminescence) display may be used. However, the display unit 161 (the first display unit 161-1 and the second display unit 161-2) may be a display of another form as long as it has a function of displaying a screen.

  The control unit 120 executes control of each unit of the information processing apparatus 10. As illustrated in FIG. 3, the control unit 120 includes an image analysis unit 121, a voice recognition unit 122, a command recognition unit 123, a first command acquisition unit 124, a second command acquisition unit 125, and a third command acquisition unit. 126, an execution control unit 127, and a display control unit 128. Details of these functional blocks will be described later. In addition, the control part 120 may be comprised by CPU (Central Processing Unit; Central processing unit) etc., for example. When the control unit 120 is configured by a processing device such as a CPU, the processing device may be configured by an electronic circuit.

  The function configuration example of the communication system according to the present embodiment has been described above.

[1.3. Functional details of communication system]
Subsequently, the functional details of the communication system will be described. Here, as a command executed by the control target device 20, there is a command that is suitable to be executed by inputting sound information, and there is an operation body (hereinafter, mainly described as “the hand of the user 80”). Some commands are suitable to be executed by entering a position.

  Specifically, simple commands (commands with a lower degree of freedom of selection by the user 80) such as a command for raising the volume of the television device and a command for turning on the air conditioner are used for the position of the user 80's hand. It is suitable to be executed by input. One reason is that when a simple command is executed by inputting the hand position of the user 80, the number of display objects (hereinafter also referred to as “buttons”) corresponding to each command can be reduced. As mentioned.

  On the other hand, it is suitable to execute complicated commands (commands with a higher degree of freedom of selection by the user 80) such as search keyword input and program name input by inputting sound information. When a complicated command is executed by inputting the hand position of the user 80, one reason is that the number of buttons corresponding to each command increases.

  Therefore, in this embodiment, a technique that can improve the flexibility of input for executing a command is mainly proposed.

  Specifically, the image analysis unit 121 obtains the position of the hand of the user 80 by image analysis on the image captured by the imaging unit 112. In addition, the voice recognition unit 122 obtains a voice recognition processing result by voice recognition processing on the sound information. The command recognition unit 123 recognizes the command (first command) based on the position of the hand of the user 80 and recognizes the command (second command) based on the voice recognition processing result. The first command acquisition unit 124 acquires the first command, and the second command acquisition unit 125 acquires the second command.

  When the first command acquisition unit 124 acquires the first command, the execution control unit 127 controls the execution of the first command by the control target device 20. On the other hand, when the second command acquisition unit 125 acquires the second command, the execution control unit 127 controls the execution of the second command by the control target device 20. With this configuration, it is possible to improve input flexibility for executing a command.

  Hereinafter, specific examples will be referred to. 4 and 5 are diagrams for describing an example of an operation of turning on the power of the television device (control target device 20-1). First, when the user 80 wants to watch the television device (the control target device 20-1), as shown in FIG. 4, he speaks “TV controller”. When the user 80 utters in this way, the sound collection unit 151 of the information processing apparatus 10 collects sound information including the utterance of the user 80, and the speech recognition unit 122 performs speech recognition processing results by speech recognition processing on the sound information. Get “TV Controller”. Here, the voice and the command are registered as information associated in advance. Therefore, the command recognizing unit 123 recognizes the command “display TV controller” from the voice recognition processing result “TV controller” with reference to information associated in advance.

  The second command acquisition unit 125 acquires the command “display TV controller”, and the display control unit 128 acquires the command “display TV controller” by the second command acquisition unit 125. The command “display TV controller” is controlled. In FIG. 4, a TV controller is displayed as a command reception screen 30-1. The command reception screen 30-1 includes buttons corresponding to each command.

  At this time, as shown in FIG. 4, the display control unit 128 may control the display of the command reception screen 30-1 in an area corresponding to the position of the user 80. This makes it easier for the user 80 to press a button corresponding to a command that the user wants to execute. The area corresponding to the position of the user 80 is not particularly limited, but may be within a range that the user 80 can reach.

  Alternatively, when causing the TV to execute a command, there may be a case where the user 80 does not want to keep an eye on the TV. Therefore, the display control unit 128 controls the display of the command reception screen 30-1 in an area (for example, within a predetermined range from the control target device 20-1) according to the position of the control target device 20-1. Good. That way, you won't have to take your eyes off the TV.

  Thus, the display control unit 128 can also change the display position of the command reception screen 30-1 according to the type of the command reception screen 30-1. However, if the command reception screen 30-1 is displayed outside the reach of the user 80, the command reception screen 30-1 needs to be performed with a gesture on the command reception screen 30-1.

  The command reception screen 30-1 may be stored in the first storage unit 130 in advance, but is downloaded from the second storage unit 230 of the control target device (TV) 20-1 to the information processing apparatus 10. Alternatively, the information may be downloaded from the external server (third storage unit 330) to the information processing apparatus 10 via the external network 30.

  When the command reception screen 30-1 is displayed, input by pressing a button becomes possible. Subsequently, as shown in FIG. 5, the user 80 presses the power button on the command reception screen 30-1. The command recognition unit 123 recognizes a command based on the position of the hand of the user 80. For example, when a button position that satisfies a predetermined relationship with the position of the hand of the user 80 is detected, the command recognition unit 123 recognizes a command corresponding to the button.

  In the present embodiment, as an example, a case will be mainly described in which the command recognizing unit 123 recognizes a command corresponding to a button when the button of the user 80 is overlapped. Here, the power button is detected as the button on which the index finger of the user 80 overlaps, and the command “power ON” corresponding to the power button is recognized. Then, the first command acquisition unit 124 acquires the command “power ON”. Further, as shown in FIG. 5, when the command “power ON” is acquired by the first command acquisition unit 124, the execution control unit 127 turns on the control target device (TV) 20-1. The control target device (TV) 20-1 is controlled.

  Here, an example is shown in which a command corresponding to a button is recognized only when a button with the user 80's hand overlapping is detected. However, the command recognizing unit 123 may recognize a command corresponding to the button when a button with which the user 80 is overlapped is detected or when a predetermined command determining operation is detected. Here, the command determining operation is not limited, but may include moving the hand of the user 80 in a direction away from a predetermined position (position of the distance detection unit 113). The movement of the hand of the user 80 may be detected by the distance detection unit 113.

  Alternatively, the command determination operation may include moving the user 80's hand in a direction away from a predetermined position (the position of the distance detection unit 113) at a speed exceeding a predetermined speed. Alternatively, the command determination operation includes the user 80 moving at a speed exceeding the predetermined speed by a distance exceeding the predetermined distance in a direction away from the predetermined position (position of the distance detecting unit 113). But you can.

  6-10 is a figure for demonstrating the example of the operation | movement which reproduces | regenerates the program currently recorded on the recorder (control object apparatus 20-2). First, when the user 80 wants to view the program list recorded in the recorder (the control target device 20-2), as shown in FIG. 6, the user 80 speaks “recorder controller”. When the user 80 speaks in this way, the display control unit 128 controls the command “display recorder controller” in the same manner as described with reference to FIGS. 4 and 5. In FIG. 6, the controller of the recorder is displayed as a command reception screen 30-2.

  When the command reception screen 30-2 is displayed, input by pressing a button becomes possible. As shown in FIG. 7, the user 80 presses a program list display button on the command reception screen 30-2. The command recognition unit 123 detects the program list display button as a button with the index finger of the user 80 overlapped, and recognizes the command “program list display” corresponding to the program list display button. Then, the first command acquisition unit 124 acquires the command “display program list”.

  When the command “display program list” is acquired by the first command acquisition unit 124, the execution control unit 127 displays the program list recorded in the control target device (recorder) 20-2 as the control target device (TV) 20. The control target device (recorder) 20-2 is controlled so as to be displayed at -1. Referring to FIG. 7, a program list is displayed on the control target device (TV) 20-1.

  Here, when the user 80 wants to see the details of the program P1, as shown in FIG. 8, he / she utters “program P1”. When the user 80 utters in this way, the sound collection unit 151 of the information processing apparatus 10 collects sound information including the utterance of the user 80, and the speech recognition unit 122 performs speech recognition processing results by speech recognition processing on the sound information. “Program P1” is obtained. The command recognition unit 123 recognizes the command “detailed display of the program P1” from the voice recognition processing result “program P1” with reference to information associated in advance.

  The second command acquisition unit 125 acquires the command “detailed display of program P1”, and the execution control unit 127 acquires the command “detailed display of program P1” by the second command acquisition unit 125. The control target device (recorder) 20-2 is controlled such that the command “detailed display of program P1” is executed. Referring to FIG. 8, the details of the program P1 are displayed on the control target device (TV) 20-1 according to the control by the control target device (recorder) 20-2.

  The priority of command recognition by the command recognition unit 123 is not particularly limited. That is, either the recognition of the command corresponding to the button overlapping the hand of the user 80 or the recognition of the command corresponding to the voice recognition processing result obtained by performing the voice recognition processing from the sound information may be preceded. For example, the command recognition unit 123 may recognize a command corresponding to the voice recognition processing result when a button overlapping the hand of the user 80 is not detected. The second command acquisition unit 125 acquires such a command.

  Thereafter, it is assumed that the user 80 wants to switch the page of the displayed program list P1. At that time, the page may be switched by a predetermined gesture. Specifically, as shown in FIG. 9, the command recognition unit 123 detects the hand of the user 80 in a state in which the index finger and the little finger are opened and the thumb, the middle finger, and the ring finger are closed. When is moved, a command for switching the display to the next page of the currently displayed page may be recognized. In the example shown in FIG. 9, such a command is recognized, acquired by the first command acquisition unit 124, and execution control of the switching to the next page is controlled by the execution control unit 127.

  Then, the user 80 moves the pointer in the screen to the program to be reproduced by a predetermined gesture (for example, an operation of moving the index finger, etc.) to determine the program to be reproduced from the program list P1, and then determines the program to be reproduced. (Such as “decision” as shown in FIG. 10). When a predetermined sound is emitted, the command recognizing unit 123 recognizes the program “content C5” indicated by the pointer and the command “playback of content C5” corresponding to the sound “decision”, and the execution control unit 127 displays “contents”. Execution of “C5 playback” is controlled.

  The priority of command recognition by the command recognition unit 123 is not particularly limited. However, for example, when the program that overlaps the pointer is detected, when the command determination operation is not detected, and when it is detected that the voice recognition processing result corresponds to the program, the command recognition unit 123 You may recognize the command according to a speech recognition process result. The third command acquisition unit 126 acquires the command, and the execution control unit 127 controls execution of the command by the control target device 20.

  FIGS. 11-14 is a figure for demonstrating the example of the operation | movement which controls an air conditioner (control object apparatus 20-3). First, when the user 80 wants to control the air conditioner (the control target device 20-3), as shown in FIG. 11, the user 80 speaks “air conditioner controller”. When the user 80 speaks in this way, the display control unit 128 controls the command “display air conditioner controller” in the same manner as described with reference to FIGS. 4 and 5. In FIG. 11, the controller of the air conditioner is displayed as a command reception screen 30-3A.

  When the command reception screen 30-3A is displayed, input by pressing a button becomes possible. As shown in FIG. 12, the user 80 presses the power button on the command reception screen 30-3A. The command recognition unit 123 detects the power button as the button on which the index finger of the user 80 is overlapped, and recognizes the command “power ON” corresponding to the power button. Then, the first command acquisition unit 124 acquires the command “power ON”.

  When the command “power ON” is acquired by the first command acquisition unit 124, the execution control unit 127 is configured to turn on the air conditioner (control target device 20-3). -3) is controlled. Referring to FIG. 12, the air conditioner (control target device 20-3) is turned on, and the wind from the air conditioner (control target device 20-3) is shown. As shown in FIG. 13, the display content is switched from the command reception screen 30-3A to the command reception screen 30-3B.

  On the command reception screen 30-3B, input by pressing a button can be continued. As shown in FIG. 13, the user 80 presses the strong airflow button on the command reception screen 30-3B. The command recognizing unit 123 detects the strong airflow button as the button on which the index finger of the user 80 overlaps, and recognizes the command “strong airflow” corresponding to the strong airflow button. Then, the first command acquisition unit 124 acquires the command “strong air current”.

  When the command “strong airflow” is acquired by the first command acquisition unit 124, the execution control unit 127 increases the airflow of the air conditioner (control target device 20-3) so that the airflow (control target device 20-is high). 3) is controlled. Referring to FIG. 13, it is shown that the airflow of the air conditioner (control target device 20-3) is strengthened and a strong wind is emitted from the air conditioner (control target device 20-3). As shown in FIG. 14, the state where the command reception screen 30-3B is displayed is switched to a state where nothing is displayed.

  Here, when the user 80 wants to switch the mode to the humidification mode, the user speaks “humidification” as shown in FIG. When the user 80 speaks in this way, as in the case described with reference to FIG. 8, the command recognizing unit 123 refers to the information associated in advance, and the command “humidification mode” from the voice recognition processing result “humidification”. Recognize mode switching to

  Then, the second command acquisition unit 125 acquires the command “mode switching to the humidification mode”, and the execution control unit 127 acquires the command “mode switching to the humidification mode” by the second command acquisition unit 125. Therefore, the control target device (air conditioner) 20-3 is controlled so that the command “mode switching to the humidification mode” is executed. Referring to FIG. 14, the mode of the control target device (air conditioner) 20-3 is switched to the humidification mode.

  FIGS. 15-17 is a figure for demonstrating the example of the operation | movement which controls the control object apparatus (coffee maker) 20-4. First, when the user 80 wants to use the control target device (coffee maker) 20-4, he / she utters “coffee maker” as shown in FIG. When the user 80 speaks in this way, the display control unit 128 controls the command “display coffee list” in the same manner as described with reference to FIGS. 4 and 5. In FIG. 15, a list of coffee is displayed as a command reception screen 30-4.

  When the command reception screen 30-4 is displayed, input by pressing a button becomes possible. As shown in FIG. 16, the user 80 places a cup Cu on the control target device (coffee maker) 20-4 and presses a cappuccino on the command reception screen 30-4. The command recognizing unit 123 detects the cappuccino button as a button on which the index finger of the user 80 overlaps, and recognizes the command “insert cappuccino” corresponding to the cappuccino button. Then, the first command acquisition unit 124 acquires the command “insert cappuccino”.

  When the command “put cappuccino” is acquired by the first command acquisition unit 124, the execution control unit 127 controls the control target device (coffee maker) 20-4 so as to put cappuccino into the cup Cu. Referring to FIG. 16, a state in which a cup Cu is placed in the control target device (coffee maker) 20-4 and a cappuccino is placed in the cup Cu is shown.

  Here, as shown in FIG. 17, instead of placing the cup Cu on the control target device (coffee maker) 20-4 and pressing the cappuccino on the command reception screen 30-4, the user 80 speaks “Cappuccino”. Also good. When the user 80 speaks in this way, as in the case described with reference to FIG. 8, the command recognizing unit 123 refers to the information associated in advance and determines the command “Cappuccino” from the speech recognition processing result “Cappuccino”. Recognize.

  Then, the second command acquisition unit 125 acquires the command “insert cappuccino”, and the execution control unit 127 acquires the command “cappuccino input” because the second command acquisition unit 125 acquires the command “insert cappuccino”. Control target device (coffee maker) 20-4 is controlled so that “put in” is executed. Referring to FIG. 17, a state in which a cup Cu is placed in the control target device (coffee maker) 20-4 and cappuccino is placed in the cup Cu is shown.

  18 to 23 are diagrams for describing an example of an operation for controlling the display of the weather forecast. First, when the user 80 wants to view the weather forecast, the user 80 utters “weather forecast” as shown in FIG. When the user 80 speaks in this way, the display control unit 128 controls the command “display weather forecast of current location” in the same manner as described with reference to FIGS. 4 and 5. In FIG. 18, the weather forecast for the current location is displayed as a command reception screen 30-5A. The weather forecast for the current location may be acquired from a server (not shown) via the external network 30.

  It should be noted that detailed information such as a weather forecast is preferably displayed on a large screen from the viewpoint of ease of viewing. Therefore, as shown in FIG. 18, the weather forecast may be displayed on the screen of the control target device (TV) 20-1. At this time, as illustrated in FIG. 18, the information processing apparatus 10 may autonomously change the direction toward the control target device (TV) 20-1. If it does so, it will become easy to grasp | ascertain easily that the user 80 will also display a weather forecast on the control object apparatus (TV) 20-1.

  Subsequently, when the user 80 wants to browse the weekly weather of the current location (Tokyo), the user 80 utters “weekly weather” as shown in FIG. When the user 80 speaks in this way, as in the case described with reference to FIG. 8, the execution control unit 127 controls the device to be controlled (server not shown) so that the command “display weekly weather at the current location” is executed. ) To control. Referring to FIG. 19, a state in which the weekly weather in Tokyo acquired from a control target device (a server not shown) is displayed as a command reception screen 30-5B is shown.

  Subsequently, when the user 80 wants to browse the weekly weather in Osaka, the user 80 utters “weekly weather in Osaka” as shown in FIG. When the user 80 speaks in this way, the execution control unit 127 controls the device to be controlled (server not shown) so that the command “display weekly weather in Osaka” is executed as in the case described with reference to FIG. ) To control. Referring to FIG. 20, a state where the weekly weather in Osaka acquired from a control target device (a server not shown) is displayed as a command reception screen 30-5B is shown.

  Subsequently, when the user 80 wishes to view the mesh weather, the user 80 utters “mesh weather” as shown in FIG. When the user 80 speaks in this way, the execution control unit 127 selects the control target device (server not shown) so that the command “display mesh weather” is executed, as in the case described with reference to FIG. Control. Referring to FIG. 21, a state in which mesh weather acquired from a control target device (a server not shown) is displayed as a command reception screen 30-5C is shown.

  Subsequently, when the user 80 wants to view the weather change in Kumamoto, as shown in FIG. 22, the user 80 moves the pointer in the screen to Kumamoto by a predetermined gesture (for example, an operation of moving the index finger, etc.). A predetermined determination operation (such as an operation of pressing the palm of the hand toward the screen as shown in FIG. 22) may be performed. When operated in this way, the execution control unit 127 controls the control target device (a server not shown) so that the command “display weather change in Kumamoto” is executed. Referring to FIG. 23, a state in which a weather change in Kumamoto acquired from a control target device (a server not shown) is displayed as a command reception screen 30-5D is shown.

  FIGS. 24-26 is a figure for demonstrating the example of the operation | movement which controls the display of the photograph of Kinkakuji. First, when the user 80 wants to view a photo of Kinkakuji, he utters “photo of Kinkakuji” as shown in FIG. When the user 80 speaks in this way, the display control unit 128 controls the command “display photo of Kinkakuji” as in the case described with reference to FIGS. 4 and 5. In FIG. 24, thumbnail images of photographs of Kinkakuji are displayed as a command reception screen 30-6A. The photograph of Kinkakuji may be acquired from a server (not shown) via the external network 30.

  Subsequently, when the user 80 wants to view the enlarged image of the lower left thumbnail image, as shown in FIG. 25, the user moves the pointer in the screen to the lower left thumbnail by a predetermined gesture (for example, an operation of moving the index finger, etc.). After moving to the image, a predetermined determination operation (such as an operation of pushing the palm toward the screen as shown in FIG. 25) may be performed. When operated in this way, the execution control unit 127 controls the control target device (server not shown) so that the command “display enlarged image” is executed. Referring to FIG. 26, a state is shown in which an enlarged image acquired from a control target device (a server not shown) is displayed as a command reception screen 30-6A.

  27 to 29 are diagrams for explaining an example of an operation for controlling display of the schedule table. First, when the user 80 wants to view the schedule, he / she utters “schedule” as shown in FIG. When the user 80 speaks in this way, the display control unit 128 controls the command “display schedule” in the same manner as described with reference to FIGS. 4 and 5. In FIG. 27, the schedule is displayed as a command reception screen 30-7A. The schedule may be stored in the first storage unit 130 in advance.

  Subsequently, when the user 80 wants to view the schedule for the 25th of this month in the schedule, he / she utters “schedule for the 25th” as shown in FIG. When the user 80 utters in this manner, the execution control unit 127 executes the command “display the schedule for 25th of this month” in the same manner as described with reference to FIG. 130 is controlled. Referring to FIG. 28, a state is shown in which the schedule table for 25th of this month acquired from the first storage unit 130 is displayed as the command reception screen 30-7B.

  Subsequently, when the user 80 wants to return to the top page of the schedule table, as shown in FIG. 29, the user 80 may perform a predetermined gesture (for example, an operation of moving the hand with the hand open). When operated in this way, the command recognition unit 123 recognizes a command for switching the display to the top page of the page group to which the currently displayed page belongs, and the first command acquisition unit 124 acquires the command. The execution control unit 127 controls the first storage unit 130 such that the command “transition to the top page” is executed. Referring to FIG. 29, a state where the top page of the schedule table is displayed as the command reception screen 30-7A is shown.

  Next, the operation flow of the information processing apparatus 10 according to the present embodiment will be described. FIG. 30A and FIG. 30B are flowcharts showing an operation flow of the information processing apparatus 10 according to the present embodiment. First, the image analysis unit 121 detects the position of the user 80 based on the image captured by the imaging unit 112 (S11). Subsequently, the display control unit 128 moves the display position of the display unit 161 based on the position of the user (S12). Subsequently, the display control unit 128 causes the display unit 161 to display a command reception screen based on the user's utterance (S13).

  Subsequently, the command recognition unit 123 refers to the analysis result by the image analysis unit 121, and moves the operation to S23 when the hand of the user 80 is not captured ("No" in S14). On the other hand, the command recognition unit 123 refers to the analysis result by the image analysis unit 121, and moves the operation to S15 when the hand of the user 80 is captured ("Yes" in S14). Subsequently, when the user 80 does not have a hand at the valid position (button position or the like) (“No” in S15), the command recognition unit 123 shifts the operation to S23. On the other hand, the command recognition unit 123 shifts the operation to S16 when the hand of the user 80 is at an effective position (button position or the like) (“Yes” in S15).

  Subsequently, the command recognition unit 123 refers to the distance to the user 80 detected by the distance detection unit 113, and when the user 80's hand has not moved in the back direction ("No" in S16), The operation is shifted to S19. On the other hand, the command recognition unit 123 refers to the distance to the user 80 detected by the distance detection unit 113, and when the user 80's hand moves in the back direction ("Yes" in S16), the command recognition unit 123 operates in S17. To migrate.

  Subsequently, when the hand of the user 80 has not moved in the back direction by a distance exceeding the predetermined distance due to the speed exceeding the predetermined speed (“No” in S17), the command recognition unit 123 proceeds to S19. Transition operation. On the other hand, when the hand of the user 80 moves in the back direction by a distance exceeding the predetermined distance due to the speed exceeding the predetermined speed (“Yes” in S17), the execution control unit 127 performs the operation by the user 80. The control target device 20 is controlled so that the instructed command is executed (S18).

  Subsequently, when there is no utterance by the user 80 (“No” in S19), the voice recognition unit 122 shifts the operation to S14, but when there is an utterance by the user 80 (“Yes” in S19). ), Voice recognition processing (this, deletion, recording, reproduction, etc.) is performed on the sound information collected by the sound collecting unit 151 (S20), and the operation is shifted to S21.

  Subsequently, when the voice corresponds to a display object (button or the like) indicated by the hand (“Yes” in S21), the execution control unit 127 executes the command indicated by the hand and the voice. The control target device 20 is controlled (S22). On the other hand, when the voice does not correspond to the display object (button or the like) indicated by the hand (“Yes” in S21), the execution control unit 127 shifts the operation to S23.

  Subsequently, when there is no utterance by the user 80 (“No” in S23), the voice recognition unit 122 shifts the operation to S14, but when there is an utterance by the user 80 (“Yes” in S23). ), Voice recognition processing (cancellation, power ON, advance to the next page, etc.) is performed on the sound information collected by the sound collection unit 151 (S24), and a command instructed by voice is executed. The control target device 20 is controlled (S25).

[1.4. Hardware configuration example]
Next, a hardware configuration of the information processing apparatus 10 according to the embodiment of the present disclosure will be described with reference to FIG. FIG. 31 is a block diagram illustrating a hardware configuration example of the information processing apparatus 10 according to the embodiment of the present disclosure.

  As illustrated in FIG. 31, the information processing apparatus 10 includes a central processing unit (CPU) 901, a read only memory (ROM) 903, and a random access memory (RAM) 905. The information processing apparatus 10 may include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925. Furthermore, the information processing apparatus 10 may include an imaging device 933 and a sensor 935 as necessary. The information processing apparatus 10 may have a processing circuit called DSP (Digital Signal Processor) or ASIC (Application Specific Integrated Circuit) instead of or in addition to the CPU 901.

  The CPU 901 functions as an arithmetic processing unit and a control unit, and controls all or a part of the operation in the information processing apparatus 10 according to various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 927. The ROM 903 stores programs and calculation parameters used by the CPU 901. The RAM 905 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like. The CPU 901, the ROM 903, and the RAM 905 are connected to each other by a host bus 907 configured by an internal bus such as a CPU bus. Further, the host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.

  The input device 915 is a device operated by the user, such as a mouse, a keyboard, a touch panel, a button, a switch, and a lever. The input device 915 may include a microphone that detects the user's voice. The input device 915 may be, for example, a remote control device using infrared rays or other radio waves, or may be an external connection device 929 such as a mobile phone that supports the operation of the information processing device 10. The input device 915 includes an input control circuit that generates an input signal based on information input by the user and outputs the input signal to the CPU 901. The user operates the input device 915 to input various data to the information processing device 10 or instruct a processing operation. An imaging device 933, which will be described later, can also function as an input device by imaging a user's hand movement, a user's finger, and the like. At this time, the pointing position may be determined according to the movement of the hand or the direction of the finger.

  The output device 917 is configured by a device capable of visually or audibly notifying acquired information to the user. The output device 917 is, for example, an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an organic EL (Electro-Luminescence) display, a display device such as a projector, a hologram output device, an audio output device such as a speaker and headphones, As well as a printer device. The output device 917 outputs the result obtained by the processing of the information processing device 10 as a video such as text or an image, or outputs it as a sound such as voice or sound. The output device 917 may include a light or the like to brighten the surroundings.

  The storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 10. The storage device 919 includes, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 919 stores programs executed by the CPU 901, various data, various data acquired from the outside, and the like.

  The drive 921 is a reader / writer for a removable recording medium 927 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built in or externally attached to the information processing apparatus 10. The drive 921 reads information recorded on the attached removable recording medium 927 and outputs the information to the RAM 905. In addition, the drive 921 writes a record in the attached removable recording medium 927.

  The connection port 923 is a port for directly connecting a device to the information processing apparatus 10. The connection port 923 may be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface) port, or the like. The connection port 923 may be an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, or the like. Various data can be exchanged between the information processing apparatus 10 and the external connection device 929 by connecting the external connection device 929 to the connection port 923.

  The communication device 925 is a communication interface configured with, for example, a communication device for connecting to the communication network 931. The communication device 925 can be, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB). The communication device 925 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various communication. The communication device 925 transmits and receives signals and the like using a predetermined protocol such as TCP / IP with the Internet and other communication devices, for example. The communication network 931 connected to the communication device 925 is a wired or wireless network, such as the Internet, a home LAN, infrared communication, radio wave communication, or satellite communication.

  The imaging device 933 uses various members such as an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor), and a lens for controlling the formation of a subject image on the imaging element. It is an apparatus that images a real space and generates a captured image. The imaging device 933 may capture a still image or may capture a moving image.

  The sensor 935 is various sensors such as a distance measuring sensor, an acceleration sensor, a gyro sensor, a geomagnetic sensor, an optical sensor, and a sound sensor. For example, the sensor 935 acquires information about the state of the information processing apparatus 10 itself, such as the attitude of the housing of the information processing apparatus 10, and information about the surrounding environment of the information processing apparatus 10, such as brightness and noise around the information processing apparatus 10. To do. The sensor 935 may also include a GPS sensor that receives a GPS (Global Positioning System) signal and measures the latitude, longitude, and altitude of the device.

<2. Conclusion>
As described above, according to the embodiment of the present disclosure, the first command acquisition unit that acquires the first command corresponding to the position of the operating tool, and the voice recognition process obtained by the voice recognition process for the sound information A second command acquisition unit that acquires a second command according to a result; and, when the first command is acquired, controls execution of the first command by a first control target device; When the second command is acquired, an information processing apparatus is provided that includes an execution control unit that controls execution of the second command by the second device to be controlled. According to such a configuration, it is possible to provide a technique capable of improving the flexibility of input for executing a command.

  The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  For example, in the above, the first display unit 161-1 performs display on a relatively high position (for example, a wall, a television device, etc.), while the second display unit 161-2 displays a relatively low position ( For example, the example which displays on a user's hand etc. was demonstrated. However, the display positions by the first display unit 161-1 and the second display unit 161-2 are not particularly limited. For example, when the information processing apparatus 10 is brought into a vehicle, at least one of the first display unit 161-1 and the second display unit 161-2 includes a vehicle dashboard, a vehicle ceiling surface, It can also be displayed on a vehicle monitor or the like.

  Moreover, you may give a priority to a display position. For example, when an area (for example, a table surface) according to the position of the user's 80 hand is messy, the second display unit 161-2 directly uses the area according to the position of the user's 80 hand as the display position. In such a case, a display that is difficult to visually recognize may be performed. In such a case, the first display unit 161-1 may perform display on a wall surface or the like instead of the area corresponding to the position of the user 80's hand.

  In addition, at least one of the first display unit 161-1 and the second display unit 161-2 is configured to change the display color according to the color of the display position in order to improve the visibility by the user 80. Also good.

  In addition, it is possible to create a program for causing hardware such as a CPU, ROM, and RAM incorporated in a computer to exhibit functions equivalent to the functions of the control unit 120 described above. Also, a computer-readable recording medium that records the program can be provided.

  Note that the position of each component is not particularly limited as long as the operation of the information processing apparatus 10 described above is realized. As a specific example, the image analysis unit 121, the voice recognition unit 122, the command recognition unit 123, and the like may be provided in a server (not illustrated) connected via the external network 30. In this case, the control unit 120 may correspond to a client connected to the server via the external network 30. The image analysis unit 121, the voice recognition unit 122, the command recognition unit 123, and the like may be provided in separate servers.

  Further, the effects described in the present specification are merely illustrative or exemplary and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
A first command acquisition unit that acquires a first command according to the position of the operating body;
A second command acquisition unit for acquiring a second command according to a voice recognition processing result obtained by the voice recognition processing for the sound information;
When the first command is acquired, the execution of the first command by the first control target device is controlled, and when the second command is acquired, the second control of the second command is performed. An execution control unit that controls execution by the target device;
An information processing apparatus comprising:
(2)
The first command acquisition unit acquires the first command according to the display object when the position of the display object satisfying a predetermined relationship with the position of the operation body is detected.
The information processing apparatus according to (1).
(3)
The information processing apparatus includes:
A display control unit for controlling display of the display object;
The information processing apparatus according to (2).
(4)
The display control unit controls display of the display object in an area according to a position of a user;
The information processing apparatus according to (3).
(5)
The display control unit varies the display position of the display object according to the type of the display object.
The information processing apparatus according to (3) or (4).
(6)
The first command acquisition unit is configured to display the display when a position of the display object that satisfies the predetermined relationship with a position of the operating body is detected, and when a predetermined command determination operation is detected. Obtaining the first command according to an object;
The information processing apparatus according to any one of (2) to (5).
(7)
The predetermined command determining operation includes moving the operating body in a direction away from a predetermined position.
The information processing apparatus according to (6).
(8)
The predetermined command determination operation includes moving the operating body at a speed exceeding a predetermined speed in a direction away from the predetermined position.
The information processing apparatus according to (7).
(9)
The predetermined command determination operation includes moving the operating body at a speed exceeding the predetermined speed by a distance exceeding a predetermined distance in a direction away from the predetermined position.
The information processing apparatus according to (8).
(10)
The second command acquisition unit acquires the second command according to the voice recognition processing result when the position of the display object satisfying a predetermined relationship with the position of the operation body is not detected.
The information processing apparatus according to (1).
(11)
The information processing apparatus includes:
When the position of the display object satisfying the predetermined relationship with the position of the operating body is detected, and when the predetermined command determination operation is not detected, and the voice recognition processing result is the display object A third command acquisition unit that acquires a third command according to the display object and the voice recognition processing result,
The information processing apparatus according to any one of (2) to (5).
(12)
The execution control unit controls execution of the third command by a third control target device when the third command is acquired.
The information processing apparatus according to (11).
(13)
The information processing apparatus includes:
An image analysis unit that obtains the position of the operating body by image analysis on an image captured by the imaging unit;
The information processing apparatus according to any one of (1) to (12).
(14)
The information processing apparatus includes:
A command recognizing unit for recognizing the first command based on the position of the operating body and recognizing the second command based on the voice recognition processing result;
The information processing apparatus according to any one of (1) to (13).
(15)
The information processing apparatus includes:
A speech recognition unit that obtains the speech recognition processing result by speech recognition processing on the sound information;
The information processing apparatus according to any one of (1) to (14).
(16)
The operation body includes the user's hand,
The information processing apparatus according to any one of (1) to (15).
(17)
The first command acquisition unit is configured to switch a display to a top page of a page group to which a currently displayed page belongs when the user's hand is moved in a state where the user's hand is opened. Obtaining a command as the first command;
The information processing apparatus according to (16).
(18)
The first command acquisition unit is configured to display the current command when the index finger and pinky finger of the user's hand are opened and the user's hand is moved with the thumb, middle finger, and ring finger closed. A command for switching display to the next page of the displayed page is acquired as the first command;
The information processing apparatus according to (16) or (17).
(19)
Obtaining a first command corresponding to the position of the operating body by a computer;
Obtaining a second command according to a voice recognition processing result obtained by the voice recognition processing for the sound information;
When the first command is acquired, the execution of the first command by the first control target device is controlled, and when the second command is acquired, the second control of the second command is performed. Controlling execution by the target device;
Including an information processing method.
(20)
Computer
A first command acquisition unit that acquires a first command according to the position of the operating body;
A second command acquisition unit for acquiring a second command according to a voice recognition processing result obtained by the voice recognition processing for the sound information;
When the first command is acquired, the execution of the first command by the first control target device is controlled, and when the second command is acquired, the second control of the second command is performed. An execution control unit that controls execution by the target device;
A program for causing an information processing apparatus to function.

DESCRIPTION OF SYMBOLS 10 Information processing apparatus 20 Control object apparatus 30 External network 80 User 111 Sound output part 112 Imaging part 113 Distance detection part 120 Control part 121 Image analysis part 122 Voice recognition part 123 Command recognition part 124 1st command acquisition part 125 2nd Command acquisition unit 126 Third command acquisition unit 127 Execution control unit 128 Display control unit 130 First storage unit 140 Communication unit 151 Sound collection unit 161 Display unit 230 Second storage unit 330 Third storage unit

Claims (20)

A first command acquisition unit that acquires a first command according to the position of the operating body;
A second command acquisition unit for acquiring a second command according to a voice recognition processing result obtained by the voice recognition processing for the sound information;
When the first command is acquired, the execution of the first command by the first control target device is controlled, and when the second command is acquired, the second control of the second command is performed. An execution control unit that controls execution by the target device;
An information processing apparatus comprising: The first command acquisition unit acquires the first command according to the display object when the position of the display object satisfying a predetermined relationship with the position of the operation body is detected.
The information processing apparatus according to claim 1. The information processing apparatus includes:
A display control unit for controlling display of the display object;
The information processing apparatus according to claim 2. The display control unit controls display of the display object in an area according to a position of a user;
The information processing apparatus according to claim 3. The display control unit varies the display position of the display object according to the type of the display object.
The information processing apparatus according to claim 3 or 4. The first command acquisition unit is configured to display the display when a position of the display object that satisfies the predetermined relationship with a position of the operating body is detected, and when a predetermined command determination operation is detected. Obtaining the first command according to an object;
The information processing apparatus according to any one of claims 2 to 5. The predetermined command determining operation includes moving the operating body in a direction away from a predetermined position.
The information processing apparatus according to claim 6. The predetermined command determination operation includes moving the operating body at a speed exceeding a predetermined speed in a direction away from the predetermined position.
The information processing apparatus according to claim 7. The predetermined command determination operation includes moving the operating body at a speed exceeding the predetermined speed by a distance exceeding a predetermined distance in a direction away from the predetermined position.
The information processing apparatus according to claim 8. The second command acquisition unit acquires the second command according to the voice recognition processing result when the position of the display object satisfying a predetermined relationship with the position of the operation body is not detected.
The information processing apparatus according to claim 1. The information processing apparatus includes:
When the position of the display object satisfying the predetermined relationship with the position of the operating body is detected, and when the predetermined command determination operation is not detected, and the voice recognition processing result is the display object A third command acquisition unit that acquires a third command according to the display object and the voice recognition processing result,
The information processing apparatus according to any one of claims 2 to 5. The execution control unit controls execution of the third command by a third control target device when the third command is acquired.
The information processing apparatus according to claim 11. The information processing apparatus includes:
An image analysis unit that obtains the position of the operating body by image analysis on an image captured by the imaging unit;
The information processing apparatus according to any one of claims 1 to 12. The information processing apparatus includes:
A command recognition unit that recognizes the first command based on the position of the operating body and recognizes the second command based on the voice recognition processing result.
The information processing apparatus according to any one of claims 1 to 13. The information processing apparatus includes:
A speech recognition unit that obtains the speech recognition processing result by speech recognition processing on the sound information;
The information processing apparatus according to any one of claims 1 to 14. The operation body includes the user's hand,
The information processing apparatus according to any one of claims 1 to 15. The first command acquisition unit is configured to switch a display to a top page of a page group to which a currently displayed page belongs when the user's hand is moved in a state where the user's hand is opened. Obtaining a command as the first command;
The information processing apparatus according to claim 16. The first command acquisition unit is configured to display the current command when the index finger and pinky finger of the user's hand are opened and the user's hand is moved with the thumb, middle finger and ring finger closed. A command for switching display to the next page of the displayed page is acquired as the first command;
The information processing apparatus according to claim 16 or 17. Obtaining a first command corresponding to the position of the operating body by a computer;
Obtaining a second command according to a voice recognition processing result obtained by the voice recognition processing for the sound information;
When the first command is acquired, the execution of the first command by the first control target device is controlled, and when the second command is acquired, the second control of the second command is performed. Controlling execution by the target device;
Including an information processing method. Computer
A first command acquisition unit that acquires a first command according to the position of the operating body;
A second command acquisition unit for acquiring a second command according to a voice recognition processing result obtained by the voice recognition processing for the sound information;
When the first command is acquired, the execution of the first command by the first control target device is controlled, and when the second command is acquired, the second control of the second command is performed. An execution control unit that controls execution by the target device;
A program for causing an information processing apparatus to function.

Images