JP5422694B2 - Information processing apparatus, command execution control method, and command execution control program - Google Patents

Description

  The present invention generally relates to an information processing apparatus, a command execution control method, and a command execution control program. More specifically, the present invention relates to an information processing apparatus, a command execution control method, and a command execution control program that recognize a user's gesture and perform control based on the recognized gesture.

  Conventionally, a method of operating an information processing apparatus such as a television or a personal computer (PC) by a user's gesture has been proposed. According to such a method, the information processing apparatus can be remotely operated without using an input device such as a mouse, a keyboard, or a remote controller.

  For example, there is a technique for detecting a movement of a recognition target object in a recognition area set in a shooting area by a camera, determining a movement category of the recognition target object based on the detected information, and executing a command corresponding to the category. It has been proposed (see Patent Document 1).

  In addition, by moving the user's specific hand shape, the cursor is moved on the display screen in correspondence with the specific hand shape photographed using the camera, and the virtual button displayed on the display screen is moved. The technique to select is proposed (refer patent documents 2 and 3).

JP 2007-34525 A JP-A-8-44490 JP 2004-78977 A

  In the above-described technique, it is necessary to recognize the user's gesture photographed by the camera, but due to the poor recognition accuracy, blurring occurs in the pointing (cursor on the display screen) due to the gesture, and the blur is caused for the user. It can be annoying.

  The problem to be solved by the present invention has been made in view of the above circumstances, and an information processing apparatus capable of improving operability on a display screen by a gesture detected from an input image, A command execution control method and a command execution control program are provided.

In order to solve the above-described problem, the information processing apparatus according to the embodiment includes an input unit, a storage unit, a shape recognition unit, and a command execution control unit. The input means inputs an image. The storage means stores one or more shapes that are the basis of the gesture expression. The shape recognition unit detects whether or not a shape that matches the shape stored in the storage unit is included in the image input by the input unit. When the shape recognition unit detects that a shape that matches the shape stored in the storage means is included in the input image, the command execution control unit changes the movement of the matching shape. Control execution of commands based on this. Further, when the movement of the matching shape satisfies the first condition, the command execution control unit enters a command invalid state in which the command cannot be executed after executing the command. In the command invalid state, the matching shape If the movement satisfies the second condition different from the first condition, the process shifts to a command valid state in which a command can be executed. The first condition is that the amount of movement of the matching shape is equal to or greater than a first threshold value. Furthermore, after the second condition satisfies the first condition and enters the command invalid state, the matching shape moves in a direction opposite to the direction moved by the first threshold or more, and It is included as a condition that the movement amount is equal to or greater than the second threshold.

  According to the present invention, it is possible to provide an information processing apparatus, a command execution control method, and a command execution control program that can improve operability on a display screen by a gesture detected from an input image.

1 is a perspective view showing an information processing apparatus according to an embodiment of the present invention. The block diagram which shows the system configuration | structure of the information processing apparatus shown in FIG. The block diagram which shows a part of system configuration | structure of the information processing apparatus shown in FIG. 1 in detail. The figure which shows the example of the hand shape used in this embodiment. The figure which shows the example of the determination axis | shaft of the movement amount of a hand shape used with the image image | photographed via the camera. 4 is a flowchart illustrating an example of an operation of a command execution control unit illustrated in FIG. 3 in the information processing apparatus illustrated in FIG. 1. The figure explaining an example of the movement amount of the movement vector in a predetermined determination axis. The figure explaining another example of the movement amount of the movement vector in a predetermined determination axis. The figure explaining further another example of the moving amount | distance of the movement vector in a predetermined determination axis | shaft. 4 is a flowchart showing another example of the operation of the command execution control unit shown in FIG. 3 in the information processing apparatus shown in FIG. (A) is a figure which shows an example of the user interface by which the guide which shows the command corresponding to a moving direction is displayed on a screen, when a predetermined hand shape is detected, (b) is a movement direction detected and a command is executed. The figure which shows an example of the user interface displayed on a screen when being done. The figure which shows the example of the determination axis | shaft of a movement vector based on another embodiment.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

  First, with reference to FIG.1 and FIG.2, the structure of the information processing apparatus which concerns on one Embodiment of this invention is demonstrated. This information processing apparatus is realized as, for example, a notebook personal computer 100 that can be driven by a battery (hereinafter abbreviated as computer 100).

  FIG. 1 is a perspective view of the computer 100 with the display unit opened. The computer 100 includes a main unit 101 and a display unit 102.

  The display unit 102 incorporates a display device composed of an LCD (Liquid Crystal Display) 103. The display unit of the LCD 103 is disposed almost at the center of the display unit 102. A camera 107 is provided in the upper center portion of the display unit of the LCD 103.

  The display unit 102 is supported by the main unit 101, and is rotatably attached to the main unit 101 between an open position where the upper surface of the main unit 101 is exposed and a closed position covering the upper surface of the main unit 101. It has been.

  The main unit 101 has a thin box-shaped housing. On the upper surface of the main unit 101, a power button 104 for turning on / off the computer 100, a keyboard 105, a touch pad 106, and the like are arranged. ing.

  FIG. 2 is a block diagram illustrating a system configuration of the computer 100.

  As shown in FIG. 2, the computer 100 includes a CPU 201, a main memory 202, a north bridge 203, a graphics controller 204, an LCD 103, a VRAM 205, a south bridge 206, a USB controller 207, an IDE controller 208, a camera 107, a USB device 209, and a hard disk. Drive (HDD) 210, optical disk drive (ODD) 211, BIOS-ROM 212, power button 104, keyboard 105, touch pad 106, embedded controller / keyboard controller (EC / KBC) 213, power supply circuit 221, battery 222, and AC adapter 223 and the like.

  The CPU 201 is a processor that controls the overall operation of the computer 100. The CPU 201 executes the OS and various application programs loaded in the main memory 202. The OS and various application programs are stored in a magnetic disk storage medium (hard disk) or the like mounted on the HDD 210 and loaded from the storage medium into the main memory 202.

  The CPU 201 also executes a BIOS program 230 (hereinafter referred to as BIOS) stored in the BIOS-ROM 212. The BIOS-ROM 212 takes the form of a nonvolatile memory such as a flash EEPROM so that the program can be rewritten.

  The BIOS 230 is a program that controls various hardware components of the computer 100, and is read from the BIOS-ROM 212 when the computer 100 is activated.

  The north bridge 203 is a bridge device that connects the local bus of the CPU 201 and the south bridge 206. The north bridge 203 includes a memory controller that controls access to the main memory 202. The north bridge 203 has a function of communicating with the graphics controller 204 via an AGP (Accelerated Graphics Port) bus or the like.

  The graphics controller 204 is a controller that controls the LCD 103 used as a display monitor of the computer 100. The graphics controller 204 outputs a video signal corresponding to display data written in the VRAM 205 by the OS or application program to the LCD 103.

  The south bridge 206 controls each device on an LPC (Low Pin Count) bus and a PCI (Peripheral Component Interconnect) bus. The south bridge 206 includes a USB controller 207 for controlling the camera 107 and the USB device 209, and an IDE controller 208 for controlling the HDD 210 and the ODD 211.

  The camera 107 is configured by a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The camera 107 captures an image (moving image) around the computer 100 and supplies the image to a hand shape recognition unit 301 described later. An image (moving image) captured by the camera 107 can be displayed on a display monitor of the computer 100. The frame rate of the image supplied by the camera 107 is, for example, 30 frames / second. In this embodiment, it is assumed that the camera 107 is a USB device compliant with the USB standard. The camera 107 may be an external type or a built-in type.

  The HDD 210 is a storage device having a hard disk controller and a magnetic disk storage medium. The magnetic disk storage medium stores various software including the OS and various data. The ODD 211 is a drive unit for driving a storage medium such as a DVD storing video content such as a DVD title or a CD storing music data.

  The EC / KBC 213 is a one-chip microcomputer in which an embedded controller (EC) for power management and a keyboard controller (KBC) for controlling the keyboard 105 and the touch pad 106 are integrated. The EC / KBC 213 is always turned on by the power from the power supply circuit 221 regardless of whether the computer 100 is turned on or off. The EC / KBC 213 turns on / off the computer 100 in cooperation with the power supply circuit 221 in response to the operation of the power button 104 by the user.

  The power supply circuit 221 uses the power from the battery 222 provided in the main unit 101 or the power from the external power source supplied via the AC adapter 223 under the control of the EC / KBC 213, Supply power to the device.

  FIG. 3 is a block diagram showing a part of the configuration of the computer 100 in more detail.

  As shown in FIG. 3, the image captured by the camera 107 is supplied to the hand shape recognition unit 301.

  The hand shape recognition unit 301 determines whether the image supplied from the camera 107 includes a hand shape that matches any one of hand shapes stored (registered) in advance in the hand shape database 302. . For example, the hand shape recognition unit 302 searches for one of hand shapes stored in advance in the hand shape database 302 from the image supplied from the camera 107.

  In the hand shape database 302, as shown in FIG. 4, a fist (five fingers are bent (FIG. 4A)) and a palm (five fingers are extended (FIG. 4B) )) And thumb-up signs (the state in which only the thumb is extended and the other four fingers are bent (FIG. 4C)) are stored in advance in association with corresponding identifiers.

  The hand shape recognition unit 301 further calculates position information (coordinates) of the hand shape in the two-dimensional coordinate system in the image. In the present embodiment, the hand shape recognition unit 301 uses the center of a rectangular area circumscribing the hand shape as position information (X, Y) of the hand shape. The position information of the hand shape is not limited to the center of the rectangular area circumscribing the hand shape, and may be, for example, the coordinates of the center of gravity of the hand shape.

  The command execution control unit 303 receives the hand shape identifier detected by the hand shape recognition unit 301 and the position information of the hand shape from the hand shape recognition unit 301. Then, the command execution control unit 303 stores the received hand shape identifier and position information, for example, in the main memory 202 for each captured frame. Note that the command execution control unit 303 may store the identifier and the position information not for each frame but for every predetermined time (for example, every 2 frames or 3 frames). In addition, the command execution control unit 303 controls the execution of commands such as selection of icons displayed on the display screen and execution of executable files in accordance with the movement of the hand shape photographed by the camera. The operation of the command execution control unit 303 will be described in detail below with reference to FIGS.

  In the present embodiment, the hand shape recognition unit 301 is realized by a dedicated hardware engine (LSI; not shown), and the command execution control unit 303 is realized by software executed by the CPU 201 (FIG. 2). However, the hand shape recognition unit 301 and the command execution control unit 303 may be realized by hardware or software. The software and hand shape database 302 are stored in, for example, the HDD 210 (FIG. 2).

  Next, the operation of the command execution control unit 303 will be described with reference to FIGS.

  FIG. 5 shows an example of a determination axis for the movement amount of the hand shape used in an image taken through the camera. In one example, as shown in FIG. 5A, two directions whose unit vectors are (1, 0) and (0, 1) are used as axes for determining the movement amount of the hand shape. However, the determination axis of the movement amount of the hand shape is not limited to the above, and for example, as shown in FIG. 5B, the unit vectors are (1 / √2, 1 / √2) and (− The two directions may be 1 / √2, 1 / √2).

  Hereinafter, in the present embodiment, description will be made on the assumption that two directions whose unit vectors are (1, 0) and (0, 1) are used as the determination axis of the movement amount of the hand shape.

  FIG. 6 is a flowchart illustrating an example of the operation of the command execution control unit 303 in the computer 100. Here, the position of the hand shape is specified by the coordinates of the two-dimensional coordinate system. That is, the hand shape moves in a two-dimensional space consisting of a horizontal direction (X-axis direction; first axial direction) and a vertical direction (Y-axis direction; second axial direction).

  First, in step S <b> 601, the command execution control unit 303 waits for the hand shape recognition unit 301 to detect a predetermined hand shape (in this embodiment, the fist in FIG. 4A) via the camera 107.

  When the fist is detected by the hand shape recognition unit 301 and the command execution control unit 303 receives a signal indicating that the fist is detected (including an identifier corresponding to the fist and position information of the fist), an identifier corresponding to the fist and For example, the position information of the fist is stored in the main memory 202. In the following, it is assumed that the clenched fist is continuously detected by the hand shape recognition unit 301.

  Further, the command execution unit 303 receives the position information of the fist in the next frame imaged through the camera 107, and calculates the movement vector 701 (see FIG. 7) of the fist from the previous frame to the current frame. .

Specifically, the position information of the grip fist in the immediately preceding frame is (X _n−1 , Y _n−1 ), and the position information of the grip fist in the current frame is (X _n , Y _n ). As shown in FIG. 7, the above-described movement vector 701 is (X _n −X _n−1 , Y _n −Y _n−1 ). When the horizontal axis is the determination axis (predetermined determination axis) 700, the movement amount V _n of the movement vector 701 on the determination axis 700 is the inner product of the movement vector 701 and the unit vector (1, 0), That is,
V _n = (X _n −X _n−1 ) × 1 + (Y _n −Y _n−1 ) × 0 = X _n −X _n−1
It becomes.

  In this embodiment, the movement vector is calculated based on the current frame and the immediately preceding frame. However, the movement vector is calculated based on the current frame and a frame of a predetermined time before (for example, 2 frames or 3 frames before). May be.

Next, the command execution control unit 303 determines whether or not the absolute value of the movement amount Vn of the movement vector 701 on the determination axis 700 is equal to or greater than a predetermined first threshold (for example, 0.05 _m ) (step S602). In step S _< b _> 602, the command execution control unit 303 stores, in the main memory 202, which determination axis is used (in this example, the determination axis 700) and the positive / negative of the movement amount Vn, in addition to the above determination. .

The absolute value of the moving amount _{V n} of the movement vector 701, when it is determined not to be greater than a predetermined first threshold value (NO in step S602), the operation returns again to step S602.

On the other hand, as shown in FIG. 7, when it is determined that the absolute value of the movement amount V _n of the movement vector 701 is equal to or greater than a predetermined first threshold (YES in step S602), the command execution control unit 303 Then, the command associated with the movement of the hand shape is executed (step S603). Examples of such commands include focus movement, media playback, and media pause (see FIG. 11). When the command execution (step S603) ends, the command cannot be executed (command execution disabled state) until it is determined YES in the determination of S605 described below.

  Next, the command execution control unit 303 receives the fist identifier and position information in the frame photographed via the camera 107 immediately after the command execution, and stores it in the main memory 201, for example. Then, the command execution control unit 303 calculates the movement vector 801 (see FIG. 8) of the clenched fist reaching the current frame from the frame immediately before the frame corresponding to the received position information.

Specifically, the position information of the grip fist in the immediately preceding frame is (X _m−1 , Y _m−1 ), and the position information of the grip fist in the current frame is (X _m , Y _m ). As shown in FIG. 8, the above-described movement vector 801 is (X _m −X _m−1 , Y _m −Y _m−1 ). The movement amount V _m of the movement vector 801 on the determination axis 700 used in step S602 is an inner product of the movement vector 801 and the unit vector (1, 0), that is,
V _m = (X _m −X _m−1 ) × 1 + (Y _m −Y _m−1 ) × 0 = X _m −X _m−1
It becomes.

  In this embodiment, the movement vector is calculated based on the current frame and the immediately preceding frame. However, the movement vector is calculated based on the current frame and a frame of a predetermined time before (for example, 2 frames or 3 frames before). May be.

Next, the command execution control unit 303 determines whether or not the absolute value of the movement amount V _m of the movement vector 801 on the determination axis 700 is greater than or equal to a predetermined second threshold (for example, 0.005 m) (step S <b> 5). S604). At step S604, the command execution controller 303 also determines with the determination in positive and negative movement amount V _m is the same or is opposite to the sign of the movement amount V _n stored in step S602.

If it is determined that the absolute value of the movement amount V _m of the movement vector 801 is not equal to or greater than a predetermined second threshold value, or the positive / negative of the movement amount V _m is the same as the positive / negative of the movement amount V _n (step This operation returns to step S604 again.

On the other hand, as shown in FIG. 8, the absolute value of the moving amount V _m of the movement vector 801 is not less than a predetermined second threshold value, and positive and negative movement amount V _m is a positive or negative movement amount V _n opposite If it is determined (YES in step S604), the operation proceeds to step S605.

  Next, the command execution control unit 303 receives the fist identifier and position information in the frame photographed via the camera 107 immediately after step S <b> 605, and stores it in the main memory 201, for example. Then, the command execution control unit 303 calculates the movement vector 901 (see FIG. 9) of the fist reaching the current frame from the frame immediately before the frame corresponding to the received position information.

Specifically, it is assumed that the position information of the grip fist in the immediately preceding frame is (X _l−1 , Y _l−1 ), and the position information of the grip fist in the current frame is (X _l , Y _l ). As shown in FIG. 9, the movement vector 901 described _above, the _{(X l -X l-1,} Y l -Y l-1). The movement amount V _l of the movement vector 901 on the determination axis 700 used in step S602 is the inner product of the movement vector 901 and the unit vector (1, 0), that is,
V _l = (X _l −X _l−1 ) × 1 + (Y _l −Y _l−1 ) × 0 = X _l −X _l−1
It becomes.

  In this embodiment, the movement vector is calculated based on the current frame and the immediately preceding frame. However, the movement vector is calculated based on the current frame and a frame of a predetermined time before (for example, 2 frames or 3 frames before). May be.

Then, the command execution controller 303, the absolute value, (determining whether a third threshold value (e.g., 0.003 m) more than a predetermined amount of movement _{V l} of the movement vector 901 in decision shaft 700 S605). At step S605, the command execution controller 303 determines with the determination of the positive and negative movement amount V _l is be a opposite or the same as the sign of the movement amount V _n stored in step S602.

The absolute value of the moving amount V _m of the movement vector 901, is not more than a predetermined third threshold value, or positive or negative movement amount V _l is, when it is determined that the opposite positive and negative movement amount V _n (step This operation returns to step S605 again.

On the other hand, as shown in FIG. 9, the absolute value of the movement amount V _l of the movement vector 901 is equal to or greater than a predetermined third threshold value, and the positive / negative of the movement amount V _l is the same as the positive / negative of the movement amount V _n. If it is determined (YES in step S605), this operation is terminated, and the processing of step S601 and step S602 is performed, so that the command can be executed again (command execution valid state).

  In the present embodiment, preferably, the predetermined second threshold value and the third threshold value are smaller than the predetermined first threshold value. Further, the predetermined second threshold and third threshold are preferably very small values, such as about 0.5.

  Although only the determination axis related to the horizontal direction has been described above, the command execution control unit 303 performs the same control for the determination axis related to the vertical direction.

(Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to the drawings. Since the second embodiment has the same configuration as that of the first embodiment except for the operation of the command execution control unit 303 (FIG. 3), only the operation of the command execution control unit 303 will be described here. .

  In the present embodiment, description will be made assuming that two directions whose unit vectors are (1, 0) and (0, 1) are used as the determination axis for the movement amount of the hand shape.

  FIG. 10 is a flowchart illustrating another example of the operation of the command execution control unit 303 in the computer 100. Here, the position of the hand shape is specified by the coordinates of the two-dimensional coordinate system. That is, the hand shape moves in a two-dimensional space consisting of a horizontal direction (X-axis direction; first axial direction) and a vertical direction (Y-axis direction; second axial direction).

  First, in step S <b> 1001, the command execution control unit 303 waits for the hand shape recognition unit 301 to detect a predetermined hand shape (in this embodiment, the fist in FIG. 4A) via the camera 107.

  When the fist is detected by the hand shape recognition unit 301 and the command execution control unit 303 receives a signal indicating that the fist is detected (including an identifier corresponding to the fist and position information of the fist), an identifier corresponding to the fist and For example, the position information of the fist is stored in the main memory 202. In the following, it is assumed that the clenched fist is continuously detected by the hand shape recognition unit 301.

  Further, the command execution unit 303 receives the position information of the fist in the next frame imaged through the camera 107, and calculates the movement vector 701 (see FIG. 7) of the fist from the previous frame to the current frame. .

Specifically, the position information of the grip fist in the immediately preceding frame is (X _n−1 , Y _n−1 ), and the position information of the grip fist in the current frame is (X _n , Y _n ). As shown in FIG. 7, the above-described movement vector 701 is (X _n −X _n−1 , Y _n −Y _n−1 ). When the horizontal axis is the determination axis (predetermined determination axis) 700, the movement amount V _n of the movement vector 701 on the determination axis 700 is the inner product of the movement vector 701 and the unit vector (1, 0), That is,
V _n = (X _n −X _n−1 ) × 1 + (Y _n −Y _n−1 ) × 0 = X _n −X _n−1
It becomes.

  In this embodiment, the movement vector is calculated based on the current frame and the immediately preceding frame. However, the movement vector is calculated based on the current frame and a frame of a predetermined time before (for example, 2 frames or 3 frames before). May be.

  Next, the command execution control unit 303 determines whether or not the absolute value of the movement amount Vn of the movement vector 701 on the determination axis 700 is greater than or equal to a predetermined first threshold (for example, 0.05 m) (step S1002). ). In step S1102, the command execution control unit 303 stores, in the main memory 202, for example, which determination axis is used (in this example, the determination axis 700) together with the above determination.

  If it is determined that the absolute value of the movement amount Vn of the movement vector 701 is not greater than or equal to the predetermined first threshold value (NO in step S602), the operation returns to step S1002 again.

  On the other hand, as shown in FIG. 7, when it is determined that the absolute value of the movement amount Vn of the movement vector 701 is equal to or greater than a predetermined first threshold (YES in step S1002), the command execution control unit 303 A command associated with the movement of the hand shape is executed (step S1003). Examples of such commands include focus movement, media playback, and media pause (see FIG. 11). When the command execution (step S1103) ends, the command cannot be executed (command execution disabled state) until YES is determined in the determination of S1105 described below.

  Next, the command execution control unit 303 determines whether or not a predetermined time (for example, 3 seconds) has elapsed since the command was executed (step S1004). If the predetermined time has not elapsed, the command execution control unit 303 waits for the predetermined time to elapse (step S1004).

  On the other hand, when a predetermined time elapses, this operation is terminated, and the processing of step S1001 and step S1002 is performed, so that the command can be executed again (command execution valid state).

  Although only the determination axis related to the horizontal direction has been described above, the command execution control unit 303 performs the same control for the determination axis related to the vertical direction.

  FIG. 11 is a guide showing a command corresponding to a moving direction when a predetermined hand shape (grip fist) is detected so that a user can know a command to be executed in the first and second embodiments described above. Shows an example of a user interface 1101 displayed on the screen (FIG. 11A). FIG. 11 also shows an example of a user interface 1102 displayed on the screen so that the executed command can be understood when the moving direction is detected and the command is executed (FIG. 11B).

  According to the first and second embodiments, command execution can be suppressed even if a subtle hand movement unintended by the user occurs (steps S602 and S1002).

  Further, according to the first embodiment, continuous command execution can be suppressed even when the user moves his hand too much (step S604).

  Further, according to the first embodiment, once the user returns his / her hand, the next command execution operation can be performed immediately. Furthermore, when the user returns his / her hand once, command execution corresponding to the opposite direction due to the excessive return of his / her hand can be suppressed (step S605).

  Further, according to the second embodiment, when it is difficult to return the hand once or forgetting to return the hand, the next command operation can be performed after a predetermined time elapses.

  The preferred embodiment of the present invention has been described above, but the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the present invention.

  For example, the present invention can be applied to various information processing apparatuses such as a desktop personal computer, a mobile phone, a personal digital assistant (PDA), a game machine, and a television in addition to the notebook personal computer described in this embodiment. can do.

  Further, for example, as shown in FIG. 12, the present invention uses a diagonal determination axis in addition to the vertical and horizontal determination axes, and detects a command in the diagonal direction. It is also possible not to execute. By doing in this way, even if the hand shape is moved halfway to the oblique direction, the execution of the command can be suppressed.

  In addition, the processing described in the above-described embodiment is performed on a recording medium such as a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), a semiconductor memory, etc. as a program that can be executed by a computer. It can be written and provided to various devices. It is also possible to transmit to a variety of devices by transmitting via a communication medium. The computer reads the program recorded on the recording medium or receives the program via the communication medium, and the operation is controlled by this program, thereby executing the above-described processing.

  As described above, according to the present invention, it is possible to provide an information processing apparatus, a command execution control method, and a command execution control program capable of improving operability on a display screen by a user's gesture photographed by a camera. it can.

  The invention described in the scope of claims at the time of the patent assessment of the original application of the present application will be appended below.

  [1] An information processing apparatus, a camera connected to the information processing apparatus, storage means storing one or more hand shapes, and one or more hand shapes stored in the storage means A hand shape recognition unit that detects whether or not a matching predetermined hand shape is included in an image photographed by the camera, and one or more stored in the storage unit by the hand shape recognition unit If it is detected that the predetermined hand shape that matches the hand shape of the camera is included in the image captured by the camera, execution of a command is controlled based on the movement of the predetermined hand shape And a command execution control unit that executes a command when the movement amount of the predetermined hand shape photographed by the camera is equal to or greater than a first threshold. After running The information processing apparatus characterized by comprising a command disabling condition that can not perform the command.

  [2] After entering the command invalid state, the command execution control unit reverses the direction in which the predetermined hand shape has moved when it is detected that the movement amount is equal to or greater than a first threshold. The information processing apparatus according to [1], wherein it is determined whether or not the predetermined hand shape moves and the amount of movement is equal to or greater than a second threshold value.

  [3] The predetermined hand shape moves in a direction opposite to the direction in which the predetermined hand shape moves when it is detected that the movement amount is equal to or greater than a first threshold, and the movement amount is When the predetermined hand shape is determined to be greater than or equal to a threshold value of 2, and when the amount of movement is detected to be greater than or equal to the second threshold value, the predetermined hand shape is opposite to the direction in which the predetermined hand shape has moved. The information according to [2], wherein the command execution control unit enters a command valid state in which a command can be executed when the command is moved and the movement amount is equal to or greater than a third threshold. Processing equipment.

  [4] The information according to [1], wherein the command execution control unit enters a command valid state in which a command can be executed when a predetermined time elapses after the command invalid state. Processing equipment.

  [5] The information processing apparatus further includes a display, and when the predetermined hand shape is detected, a guide indicating a command corresponding to a moving direction of the predetermined hand shape is displayed on the display. The information processing apparatus according to [1].

  [6] The information processing apparatus further includes a display, and when executing the command, a user interface indicating that the command is being executed is displayed on the display. ] Information processing apparatus of description.

  [7] A command execution control method for controlling execution of a command in an information processing apparatus having a storage unit that stores one or a plurality of hand shapes, wherein an image is captured via a camera connected to the information processing apparatus. Acquire and detect whether or not a predetermined hand shape that matches one or more hand shapes stored in the storage means is included in an image photographed by the camera, and store it in the storage means If it is detected that the predetermined hand shape that matches the one or more hand shapes that are made is included in the image taken by the camera, based on the movement of the predetermined hand shape If the movement amount of the predetermined hand shape photographed by the camera is greater than or equal to the first threshold value, the command is executed, and the command cannot be executed after executing the command. Command execution control method characterized by comprising a command invalid state.

  [8] After the command is disabled, the predetermined hand shape is in a direction opposite to the direction in which the predetermined hand shape has moved when it is detected that the movement amount is equal to or greater than a first threshold. The command execution control method according to [7], wherein it is determined whether or not the movement amount is equal to or greater than a second threshold value.

  [9] The predetermined hand shape moves in a direction opposite to the direction in which the predetermined hand shape moves when it is detected that the movement amount is equal to or greater than a first threshold, and the movement amount is When the predetermined hand shape is determined to be greater than or equal to a threshold value of 2, and when the amount of movement is detected to be greater than or equal to the second threshold value, The command execution control method according to [8], wherein the command is enabled so that the command can be executed when the command is moved and the amount of movement is equal to or greater than a third threshold value.

  [10] The command execution control method according to [7], wherein when a predetermined time elapses after the command becomes invalid, the command becomes valid so that the command can be executed.

  [11] The information processing apparatus further includes a display, and when the predetermined hand shape is detected, a guide indicating a command corresponding to a moving direction of the predetermined hand shape is displayed on the display. The command execution control method according to [7] above.

  [12] The information processing apparatus further includes a display, and when executing the command, a user interface indicating that the command is being executed is displayed on the display. [7] ] Command execution control method of description.

  [13] A procedure for acquiring an image via a camera connected to the information processing apparatus in an information processing apparatus having storage means storing one or more hand shapes, and one stored in the storage means Or a procedure for detecting whether or not a predetermined hand shape that matches a plurality of hand shapes is included in an image photographed by the camera, and one or more hand shapes stored in the storage means, A procedure for controlling execution of a command based on movement of the predetermined hand shape when it is detected that the matching predetermined hand shape is included in the image captured by the camera; When the movement amount of the predetermined hand shape photographed by the camera is greater than or equal to the first threshold value, a command is executed, and after executing this command, the command cannot be executed and the command cannot be executed. Command execution control program characterized.

100 Computer 101 Main Unit 102 Display Unit 103 LCD
104 Power button 105 Keyboard 106 Touchpad 107 Camera 201 CPU
202 Main memory 203 North bridge 206 South bridge 210 HDD
211 ODD
212 BIOS-ROM
213 EC / KBC
230 BIOS
301 Hand shape recognition unit 302 Hand shape database 303 Command execution control unit

Claims (7)

An input means for inputting an image;
Storage means for storing one or more shapes to be a basis for gesture expression;
A shape recognition unit that detects whether or not a shape that matches the shape stored in the storage unit is included in the image input by the input unit;
When the shape recognition unit detects that a shape that matches the shape stored in the storage means is included in the input image, the command is executed based on the movement of the matching shape. A command execution control unit to control;
Comprising
When the movement of the matching shape satisfies the first condition, the command execution control unit enters a command invalid state where the command cannot be executed after executing the command. In the command invalid state, the movement of the matching shape However, when a second condition different from the first condition is satisfied, the command shifts to a command valid state in which a command can be executed ,
The first condition is that the amount of movement of the matching shape is not less than a first threshold value,
The second condition satisfies the first condition and enters the command invalid state, and then the matching shape moves in a direction opposite to the direction moved by the first threshold or more, and the movement An information processing apparatus including a condition that the amount is equal to or greater than a second threshold . The second condition is that, in addition to the movement amount being equal to or greater than the second threshold value, the matching shape is moved in a direction opposite to the direction in which the movement amount is equal to or greater than the second threshold value, and the movement amount is On condition that is greater than or equal to a third threshold,
The information processing apparatus according to claim 1 . After satisfying the first condition and entering the command invalid state, when the third condition is satisfied that a predetermined time elapses, the command shifts to the command valid state.
The information processing apparatus according to claim 1. A display,
When the matching shape is detected, a guide indicating a command corresponding to the moving direction of the matching shape is displayed on the display.
The information processing apparatus according to any one of claims 1 to 3 . A display,
When executing the command, a user interface indicating that the command is being executed is displayed on the display.
The information processing apparatus according to any one of claims 1 to 3 . A command execution control method for controlling execution of a command in an information processing apparatus having a storage unit storing one or more shapes as a basis for a gesture expression,
Inputting an image;
Detecting whether a shape matching the shape stored in the storage means is included in the input image;
If it is detected that a shape matching the shape stored in the storage means is included in the input image, controlling the execution of a command based on the movement of the matching shape;
Have
In the step of controlling, when the movement of the matching shape satisfies the first condition, after executing the command, the command cannot be executed and a command invalid state is entered. , When a second condition different from the first condition is satisfied, the command shifts to a command valid state in which a command can be executed ,
The first condition is that the amount of movement of the matching shape is not less than a first threshold value,
The second condition satisfies the first condition and enters the command invalid state, and then the matching shape moves in a direction opposite to the direction moved by the first threshold or more, and the movement A command execution control method including a condition that the amount is equal to or greater than a second threshold . A procedure for inputting an image into an information processing apparatus having a storage means storing one or more shapes as a basis of gesture expression;
A procedure for detecting whether or not a shape matching the shape stored in the storage means is included in the input image;
A procedure for controlling the execution of a command based on the movement of the matching shape when it is detected that a shape that matches the shape stored in the storage means is included in the input image;
And execute
When the movement of the matching shape satisfies the first condition, after executing the command, the command cannot be executed, and the command invalid state is entered. In the command invalid state, the movement of the matching shape is the first condition. If the second condition different from the above is satisfied, the command shifts to a command valid state in which the command can be executed ,
The first condition is that the amount of movement of the matching shape is not less than a first threshold value,
The second condition satisfies the first condition and enters the command invalid state, and then the matching shape moves in a direction opposite to the direction moved by the first threshold or more, and the movement A command execution control program including a condition that the amount is equal to or greater than a second threshold .

Images