JP2011209773A - Apparatus and method for processing of gesture command, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allocate a new command to a new gesture and to make the command be stored, even when the new gesture not stored associatively to a command is input.SOLUTION: A gesture command processing apparatus 200 includes: a gesture command memory 210 for associating and storing a gesture and a command executed by the gesture; an input gesture specification part 220 for specifying a gesture input by a user; a command execution part 230 for reading the command corresponding to the input gesture from the gesture command memory 210 and executing the command; a new gesture memory 240 for storing input information of the new gesture associatively to the new gesture when the input gesture is the new gesture not stored in the gesture command memory 210; and a gesture command allocation part 250 for making the command be stored in the gesture command memory 210 associatively to the new gesture wherein the input information satisfies a prescribed command allocation condition.

Description

  The present invention relates to a gesture / command processing device, a gesture / command processing method, and a program, and in particular, by performing gesture input using a part of a user's body or a dedicated instruction medium, The present invention relates to a gesture command processing apparatus, a gesture command processing method, and a program capable of executing a command assigned corresponding to a gesture input.

  Conventionally, as a user interface for executing a predetermined operation command for an electronic device such as a computer, a television, and an audio, an operation input using a mouse, a keyboard, or a remote controller is generally used. As a new method, there is known a gesture recognition system that executes a corresponding command by performing a gesture registered in advance in association with a command using a pen, a mouse, or the like (see, for example, Patent Document 1). .

JP 2003233345 A JP 2008-282092 A

  By the way, when such a system is used by a plurality of users or when the frequency of use is low, it has been a problem that the correspondence relationship between a registered gesture and a command cannot be understood. On the other hand, for example, as disclosed in Patent Document 2, a method of displaying a list of correspondence relationships between gestures and commands is known.

  In such a method, the user can be notified of the gestures and commands registered in the system, but the user must remember the registered gestures, and can create new gestures that are easy to understand or simple for him / her. It was difficult to add or change the gesture-command correspondence relationship such as registering to a previously registered gesture or replacing it with a registered gesture.

  In order to solve the above-described problems, the present invention provides a gesture command storage unit that stores a gesture and a command executed by the gesture in association with each other, and an input gesture specifying unit that specifies a gesture input by a user. A command execution unit that reads and executes the command corresponding to the input gesture from the gesture command storage unit, and the input gesture is a new gesture that is not stored in the gesture command storage unit The new gesture storage unit that stores the input information of the new gesture in association with the new gesture, and the command associated with the new gesture in which the input information satisfies a predetermined command allocation condition. Store in the gesture command storage unit Providing a gesture command processing apparatus characterized by comprising: a Esucha command allocation unit.

  According to such a gesture command processing apparatus, even when a new gesture that is not stored in association with a command is input, a new command can be assigned to the gesture and stored.

  In the gesture command processing apparatus, the new gesture storage unit stores the cumulative input count of the new gesture as the input information in association with the new gesture, and the gesture command allocation unit stores the new gesture. It is preferable that the command is associated with the new gesture and stored in the gesture command storage unit in response to the cumulative number of times of reaching the predetermined number.

  Accordingly, for example, when a user inputs a gesture that is easy to understand or simple for the user a predetermined number of times, a new command can be assigned to the gesture and stored.

  In the gesture / command processing device, the new gesture storage unit stores the number of continuous inputs of the new gesture as the input information in association with the new gesture, and the gesture / command allocation unit stores the new gesture. It is preferable that the command is associated with the new gesture and stored in the gesture command storage unit when the number of continuous inputs reaches a predetermined number.

  As a result, for example, when the user inputs a gesture that is easy to understand or is easy to understand for a predetermined number of times in succession, a new command can be assigned to the gesture and stored.

  The gesture command processing device further includes an unregistered command storage unit that stores the unregistered command that is not associated with any of the gestures, and the gesture command allocation unit includes the command allocation condition It is preferable that the unregistered command is associated with the new gesture satisfying the above and stored in the gesture command storage unit.

  As a result, a command to which no gesture is assigned can be assigned and stored for a new gesture that is input while satisfying a preset command assignment condition.

  In the gesture command processing device, the gesture command assigning unit may change the predetermined command together with the gesture when the input gesture is the gesture stored in the gesture command storage unit. It is preferable that the command stored in the gesture command storage unit in association with the gesture is changed to another command in response to the input of the request.

  As a result, even if a gesture is already assigned to a command, the command associated with the gesture can be changed on condition that a predetermined command change request is input.

  As another embodiment, the present invention stores a gesture and a command executed by the gesture in association with each other, specifies a gesture input by a user, and executes the command corresponding to the input gesture When the input gesture is a new gesture that is not stored, the input information of the new gesture is stored in association with the new gesture, and the input information satisfies the predetermined command allocation condition. Provided is a gesture command processing method characterized in that the command is stored in association with a gesture.

In addition, the present invention, as yet another form,
A gesture command storage unit that stores a gesture and a command executed by the gesture in association with each other, an input gesture specifying unit that specifies a gesture input by a user, and the command corresponding to the gesture input A command execution unit that reads out and executes from a gesture command storage unit, and if the input gesture is a new gesture that is not stored in the gesture command storage unit, input information of the new gesture to the new gesture A new gesture storage unit that stores the associated command, and a gesture command allocation unit that stores the command in the gesture command storage unit in association with the new gesture in which the input information satisfies a predetermined command allocation condition And having Providing a program to function as a gesture command processing apparatus according to symptoms.

It is a functional block diagram of gesture input system 10 concerning an embodiment of the present invention. 3 is a functional block diagram of the gesture input device 100. FIG. An example of imaging data is shown. It is the example which showed the moving direction and moving speed of the gravity center position of the said area | region specified from the area | region where the user's hand exists in the imaging data of FIG. 3 with the vector. 3 is a functional block diagram of a gesture command processing device 200. FIG. An example of a processing flow in the gesture input device 100 when a gesture is input by the user is shown. An example of the processing flow in the gesture command processing apparatus 200 when a gesture is input by the user is shown. 6 is an example of a list of candidate commands displayed on the display screen of the display device 300. 2 shows an exemplary hardware configuration of a computer 1000.

  Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. However, the following embodiment does not limit the invention according to the claims, and all combinations of features in the embodiment are based on the invention. It is not always essential to the solution.

  FIG. 1 is a functional block diagram of a gesture input system 10 according to an embodiment of the present invention. As shown in FIG. 1, the gesture input system 10 according to the present embodiment includes a gesture input device 100, a gesture command processing device 200, a display device 300, and an operation target device 400. When a registered gesture is input, a command corresponding to the gesture input by the gesture command processing device 200 is executed, and the command is transmitted to the operation target device 400 such as a television, a game machine, or an audio device. It is a system that can perform operations according to the contents.

  FIG. 2 is a functional block diagram of the gesture input device 100 constituting the gesture input system 10. In this example, the gesture input device 100 is a camera capable of shooting a moving image, and includes an imaging unit 110, an imaging data processing unit 120, a storage unit 130, and a control unit 140, as shown in FIG.

  The gesture input device 100 may be, for example, a mouse or a pen device connected to the gesture command processing device 200 wirelessly or by wire. In this case, the user moves the gesture command by moving the mouse or the pen device. A gesture is input to the processing device 200. Alternatively, if the display device 300 is a device having a display screen such as an LCD, the gesture input device 100 may be a touch panel provided on the display screen. In this case, the user inputs a gesture to the gesture command processing apparatus 200 by, for example, tracing the display screen with a finger.

  The imaging unit 110 includes an optical system such as an optical lens and an image sensor, and outputs an imaging signal of a moving image or a still image within the imaging range to the imaging data processing unit 120. An image sensor array such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) is used for the image sensor.

  The imaging data processing unit 120 includes a signal amplification circuit, a noise correction circuit, and various signal processing circuits, and generates imaging data at a predetermined frame rate from the imaging signal from the imaging unit 110. In addition, the imaging data processing unit 120 executes user face detection processing and face orientation determination processing from the generated imaging data. Specifically, for example, the imaging data processing unit 120 extracts a skin color region from the generated imaging data, specifies the shape of the region, and performs a comparison operation between the shape and pattern data stored in advance. Then, it is determined whether or not the user's face exists in the imaging data.

  Then, when the user's face is detected, the imaging data processing unit 120 extracts a feature point in the face area and performs a comparison operation with the feature point stored in association with the pattern data, Detect the user's face orientation. Then, when it is detected that the user's face is facing the imaging unit 110 side (front) for a predetermined time or longer, the imaging data processing unit 120 detects the position and movement of the user's hand.

  For example, the imaging data processing unit 120 specifies the shape of an area other than the user's face in the skin color area extracted from the imaging data, and performs comparison operation between the shape and pre-stored pattern data, thereby obtaining the imaging data. Detect areas where the user's hands are present. More specifically, when the generated imaging data is as shown in FIG. 3, for example, the imaging data processing unit 120 determines that the user's hand is based on the shape characteristics of the skin color area extracted from the imaging data. As the existing areas, the areas indicated by “H1” and “H2” in FIG. 3 are specified.

  FIG. 4 is an example in which the moving direction and moving speed of the centroid position of the area identified from the area where the user's hand exists in the imaging data of FIG. 3 are shown by vectors. The imaging data processing unit 120 extracts the feature amounts of the areas indicated by the above “H1” and “H2” specified from the imaging data shown in FIG. In this example, as shown in FIG. 4, the imaging data processing unit 120 specifies the length in the longitudinal direction and the gravity center position of each area of “H1” and “H2”, and the gravity center position from the imaging data of the immediately preceding frame. Specify the travel distance. Thereby, the moving direction and moving speed of the center of gravity of each area are specified (in FIG. 4, the moving direction and moving speed of each area of “H1” and “H2” are indicated by vectors “V1” and “V2”. ing).

  Then, the imaging data processing unit 120 outputs the gravity center position, the moving direction, and the moving speed of each region to the storage unit 130 as the position, moving direction, and moving speed of the user's hand, that is, the feature amount of the gesture. Note that the imaging data processing unit 120 may output the feature amount of the gesture to the storage unit 130 in association with one or a plurality of frames of the generated imaging data. Further, the above-described feature amount specification by the imaging data processing unit 120 may be performed by, for example, an input gesture specifying unit 220 described later in the gesture command processing device 200.

  The control unit 140 detects the operation status and setting information of each unit of the gesture input device 100 and controls each unit. For example, the control unit 140 controls whether to store the imaging data generated by the imaging data processing unit 120 and the feature amount in the storage unit 130 based on each detection result by the imaging data processing unit 120. .

  For example, the control unit 140 outputs, to the storage unit 130, a capture command indicating that storage of imaging data should be started based on a preset condition. In this example, the control unit 140 outputs a capture command to the storage unit 130 on the condition that the imaging data processing unit 120 detects that the user's face is facing the front. Note that the condition for the control unit 140 to output the capture command is not limited to this. For example, a gesture to start capturing is set in advance, and the imaging data processing unit 120 indicates that the user has performed the gesture. It is good also as a condition that it detected.

  Then, the control unit 140 outputs a capture stop command indicating that the storage of the imaging data should be stopped to the storage unit 130 based on a preset condition. In this example, the control unit 140 detects that the imaging data processing unit 120 has detected that the user's face has stopped facing the front or that the user's face or hand has gone out of the imaging range of the imaging unit 110. As a condition, a capture stop command is output to the storage unit 130. Alternatively, the control unit 140 confirms that the gravity center position of the user's hand remains within a predetermined area for a certain period of time, or that a certain period of time has elapsed since the capture command was output to the storage unit 130. A capture stop instruction may be output to the storage unit 130 as the above condition.

  The storage unit 130 stores the imaging data input from the imaging data processing unit 120 and the feature amount. In this example, the storage unit 130 stores the imaging data from the imaging data processing unit 120 in units of frames. Then, the storage unit 130 outputs the stored imaging data and the feature amount to the gesture command processing device 200 in response to the access from the gesture command processing device 200. In this example, in response to receiving the capture command from the control unit 140, the storage unit 130 starts storing the imaging data input from the imaging data processing unit 120 and the feature amount. In response to receiving the capture stop command, the storage of the imaging data and the feature amount is ended. For the storage unit 130, for example, a storage element such as a flash memory or a storage medium such as a hard disk is used.

  FIG. 5 is a functional block diagram of the gesture / command processing apparatus 200. As shown in FIG. 2, the gesture command processing device 200 includes a gesture command storage unit 210, an input gesture specifying unit 220, a command execution unit 230, a new gesture storage unit 240, a gesture command allocation unit 250, and a setting condition storage unit. 260 and an unregistered command storage unit 270.

  The gesture command storage unit 210 stores a gesture and a command to be executed by the gesture in association with each other. For example, the gesture command storage unit 210 stores a gesture “draw a circle with the right hand (left hand)” and a command (operation command) “turn on the operation target device 400” in association with each other. The command here indicates a specific operation on the operation target device 400.

  The input gesture specifying unit 220 specifies a gesture input by the user through the gesture input device 100. More specifically, the input gesture specifying unit 220 accesses the storage unit 130 of the gesture input device 100 and captures the imaging data and the feature amount stored in the storage unit 130. Then, the input gesture specifying unit 220 specifies a gesture input by the user based on the imaging data and the feature amount.

  Then, the input gesture specifying unit 220 accesses the gesture / command storage unit 210 to read a command corresponding to the specified gesture and outputs the command to the command execution unit 230. More specifically, for example, when the gesture performed by the user is identified as a “draw a circle with the right hand (left hand)” gesture, the input gesture identification unit 220 identifies “the operation target device 400 corresponding to the gesture”. Is read from the gesture command storage unit 210 and the command is output to the command execution unit 230.

  The gesture specifying method by the input gesture specifying unit 220 is not particularly limited. For example, the input gesture specifying unit 220 accesses the gesture command storage unit 210 and stores all of the gestures stored in correspondence with the command. It is also possible to read a gesture, calculate the similarity between the feature amount and the feature amount of the input gesture, and use the gesture with the highest similarity as the gesture performed by the user.

  The command execution unit 230 executes a command stored in the gesture command storage unit 210 in association with the gesture specified by the input gesture specification unit 220. More specifically, for example, when the command “turn on the operation target device 400” is input from the input gesture identification unit 220, the command execution unit 230 turns on the operation target device 400. A power signal is output.

  The new gesture storage unit 240 inputs the new gesture when the gesture input to the input gesture specifying unit 220 is a gesture that is not stored in the gesture command storage unit 210 (hereinafter referred to as “new gesture”). Store information. In this example, each time a new gesture is input to the input gesture specifying unit 220, the new gesture storage unit 240 stores the input information in association with the new gesture. Here, the input information includes the timing (time) at which the new gesture is input, the cumulative input count, the continuous input count, the elapsed time since the last input, and the like.

  The gesture command allocation unit 250 associates a command for performing a specific operation on the operation target device 400 with a new gesture whose input information satisfies a predetermined command allocation condition, and performs a gesture command storage unit 210. Remember me. More specifically, the gesture / command allocation unit 250, for example, when the cumulative input count of new gestures reaches a preset count, or when the continuous input count of new gestures reaches a preset count, Assuming that the command allocation condition is satisfied, the command is associated with the new gesture and stored in the gesture command storage unit 210.

  In the present example, the command assignment condition is stored in the setting condition storage unit 260. Therefore, when any of the input information of each new gesture stored in the new gesture storage unit 240 is updated, the gesture / command allocation unit 250 reads the command allocation condition stored in the setting condition storage unit 260. Compare with the updated input information of the new gesture. Note that the setting condition storage unit 260 may be configured by a storage element that can rewrite the stored content by an external operation input or an internal program.

  The unregistered command storage unit 270 stores an unregistered command that is not associated with any gesture. For example, the unregistered command storage unit 270 may store all commands that are not stored in the gesture command storage unit 210, but among these all commands, a command to be executed in response to a gesture input You may memorize only.

  In this example, the gesture / command allocation unit 250 reads all unregistered commands from the unregistered command storage unit 270 for new gestures that satisfy the command allocation conditions. Then, a list of all unregistered commands is output to the display device 300. When the user performs a gesture for selecting a specific command from the list of commands displayed on the display device 300, the gesture command allocation unit 250 associates the selected command with the new gesture and performs the gesture. Store in the command storage unit 210.

  When the user next performs a gesture newly associated with a command and stored in the gesture command storage unit 210, the command is executed by the command execution unit 230.

  In addition, the gesture / command allocation unit 250 is usually configured when the gesture input by the user is a gesture (registered gesture) that is already stored in association with one of the commands in the gesture command storage unit 210. The command is executed. However, when a predetermined command allocation condition is input together with the already registered gesture, the command stored in the gesture command storage unit 210 in association with the gesture is changed to another command.

  Specifically, in this example, a specific gesture is used as a command change gesture indicating that a change operation to change a command assigned to a previously registered gesture to another command should be started. It is stored in advance in the gesture command storage unit 210. Then, the gesture / command allocation unit 250 reads all unregistered commands from the unregistered command storage unit 270 in response to the input of the already registered gesture following the command change gesture, and displays a list of the commands. Output to 300. Then, when the user performs a gesture for selecting a specific command from the list of commands displayed on the display device 300, the gesture / command allocation unit 250 selects the command associated with the registered gesture. The command is changed to a command and stored in the gesture command storage unit 210. The command assignment condition for starting the change operation is not limited to the input of the command change gesture, and a specific command input by another interface may be used as the command assignment condition for starting the change operation. .

  Below, the specific flow at the time of operating the operation target apparatus 400 by gesture input using this system is demonstrated. FIG. 6 shows an example of a processing flow in the gesture input device 100 when a gesture is input by the user. In this flow, first, imaging of a moving image is started by the imaging unit 110 of the gesture input device 100 (step S500).

  Then, in the imaging data processing unit 120, a user face detection process and a face orientation determination process are performed from the imaging data generated based on the imaging signal from the imaging unit 110 (step S505). When it is detected that the user's face is facing the imaging unit 110 side (front) (step S510: YES), the imaging data is stored in the storage unit 130 (step S515). At this time, the feature amount of the gesture is extracted by the imaging data processing unit 120 and stored in the storage unit 130 together with the imaging data (step S520). Note that, as a result of the face detection process and the face direction determination process, if the user's face is not facing front (step S510: NO), the face detection process and the face direction determination process are subsequently performed (step S505).

  Then, it is determined by the control unit 140 whether or not the capturing of the imaging data and the feature amount of the gesture by the storage unit 130 should be stopped (step S525). In this example, the gravity center position of the user's hand remains in a predetermined area for a certain period of time, or the elapsed time after the capture command is output from the control unit 140 to the storage unit 130 reaches a preset time Then, it is determined that the condition for stopping the capture by the storage unit 130 is satisfied (step S530: YES), and a capture stop command is output from the control unit 140 to the storage unit 130.

  As a result, the capture of the image data and the feature amount of the gesture by the storage unit 130 ends (step S535), and the image data and the feature amount of the gesture are output to the gesture command processing device 200 (step S540). Thus, this flow ends. If the above conditions are not satisfied (step S530: NO), the feature value of the gesture is continuously extracted by the imaging data processing unit 120 and stored in the storage unit 130 together with the imaging data (step S520).

  FIG. 7 shows an example of a processing flow in the gesture command processing apparatus 200 when a gesture is input by the user. In this flow, first, the input gesture specifying unit 220 obtains image data and a feature amount of the gesture from the gesture input device 100 when the user performs a gesture (step S600). The input gesture specifying unit 220 searches for gestures that have already been assigned a command and stored in the gesture command storage unit 210 (step S605). Here, the feature amount of each gesture is compared with the feature amount of the input gesture (step S610). For example, DP matching is used for the gesture comparison. In addition, it is possible to speed up gesture search by indexing the gesture data stored in the gesture command storage unit 210 with a hash value.

  Then, if there is a gesture that matches the input gesture (step S610: YES), a command assignment condition that a change operation for changing a command assigned to the registered gesture to another command should be started ( Whether or not a command change request) is also input is confirmed by the gesture / command assignment unit 250 (step S615).

  If a command change request is input together with the already registered gesture (step S615: YES), the gesture command allocating unit 250 displays all the unregistered commands as candidate commands to be allocated after the change, and the display device 300. Is displayed on the display screen (step S650).

  FIG. 8 is an example of a list of candidate commands displayed on the display screen of the display device 300. As shown in FIG. 8, the candidate commands are displayed on the display screen of the display device 300 as a list corresponding to gestures to be performed to select the candidate commands, for example. In the list shown in FIG. 8, for example, candidate commands “A”, “B”, and “C” are “turn on power”, “turn off power”, and “switch input”, respectively.

  When the user performs a gesture for selecting a specific command from the list of commands displayed on the display device 300, the gesture / command allocation unit 250 changes the command associated with the registered gesture to the selected command. The change is made and stored in the gesture command storage unit 210 (step S655).

  On the other hand, if the command change request is not input together (step S615: NO), the command execution unit 230 executes the command stored in the gesture command storage unit 210 in association with the specified gesture. (Step S620).

  On the other hand, in step S610, if there is no gesture that matches the input gesture (step S610: NO), the gesture stored together with the input information in the new gesture storage unit 240 is searched by the input gesture specifying unit 220. That is, it is determined whether or not the input gesture is a gesture that has been input before (step S625).

  If the input gesture is a gesture stored together with the input information in the new gesture storage unit 240 (step S625: YES), the input information is updated (step S635). Then, the gesture / command assignment unit 250 reads the command assignment condition stored in the setting condition storage unit 260 and compares it with the input information updated in step S635 (step S640).

  If the input information corresponding to the input gesture satisfies the command allocation condition (step S645: YES), the gesture command allocation unit 250 lists all the unregistered commands as candidate commands to be allocated after the change. Is displayed on the display device 300 (step S650). When the user performs a gesture for selecting a specific command from the list of commands displayed on the display device 300, the gesture / command allocation unit 250 selects the command associated with the registered gesture. The command is changed and stored in the gesture command storage unit 210 (step S655).

  On the other hand, in step S625, if the input gesture is a new gesture that is not stored in the new gesture storage unit 240 (step S625: NO), the new gesture storage unit 240 determines the input time, the number of times of input, and the like. Is stored (step S630). This flow is completed by the above.

  As described above, according to the gesture input system 10 according to the present embodiment, even when a new gesture that is not stored in association with a command is input, a new command can be assigned to the gesture and stored. it can. In addition, since a condition for assigning a command to a new gesture can be set, for example, a user can input a new command to the gesture by inputting a predetermined number of continuous or simple gestures that are easy to understand for the user. Can be assigned and stored.

  Further, according to the present system, by setting a command allocation condition for allocating a command to a newly input gesture, for a new gesture input satisfying the command allocation condition, Commands to which no gesture is assigned can be assigned and stored. In addition, according to the present system, for a registered gesture to which a command has already been assigned, a specific gesture input or the like is set as a command change request for changing the command assigned to the registered gesture. Thus, the command associated with the registered gesture can be changed.

  Further, instead of a mode in which a user's gesture is imaged and specified as in the gesture input device 100 in the present system, for example, a controller incorporating an acceleration sensor or a GPS sensor is provided as the gesture input device 100, and the user inputs these controllers. A gesture may be input via. In addition, the gesture input device 100 may include a controller that can check and correct a gesture input by the user.

  Further, the gesture input device 100, the gesture command processing device 200, and the display device 300 in this system may be an integrated device or may be incorporated in the operation target device 400.

  FIG. 9 shows an exemplary hardware configuration of the computer 1000. The computer 1000 functions as the gesture command processing device 200 of the gesture input system 10 described with reference to FIGS. 1 to 8 based on a given program. For example, when the computer 1000 functions as the gesture command processing device 200, the program causes the computer 1000 to use the gesture command storage unit 210, the input gesture identification unit 220, the command execution unit 230, and the new gesture. The storage unit 240, the gesture / command allocation unit 250, the setting condition storage unit 260, and the unregistered command storage unit 270 may function.

  The computer 1000 includes a CPU peripheral unit, an input / output unit, and a legacy input / output unit. The CPU peripheral portion includes a CPU 1005, a RAM 1020, a graphic controller 1075, and a display device 1080 that are connected to each other by a host controller 1082. The input / output unit includes a communication interface 1030, a hard disk drive 1040, and a CD-ROM drive 1060 that are connected to the host controller 1082 by the input / output controller 1084. The legacy input / output unit includes a ROM 1010, a flexible disk drive 1050, and an input / output chip 1070 connected to the input / output controller 1084.

  The host controller 1082 connects the RAM 1020 to the CPU 1005 and the graphic controller 1075 that access the RAM 1020 at a high transfer rate. The CPU 1005 operates based on programs stored in the ROM 1010 and the RAM 1020 and controls each unit. The graphic controller 1075 acquires image data generated by the CPU 1005 or the like on a frame buffer provided in the RAM 1020 and displays the image data on the display device 1080. Instead of this, the graphic controller 1075 may include a frame buffer for storing image data generated by the CPU 1005 or the like.

  The input / output controller 1084 connects the host controller 1082 to the communication interface 1030, the hard disk drive 1040, and the CD-ROM drive 1060, which are relatively high-speed input / output devices. The communication interface 1030 communicates with the gesture input device 100, the display device 300, the operation target device 400, and the like via a network. The hard disk drive 1040 stores programs and data used by the CPU 1005 in the computer 1000. The CD-ROM drive 1060 reads a program or data from the CD-ROM 1095 and provides it to the hard disk drive 1040 via the RAM 1020.

  The input / output controller 1084 is connected to the ROM 1010, the flexible disk drive 1050, and the relatively low-speed input / output device of the input / output chip 1070. The ROM 1010 stores a boot program executed when the computer 1000 is started, a program depending on the hardware of the computer 1000, and the like. The flexible disk drive 1050 reads a program or data from the flexible disk 1090 and provides it to the hard disk drive 1040 via the RAM 1020. The input / output chip 1070 is a flexible disk drive 1050, such as a gesture input device 100, a display device 300, and an operation target device 400 via a parallel port, a serial port, a keyboard port, a mouse port, and the like. Input / output data to / from various input / output devices.

  A program provided to the hard disk drive 1040 via the RAM 1020 is stored in a recording medium such as the flexible disk 1090, the CD-ROM 1095, or an IC card and provided by the user. The program is read from the recording medium, installed in the hard disk drive 1040 in the computer 1000 via the RAM 1020, and executed by the CPU 1005.

  The program is installed in the computer 1000. The program works on the CPU 1005 or the like to cause the computer 1000 to change the above-described gesture / command storage unit 210, input gesture identification unit 220, command execution unit 230, new gesture storage unit 240, gesture / command allocation unit 250, setting condition storage. Function as the unit 260 and the unregistered command storage unit 270.

  The program shown above may be stored in an external recording medium. As the recording medium, in addition to the flexible disk 1090 and the CD-ROM 1095, an optical recording medium such as DVD or CD, a magneto-optical recording medium such as MO, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1000 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment.

DESCRIPTION OF SYMBOLS 10 ... Gesture input system, 100 ... Gesture input device, 110 ... Imaging part, 120 ... Imaging data processing part, 130 ... Storage part, 140 ... Control part, 200 ... Gesture command processing apparatus, 210 ... Gesture command storage part, DESCRIPTION OF SYMBOLS 220 ... Input gesture specific | specification part, 230 ... Command execution part, 240 ... New gesture memory | storage part, 250 ... Gesture command allocation part, 260 ... Setting condition memory | storage part, 270 ... Unregistered command memory | storage part, 300 ... Display apparatus, 400 ... Operation target device, 1000 ... computer, 1005 ... CPU, 1010 ... ROM, 1020 ... RAM, 1030 ... communication interface, 1040 ... hard disk drive, 1050 ... flexible disk drive, 1060 ... CD-ROM drive, 1070 ... input / output chip, 1 75 ... graphics controller, 1080 ... display device, 1082 ... the host controller, 1084 ... input and output controller, 1090 ... flexible disk, 1095 ... CD-ROM

Claims (7)

A gesture command storage unit that stores a gesture and a command executed by the gesture in association with each other;
An input gesture specifying unit for specifying a gesture input by the user;
A command execution unit that executes the command stored in the gesture command storage unit in association with the input gesture;
A new gesture storage unit that stores input information of the new gesture in association with the new gesture when the input gesture is a new gesture that is not stored in the gesture command storage unit;
A gesture command allocation unit that associates a command with the new gesture in which the input information satisfies a predetermined command allocation condition and stores the command in the gesture command storage unit;
A gesture command processing apparatus comprising: The new gesture storage unit stores the accumulated input count of the new gesture in association with the new gesture as the input information,
The gesture command allocating unit associates the command with the new gesture and stores the command in the gesture command storage unit in response to the cumulative input count of the new gesture reaching a predetermined number of times. The gesture command processing apparatus according to claim 1, characterized in that: The new gesture storage unit stores the number of continuous inputs of the new gesture in association with the new gesture as the input information,
The gesture command assigning unit associates the command with the new gesture and stores it in the gesture command storage unit in response to the number of continuous inputs of the new gesture reaching a predetermined number of times. The gesture command processing apparatus according to claim 1, wherein the gesture command processing apparatus is characterized. An unregistered command storage unit that stores the unregistered command that is not associated with any of the gestures;
The gesture command allocation unit stores the unregistered command in the gesture command storage unit in association with the new gesture that satisfies the command allocation condition. The gesture command processing device according to any one of the above. The gesture command allocation unit
When the input gesture is the gesture stored in the gesture command storage unit, the gesture command is associated with the gesture in response to the input of the command change request together with the gesture. 5. The gesture command processing apparatus according to claim 1, wherein the command stored in the storage unit is changed to another command. 6. Storing the gesture and the command executed by the gesture in association with each other;
Identify gestures entered by the user,
Execute the command corresponding to the input gesture,
When the input gesture is a new gesture that is not stored, the input information of the new gesture is stored in association with the new gesture,
A gesture command processing method characterized by storing the command in association with the new gesture in which the input information satisfies a predetermined command allocation condition. Computer
A gesture command storage unit that stores a gesture and a command executed by the gesture in association with each other;
An input gesture specifying unit for specifying a gesture input by the user;
A command execution unit that reads and executes the command corresponding to the input gesture from the gesture command storage unit;
A new gesture storage unit that stores input information of the new gesture in association with the new gesture when the input gesture is a new gesture that is not stored in the gesture command storage unit;
A gesture command allocating unit that associates the command with the new gesture in which the input information satisfies a predetermined command allocation condition and stores the command in the gesture command storage unit;
A program that functions as a gesture command processing device.

Images