JP2011242889A - Information input device using gesture, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To recognize a gesture action with high accuracy using relatively simple image processing.SOLUTION: A television receiver 2 receives graphic data drawn on a touch panel of a remote controller 1 to be stored in a signal storage unit 21. A gesture recognition unit 30 detects a start/end point A of the stored graphic data, and detects a trajectory between the start and end points configuring the start/end point A to determine the shape of the graphic. When a predetermined graphic shape including the start/end point A is detected, the direction of a graphic drawing position with respect to the start/end point A is detected to associate the direction with a direction key, and a cursor position in EPG information is moved.

Description

  The present invention relates to an apparatus, a method, and a program for recognizing input information expressed using a gesture such as a user's finger or arm movement.

  As a representative technique for pointing to information displayed on the screen of a display device, a technique using a pointing device such as a mouse or a tablet pen is known. In addition, as other pointing techniques, there are known a technique for performing pointing remotely using a remote control terminal and a technique for performing pointing by recognizing a user's gesture operation.

  In the technology using the remote control terminal, for example, a user operates a cursor key such as a cross key provided on the remote control terminal with a finger, and the operation data is transmitted to the display device via infrared or wireless. Pointing is performed by receiving operation data.

  On the other hand, a technique for recognizing a user's gesture motion is, for example, capturing a user's motion using a camera, recognizing a motion locus of a specific body part of the user from the captured image data by pattern recognition processing, Pointing is performed based on the recognition result (see, for example, Patent Document 1).

JP 2004-272598 A

However, these conventional pointing techniques have the following problems to be solved.
Touch screen terminals that have become popular in recent years are not equipped with a mechanical cursor key. By displaying the cursor key on the touch panel and tapping the displayed cursor key, the mechanical cursor key is displayed. The pointing operation is realized. However, while it can be operated by pressing a key while touching the key with a mechanical cursor key, it is difficult to grasp without knowing where the finger is located until the finger touches the panel on the touch panel. Therefore, it is difficult to input such a touch panel type cursor key pressing operation without looking at the cursor key displayed on the touch panel. For example, the remote controller is used to operate from a remote location such as a television receiver. Operation is difficult for equipment.

  On the other hand, in the method of recognizing a user's gesture action, the process of recognizing the user's gesture action and associating it with an input command strongly depends on the image processing, and in order to improve the recognition accuracy of the gesture action, a marker or sensor prepared in advance Etc. need to be worn on the user's hand or finger. For this reason, there is a problem that the system becomes large and the operability of the user is impaired.

  The present invention has been made paying attention to the above circumstances, and the object of the present invention is to make it unnecessary to display cursor keys on the touch panel when using a remote control terminal using a touch panel method, and to use a camera. The present invention provides an information input device, method, and program using a gesture that eliminates the need for attaching a marker or the like to a user and that can recognize a gesture operation with high accuracy by relatively simple image processing. .

  In order to achieve the above object, a first aspect of the present invention is to capture and save graphic data drawn by a gesture, and detect first and second points whose coordinates match from the stored graphic data. Then, the detected first and second points are recognized as the starting point of the graphic data. When this end point is detected, a trajectory between the first point and the second point is detected based on the stored graphic data, and the detected trajectory and the end point are detected. At the same time, the characteristics of the graphic data are determined, and information representing the characteristics of the determined graphic data is converted into input information.

  Therefore, the feature of the graphic data is determined based on the start point of the graphic data drawn by the user's gesture operation and the trajectory between the start point and the end point, and the input information is recognized based on this feature. . For this reason, whether you draw a figure by moving your finger on the touch panel of the remote control terminal or when you draw a figure by moving your hand or arm in front of the camera, the starting point and the locus between them are detected from the drawn figure data. By simply doing this, it is possible to recognize the input information by determining the feature of the figure from the detection result. That is, it becomes possible to recognize input information by a gesture by relatively simple image processing. In addition, when a touch panel is used, it is possible to easily operate without visually recognizing the keys on the touch panel, so there is no need to display operation keys on the touch panel of the remote control terminal. No need to wear etc. From the above, operational restrictions are reduced and operability can be improved.

According to a second aspect of the present invention, when converting information representing the characteristics of graphic data into input information, a plurality of direction areas are set in different directions around the detected start point, and the detected locus It is determined which of the plurality of directional areas is included, and information indicating the determination result is converted into an input command indicating the movement direction of the cursor.
In this way, it becomes possible for the user to designate and input the moving direction of the cursor depending on in which direction the graphic is drawn with respect to the starting point. For this reason, it is possible to recognize the movement direction of the cursor without performing special image processing.

According to a third aspect of the present invention, when information representing the characteristics of graphic data is converted into input information, the type of graphic data is determined based on the detected locus, and the determined graphic data The contents of the input command are changed according to the shape type.
In this way, according to the type of shape of the figure drawn by the gesture, for example, an input command indicating the cursor movement direction is changed to a command for switching the display screen, or the cursor movement instruction function and the display screen are displayed. It is possible to change to a command having both of the switching instruction functions.

According to a fourth aspect of the present invention, when information representing the characteristics of graphic data is converted into input information, any one of the drawing speed, drawing time, and drawing size of the graphic data is determined based on the detected locus. And the contents of the input command are changed according to any one of the drawing speed, drawing time, and drawing size of the detected graphic data.
In this way, according to either the drawing speed, the drawing time, or the drawing size of the detected graphic data, for example, an input command that indicates only the moving direction of the cursor is a function that indicates both the moving direction and the moving amount thereof. It is possible to change to an input command having As a result, for example, when the user draws a figure at a slower speed slower than the normal speed, draws a time longer than the normal drawing time, or draws a figure larger than the normal size, the cursor 1 It is possible to realize highly functional information input such as setting a large number of movement steps.

  That is, according to the present invention, an operation key or the like is not required when a remote control terminal is used, and a marker or the like is not required to be attached to a user when a camera is used. It is possible to provide an information input device, method, and program using a gesture capable of recognizing gesture operation with high accuracy by processing.

1 is a schematic configuration diagram showing a system configuration of an information input device according to a first embodiment of the present invention. The block diagram which shows the function structure of the television receiver shown as an information input device in FIG. It is a flowchart which shows the process sequence of the whole television receiver shown in FIG. 2, and the processing content. The flowchart which shows the procedure and content of a signal reception process among the whole process procedures shown in FIG. The flowchart which shows the procedure and process content of gesture recognition process among the whole process procedures shown in FIG. The flowchart which shows the procedure and process content of a display image control process among the whole process procedures shown in FIG. The figure for demonstrating the 1st method for detecting the coincidence of the start point and end point of a figure in the gesture recognition process shown in FIG. The figure for demonstrating the 2nd method for detecting the coincidence of the start point and end point of a figure in the gesture recognition process shown in FIG. The figure for demonstrating a direction key detection process in the gesture recognition process shown in FIG. The figure for demonstrating a direction key detection process in the gesture recognition process shown in FIG. The figure which shows the kind of shape of the gesture drawing figure used in the information input device concerning 2nd Embodiment of this invention. The schematic block diagram which shows the system configuration | structure of the information input device concerning the 3rd Embodiment of this invention.

Embodiments according to the present invention will be described below with reference to the drawings.
(First embodiment)
It is a schematic block diagram which shows the system configuration | structure of the information input device concerning the 1st Embodiment of this invention. In this system, a television receiver 2 receives a remote control signal transmitted from a remote control device (hereinafter abbreviated as a remote control device) 1. For example, infrared or wireless is used as the communication line 3. As a communication method in the case of wireless, a short-range wireless data communication method of weak or low power type such as Bluetooth (registered trademark) can be used.

  The remote control device 1 is composed of a terminal using a capacitive touch panel as an input device. Then, the electrostatic distribution data of the touch panel is transmitted to the television receiver 2 as a remote control signal in real time.

By the way, the television receiver 2 is configured as follows. FIG. 2 is a block diagram showing the functional configuration.
That is, the television receiver 2 includes a signal receiving unit 10 that receives a remote control signal transmitted from the remote control device 1, a database 20, a gesture recognition unit 30, and a display image control unit 40.

  The signal receiving unit 10 includes a signal receiving unit 12 that receives an infrared or wireless remote control signal transmitted from the remote control device 1 and a signal reception determining unit 11. The signal reception determination unit 11 determines the presence / absence of finger contact with the touch panel based on the remote control signal received by the signal reception unit 12 and stores electrostatic distribution data in the database 20 in the period determined to be in contact. The process which memorize | stores in the signal storage part 21 is performed.

  The database 20 includes a signal storage unit 21, a gesture command conversion table unit 22, a display image data storage unit 23, and a graphic pattern storage unit 24. The signal storage unit 21 is used for storing electrostatic distribution data of the remote control signal received by the signal receiving unit 10. The gesture command conversion table unit 22 stores in advance information representing the display processing content that the input command means in association with a plurality of input commands to be recognized. The display image data storage unit 23 stores various display image data necessary for displaying an image corresponding to the display processing content meaning the input command. The graphic pattern storage unit 24 stores basic patterns of a plurality of graphic shapes to be recognized.

  The gesture recognition unit 30 includes an end-to-end point coincidence detection unit 31, a graphic tracking unit 32, a graphic determination unit 33, and a graphic position determination unit 34. These functions are realized by causing the central processing unit (CPU) to execute an application program stored in a program memory (not shown) in the database 20 together with the received signal determination unit 11.

  The end point coincidence detection unit 31 is based on the electrostatic distribution data stored in the signal storage unit 21, and the end point of the graphic data drawn by the user moving his / her finger on the touch panel of the remote control device 1, that is, It has a function of detecting two points whose coordinate values match.

  The figure tracking unit 32 uses the electrostatic distribution data stored in the signal storage unit 21 as the locus of the figure connecting the two points detected as the starting point by the starting point coincidence detecting unit 31, that is, the starting point and the ending point. It has a function to detect originally.

  The graphic position determination unit 34 sets four direction areas in the up, down, left, and right directions of the touch panel around the start point detected by the start point match detection unit 31, and the trace of the graphic detected by the graphic tracking unit 32. It is determined which of the four directional areas is included in the drawing position. Then, an input command corresponding to the determination result is generated. In addition to setting four direction areas, it is also possible to set eight direction areas in each of the diagonal directions of the touch panel.

  The graphic determination unit 33 refers to the basic patterns of a plurality of graphic shapes to be recognized stored in the graphic pattern storage unit 24 of the database 20 and corresponds to which graphic the locus detected by the graphic tracking unit 32 corresponds to. Determine whether. For this determination process, pattern matching is used. Then, it is determined whether or not the input command generated by the graphic position determination unit 34 needs to be updated according to the determined shape type of the graphic, and the input command is changed when it is necessary to update it. Process.

  The display image control unit 40 includes an image update unit 41, an image output unit 42, and a display image determination unit 43. These functions are also realized by causing the central processing unit (CPU) to execute an application program, similarly to the functions of the gesture recognition unit 30 described above.

  The image updating unit 41 displays the meaning of the input command from the gesture command conversion table unit 22 based on the input command generated by the graphic position determining unit 34 or the input command updated by the graphic determining unit 33. Information representing the processing content is read out, and the display image data is updated based on the read out information.

The image output unit 42 performs a process of outputting and displaying the display image data updated by the image update unit 41 on a display (not shown).
The display image determination unit 43 performs processing for determining image data to be displayed on the display.

Next, the operation of recognizing input information using gestures by the television receiver 2 configured as described above will be described.
FIG. 3 is a flowchart showing the overall processing procedure and processing contents. Here, a case will be described as an example where electronic program guide (EPG) information is displayed on the display of the television receiver 2 and a program selection operation is performed from the remote control device 1 for this EPG information.

  In the remote control device 1, when a user draws a figure for selecting the program on the touch panel with a finger, information representing the electrostatic distribution is transmitted as a remote control signal from the remote control device 1 via the communication line 3 to the television receiver. 2 is sent.

  First, in step S11, the television receiver 2 performs a process in which the signal receiving unit 12 and the signal reception determining unit 11 of the signal receiving unit 10 receive the remote control signal. In step S12, the television receiver 2 is represented by the received remote control signal. The process of storing the electrostatic distribution data to be stored in the signal storage unit 21 in the database 20 is executed.

  Next, in step S <b> 13, the gesture recognition unit 30 detects the start point from the graphic data drawn by the user on the touch panel of the remote control device 1 based on the electrostatic distribution data stored in the signal storage unit 21. Thus, it is determined whether or not the figure corresponds to the program selection operation of the EPG information. If the figure corresponds to a program selection operation of EPG information, the position where the figure is drawn and the shape of the figure are determined, and an input command is generated or updated according to the determination result.

  Finally, in step S14, the display image control unit 40 searches for information representing the display processing content that the input command generated in step S13 means, and in accordance with this information, the program selection position for the EPG information, that is, the cursor position. The display image data is updated so as to change the position.

Hereafter, the processing content in each said step S11-S14 is demonstrated in detail.
(1) Signal reception processing
FIG. 4 is a flowchart showing the procedure and details of the signal reception process.
In the signal receiving unit 10, when it is detected in step S 21 that the signal receiving unit 12 has received the remote control signal transmitted from the remote control device 1, first, in step S 22, the signal reception determining unit 11 stores the received remote control signal. Whether or not the user's finger is in contact with the touch panel is determined. If the result of this determination is that there is no contact, the electrostatic distribution data is erased from the signal storage unit 21 in step S23. On the other hand, when the finger continues to touch the touch panel, the electrostatic distribution data representing the graphic drawn by the continuous contact operation is output to the signal storage unit 21 of the database 20 and stored in step S24. Therefore, data representing a figure drawn on the touch panel of the remote control device 1 is stored in the signal storage unit 21.

(2) Gesture Recognition Processing FIG. 5 is a flowchart showing the procedure and processing contents of this gesture recognition processing.
The gesture recognition unit 30 first executes the end point coincidence detection process in step S31 as follows. That is, the start point coincidence detection unit 31 reads out the electrostatic distribution data from the signal storage unit 21 and draws by moving the finger on the touch panel of the remote control device 1 based on the read out electrostatic distribution data. The end point of the graphic data, that is, two points having the same coordinate value are detected.

  At this time, for example, the following two methods can be considered as the starting point detection method. In the first detection method, as shown in FIG. 7, when the user starts drawing the figure B from the point A where the user first touched the finger on the touch panel and touches the point A again, this point A is detected as the starting point. Is. In the second detection method, when the user moves a finger on the touch panel and draws a figure as shown in FIG. 8, the locus is traced and the point where the locus intersects is detected as the starting point A. is there.

  When the start point A is detected, the gesture recognition unit 30 determines that the graphic drawn by the user on the touch panel satisfies the condition as the graphic representing the program selection operation of the EPG information, and performs the graphic tracking process in step S32. Transition. On the other hand, if the starting point A is not detected, no processing is performed, and if the finger is released in a state where it is not detected, it is determined in S23 that the drawn figure does not satisfy the selection operation condition. The gesture recognition process is finished as it is. When the gesture recognition process is completed, the gesture recognition unit 30 erases the determination target electrostatic distribution data stored in the signal storage unit 21.

  Next, in step S32, the gesture recognition unit 30 executes the graphic tracking process as follows. That is, the signal storage unit 21 stores electrostatic distribution data from the end point (time Te) to the start point (time Ts) constituting the start point A detected by the end point match detection process (step S31) by the figure tracking unit 32. Read from. Then, based on the read electrostatic distribution data, processing for tracing the locus of the graphic data is performed.

  As means for tracking the trace of the graphic data, for example, the following can be considered. That is, in the case of a touch panel using electrostatic capacitance, the electrostatic distribution with respect to the periphery of the point touched by the finger is a convex distribution. Therefore, the locus of the drawn graphic data can be traced by connecting the vertices of the convex distribution.

  When the locus of the graphic data is detected, the gesture recognition unit 30 subsequently executes graphic determination processing in step S33. That is, a plurality of basic graphic patterns are sequentially read from the graphic pattern storage unit 24 of the database 20 by the graphic determination unit 33, and the read basic graphic pattern and the locus of the graphic detected by the graphic tracking process (step S32). Are compared by pattern matching processing, and the similarity is detected. Then, the highest similarity that is equal to or greater than the threshold value is selected. The selected basic graphic pattern is recognized as the shape type of the graphic drawn on the touch panel.

  Next, the gesture recognition unit 30 proceeds to step S34 and executes a graphic position determination process. That is, the figure position detection unit 34 firstly centers the start point A detected by the start point coincidence detection process (step S31), as shown in FIG. Four direction areas are set in (b). Then, it is determined which of the four direction areas the drawing position of the locus of the figure detected by the figure tracking process (step S32) is included. For example, this determination processing obtains the center of gravity of the drawn figure, assumes that the drawing position of the figure exists in the direction of the straight line connecting the center of gravity and the start point A, and the direction of this straight line is the angle of any direction area. This is possible by determining whether it is included.

  When the drawing position of the figure is determined, the gesture recognition unit 30 subsequently executes a direction key detection process in step S35, and the drawing position of the figure determined by the figure position determination process (step S34) is changed up, down, left, and right. Correspond to one of the four directions. Then, an input command corresponding to the associated direction key is generated.

  For example, as shown in FIG. 10A, when the drawing position of the figure is included in the left direction area with respect to the start point A, an input command indicating the left direction key is generated, and conversely, included in the right direction area. An input command indicating a right arrow key is generated. Similarly, as shown in FIG. 10B, when the drawing position of the figure is included in the upward area with respect to the starting point A, an input command indicating an upward key is generated, and conversely, included in the downward area. In this case, an input command indicating a down key is generated.

  In the graphic position determination process (step S34) described above, the case where it is determined which of the four directions the graphic drawing position is included as shown in FIG. However, the present invention is not limited to this. For example, as shown in FIG. 9B, eight directional areas (A), (B), (C), and (D) in the vertical and horizontal directions are set, and the drawing position of the detected figure is set. May be included in any of the above eight direction regions. In this case, in the direction key detection process (step S35), the drawing position of the figure is associated with one of eight directions that are diagonally up, down, left, and right. An input command corresponding to the associated direction key is generated.

(3) Display Image Control Process When the gesture recognition process (step S13) is completed, the display image control unit 40 subsequently executes a display image update process as follows. FIG. 6 is a flowchart showing the control procedure and control contents.

  First, in step S42, based on the input command generated by the graphic position determination process (step S34), the image update unit 41 obtains information representing the display processing content that the input command means from the gesture command conversion table unit 22. A process of updating the display image data based on the read information is performed.

For example, if the meaning of the input command generated by the graphic position determination process (step S34) indicates a left direction key, the cursor is updated to an image in which the position of the cursor in the EPG information is shifted by one column in the left direction. The On the other hand, if the meaning of the input command indicates a right arrow key, the cursor is updated in the EPG information to an image shifted by one column to the right. Similarly, if the meaning of the input command indicates an up or down key, the cursor position in the EPG information is updated to an image that is shifted up or down by one column, respectively. Note that the display image of the EPG is similarly updated in the case of the 8-direction key.
Then, the display image of the EPG updated as described above is output and displayed on the display in step S42.

  Therefore, the user selectively draws one of the four circles shown in FIG. 9A on the touch panel of the remote control device 1 as shown in FIG. 7, so that the cursor position in the EPG information is set to a desired program. It is possible to make step movement to the position. For example, when the cursor position of the EPG information is moved to the right by two steps, the circle R in FIG. 9A may be drawn twice.

As described above in detail, in the first embodiment, the graphic data drawn on the touch panel of the remote control device 1 is received by the television receiver 2 and stored in the signal storage unit 21, and the above-mentioned storage is performed by the gesture recognition unit 30. The end point A of the graphic data thus detected is detected, and the locus between the start point and the end point constituting the end point A is detected to determine the shape of the graphic. When a predetermined figure shape having the start point A is detected, the direction of the drawing position of the figure with respect to the start point A is detected, the detected direction is associated with the direction key, and the cursor position in the EPG information is set. I try to move it.
Therefore, since the television receiver 2 only needs to recognize a circular figure having the starting point A, the gesture can be recognized by relatively simple image processing. Further, it is not necessary to display a cursor key on the touch panel of the remote control device 1. Users can input without viewing the touch panel.

(Second Embodiment)
In the second embodiment of the present invention, by changing the shape of a figure drawn on the touch panel of the remote control device 1, a page changing operation of EPG information can be performed instead of a cursor moving operation. .
In the second embodiment, the description will be made with reference to FIGS. 1 and 2 used in the first embodiment.

  The graphic determination unit 33 of the gesture recognition unit 30 recognizes a square (b), a hexagon (c), a triangle (d), or a pentagon (e) in addition to the circle (a) as shown in FIG. have. This graphic shape recognition processing is performed by pattern matching the trajectory of a graphic drawn on the touch panel with a plurality of basic patterns of graphic shapes stored in advance in the graphic pattern storage unit 24.

  The display image determination unit 43 of the display image control unit 40 stores the graphic stored in the database 20 as to which of the operation contents for the EPG information corresponds to the shape type of the drawing graphic recognized by the graphic determination unit 33. The determination is based on table information (not shown) indicating the correspondence between the shape and the operation content. Then, a process of selecting a display screen corresponding to the determined figure shape type and displaying it on the display is performed.

  For example, if the triangle shown in FIG. 11 (d) is drawn and the drawing direction of the triangle is rightward with respect to the starting point, it is determined that the EPG information page feed operation is performed, and the display screen of the next page is displayed. Display. On the other hand, if the triangle drawing direction is to the left with respect to the starting point, it is determined that the EPG information page return operation and the display screen of the previous page is displayed.

  If the rectangle shown in FIG. 11B is drawn and the drawing direction of the rectangle is upward with respect to the start point, it is determined that the operation is a switching operation of EPG information for broadcasting using a broadcasting satellite (BS broadcasting). Then, EPG information of BS broadcast is displayed. On the other hand, if the drawing direction of the quadrangle is downward with respect to the starting point, it is determined that the operation is a switching operation of EPG information of broadcasting using a communication satellite (CS broadcasting), and EPG information of CS broadcasting is displayed. Similarly, if the drawing direction of the quadrangle is rightward with respect to the starting point, it is determined that the operation is for switching EPG information for cable television broadcasting (CATV broadcasting), and the EPG information for CATV broadcasting is displayed. If the quadrangular drawing direction is the left direction with respect to the start point, it is determined that the digital terrestrial broadcast EPG information is switched, and the digital terrestrial broadcast EPG information is displayed.

  If the user draws a circular figure on the touch panel of the remote control device 1 after changing the EPG information page, the program of the displayed EPG information is selected according to the series of processes described in the first embodiment. Cursor movement is performed.

  As described above, according to the second embodiment, if the shape of the figure drawn on the touch panel of the remote control device 1 is changed, a page changing operation of EPG information can be performed instead of the cursor moving operation.

(Third embodiment)
In the third embodiment of the present invention, when a user moves his / her arm and draws a figure in the space, the movement of drawing the figure, that is, the user's gesture is imaged by the camera, and the captured image data is received by the television. The gesture is recognized based on the captured figure.

  In order to realize this embodiment, for example, as shown in FIG. 12, a camera 4 is attached to the television receiver 2, and a user's gesture is imaged by the camera 4. The signal receiving unit 10 of the television receiver 2 has a function of receiving captured image data output from the camera 4, extracting data representing arm movement from the captured image data, and storing the extracted data in the signal storage unit 21. . Arm recognition is possible by pattern matching. The functions of the gesture recognition unit 30 and the display image control unit 40 are the same as the functions described in the first and second embodiments.

  As described above, according to the third embodiment, even when the user moves his / her arm and draws a figure in the space, the figure based on this gesture is captured by the camera 4 and loaded into the television receiver 2. As in the first and second embodiments described above, it is possible to perform a program selection operation and a page change operation for EPG information by a user's gesture.

(Other embodiments)
In the first embodiment, the drawing position with respect to the starting point A of the figure is detected and the movement direction of the cursor is controlled. However, the present invention is not limited to this, and the drawing speed, drawing time, or drawing size of the figure may be determined, and the amount of movement of the cursor may be changed according to the determination result of the drawing speed, drawing time, or drawing size of the figure. .

  For example, if the user draws a figure at a slower speed slower than the normal speed, takes a longer time than the normal drawing time, or draws a figure larger than the normal size, Increase the moving step amount. The drawing speed or drawing time of the figure is detected by detecting the reception start timing and the reception end timing of the graphic data, respectively, or by detecting the detection timing of the start point and the end point constituting the start point A, and based on each detected timing. Can be obtained by calculation. In this embodiment as well, the movement direction of the cursor is determined by the direction of the drawing position of the figure with respect to the starting point A of the drawn figure as described in the first embodiment.

In the first embodiment, the gesture recognition process is performed in the television receiver 2, but the same process is performed in the remote controller 1, and an input command representing the recognition result is transmitted to the television receiver. It may be configured. In each of the above embodiments, the case where the EPG information displayed on the television receiver 2 is operated by the gesture has been described as an example. However, the display screen of the personal computer or the display screen by the video projector is operated by the gesture. It may be.
In addition, the type and configuration of the information input device, the processing procedure and processing content, the shape of the figure, and the like can be variously modified without departing from the paper of the present invention.

  In short, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in each embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 1 ... Remote control apparatus, 2, 5 ... Television receiver, 3 ... Communication line, 4 ... Camera, 10 ... Signal reception unit, 11 ... Signal reception judgment part, 12 ... Signal reception part, 20 ... Database, 21 ... Signal accumulation , 22 ... gesture command conversion table part, 23 ... display image data storage part, 24 ... figure pattern storage part, 30 ... gesture recognition unit, 31 ... start point coincidence detection part, 32 ... figure tracking part, 33 ... figure judgment part , 34... Graphic position determination unit, 40... Display image control unit, 41... Image update unit, 42.

Claims (9)

Means for capturing and saving graphic data drawn by gestures;
Means for detecting first and second points having the same coordinates from the stored graphic data, and recognizing the first and second points having the same coordinates as the start points of the graphic data;
Means for detecting a trajectory between the first point and the second point of the stored graphic data if the end point is detected;
Conversion means for determining characteristics of the graphic data based on the recognized starting point and the detected locus, and converting information representing the characteristics of the determined graphic data into input information. An information input device using a featured gesture. The converting means includes
Means for setting a plurality of direction areas in different directions around the recognized start point, and determining which of the plurality of direction areas the drawing position of the detected locus is included;
The information input device using a gesture according to claim 1, further comprising means for converting information representing the determination result into an input command representing a movement direction of a cursor. The converting means includes
Means for determining the type of shape of the graphic data based on the detected locus;
The information input device using a gesture according to claim 2, further comprising means for changing the content of the input command in accordance with the determined shape type of the graphic data. The converting means includes
Means for detecting any one of a drawing speed, a drawing time, and a drawing size of the graphic data based on the detected locus;
3. The information using a gesture according to claim 2, further comprising means for changing the content of the input command according to any one of the drawing speed, drawing time, and drawing size of the detected graphic data. Input device. The process of capturing and saving graphic data drawn by gestures,
Detecting the first and second points having the same coordinates from the stored graphic data, and recognizing the first and second points having the same coordinates as the starting points of the graphic data;
A step of detecting a trajectory between the first point and the second point of the stored graphic data when the end point is detected;
A conversion process for determining characteristics of the graphic data based on the recognized starting point and the detected locus, and converting information representing the characteristics of the determined graphic data into input information. An information input method using a feature gesture. The conversion process is:
Setting a plurality of direction areas in different directions around the recognized start point, and determining which of the plurality of direction areas the drawing position of the detected trajectory is included in;
The information input method using a gesture according to claim 1, further comprising: converting information representing the determination result into an input command representing a movement direction of a cursor. The conversion process is:
Determining the shape type of the graphic data based on the detected locus;
3. The information input method using a gesture according to claim 2, further comprising a step of changing contents of the input command in accordance with the determined shape type of the graphic data. The conversion process is:
A process of detecting any of drawing speed, drawing time and drawing size of the graphic data based on the detected locus;
The gesture according to claim 2, further comprising a step of changing the content of the input command according to any one of a drawing speed, a drawing time, and a drawing size of the detected graphic data. How to enter information.   The program which makes the computer with which the said information input device performs the process corresponding to each means with which the information input device is provided of Claims 1 thru | or 4.

Images