JP5449088B2 - Information input device - Google Patents

Description

  The present invention relates to an information input device having a function of selecting and operating a link of a web page using a gesture such as a finger movement of a user.

  In recent years, browser functions for accessing the Internet have been installed not only in personal computers but also in game consoles, television receivers, and the like, so that websites on the Internet can be browsed from television receivers.

  Since a personal computer is generally installed on a table, the website can be accessed using a pointing device such as a keyboard or a mouse. However, since game machines and television receivers are often viewed from a remote location, it is difficult to perform browsing operations by connecting a pointing device such as a mouse, and it is necessary to rely on operations by a remote controller.

  However, when electronic program guide (EPG) information is displayed on the display of the television receiver, many links to the website for each program are displayed. Also, when a web page such as a news site is displayed, a number of news headlines and links to each genre are displayed. On the other hand, a remote controller generally has only a cross-shaped cursor key in addition to numeric keys and function keys. For this reason, it is very troublesome to selectively operate the multiple links using a remote controller.

Therefore, conventionally, a technique has been proposed in which an arrow tag having a different direction is assigned to each link and displayed, and a desired link can be selected and operated by operating the cursor key of the remote controller according to the displayed arrow tag. (For example, refer to Patent Document 1).
Recently, personal devices with touch panels such as smartphones are rapidly spreading, and the use of this type of device as a remote controller for a television receiver is being studied. In addition, cameras that are installed in television receivers for so-called videophone services are also appearing, and remote control operations using image recognition of cameras are increasing.

JP 2008-217228 A

  However, there are as many as 80 links on a web page, while there are only four types of arrow tags indicating up, down, left, and right. For this reason, in order to individually identify the large number of links, the four types of arrow tags must be combined in three or four types. In such a case, the user has to operate the cursor key three or four times each time in order to select one desired link, and the number of operations increases, and much effort is required before selecting one link. And takes time. Also, inputting the up / down / left / right direction keys on the touch panel is more troublesome than pressing a conventional mechanical button. Furthermore, it is not easy to perform vertical and horizontal input by a conventional input method using image recognition using a camera.

  The present invention has been made by paying attention to the above circumstances, and the object of the present invention is to make it possible to select and operate a link such as a web page with a small number of times using a gesture, and to easily and easily perform an operation by the gesture. It is an object of the present invention to provide an information input device that can be accurately performed to improve operability.

In order to achieve the above object, one aspect of the present invention is that a two-dimensional figure drawn by a single stroke is set for link information for accessing another information page set in an information page displayed on a display. Unique graphic tag information expressed by combining the type and the position of the start point of the two-dimensional graphic is assigned, and this graphic tag information is displayed on the information page in a state associated with the link information. In this state, the two-dimensional graphic data drawn by a single stroke is taken and the positional relationship between the type of the drawn two-dimensional graphic and the starting point of the two-dimensional graphic is determined from the drawing locus and the coordinates of the starting point. If the two-dimensional figure type and the positional relationship between the start point of the two-dimensional figure are compared with the figure tag information being displayed on the information page, and the two match, the figure tag information being displayed The link information associated with is selected.

Therefore, a large number of graphic tag information can be expressed by a combination of a small number of two-dimensional graphics, and a large number of link information is set on the information page by individually assigning this graphic tag information to the link information. However, the user can select desired link information with a small number of graphic drawing times. For this reason, it is possible to improve the operability by reducing the number of operations when selecting link information, compared to, for example, using an arrow tag that combines four types of arrows, that is, up, down, left, and right.
Moreover, graphic tag information is displayed on the information page in association with the link information. For this reason, the user can always draw and input a figure easily and accurately without making a mistake according to the figure tag information associated with the desired link information.

One aspect of the present invention is characterized by comprising the following aspects.
In the first aspect, when tag information is displayed, graphic tag information expressed by one two-dimensional graphic is preferentially given to link information that is highly likely to be selected by the user among a plurality of pieces of link information. To be assigned.
In the second mode, when tag information is displayed and there are a plurality of pieces of graphic tag information having the same number of figures, a rounded two-dimensional figure such as an ellipse or a circle is used. The assigned graphic tag information is preferentially assigned to the link information to be assigned.
In the third aspect, in the case of graphic tag information using a graphic with corners such as a polygon when displaying tag information, a graphic with a small number of corners is given priority over the link information to be allocated. Assign.
In the fourth aspect, when there is a plurality of graphic tag information expressed by a combination of a plurality of two-dimensional graphics when displaying the tag information, the positional relationship of the plurality of graphics among these graphic tag information is pointed out. Symmetric graphic tag information is preferentially assigned to the assignment target link.
By selectively adopting these modes, it is possible to perform a selection operation of link information that is highly likely to be selected from link information in a simpler and shorter time.

  In the fifth aspect, information indicating the type of graphic tag, information indicating the link destination address, information specifying the display position of the graphic tag information, and information specifying the display color are associated with each other. . In this way, the display position and display color of the graphic tag information can be controlled, so that the graphic tag information can always be displayed in an optimal state.

  In the sixth aspect, it is determined whether or not the user has performed an operation indicating the intention to select link information, and the graphic tag information is displayed on the information page only when the operation is performed. In this way, the graphic tag information is displayed only when the user indicates an intention to select link information. For this reason, when the user performs other operations such as a scroll operation of the display screen, the graphic tag information is not displayed, so that the display screen of the information page is not congested with the graphic tag information. Can be.

  That is, according to the present invention, a link such as a web page can be selected and operated with a small number of times using a gesture, and the operability is improved by making it possible to easily and accurately perform the operation using the gesture. An information input device can be provided.

1 is a schematic configuration diagram showing a system configuration of an information input device according to an embodiment of the present invention. The block diagram which shows the function structure of the television receiver shown as an information input device in FIG. 3 is a flowchart showing an overall processing procedure and processing contents of the television receiver shown in FIG. 2. The flowchart which shows the procedure and content of a signal reception process among the whole process procedures shown in FIG. The flowchart which shows the procedure and process content of gesture recognition process among the whole process procedures shown in FIG. The flowchart which shows the procedure and process content of a display image control process among the whole process procedures shown in FIG. 7 is a flowchart showing the processing procedure and processing contents of a UFT-link correspondence table process and a gesture input correspondence process in the display image determination process in the display image control process shown in FIG. 6. 7 is a flowchart showing a processing procedure and processing contents of a display image update process including a UFT information display determination process in the display image control process shown in FIG. 6. The figure for demonstrating the 1st method for detecting the coincidence of the start point and end point of a figure in the gesture recognition process shown in FIG. The figure for demonstrating the 2nd method for detecting the coincidence of the start point and end point of a figure in the gesture recognition process shown in FIG. The figure for demonstrating a direction key detection process in the gesture recognition process shown in FIG. The figure for demonstrating a direction key detection process in the gesture recognition process shown in FIG. The figure which shows an example of the kind of UFT used in the display image determination process shown in FIG. The figure which shows an example of the kind of EUOT used in the display image determination process shown in FIG. The figure which shows the initial state of the UFT-link corresponding table memory | storage part used in the display image determination process shown in FIG. The figure which shows the state which memorize | stored the information in the UFT-link corresponding table memory | storage part used in the display image determination process shown in FIG. The figure which shows an example of the state by which UFT was displayed on the display. The figure which shows the state by which one of UFT displayed on the display was selected.

Embodiments according to the present invention will be described below with reference to the drawings.
It is a schematic block diagram which shows the system configuration | structure of the information input device concerning one Embodiment of this invention. In this system, a television receiver 2 receives a remote control signal transmitted from a remote control device (hereinafter abbreviated as a remote control device) 1. For example, infrared or wireless is used as the communication line 3. As a communication method in the case of wireless, a short-range wireless data communication method of weak or low power type such as Bluetooth (registered trademark) can be used.

  The remote control device 1 is composed of a terminal using a capacitive touch panel as an input device. Then, the electrostatic distribution data of the touch panel is transmitted to the television receiver 2 as a remote control signal in real time.

By the way, the television receiver 2 is configured as follows. FIG. 2 is a block diagram showing the functional configuration.
That is, the television receiver 2 includes a signal receiving unit 10 that receives a remote control signal transmitted from the remote control device 1, a database 20, a gesture recognition unit 30, and a display image control unit 40.

The signal receiving unit 10 includes a signal receiving unit 12 that receives an infrared or wireless remote control signal transmitted from the remote control device 1 and a signal reception determining unit 11. The signal reception determination unit 11 determines the presence / absence of finger contact with the touch panel based on the remote control signal received by the signal reception unit 12 and stores electrostatic distribution data in the database 20 in the period determined to be in contact. The process which memorize | stores in the signal storage part 21 is performed.
The database 20 includes a signal storage unit 21, a gesture command conversion table unit 22, a display image data storage unit 23, and a graphic pattern storage unit 24, and further includes a UFT-link correspondence table storage unit 25.

  The signal storage unit 21 is used for storing electrostatic distribution data of the remote control signal received by the signal receiving unit 10. The gesture command conversion table unit 22 stores in advance information representing the display processing content that the input command means in association with a plurality of input commands to be recognized. The display image data storage unit 23 stores various display image data necessary for displaying an image corresponding to the display processing content meaning the input command. The graphic pattern storage unit 24 stores basic patterns of a plurality of graphic shapes to be recognized.

  The UFT-link correspondence table storage unit 25 associates a plurality of link information displayed on the web page with a UFT (Unicursal Figure Tag) used to support the operation when selecting the link information by gesture. And remember. UFT is tag information expressed by combining the type of figure that can be drawn with a single stroke and the position of the point (hereinafter referred to as the end point) where the start point and end point of the figure match. Specifically, in the UFT-link correspondence table storage unit 25, as illustrated in FIG. 16, information indicating the link destination, information indicating the display position of the UFT, and display are associated with information indicating the type of UFT. Information representing the color is stored.

  The gesture recognition unit 30 includes a UGI input processing unit 310 and a flick input processing unit 320. The UGI input processing unit 310 has an interface function (UGI; (Unicursal Gesture Interface)) for recognizing a graphic input by a stroke with a gesture. The UGI input processing unit 310, a graphic tracking unit 312, A determination unit 313 and a figure position determination unit 314 are provided.

  The end point coincidence detection unit 311 is based on the electrostatic distribution data stored in the signal storage unit 21, that is, the end point of the graphic data drawn by the user moving his / her finger on the touch panel of the remote control device 1, that is, It has a function of detecting two points whose coordinate values match.

  The figure tracking unit 312 uses the electrostatic distribution data stored in the signal storage unit 21 as the trace of the figure connecting the two points detected as the start points by the start point match detection unit 311, that is, the start point and the end point. It has a function to detect originally.

  The figure position determination unit 314 sets four direction areas in the vertical and horizontal directions of the touch panel around the start point detected by the start point match detection unit 311, and the trace of the figure detected by the figure tracking unit 312. It is determined which of the four directional areas is included in the drawing position.

  The graphic determination unit 313 refers to the basic patterns of a plurality of graphic shapes to be recognized stored in the graphic pattern storage unit 24 of the database 20 and corresponds to which graphic the locus detected by the graphic tracking unit 312 corresponds. Determine whether. For this determination process, pattern matching is used. Based on the determined shape type of the figure and the drawing direction of the figure determined by the figure position determination unit 314, a process of reading a corresponding input command from the gesture command conversion table 22 is performed.

  The flick input processing unit 320 recognizes a form of an input operation for scrolling information displayed on the display, and includes a flick input detection unit 321 and a flick direction determination unit 322. Flick input is a method of inputting a scroll direction of display information by sliding a finger while touching the touch panel and then releasing the finger from the touch panel.

  The flick input detection unit 321 detects a continuous touch time when a finger is touched on the touch panel, and recognizes that the touch operation at this time is a flick input operation when the continuous touch time is within a predetermined time. To do. The flick direction determination unit 322 detects a change in position coordinates when the touch is continuously performed, and determines a flick input direction from the detected change direction of the position coordinates. Specifically, when the touch position changes from the initial touch position coordinate to any one of the upper, lower, left, and right position coordinates, the operation at this time is determined as a flick input operation, and the sliding direction of the touch position is set as the scroll direction. recognize.

  The display image control unit 40 includes a display image determination unit 410, a display image update unit 420, and a display image output unit 430. The display image determination unit 410 determines the content of the display image on the display according to the input command generated by the gesture recognition unit 30. The display image determination unit 410 includes a UFT-link correspondence table processing unit 411 and a gesture input correspondence processing unit 412. Have.

  The UFT-link correspondence table processing unit 411 determines whether or not to associate a UFT with a link in the display image on the display, and performs a process of updating data in the UFT-link correspondence table storage unit 25. The gesture input correspondence processing unit 412 updates the data in the UFT-link correspondence table storage unit 25 according to the graphic input operation and flick input operation by the UGI detected by the gesture recognition unit 30, and is selected by the graphic input operation. A UFT display change process corresponding to the link and a scroll process corresponding to the flick input operation are performed.

The display image update unit 420 includes a UFT information display determination unit 421. Based on the input command generated by the graphic position determination unit 314 or the input command updated by the graphic determination unit 313, the UFT information display determination unit 421 has the meaning of the input command from the display image data storage unit 23. The information indicating the display processing content of the UFT to be read is read, and the display image data is updated based on the read UFT display information.
The display image output unit 430 performs processing for outputting and displaying the display image data of the UFT updated by the UFT information display determination unit 421 on the display.

  Note that the functions of the received signal determination unit 11, the gesture recognition unit 30, and the display image control unit 40 described above are as follows. An application program stored in a program memory (not shown) in the database 20 is stored in the center (not shown). This is realized by causing a processing unit (CPU) to execute.

Next, the operation of recognizing input information using gestures by the television receiver 2 configured as described above will be described.
Here, a case where a web page such as a news site is displayed on the display of the television receiver 2 and a link displayed on the web page is selected and operated from the remote control device 1 will be described as an example.

The link selection process is generally performed in the following procedure.
(1) Display UFT in association with the displayed link.
(2) When a figure corresponding to the UFT is drawn and input on the touch panel of the remote control device 1 in accordance with the UFT displayed in association with the link to be selected, based on the type and drawing direction of the drawn figure. Generate input commands for.
(3) Determine which link is selected based on the above input command.

Hereinafter, the above processing will be described according to the processing procedure. FIG. 3 is a flowchart showing the overall processing procedure and processing contents.
In the remote control device 1, when the user performs a touch operation on the touch panel, information representing the electrostatic distribution is sent from the remote control device 1 to the television receiver 2 through the communication line 3 as a remote control signal.

  First, in step S11, the television receiver 2 performs a process in which the signal receiving unit 12 and the signal reception determining unit 11 of the signal receiving unit 10 receive the remote control signal. In step S12, the television receiver 2 is represented by the received remote control signal. The electrostatic distribution data to be stored is stored in the signal storage unit 21 in the database 20.

  Next, in step S <b> 13, the gesture recognition unit 30 is a UGI input operation in which a user's operation draws a figure with a single stroke on the touch panel based on the electrostatic distribution data stored in the signal storage unit 21. It is determined whether there is a flick input operation for scrolling the information displayed on the display. If it is a UGI input operation, the type of the input figure and the drawing direction are determined and a corresponding input command is output. On the other hand, in the case of a flick input operation, the scroll direction is determined from the slide direction of the touch operation, and the scroll command is output.

  Finally, in step S14, the display image control unit 40 searches for information representing the display processing content that is meant by the input command generated in step S13, and displays the UTF on the display data of the web page according to this information. The display image data is updated so as to change the program selection position with respect to the EPG information, that is, the position of the cursor.

Hereafter, the processing content in each said step S11-S14 is demonstrated in detail.
(1) Signal reception processing
FIG. 4 is a flowchart showing the procedure and details of the signal reception process.
In the signal receiving unit 10, when it is detected in step S 21 that the signal receiving unit 12 has received the remote control signal transmitted from the remote control device 1, first, in step S 22, the signal reception determining unit 11 stores the received remote control signal. Whether or not the user's finger is in contact with the touch panel is determined. If the result of this determination is that there is no contact, the electrostatic distribution data is erased from the signal storage unit 21 in step S23. On the other hand, when the finger continues to touch the touch panel, the electrostatic distribution data representing the graphic drawn by the continuous contact operation is output to the signal storage unit 21 of the database 20 and stored in step S24. Therefore, data representing a figure drawn on the touch panel of the remote control device 1 is stored in the signal storage unit 21.

(2) Gesture Recognition Processing FIG. 5 is a flowchart showing the procedure and processing contents of this gesture recognition processing. In the figure, step S30 indicates a UGI input process, and step S36 indicates a flick input process.

  The gesture recognition unit 30 first executes the end point coincidence detection process in step S31 as follows. That is, the start point coincidence detection unit 31 reads out the electrostatic distribution data from the signal storage unit 21 and draws by moving the finger on the touch panel of the remote control device 1 based on the read out electrostatic distribution data. The end point of the graphic data, that is, two points having the same coordinate value are detected.

  At this time, for example, the following two methods can be considered as the starting point detection method. As shown in FIGS. 9A to 9C, the first detection method is such that when the user starts drawing the figure B from the point A where the user first touched the finger on the touch panel and touches the point A again, The point A is detected as the starting point. As shown in FIGS. 10A to 10C, the second detection method is such that when a user draws a figure by moving a finger on the touch panel, the locus is traced and the locus intersects. This is detected as the starting point A.

  When the end point A is detected, the gesture recognition unit 30 determines that the graphic drawn by the user on the touch panel satisfies the condition as a graphic representing the link selection operation, and proceeds to the graphic tracking process in step S32. On the other hand, if the starting point A is not detected, no processing is performed, and if the finger is released without being detected, it is determined that the drawn figure does not satisfy the condition as a figure representing the link selection operation. Then, the process proceeds to the flick input process S36.

In the flick input process S36, first, in step S37, it is determined whether or not the continuous touch time after the finger touches the touch panel is within a predetermined time, and the continuous touch time is within the predetermined time. In addition, it is determined that the touch operation at this time is a flick input operation. In step S38, the direction of flick input is determined as the scroll direction from the change direction of the position coordinates when the touch is continuously performed.
After completing this determination process, the gesture recognition unit 30 erases the determination target electrostatic distribution data stored in the signal storage unit 21.

  Now, if it transfers to said step S32, the gesture recognition unit 30 will perform a figure tracking process as follows. That is, the signal storage unit 21 stores the electrostatic distribution data from the end point (time Te) to the start point (time Ts) constituting the start point A detected by the end point match detection process (step S31) by the figure tracking unit 312. Read from. Then, based on the read electrostatic distribution data, processing for tracing the locus of the graphic data is performed.

  As means for tracking the trace of the graphic data, for example, the following can be considered. That is, in the case of a touch panel using electrostatic capacitance, the electrostatic distribution with respect to the periphery of the point touched by the finger is a convex distribution. Therefore, the locus of the drawn graphic data can be traced by connecting the vertices of the convex distribution.

  When the locus of the graphic data is detected, the gesture recognition unit 30 subsequently executes graphic determination processing in step S33. That is, a plurality of basic graphic patterns are sequentially read from the graphic pattern storage unit 24 of the database 20 by the graphic determination unit 313, and the read basic graphic pattern and the locus of the graphic detected by the graphic tracking process (step S32). Are compared by pattern matching processing, and the similarity is detected. Then, the highest similarity that is equal to or greater than the threshold value is selected. The selected basic graphic pattern is recognized as the shape type of the graphic drawn on the touch panel.

  Next, the gesture recognition unit 30 proceeds to step S34 and executes a graphic position determination process. That is, the graphic position detection unit 314 first sets the input area of the touch panel as shown in FIGS. 11A and 11B around the start point A detected by the end point match detection process (step S31) as shown in FIG. By dividing in this way, four direction areas are set in each of the upper, lower, left and right directions. Then, it is determined which of the four direction areas the drawing position of the locus of the figure detected by the figure tracking process (step S32) is included. For example, this determination processing obtains the center of gravity of the drawn figure, assumes that the drawing position of the figure exists in the direction of the straight line connecting the center of gravity and the start point A, and the direction of this straight line is the angle of any direction area. This is possible by determining whether it is included.

  When the drawing position of the figure is determined, the gesture recognition unit 30 subsequently executes a direction key detection process in step S35, and the drawing position of the figure determined by the figure position determination process (step S34) is changed up, down, left, and right. Correspond to one of the four directions. Then, an instruction command corresponding to the associated direction key is generated.

  For example, as shown in FIG. 12B, when the drawing position of the figure is included in the right direction area with respect to the starting point A, an input command indicating the right direction key is generated, and conversely, as shown in FIG. Thus, if it is included in the left direction area, an input command indicating the left direction key is generated. Similarly, as shown in FIG. 12A, when the drawing position of the figure is included in the upward area with respect to the starting point A, an input command indicating an upward key is generated, and conversely in FIG. As shown, if it is included in the downward area, an instruction command indicating the downward key is generated.

(3) Display Image Control Process When the gesture recognition process (step S13) is completed, the display image control unit 40 subsequently executes a display image update process as follows. FIG. 6 is a flowchart showing the control procedure and control contents.
That is, first in step S41, the display image determination unit 410 determines display contents corresponding to the command command generated by the gesture recognition process. Subsequently, in step S42, the display image update unit 420 updates the display data on the display screen based on the command command generated by the graphic position determination process (step S34), and finally, in step S43, the display image output is output. The unit 430 displays the updated display data on the display.

FIG. 7 is a flowchart showing a specific example of the processing procedure and processing contents of the display image control process. In FIG. 7, S50 shows UFT-link correspondence table processing, and S60 shows gesture input correspondence screen processing.
The UFT-link correspondence table processing unit 411 of the display image determining unit 410 detects that the finger is touched on the touch panel of the remote control device 1 by the gesture recognition unit 30 described above, and in step S41, the finger is applied to the touch panel. It is determined whether or not the contact state has continued for T seconds. As a result of this determination, if the state in which the finger is touched on the touch panel is less than T seconds, the process proceeds to step S52, where the process of initializing the UFT-link correspondence table storage unit 25 is executed.

  That is, when the user's finger is not touching the touch panel, or when the time length is less than T seconds even if the user touches the touch panel, the information corresponding to the UFT in the UFT-link correspondence table storage unit 25 is as shown in FIG. To "-" (invalid). The determination time T is set to be longer than the finger touch time for flick input used for scrolling the display screen. By doing so, it is possible to prevent the UFT from blinking during the flick input operation.

  On the other hand, it is assumed that the state where the finger is touched on the touch panel continues for T seconds or more. In this case, the UFT-link correspondence table processing unit 411 determines whether or not the UFT-link correspondence table storage unit 25 is initialized in step S53. As a result of this determination, if the UFT-link correspondence table storage unit 25 is in an initialized state, the UFT-link correspondence table processing unit 411 executes processing for associating the link with the UFT in step S54.

  The association between the link and the UFT is performed as follows. That is, it is assumed that 12 types of graphic patterns are prepared as UFT as shown in FIGS. 13A to 13L, for example. It is also possible to prepare an Extended Unicursal Object Tag; EUOT as shown in FIGS.

  The UFT-link correspondence table processing unit 411 sequentially selects the links displayed on the web page, and selects an appropriate UFT for each of the selected links from the 12 types of UFTs. assign. When the number of links exceeds the number of UFTs (12 types), two of the 12 types of UFTs are selected and combined, and this combination of UFTs is assigned to the link. Then, the UFT-link correspondence table storage unit 25 stores a URL (Uniform Resource Locator) representing the link destination of the link in association with the selected UFT or a combination thereof. Further, the coordinate information indicating the display position of the selected UFT on the display screen and the information indicating the display color are respectively determined, and the coordinate information indicating the determined display position and the information indicating the display color are determined as the selected UFT. And stored in the UFT-link correspondence table storage unit 25. FIG. 16 shows an example of the UFT-link correspondence table storage unit 25 in which the association information is stored in this way. FIG. 15 shows the state of the UFT-link correspondence table storage unit 25 before storage.

  Here, the UFT assignment process for each link is not performed at random, but a UFT that is easy to input is preferentially assigned to a link that is highly likely to be selected from the displayed links. To do. The following can be considered as the allocation algorithm.

  In the first algorithm, a plurality of UFTs constituting a set of UFTs are rearranged in order of input, and UFTs represented by one figure in this state are given priority over links that are likely to be selected. Is assigned.

  The second algorithm preferentially assigns a UFT that uses a figure similar to a round shape such as an ellipse or a circle among UFTs represented by the same number of figures to a link that is likely to be selected. Is. This is because a figure close to a round shape such as an ellipse or a circle can be drawn more smoothly, so that the burden on the user's gesture operation is small.

  The third algorithm preferentially assigns a graphic having a corner such as a polygon with a small number of corners (vertex number) to a link that is likely to be selected. This is because a figure with a smaller number of vertices is easier to draw.

  In the fourth algorithm, in a UFT expressed by a combination of a plurality of figures, a combination of a plurality of figures that are point-symmetric is assigned to a link that is likely to be selected. When drawing multiple figures consecutively with a single stroke, if each figure is point-symmetric, the tangent line at the starting point is the same, so the user can draw a series of figures more smoothly and with less burden. Because.

  The UFT display position is set to a position that is close to the associated link and does not overlap other nearby links. The display colors are all set to the same color. Information indicating the ease of selection of a link can be easily obtained by storing a past selection history for the link.

  Reflecting the determination of the display image by the display image determination unit 410, the display image update processing unit 420 executes display image data update processing as follows. FIG. 8 is a flowchart showing the processing procedure and processing contents, and S70 shows the UFT information display determination processing.

  That is, the display image update processing unit 420 first determines whether or not the UFT-link correspondence table storage unit 25 is initialized in step S71 by the UFT information display determination unit 421. As a result of this determination, if the customizing information is stored in the UFT-link correspondence table storage unit 25 as described above, the association information is read from the UFT-link correspondence table storage unit 25 in step S73, The UFT is displayed on the web page in association with each link based on the association information that has been issued. FIG. 17 shows a display example. In this example, the UFT is displayed on each of the links C, D and E among the links currently displayed on the display.

When the association processing between the link and the UFT by the UFT-link correspondence processing unit 411 described above ends, the display image determination unit 410 next executes the gesture input correspondence processing as follows.
That is, the gesture input correspondence processing unit 412 of the display image determination unit 410 first determines whether or not UFT is displayed on the display screen in step S61. If the UFT is displayed as illustrated in FIG. 17 above, the detection of the graphic in the gesture recognition unit 30 is awaited in step S62.

  In this state, when the user draws and inputs the figure on the touch panel of the remote control device 1 in accordance with the displayed UFT, the drawing input of the figure is detected by the gesture recognition unit 30, and the input command is generated. This graphic recognition process is as described above with reference to FIGS. 5 and 9 to 12.

  When the input command is generated, the gesture input correspondence processing unit 412 proceeds to step S63, and performs a link selection process by UFT. Specifically, the link associated with the UFT corresponding to the input command is held in the “selected state”, and the display color of the corresponding UFT in the UFT-link correspondence table storage unit 25 is changed from “black” to “gray”. To "". As a result, the display color of the selected UFT on the display screen is changed from “black” to “gray” as shown in FIG. For this reason, the user can confirm that his / her selection operation has been accepted by changing the display color.

  In this state, it is assumed that the user lifts his / her finger after inputting the drawing of the graphic from the touch panel. Then, the display image determination unit 410 determines whether or not there is a selected link destination in step S64. If the “selected state” of the link is held as described above, it is determined that the selected link is determined as the access destination. Then, the process proceeds to step S66, where a process of acquiring data of the selected linked web page is executed.

  When the acquisition process of the web page is performed, the display image update unit 420 proceeds from step S74 to step S75 as shown in FIG. 8, where the display data of the acquired web page has been displayed so far. The display image data is updated to be displayed instead of the display data. As a result, the display image data of the new web page after the update is displayed on the display. When the web page display update process is completed, the display image update unit 420 initializes the “selected state” for the link.

  If it is determined in step S64 that the selected link does not exist, the process proceeds to step S67, and the flick input is performed based on the detection result in the flick input process S36 described above. Judgment is made or not. If a flick input is made, in step S68, the display image update unit 420 is instructed to perform a scroll process according to the slide direction of the flick input.

  Upon receiving this scroll processing instruction, the display image update unit 420 proceeds from step S76 to step S77 as shown in FIG. 8 to scroll the display image of the currently displayed web page in either the up, down, left, or right direction. Update the display image data. As a result, the updated display image data after the update is displayed on the display.

  As described in detail above, in this embodiment, in the television receiver 2, each link set on the web page displayed on the display is associated with a UFT represented by the type of figure and the drawing direction, This UFT is displayed in association with the position of each link on the web page. Then, when the user draws the UFT associated with the link to be selected on the touch panel of the remote control device 1, the television receiver 2 recognizes the UFT that has been inputted and associated with the UFT. A link is selected, and the corresponding site is accessed to obtain information.

  Therefore, a large number of UFTs can be expressed by a combination of a small number of figures, and even if a large number of links are set on the web page by associating the UFTs individually with links, the user can draw a small number of figures. A desired link can be selected according to the number of times. For this reason, compared with the case where the arrow tag which combined 4 types of arrows of up, down, left, and right is used, the frequency | count of operation at the time of selecting a link can be reduced and operativity can be improved.

  Moreover, the UFT is displayed on the web page in a display color that is associated with the display position of each link and set in advance. For this reason, the user can always draw and input easily and accurately without making a mistake in accordance with the UFT associated with the desired link. At that time, the UFT is displayed only when the user touches the touch panel continuously for a certain period of time, that is, when the user indicates the intention to select a link. For this reason, when the user touches the touch panel for a short time for scrolling the display screen, the UFT is not displayed, thereby preventing the display screen of the web page from being crowded by the UFT. be able to.

  Furthermore, when associating a UFT with each link, a plurality of UFTs constituting a set of UFTs are rearranged in order of input, and a UFT represented by only one figure is selected according to this arrangement. Is assigned to a link with a high possibility of being preferentially assigned. Also, among UFTs represented by the same number of figures, UFTs using figures that are close to a round shape such as an ellipse or a circle are preferentially assigned to links that are likely to be selected. . The distinction between this rounded figure and a polygonal figure such as a polygon is made by judging whether the tangents are smoothly connected at all points when looking at the tangent direction of each point of the figure. It becomes possible. Among polygons, those with a small number of corners are preferentially assigned to links. In addition, when a graphic with a corner such as a polygon is allocated, a graphic with a small number of corners is preferentially allocated to a link that is highly likely to be selected. Further, in a UFT expressed by a combination of a plurality of figures, a combination of a plurality of figures that are point-symmetric is assigned to a link that is highly likely to be selected. Therefore, it is possible to perform a link selection operation with a high possibility of being selected more easily and in a short time.

  The present invention is not limited to the above embodiment. For example, in the above-described embodiment, when the user indicates the intention to select a link by touching the touch panel continuously for a predetermined time or longer, the UFT is associated with the link. However, the present invention is not limited to this, and UFTs are stored in a fixed association in advance for links that frequently appear on the web page, and the above links are always set in a fixed manner. UFT may be displayed. In this way, the user can perform a smoother selection operation by storing the UFT associated with the frequently selected link.

  In the embodiment, the drawing position with respect to the starting point A of the figure is detected to control the moving direction of the cursor. However, the present invention is not limited to this, and the drawing speed, drawing time, or drawing size of the figure may be determined, and the amount of movement of the cursor may be changed according to the determination result of the drawing speed, drawing time, or drawing size of the figure. .

  The embodiment has been described by taking as an example a case where a user draws a figure with a finger on the touch panel and recognizes the locus. However, the present invention is not limited to this, and the user moves his / her arm to draw a figure in the space, the movement of drawing the figure, that is, the user's gesture is captured by the camera, and the captured image data is taken into the television receiver, You may make it recognize a gesture based on this taken-in figure.

  In order to implement this embodiment, for example, a camera is attached to the television receiver 2 and a user's gesture is imaged by this camera. The signal receiving unit 10 of the television receiver 2 has a function of receiving captured image data output from the camera, extracting data representing arm movement from the captured image data, and storing the extracted data in the signal storage unit 21. Arm recognition is possible by pattern matching. The functions of the gesture recognition unit 30 and the display image control unit 40 are the same as those described in the above embodiment.

  According to this embodiment, even when the user moves his / her arm and draws a figure in the space, the figure by this gesture is captured by the camera and taken into the television receiver 2 to obtain the embodiment described above. Similarly, a web page link selection operation can be performed by a user's gesture.

In addition, the type and configuration of the information input device, the type and size of the graphic representing the UFT, the type of graphic combination, and the like can be variously modified without departing from the scope of the present invention.
In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 1 ... Remote control device, 2 ... Television receiver, 3 ... Communication line, 10 ... Signal reception unit, 11 ... Signal reception judgment part, 12 ... Signal reception part, 20 ... Database, 21 ... Signal storage part, 22 ... Gesture command Conversion table section, 23 ... Display image data storage section, 24 ... Graphic pattern storage section, 25 ... UFT-link correspondence table storage section, 30 ... Gesture recognition unit, 310 ... UGI input processing section, 311 ... End point match detection section, 312 ... Graphic tracking unit, 313 ... Graphic determination unit, 314 ... Graphic position determination unit, 320 ... Flick input processing unit, 321 ... Flick input detection unit, 322 ... Flick direction determination unit, 40 ... Display image control unit, 410 ... Display Image determining unit, 411... UFT-link correspondence table processing unit, 412... Gesture input correspondence processing unit, 420. ... UFT information display determination unit, 430 ... display picture output unit, 41 ... image update section, 42 ... image output unit, 43 ... display image determination unit.

Claims (7)

For the link information to access other information pages set on the information page displayed on the display, combine the type of 2D figure drawn with a single stroke and the position of the start point of the 2D figure a unique assignment graphic tag information, the tag information display control means for displaying on the information page while associating the graphic tag information to the link information in the representation,
Graphical judgment that captures two-dimensional graphic data drawn with a single stroke and determines the positional relationship between the type of the two-dimensional graphic and the starting point of the two-dimensional graphic from the drawing trajectory of the imported two-dimensional graphic data and the coordinates of the starting point Means,
The positional relationship between the determined two-dimensional figure type and the starting point of the two-dimensional figure is compared with the graphic tag information being displayed on the information page, and when the two match, the graphic tag information being displayed is associated. An information input device comprising: link information selection means for selecting the received link information.   The tag information display control means preferentially assigns graphic tag information expressed by one two-dimensional graphic to link information that is highly likely to be selected by a user from among a plurality of link information. The information input device according to claim 1.   When there are a plurality of pieces of graphic tag information having the same number of figures, the tag information display control means uses a figure tag using a two-dimensional figure close to a round shape such as an ellipse or a circle. 3. The information input device according to claim 1, wherein information is preferentially assigned to the link information to be assigned.   When there are a plurality of graphic tag information with the same number of figures, the tag information display control means assigns graphic tag information using a two-dimensional figure having a corner such as a polygon among these graphic tag information. 3. The information input device according to claim 1, wherein tag information of a figure having a small number of corners is preferentially assigned to the link information to be assigned.   When there are a plurality of pieces of graphic tag information expressed by a combination of a plurality of two-dimensional figures, the tag information display control means has graphic tag information in which the arrangement relation of the plurality of figures is point-symmetric among these pieces of graphic tag information. 5. The information input device according to claim 1, wherein the information input device is preferentially assigned to the link to be assigned.   The tag information display control means correlates information indicating a graphic tag type, information indicating a link destination address, information specifying a display position of graphic tag information, and information specifying a display color. The information input device according to any one of claims 1 to 5.   The tag information display control means determines whether or not the user has performed an operation indicating the intention to select link information, and displays the graphic tag information on the information page only when the operation is performed. The information input device according to claim 1, wherein the information input device is an information input device.

Images