WO2005057395A1

WO2005057395A1 - Data entering device, information apparatus, and user interface method

Info

Publication number: WO2005057395A1
Application number: PCT/JP2004/018586
Authority: WO
Inventors: Itsuo Kumazawa
Original assignee: Itsuo Kumazawa
Priority date: 2003-12-12
Filing date: 2004-12-13
Publication date: 2005-06-23
Also published as: JPWO2005057395A1

Abstract

Various commands can be entered correctly with a narrow range of finger motion. There are provided with rotary body arrangement means having rotary bodies arranged in the range of fingertip motion and rotatable by a fingertip, pressure application position detecting means for detecting the position where the pressure exerted by a downward motion of the fingertip is applied on the rotary body arrangement means, pressure removal position detecting means for detecting the position where the pressure exerted by the fingertip on the rotary body arrangement means is removed, and fingertip moving direction detecting means for detecting the moving direction of the moving fingertip when the pressure exerted by the fingertip operating the rotary body of the rotary body arrangement means is applied. Further there is provided with braking means for braking the rotating movement of the rotary body according to the position of the fingertip or the rotational angle of the rotary body by combining an output signal indicating the fingertip landing position or pressing position detected by the pressure application position detecting means and an output signal indicating the fingertip moving direction detected by the fingertip moving direction detecting means so as to specify the information to be entered.

Description

Specification

Data input device, information equipment, and user interface method

The present invention relates to a multimodal user interface technology for inputting characters and instructions to information devices, and particularly to a data input device that assists a user operation by comprehensively utilizing visual, auditory, and tactile sensations. , Information equipment, and a user interface method.

^ Scenic technology

[0002] Conventionally, as a data input device provided with a mechanism for stimulating a user's tactile sensation, there are, for example, a device in which a pin display can protrude a pin and a device in which a vibrator or a drive unit incorporated in a mouse is operated. (See Patent Documents 1-3).

[0003] There is also a method of notifying an operator that a cursor has reached a target area on a screen by vibrating a pointing stick. In addition, a device has been proposed in which when a fingertip is moved, a pin is put out according to the position of the fingertip to stimulate the finger to give a tactile sensation of a virtual object. (See Patent Documents 5-7).

In general, in order to input various information with one finger, it is effective to use a method of designating information to be input in combination with a lowered position and a raised position of a fingertip. (See Patent Documents 9 and 10).

[0005] However, when the range of movement of the finger is narrowed in order to reduce the size of the device, it is difficult to accurately grasp the approaching descending position and ascending position within the narrow moving range.

[0006] In order to solve this problem, when inputting information by combining the descending position and the ascending position of the fingertip, different tactile stimuli depending on the position of the fingertip are used to specify the descending position and the ascending position. A method has been devised that allows the user to clearly grasp the finger position based on the difference in tactile sensation. Was complicated. (See Patent Document 11).

[0007] Furthermore, the shape and size of the cursor keys are changed for each direction so that they can be distinguished by tactile sense. A plurality of ball-shaped protrusions are arranged at the fingertip contact portion, and the fingertip is placed on the ball-shaped protrusion array. A method of inputting information based on tactile information of the unevenness of the ball-shaped projection array while moving smoothly has also been proposed. (See Patent Documents 12-14). [0008] However, in these methods, since the unevenness is static and fixed, even when the fingertip is moved, no clear difference in the unevenness shape was obtained. In addition, since the information to be input is specified only by the lowering position of the fingertip, various information cannot be input unless the number of ball-shaped projections is increased.

Patent document 1: JP-A-11-161152

Patent Document 2: JP-A-10-55252

Patent Document 3: JP-A-6-102997

Patent Document 4: JP 2001-356862 A

Patent Document 5: JP-A-2000-29623

Patent Document 6: JP-A-2000-259333

Patent Document 7: JP-A-2000-47792

Patent Document 8: JP-A-10-143301

Patent Document 9: JP-A-11-224161

Patent Document 10: Japanese Utility Model Application No. 5-55222

Patent Document 11: JP-A-2002-278694

Patent Document 12: JP-A-3-90922

Patent Document 13: JP-A-11-353091

Patent Document 14: JP 2001-166871 A

Disclosure of the invention

Problems to be solved by the invention

[0009] The present invention has been made in view of the above-described powerful circumstances, and has a data input device, an information device, and a user interface capable of accurately inputting various instructions within a narrow finger movement range. The purpose is to provide methods and the like.

Means for solving the problem

[0010] The data input device according to the present invention solves the above problem by devising a method of detecting the fingertip position without using the rotation angle of the rotating body. When a fingertip applies a slight pressure on the rotating body array, the switch (position detection) corresponding to the pressure applied position indicates the center of gravity of the pressure on the rotating body or between the rotating bodies. Switch) Detection was made by changing the contact state. If the rotating bodies are arranged close to each other, when applying pressure to the target rotating body, a finger accidentally touches the nearby rotating body and pressure is applied, so that an erroneous input is likely to occur. In particular, since a switch that changes the contact state with weak finger pressure is used so that the position of the fingertip can be detected simply by placing the fingertip lightly on the rotating body arrangement, it is erroneous even if the finger touches another rotating body slightly. Raise input.

[0011] In the present invention, when a seesaw-like mechanism is introduced between rotating bodies, and pressure is applied to the target rotating body to lower it, an arm on the target rotating body side of a fulcrum of the seesaw-like mechanism is caused by the drop. The arm on the other side of the fulcrum was lifted up by the seesaw principle, which lifted another rotating body, thereby preventing erroneous input. In order to further increase the resolution of position detection, a seesaw-like mechanism with two fulcrums was introduced, and the pressure application position when pressure was applied between rotating bodies was the same as the pressure application position when pressure was applied on rotating bodies. Detected separately.

[0012] If the fingertips are left in a dangling state, trembling occurs and erroneous input occurs due to trembling immediately. Even people whose fingertips tend to tremble can suppress trembling by pressing the fingertip or part of the finger somewhere. In addition, the fingertip may move unintentionally due to the rebound generated when another button is operated with another finger, in which case an erroneous input may occur. In this case, the force that generates the reaction force in any direction is analyzed kinematically and mechanically, and by supporting a part of the finger, the finger is powered in the direction in which the reaction force acts. Erroneous input can be prevented.

Therefore, in the present invention, in order to prevent such erroneous input, a mechanism for supporting a part of a finger called a finger support base or a finger support rotating body is introduced. The finger support follows the movement of the finger when changing the position of the fingertip and moves back and forth and left and right to allow the fingertip to freely change its position, but undesired positions (unintended positions) In order to prevent the fingertip from applying pressure to the rotating body array with the finger, the platform (height) that does not move in the direction of the movement of the finger that applies pressure (downward movement) and supports part of the finger in this direction does not move. This is a platform that does not change the height), and supports the finger at a position slightly away from the part of the finger used during pressurization (usually the tip of the finger, but sometimes the middle abdomen). At the time of pressurization, while the part supported by the base is fixed, the finger applies pressure to the target position on the rotating body array by moving the finger part to be pressurized by changing the bending force and inclination of the joint. Rotating body for finger support works in the same way, but this moves back and forth and left and right Instead of rotating, the fingertip on it rotates so that the position can be changed freely. Also in this case, the height is not changed, and a part of the finger is supported so as not to move in the direction in which pressure is applied to the rotating body arrangement. By supporting a part of the finger with the finger support or the finger support rotating body configured in this way, undesired vertical movement of the fingertip caused by finger tremor or recoil of operation by another finger is suppressed, This eliminates unintended up and down movement while leaving the freedom to move back and forth or left and right to prevent erroneous input.

[0014] According to the above-described improvement, the data input device of the present invention does not need to use the rotation angle of the rotating body for detecting the fingertip position, so that the rotating body can be rotated without limitation without being limited by the amount of rotation angle. become. Therefore, the coordinates can be designated using this rotating body like a trackball. However, since the rotating body of the present invention can rotate only in one direction, that is, left and right or back and forth, only one-dimensional coordinates can be specified. The data input device is configured to slide the entire rotator array in a direction perpendicular to the rotation direction of the rotator to specify another dimension of coordinates. Alternatively, the movement amount or the rotation amount of the finger support or the finger support rotating body is detected and used for coordinate designation.

[0015] In addition, the interval between the rotating bodies is changed by swinging the rotating body according to the position of the fingertip, or a height difference is generated between the rotating bodies, thereby emphasizing the feeling of unevenness felt by the fingertip touching. This makes it possible to more clearly grasp the position of the fingertip from the difference in the feel of the unevenness when the fingertip is moved.

In the present invention, when specifying information to be input by a combination of a fingertip lowering position (pressure applying position) and a fingertip raising position (pressure releasing position), the shorter the distance between these two positions, the higher the speed. 'You can easily specify information. Thus, the input efficiency can be improved by preferentially associating characters or commands that are frequently input with the movement of the fingertip having a short distance.

In particular, if only the fingertip movement direction immediately after the fingertip descent is used instead of the fingertip elevation position (pressure release position), the types of information that can be specified are the fingertip descent position (pressure application position) and the fingertip movement direction ( (For example, left, stationary, and right directions are limited to three combinations.) Force The input efficiency can be further improved because the information can be specified by the quick movement of the fingertip.

[0018] In addition, at present, the only browser on the Internet (software for content browsing) uses a mouse. The mainstream method is to move the cursor with a pointing device such as a cursor, specify an item with an underline or the like according to the cursor position, and select that item by clicking the mouse button. Instead of using this underline, we want to mark and select a selection item in the content using a design icon that suggests finger movement, or an underline or background color that is displayed as a movie that suggests finger movement. An information device and a user interface method for selecting a target item by performing a finger motion indicated by a mark added to the item are provided.

In the present invention, a mark is displayed on a plurality of selection candidate items in the vicinity of the cursor only by roughly positioning the cursor without precisely positioning the cursor, and the finger motion indicated by the mark is executed. The target item is selected immediately by just doing. Cursor positioning is time-consuming and psychologically burdensome, so even in the conventional method, a shortcut is used to select an item instantly by pressing a specific key in order to select items quickly without moving the cursor. Although the function is provided, the means provided by the present invention also provides a kind of shortcut function, and after the cursor position is roughly determined, the item can be selected at high speed. At this time, since it is not necessary to keep an eye on the cursor for precise positioning, the psychological load is reduced. Normal shortcuts use the keys on the keyboard, so it takes time to find the corresponding key and press the key. However, according to this method, the target item can be selected simply by performing the finger movement indicated by the mark. Since you can select using shortcuts, there is no need to intuitively understand or immediately memorize the relationship between keys and finger movements. This method is effective not only for the browser but also for any user interface based on item selection.

For example, when creating a sentence of an electronic mail, words and expressions that appear frequently are registered, and a term to be used is selected from the registered terms and inserted into the sentence, thereby improving the efficiency of the sentence creation. In the past, it was often the case that a term was selected using the cursor keys.However, it takes time to move each item one by one with the cursor keys to reach the target item, and it is not efficient. Psychological load is great because it is necessary to keep an eye on items while moving. According to the present invention, a target word can be selected instantaneously by performing a finger motion indicated by the mark after marking each term, so that the efficiency of text creation can be improved. [0021] However, a tactile cueing force such as a feeling of unevenness of the rotating body easily misidentifies the finger position and makes an input error easily. Therefore, in the present invention, an auditory cue is first added. Either a different beep sound is generated depending on the fingertip position, or a beep sound is generated at the moment the fingertip position changes so that the fingertip position can be grasped audibly to reduce erroneous input. For example, if a total of three sections are provided at the center and left and right of the movement range of the fingertip to distinguish whether the finger position is included in the deviation or deviation, when the finger is at the center position it moves left and right without generating a beep sound If a beeping sound is generated at that time, the left and right and center positions can be distinguished by the beeping sound. In addition, it is possible to know that the finger position has changed through the beep sound by the method of generating a beep sound at the moment of moving to the left and right compartments of the center compartment force.

[0022] Depending on the application, the movement of the fingertip and the input command may be intuitively related. For example, moving the content display (playback) according to the direction of movement of the fingertip, switching channels, or fast-forwarding or reverse-feeding the tape can avoid the difficulty of storing the relationship between movement and commands. . For such applications, it is better to precisely measure the amount of rotation of the rotating body with a rotary encoder, etc., and make the amount of rotation correspond to the amount of movement of the content.

When the rotating body rotates smoothly, the fingertip can move smoothly while contacting the rotating body on the rotating body array, but when the fingertip comes to a predetermined position or when the rotating body rotates a predetermined angle. When the brake is pressed against the rotating body or a part of the rotating body collides with the anti-rotation member to brake or limit the rotation of the rotating body, the user can feel the reaction force due to the braking through force sense. For example, when the fingertip moves from the left zone to the center zone, the rotation is momentarily braked at the boundary between the two zones and the reaction force is applied to the user's fingertip. You can know that the area has changed. Alternatively, if the rotation is stopped so that the user cannot move any more after moving the required amount, the user can grasp that the required amount has been moved by stopping the rotation. In the present invention, such a braking mechanism is introduced so that the user can more clearly grasp the position of the fingertip.

[0024] Specifically, the data input device according to the present invention includes a rotating body arrangement means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotating by the fingertip, and an upper part supporting the rotating body arrangement means. A rotating body provided between the table and a lower table located below the upper table; A pressure applied by the downward movement of the fingertip is applied to the arrangement means, and a pressure application position detection means for detecting a pressure application position, and a pressure release position at which the pressure applied from the fingertip on the rotator arrangement means is released are detected. Pressure release position detecting means, and fingertip moving direction detecting means for detecting the moving direction of the fingertip which moves by applying pressure by the fingertip operating the rotating body of the rotating body arrangement means; The information to be input can be specified by combining at least one of the position detecting means and the output signal from the fingertip moving direction detecting means.

Preferably, the rotating body arrangement means is formed so as to be movable in a direction orthogonal to the rotating direction of the rotating body.

[0025] In the present invention, various information can be accurately obtained by combining the data from the rotator arrangement means for inputting data while confirming the user's own operation by the tactile sensation, and the moving direction of the fingertip and the pressure application signal. Input is possible.

[0026] Preferably, the fingertip moving direction detecting means is provided with a rotating direction detecting means for detecting the rotating direction of the rotating body, and the fingertip moving direction is detected based on the rotating direction of the rotating body detected by the rotating direction detecting means. It is desirable to detect the direction in which the object moves. In addition, the rotation amount of the rotating body or the finger supporting rotating body or the moving amount of the finger supporting base is detected, and the coordinates are designated in an information device such as a computer device based on the rotating amount or the moving amount. This improves operability.

Further, the data input device according to the present invention includes a position detecting switch for detecting a position by changing a contact state according to a position where a weak fingertip pressure applied to the rotating body acts, and a pressure detecting switch. The applied position detecting means is provided with a pressure detecting switch for changing the contact state when a relatively stronger pressure than the pressure for changing the contact state of the position detecting switch is applied from a fingertip, and a contact state by the pressure detecting switch is provided. It is characterized in that a contact state by a position detecting switch determined according to a position of a weak pressure applied from a fingertip is detected separately.

[0028] In the present invention, two types of switches for position detection and pressure detection are provided, and the position detection switch operates with a relatively smaller force than the pressure detection switch.

Here, "weak" means that the position detection switch operates, but the pressure detection switch is not connected. Tactile state means a degree that does not change.

[0029] In the data input device according to the present invention, the position detecting switch is formed of a seesaw mechanism that can move the seesaw on the upper table, and includes a conductive arm member that rotatably supports the rotating body. When the rotating body at the fingertip drops relative to the other rotating bodies due to the slight pressure applied from the fingertip and changes the contact state of the position detection switch, the rotating body on the falling side is supported. The arm to be moved lands on the upper table and makes a seesaw movement, thereby lifting another rotating body via the arm on the other side.

In the present invention, the contact state is exclusively changed in the left-right direction or the front-back direction by the above-mentioned seesaw mechanism by a weak pressure, and the amount of rotation is further reduced by the rotating body on the descending side. Enable operation.

[0031] Preferably, the arm member is lifted by a conductive elastic body attached between the arm member and the upper base, and when the pressure is released, all of the position detection switches are brought into a contact state. It is desirable that the release state be configured to be identifiable. It is possible to diversify control using this data input device and improve the reliability of data.

[0032] The information device according to the present invention is an information device provided with means for designating information to be input by combining a landing position or pressing position of a fingertip with a movement direction of a fingertip at the time of landing or before and after landing. , The background color, underline, icon, etc. of items displayed on the display screen are displayed statically or dynamically with a pattern or animation that suggests the fingertip landing position or pressure position and fingertip movement direction Thus, means for selecting a corresponding item when performing a finger motion suggested by a symbol or an animation is provided.

In the present invention, a plurality of modes can be selected by a simple operation by performing an identification display (mark) indicating a finger movement on a selectable item.

Here, the “information device” means a computer device or a device having a built-in computer, and includes a control device, a so-called control device, a mobile phone, and the like.

It is also possible to provide a means for audibly notifying the fingertip position by changing the sound output according to the fingertip position. [0034] Further, the information device according to the present invention is an information device provided with means for designating information to be input by combining a landing position of a fingertip and a movement direction of the fingertip at the time of landing or before and after landing. It is characterized in that the direction and the moving direction of the display / playback range of the content such as video, music, and text are displayed on the display in association with each other.

In the present invention, a plurality of modes can be easily controlled by associating fingertip movements with functions such as display and reproduction of content.

[0036] The information device according to the present invention further includes a content browsing unit for browsing contents such as video, music, and text through an Internet communication network or a storage device. It has a selection candidate detection means for detecting a plurality of selection candidate items near the position, and a mark as a selection candidate item detected by the selection candidate detection means is statically or dynamically set so as to indicate finger movement. It is displayed on a display.

[0037] Preferably, there is provided a sentence registration unit for registering a sentence unit appearing frequently, and the display unit statically or dynamically displays on the display such that the mark of the sentence unit registered in the sentence registration unit indicates finger movement. It should be displayed.

[0038] Further, the information device according to the present invention includes a rotating body arranging means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotating by the fingertip, and a downward movement of the fingertip on the rotating body arranging means. Pressure applying position detecting means for detecting a position to which the accompanying pressure is applied, a rotating body array, a pressure releasing position detecting means for detecting a position where a pressure applied from a fingertip is released on the rotating body array means, and a rotating body array Fingertip moving direction detecting means for detecting the moving direction of the fingertip that moves by applying pressure by the fingertip operating the rotating body of the means, and detects the fingertip landing position or the pressing position by detecting the pressure application position; The moving direction detecting means detects a fingertip moving direction.

In the present invention, by detecting the movement of the fingertip in detail by each of these means, it is possible to operate a complicated information device using only the fingertip.

[0040] Further, the information device according to the present invention includes a rotating body arranging means having a plurality of rotating bodies arranged in a movement range of the fingertip and rotating by the fingertip, and a pressure accompanying a downward movement of the fingertip on the rotating body arranging means. Pressure application position detection means for detecting the position where Pressure release position detecting means for detecting the position where the pressure applied from the fingertip is released on the row means, and the fingertip which moves by applying pressure by the fingertip operating the rotating body of the rotating body arrangement means A fingertip moving direction detecting means for detecting a moving direction of the fingertip, an output signal of the fingertip landing position or the pressing position detected by the pressure applying position detecting means, and a fingertip movement detected by the fingertip moving direction detecting means. In combination with the output signal of the direction, the information to be input is specified, and the braking means for braking the rotational movement of the rotating body according to the position of the fingertip or the rotating angle of the rotating body is provided. Features.

In the present invention, the rotational movement of the rotating body is braked particularly in accordance with the position or the rotation angle of the fingertip. Therefore, the braking force is transmitted to the fingertip, and the operator can determine how much the rotation angle is. You can recognize without looking.

[0042] The information device according to the present invention includes a mode table that stores switch states and mode identification information (mode IDs) in association with each other, and a correspondence table that associates one or more selection candidate items with the mode identification information. After creating and temporarily storing information and outputting switch operation information for selecting a selection candidate item, inputting switch state data, referring to a mode table, and setting a mode corresponding to the switch state. Individual function selecting means for extracting identification information, extracting a selection candidate item corresponding to the mode identification information based on the correspondence information, and outputting an output to inform that the selection candidate item is selected; Individual function executing means for executing processing relating to the selection candidate item selected by the function selecting means.

According to the present invention, in the operation state of the information device, a table in which the switch state and the mode ID are associated in advance is stored, and a mode ID is assigned to the extracted selection candidate item to correspond to the mode ID. The switch operation information is notified to the operator, and then the switch state is read, the corresponding item is extracted with reference to the mode table, and the related process is executed.

A user interface method according to the present invention is a user interface method for designating information to be input by combining a position of a fingertip landing position or a pressing position with a direction of movement of a fingertip at the time of landing or before and after landing. Mark the background color, underline, icon, etc. of the item displayed on the display screen with the fingertip landing position or pressure Characteristically or dynamically displayed with a design or animation that suggests the position and fingertip movement direction, and the corresponding item is selected when performing the finger movement suggested by the design or animation. And

In the present invention, the movement of the fingertip for selecting an item is represented by a mark on the screen, and the movement of the fingertip is detected to select the corresponding item.

[0046] Further, the user interface method according to the present invention provides a content browsing means for browsing contents such as video, music, and text through a communication network or a storage device of the Internet, and a content browsing means which is located near an attention position in the content. Using a selection candidate detection means for detecting a plurality of selection candidate items existing in the display, a mark as a selection candidate item detected by the selection candidate detection means is statically or dynamically displayed on the display so as to indicate finger movement. It is characterized in that it is displayed.

[0047] In the present invention, a plurality of selection candidate items near the target position in the content, for example, near the cursor are detected, and information that suggests finger movement as a mark for selecting the item is detected. Display to allow the operator to select the desired item.

[0048] In the user interface method according to the present invention, the rotating body arranging means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotating by the fingertip; Pressure applying position detecting means for detecting a position to be applied, pressure releasing position detecting means for detecting a position where the pressure applied from a fingertip on the rotating body arranging means is released, and a rotating body of the rotating body arranging means And a fingertip moving direction detecting means for detecting a moving direction of the fingertip which is moved by applying pressure with the fingertip for operating the fingertip, and detects a fingertip landing position or a pressing position by the pressure applying position detecting means. The moving direction detecting means detects the direction of fingertip movement.

[0049] In the present invention, the fingertip movement is detected based on the fingertip moving direction and the landing position or pressing position of the fingertip.

[0050] The user interface method according to the present invention further comprises an output signal of the fingertip landing position or the pressing position detected by the pressure application position detection, and an output signal of the fingertip movement direction detected by the fingertip movement direction detecting means. In order to specify the information to be entered, and rotate the rotating body according to the position of the fingertip or the rotating angle of the rotating body. The movement is braked.

[0051] Further, the user interface method related to mode selection according to the present invention includes an execution switch capable of distinguishing at least two states between a non-pressurized state and a pressurized state, and an execution switch positioned above the execution switch. It is possible to distinguish between the open state and the use state provided on the table to which pressure can be applied to change the state.In the use state, at least three types of position states, left, right and center, can be input, and left and right Is a user interface method for inputting each switch state of a data input device having a mode selection switch switched by a seesaw mechanism to an information device, and selecting an item for operating the information device according to the switch state, the user interface method comprising: Each position of the mode selection switch and the information device The mode identification information is stored in association with the mode identification information, and the mode identification information including the mode identification information in the non-pressurized state and the mode identification information in the pressurized state is uniquely assigned to each of the plurality of selection candidate items. Then, the finger operation information related to the mode identification information in the non-pressurized state is output, the state of the mode selection switch is input from the data input device, and when the execution switch changes to the pressurized state, the input is performed. The mode identification information in the non-pressurized state is determined from the state of the selected mode selection switch, and one or more selection candidate items corresponding to the mode identification information are extracted, and the extracted selection candidate items are pressurized. When the finger operation information of the mode identification information is output, the state of the data input device power mode selection switch is input, and then, when the execution switch changes to the non-pressurized state, The mode identification information for the pressurized state is determined from the state of the input mode selection switch, and information indicating that the selection candidate item corresponding to the mode identification information is finally selected is output. After that, if there is no release input within a predetermined time, a process related to the finally selected selection candidate item is executed.

In the present invention, a mode ID is set for each of the 〇N state and the OFF state of the execution switch (center button), and is assigned to the selection candidate items in the operation state of the information device, thereby providing a plurality of selection candidate items. Of the desired items can be easily selected. This also allows hierarchical mode selection.

[0053] Preferably, the mode selection switch is shifted from the left or right position to the middle position. It is desirable to start the timer when the center position is reached, stop the timer when the other position is reached, and use the timer value as an operation parameter of the information device.

. The binary input switch enables analog data input with simple operation.

[0054] A program according to the present invention includes an execution switch capable of determining at least two states of a non-pressurized state and a pressurized state, and a program for changing the state of the execution switch which is located above the executed switch. It is possible to distinguish between the open state and the use state provided on the table to which pressure can be applied.In the use state, at least three types of position states, left, right and center, can be entered, and the left and right are switched by a seesaw mechanism A program for inputting each switch state of a data input device having a mode selection switch to an information device, and controlling the operation of the information device according to the switch state. For each of the mode selection switches and the mode identification information for selecting the item of the information device in association with each other, and a plurality of selection candidate items. For each eye, a process of uniquely assigning mode identification information comprising mode identification information in the non-pressurized state and mode identification information in the pressurized state, and finger operation information related to the mode identification information in the non-pressurized state. Outputting and inputting the state of the mode selection switch from the data input device; and when the execution switch changes to the pressurized state, the mode identification information of the non-pressurized state is determined from the input state of the mode select switch. At the same time, one or more selection candidate items corresponding to the mode identification information are extracted, and finger operation information of the mode identification information at the time of pressurization is output for the extracted selection candidate items, and the data input device The process of inputting the state of the force mode selection switch, and when the execution switch changes to the non-pressurized state, the mode of the input mode select switch is changed to the pressurized mode. Information that indicates that the selection candidate item corresponding to the mode identification information has been finally selected, and then, if there is no release input within a predetermined time, this final And a computer for executing a process related to the selected candidate item selected.

[0055] Here, the "mode" is not limited mainly to the operation mode of the information device and the power that means the processing content. It is sufficient if some selection is possible, and if there are a plurality of selectable items. The purpose is to include the item.

The invention's effect

[0056] According to the present invention, by using a means for detecting a position (pressure application position) where pressure is applied from a fingertip without using a switch that changes a contact state according to the rotation angle of the rotating body, the fingertip is always kept on the rotating body. Freed from the constraining constraints, it allows rapid and accurate input of diverse data within a narrow range of finger movement.

[0057] In a content browser (browsing method) or the like, the efficiency of item selection is improved by introducing means for instantly selecting an item corresponding to finger movement without having to precisely determine the cursor position. Therefore, the psychological load can be reduced.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, a first embodiment of the present invention will be described.

In the present invention, the direction of movement of the fingertip is defined as shown in FIG. Figure 1 shows the relationship between the right thumb placed on the data input device and its movement direction. The direction of vertical pressing with the finger pad is “down”, the reverse direction is “up”, the direction from the base of the finger to the nail is “front”, and the reverse is “rear”. Seeing as "right" or "left". The same applies when operating with other fingers instead of the right thumb.

[0059] The operator operates the switch arranged on the data input device by moving the fingertip in the front, rear, left, right and up and down directions indicated by the arrows in FIG. The definition of this direction is for the purpose of specifying the present invention or describing the present embodiment, and the direction is not universal, and the direction can be determined by another definition.

[0060] Data input device>

FIG. 2 is a perspective view of a part of the data input device according to the first embodiment of the present invention viewed obliquely from above and forward. Reference numerals 1 and 2 denote rotating bodies, which rotate around wires 3 and 4, respectively, and the fingertips riding thereon move smoothly left and right while riding on the rotating body due to the rotation of the rotating body. At this time, the fingertip has a convex portion of the rotating body and a concave portion of the rotating body as a concave portion to obtain an uneven tactile sensation, and the fingertip position can be grasped based on the tactile information. Even if the rotating bodies 1 and 2 are arranged close to each other, the positions of the fingertips can be clearly distinguished by tactile cues, so that data can be input without error. In FIG. 2, wires 3 and 4 are rotating shafts of the rotating bodies 1 and 2, and are supporting columns of the rotating body that bends in the middle and lifts the rotating body from the base 9, and are made of a conductive material. Therefore, it also functions as a conduction path of a switch mechanism described later. The wires 3 and 4 together form a loop, which loops through 6, 7 arches made of conductive wire. A unit in which the two rotating bodies (the right rotating body 1 and the left rotating body 2) are integrated through loop wires 3 and 4 is hereinafter referred to as a rotating body arrangement.

The inner diameter of the arches of the arched wires 6 and 7 is sufficiently larger than the diameter of the wires 3 and 4, and the loop formed by the wires 3 and 4 is surrounded by the arched wires 6 and 7 and connected to the base 9 Because the arch is connected with play within the margin of the inner diameter of the arch, the arch can swing with respect to the base 9.

[0062] Furthermore, the platform 9 is connected to another platform 8 at the bottom through hinges 10, 11, and 12, and when the rotating bodies 1 and 2 receive a downward force from the fingertip on the platform, the platform 9 rotates the hinge. With the bending force S on the shaft 12, it descends with the rotating bodies 1 and 2 downward. Reference numeral 11 denotes a joint between the part 10 of the hinge and the base 8. The conductor 5 is a conductor that is arranged at a portion where the loops 3 and 4 of the wire are in contact with the base 9 and is in contact with the loops 3 and 4 and is energized. The arched wires 6 and 7 are conductive, but the surface of the part that rises vertically from the base 9 is covered with insulating coating, and there is no electricity even when it comes into contact with the wires 3, 4, and 5. . However, in the horizontal part on the upper part of the arched wires 6 and 7, this insulating coating is removed to expose the inner conductor, and electricity is supplied when the wire 3 or 4 is lifted and comes into contact with it. .

FIG. 3 (a) shows a side view and FIG. 3 (b) shows a front view of a part of the data input device shown in FIG. The vertically standing part of the arched wire 6 is covered with an insulating film 13, and the lower part of the base 9 is bent by the rotation axis 12 of the hinge and descends. And press it to turn on switch 14. Note that a unit in which the two rotating bodies 1 and 2 are integrated through looped wires 3 and 4 is hereinafter referred to as a rotating body arrangement. The application and release of the pressure applied to the rotating body arrangement by the downward movement of the fingertip (hereinafter referred to as the “pressure associated with the downward movement of the fingertip” to distinguish it from the weak pressure used to detect the position of the fingertip) Detect with switch 14. Through the 〇N-OFF of the switch 14, the starting point and the ending point of the pressing (landing) of the finger are detected. Each figure in FIG. 4 shows a state in which the apparatus in FIG. 2 is viewed from the front. When the fingertip in contact with the rotating body array with a small pressure moves left and right, the center of gravity of the minute pressure applied from the fingertip to the rotating body array changes according to the fingertip position. For example, in FIG. 4 (a), the position of the center of gravity is on the left side of the rotating body as viewed in the drawing, and the rotating body arrangement behaves in the same manner as the seesaw with the portion indicated by 15 as a fulcrum, and tilts to the left. At this time, the left side of the loop wire (3, 4), which is a conductor, is in contact with the conductor 5 and the right side is in contact with the conductor 7, and the conductors 5 and 7 are energized. This energization is detected by the conductors 17 and 18. Then, it detects that the fingertip has come to the left on the drawing. In Fig. 4 (b), the center of gravity is located at the midpoint between the fulcrum 15 and the fulcrum 16, so that the rotating body arrangement is kept horizontal and there is no energizing relationship between the conductors 5, 6, and 7, so the fingertip position is at the center. Is detected. In FIG. 4 (c), the position of the center of gravity comes on the right side of the rotating body, and the rotating body arrangement is inclined rightward with the portion shown in 16 as a fulcrum. At this time, the left side of the loop wire (3, 4), which is a conductor, is in contact with the conductor 6, and the right side is in contact with the conductor 5, and the conductors 5 and 6 are energized. This energization is detected by the conductors 17 and 19. To detect that the fingertip has come to the right on the drawing.

As described above, in the method shown in FIG. 4, switches are formed between conductors 5 and 6, and between conductors 5 and 7, and these two switches are set to ΔN and OFF according to the position of the fingertip. To detect the fingertip position. When one of the contacts of these two switches is turned on, the other is necessarily turned off. That is, the contact state between the two is exclusively determined. Such an exclusive mechanism is effective for the purpose of turning on only the target switch reliably in a narrow range. When trying to press the target rotating body from among the closely arranged rotating bodies, the fingertips will inevitably touch the nearby rotating body and exert a slight pressure on it as well. According to this, it is possible to exclusively and selectively press down the target rotating body to detect the finger position.

[0066] In the method shown in Fig. 4, the rotating body array is supported by two fulcrums, and the three areas are tilted in three ways by distinguishing three areas depending on which side of the fulcrum is the center of gravity of the force applied from the fingertip. It constitutes a seesaw-like mechanism that changes direction. The loop wire (3, 4) plays the role of a seesaw arm, and when the fingertip comes to the right or left of the three areas, the rotating body at the fingertip position drops and the seesaw mechanism Push down the arm on the fingertip position side of the fulcrum, and as a result, push up the arm on the opposite side of the fulcrum and hold the other rotating body Raise it. When the fingertip is in the center area, the arm does not move and there is no height difference between the rotating bodies. Since the height difference between the rotating bodies differs depending on the fingertip position in this manner, the fingertip position can be clearly distinguished by feeling the tactile sense.

In the method shown in FIG. 4, in order to detect a weak pressure generated when the fingertip touches the rotating body arrangement lightly, the contact state of the switch is devised with as little force as possible. Normal switches use a panel to restore contact, but using a panel makes it impossible to detect weak pressure, so the method in Fig. 4 uses only the movement of the center of gravity without using the panel to switch the switch. The conduction state is switched by changing the contact state. They change the contact state of the switch without using a panel, and use the power of the fingertips effectively to restore it. To reduce the contact resistance, it is better to solder the wires directly to the loop wires 3 and 4.However, it is also necessary to energize the loop wires 3 and 4 through the conductor 5 separately. , 4 is a device to make it move smoothly. In addition, the method in Fig. 4 switches the switch by moving the center of gravity without applying a force in the direction of fingertip movement and pressing the switch, so that the fingertip can be moved very smoothly without requiring any force. . In addition, if the cost can be increased, it is also possible to switch without using force by the optical method or the capacitance method.

[0068] Thus, the switch for detecting the finger position changes the contact state with a relatively weaker force (extremely weak force) than the switch 14 for detecting the pressure accompanying the downward movement of the fingertip. When the contact state is changed by the force applied in the same direction, the switch that changes the contact state with a weak force is switched first, so when the switch 14 is turned on by the downward movement of the fingertip, the position of the fingertip must be moved earlier than that. The contact state of the switch to be detected is determined. Therefore, the method of Fig. 4 guarantees that the position detection timing is always earlier than the descent motion (pressurization) detection, and prevents erroneous input caused by a delay in timing.

[0069] The switch for detecting the position and the switch for lowering the fingertip are both configured so that the contact relation (ON or OFF) of the contacts is strengthened by the force in the same direction (force acting in the downward direction). It is also important that If the two directions are the same, if one tries to apply force to ensure that one contact is made, the other contact weakens and causes erroneous input. In the method of Fig. 4, switch contact is strong unless the center of gravity of the pressure dropping the fingertip is changed. And the position of the fingertip is stably held. Furthermore, the position detection method shown in Fig. 4 is stable against perturbation of the finger position. In other words, even if the finger moves slightly within the set area, the position detection switch is turned on and off as long as it does not move beyond the fulcrum of the seesaw mechanism (conductors 3, 4, 5, 6, 7). Contact relationship).

[0070] It should be noted that instead of the method of detecting the fingertip pressure by the mechanical switch described above, the position of the fingertip may be detected by an optical method. Without detecting the fingertip position.

When the finger position is obtained using the absolute angle of the rotating body in the conventional method, it is necessary to move the fingertip while keeping it in contact with the rotating body. However, the rotation angle of the rotating body and the movement of the fingertip are required. Since there is a certain relationship between the quantities, the fingertip position could be determined from the rotation angle of the rotating body. For example, if an appropriate switch is pressed and turned ON when the rotating body rotates a predetermined angle, it is possible to detect that the fingertip has reached a predetermined position through ΔN-OFF of the switch. However, constraining the fingertip to always touch the device during operation was psychologically stressful, and the operability of the input device was also reduced. On the other hand, in the method of Fig. 3, the fingertip position is detected based on the position of the center of gravity of the minute pressure applied from the fingertip on the rotating body array, so that the fingertip does not need to be kept in contact with the rotating body. Even if you move away in the air and land at a distant point, the fingertip position can be correctly detected based on the center of gravity of the pressure applied there. If the fingertip can be released freely during operation, the user can jump and move quickly to the target position, thereby improving input efficiency.

When a switch that changes the contact state by being pressed when the rotating body is rotated by a predetermined angle for detecting the fingertip position is used, the amount of rotation of the rotating body is limited. When the fingertip position is detected by the method 3, the rotating body can rotate indefinitely, so if the amount of rotation of the rotating body is measured, the coordinate designation (pointing) can be performed with the same operational feeling as a trackball. . Figure 5 illustrates this mechanism.

[0073] Fig. 5 shows a striped reflection band provided on the surface or inside of the rotator below the rotators 1 and 2, and detects the reflected light to measure the amount of rotation of the rotator. 'Indicates encoder 20.

The rotary encoder ₂₀ is integrated with the rotating body arrangement, and the rotating body arrangement changes the posture. However, the relative positional relationship with the rotating body is kept constant. If the change in the attitude of the rotator array is small, the amount of rotation can be measured even if the rotary encoder 20 is installed on a table without being integrated with the rotator array. Although the method of optically detecting the rotation amount and the rotation direction is shown here, the rotation amount and the rotation direction may be detected electrically through a contact.

The movement amount of the fingertip can be calculated from the rotation direction and the rotation amount of the rotating body thus detected.

Regarding the relationship between the movement of the fingertip and the switch, the vertical movement shown in FIG. Regarding the movement in the left-right direction, the inner diameter of the arches of the arched wires 6 and 7 is sufficiently larger than the diameter of the wires 3 and 4 as described above. The posture is changed according to the position (the downward pressing position), and as a result, the contact state between the wires 3 and 4 and the arched wires 6 and 7 is changed. By electrically detecting this contact state, The landing position of the fingertip can be distinguished. In the example of FIG. 4, it is possible to distinguish between a case where the fingertip is on the rotating body 1 and a case where the fingertip is on the rotating body 2 and a case where the fingertip is at an intermediate point between the two.

FIG. 3 is a configuration diagram when the switch 14 is further introduced and the switch 14 is mounted on the table 8. When pressure is applied downward from the fingertips on the rotating body array, the table 9 bends at the hinge rotation axis 12 and descends, and the lower part of the table 9 contacts the switch 14 for vertical movement detection, and the switch 14 is turned on. I do. Through the ON / OFF of the switch 14, the start time and the end time of the finger pressing (landing) are detected.

As described above, when the mechanism shown in FIGS. 2 to 5 is used, the finger position is detected through the contact state between the wires 3 and 4 and the arched wires 6 and 7, and the fingertip position from the fingertip position when the switch 14 is turned on and off is landed. The position (pressing position) and the direction of movement of the fingertip after landing can be detected. Alternatively, the movement direction of the fingertip can be determined from the rotation direction and the rotation amount of the rotating body detected by the rotary encoder 20. Since the rotating body may be erroneously moved minutely even if the finger is intended to be stationary, it is desirable to determine that the fingertip has moved only when the amount of rotation detected by the rotary encoder 20 exceeds a predetermined angle. . Since information about the direction of movement can be obtained redundantly from the contact state between the rotary encoder and the wire, one of the information may be omitted, and the redundancy can be used to improve the reliability of detecting the rotation direction and the fingertip landing position.

[0077] Although the method using the rotating body array has been described above, a single rotating body such as a track ball may be used instead of the rotating body array, or the fingertip may slide with the fingertip after landing. It doesn't matter if you use a moving platform or a pad that moves with your fingertips sliding with small frictional forces. However, the conventional trackball or pad alone cannot detect the absolute position of the fingertip landing point, and cannot be used in the present invention. Conventional trackballs and pads can detect the relative direction and amount of movement of the fingertip. However, to use in the present invention, the trackballs and pads must have wires 3 and 4 and arched wires 6 and 7. A mechanism to detect the absolute position of the fingertip landing by adding a mechanism for detecting the contact state, etc., and determine the information to be input by combining this absolute position with the direction of movement of the fingertip at or immediately after landing is indispensable.

[0078] Furthermore, a pad is provided with irregularities for tactilely grasping the fingertip landing position, and when the trackball is rotated by a predetermined amount to visually grasp the pressing position, the rotation is braked to rebound. It is good to introduce a mechanism to notify that the required amount of rotation has been generated by generating force.

Further, if necessary, the rotating body may be arranged back and forth, or a combination of the rotating body and a contact for detecting the direction of finger movement may be arranged in the front and rear, left and right, and further in the middle direction between them. .

By providing the rotating body and the contacts shown in FIG. 3 in the front-back direction, it is possible to detect the movement of the finger not only in the left-right direction but also in the front-back direction. You can detect the movement of your finger by using this.

FIG. 6 shows an example of this configuration. In FIG. 6, the wheel 8 causes the table 8 to smoothly move in the front-rear direction following the movement of the fingertip in the front-rear direction, and the amount and direction of the movement are detected by the optical detector 22. In the method shown in Fig. 6, the rotation of the rotating body and the sliding movement of the device are used separately, and the left and right coordinates are specified in the former, and the coordinates in the front and rear directions are specified in the latter. The difference in the feel of the slide movement is convenient because the cursor movement in the left-right direction and the movement in the front-back direction can be tactilely distinguished.

When the fingertip is moved in the front-rear direction, the seesaw-shaped mechanism having two fulcrums can detect the position of the fingertip in the front-rear direction similarly to the case of moving the fingertip in the left-right direction. For example, in the configuration example shown in FIG. 7, when the position of the rotating body array moves in the front-back direction, the center of gravity of the pressure applied from the fingertip placed on the rotating body array also moves in the front-back direction, so that the center of gravity is shifted. 7 (a), (b), and (c), depending on which side of the fulcrum 30 or 31 the fulcrum comes, the contact points 26, 27, 28, 29 is switched, and the three positions, front and rear, can be distinguished and detected.

[0083] According to the mechanism described above, the user determines the fingertip landing position while referring to the tactile cues received at the fingertip, and raises the fingertip as it is without changing the position of the fingertip after landing or powers up and down after moving left and right. , And different information can be input by combining finger movements in the front-back direction. During this operation, the input device detects the fingertip landing position and the direction of movement of the fingertip at the time of landing or before and after landing, and determines information to be input based on a combination of the two. At this time, the tactile cue force and the beam alone may cause the landing position or the pressing position to be incorrect, and it is difficult to memorize the relationship between the finger movement and the information to be input. It is desirable to construct a multi-modal user interface by using the visual cues together to support the user's work in multiple ways.

Hereinafter, a specific user interface method will be described.

FIG. 8 is a functional block diagram of the computer device 60. The computer unit main body 66 is connected to the input unit 50 including the data input device 51 via the interface cable 90.

Here, the data input device 51 has a front contact 29, a rear contact 28, and an optical detector 22 for inputting a forward movement amount and a backward movement amount as shown in FIG. As shown in Fig. 3, the upper part is provided with a center button (execute button) 14, a right rotating body 1, a left rotating body 2, a right contact 7 and a left contact 6. In the above description, the arched wire 6 or the conductor 6 is called, but it constitutes a contact for an operator (user) to conduct when the left rotating body 2 or the arm 4 is pressed. Therefore, in the following description, it is referred to as the left contact, and similarly, the arched wire 7 or the conductor 7 is referred to as the right contact.

[0086] The interface means 52 converts a state signal of each switch and contact of the data input device 51 into a predetermined electric signal for computer input such as USB.

[0087] The computer device 60 is an interface for exchanging data with the input unit 50. Means 61, a processing unit 62 for performing calculations using the input data, a storage unit 63 composed of a memory for storing data, a display unit 65 such as a display device, and for sending data to the display unit 65. It is composed of a display memory 64.

[0088] The processing unit 62 includes a switch state input means (function) 71 for inputting the state of a switch or a contact of the data input device 51, and an individual function for selecting a means (function) to be executed according to the state of the switch. Selection means (function) 72 and one or more individual function execution means (functions) 74 which are activated by a command from individual function selection means 72 and execute predetermined processing. The individual function execution means 74 includes scroll execution means (function) 75 for executing screen scroll processing, link means (function) 76 for jumping to a link added to the screen display data, and the like. ing. Each means 7176 is realized by processing of a computer. In addition, the storage unit 63 associates the status file storing the switch status, the window displayed on the display unit 65, and the position range of the cursor in the window with the identification information (individual function ID) of the function to be executed. And a mode table 83 for storing switches and contacts of the data input device 51 and mode identification information (mode ID) in association with each other.

Next, the operation of the computer device 60 having the above configuration will be described.

Data input processing>

First, the data input processing of the switch state input means 71 will be described. The switch status input means 71 is activated periodically, reads the data of the input unit 50, and stores it in the status file 81. FIG. 10 is an example of the data configuration of the state file 81. The center button 14, the states of the left, right, front and rear contacts 6, 7, 29, and 28, the rotation amounts of the rotating bodies 1 and 2, and the front and rear movement amounts are sequentially updated. Also, with the change in the state of each switch, the center button flag, left input flag, right input flag, previous input flag, and rear input flag are set and reset. Each state may be converted into a predetermined code and stored for convenience of subsequent computer processing. For example, if the left contact is ON, it is converted to a press signal of “8” on the USB keypad, and if the left contact is OFF, it is converted to a release signal of “8” on the USB keypad and input to the computer device . Or

When the center button is ON, the signal is converted to a keyboard "backspace" press signal, and the center button is pressed. If it is off, it is converted to a keyboard “backspace” release signal and input to the computer device.

Alternatively, the state change detection may be performed on the data input device side, and the data may be input to the computer device at the timing of turning on or off.

[0090] Individual function selection processing>

Next, the operation of the individual function selecting means 72 will be described with reference to FIG. The individual function selecting means 72 is activated periodically or in response to a state change notification from the switch state input means 71, and first obtains cursor position information (S101). Next, referring to the state file 81, it is determined whether or not the center button 14 is turned on (S102). If the center button 14 is turned on, based on the individual function selection file 82 in FIG. Next, an individual function ID associated with the window or the activated function indicated by the cursor is extracted (S103). The individual function ID may be provided not only for each window but also for each position range within the window. For example, when the user points to the area A in the window shown in Fig. 13, the vertical scroll function is activated; when the user points to the area B, the horizontal scroll function is activated; otherwise, the link function is activated.

Then, the processing corresponding to the extracted individual function ID is executed by the individual function executing means 74 (S104).

[0091] On the other hand, if "No" in step S102, that is, if the center button 14 is OFF, it is next determined whether any of the left contact, right contact, front contact, and rear contact is ON ( If any of them is ON, the cursor movement processing is executed (S106). For example, when one of the contacts is ON, the cursor is moved in the direction of the contact, or the cursor is moved according to the rotation angle of the rotating body or the amount of movement of the optical detector. There are ways to change the speed.

[0092] When both the left contact and the front contact are ON, it is acceptable to perform a process such as moving diagonally to the upper left.

[0093] Individual function execution processing>

Next, the individual function execution means 74 activated in step S104 will be described with reference to a scroll function 75 and a link function 76 as examples. [0094] (Scroll function)

First, the operation of the horizontal scroll execution unit 73 will be described with reference to FIGS. In FIG. 14, when the scroll execution means 73 is activated by an activation request from the individual function selection means 72, it first determines whether or not the center button flag is set to 〇N with reference to the state file 81. (S201) If the center button flag is ON, the scroll flag is set to "neutral" (S202). Then, the detection of the scroll speed is stopped (S203), and then, it is determined whether or not the left input flag has changed after the start-up or from the previous determination (S204). Execute (S205).

[0095] If there is no change in the left input flag in step S204, it is next determined whether or not the right input flag has changed (S206). S 207). If there is no change in either the left input flag or the right input flag ("No" in S206), a center pressing process is executed (S208). Then, after each process (S205, S207, S208), it is determined whether or not the scroll process is completed (S211). If not completed, the process returns to step S204 to repeat the process. Note that as the determination condition in step S211, the scroll processing ends when the center button flag changes from ON to OFF or when the cursor is out of the range of the scroll function.

On the other hand, if “No” in step S201, that is, if the center button flag is OFF, the scroll flag is set to “neutral” (S209), and scroll speed detection is stopped (S210).

Next, the operation of the left press input process (S205) will be described with reference to FIG.

First, it is determined whether or not the left input flag is ON (S401). If it is ON, then, it is determined whether or not the scroll flag force S is “Right to left scrolling” ( S402). If “Yes” in the step S402, the scroll speed detection is ended (S403), and a scroll process from right to left is executed (S404).

[0098] Here, the scroll speed is obtained by a software timer that is started at the start of scroll speed detection and stopped at the end of scroll speed detection. The slow speed is used when the timer value is large, and the fast speed is used when the timer value is small. To scroll the screen. Thereafter, the scroll flag is set to “end right-to-left scroll” (S405). Note that the scrolling process also updates the coordinate range information of the individual function selection file 82 sequentially. [0099] If "No" in step S401, that is, if the left input flag is OFF, it is next determined whether or not scroll flag force S is "right to left scroll end" (S406). In this case, the scroll flag is set to “neutral” and the process ends (S407).

If "No" in step S406, the scroll flag is set to "left to right scrolling" (S408), and the detection of the scroll speed is started (S409).

Next, the operation of the right-press input process will be described with reference to FIG.

First, it is determined whether or not the right input flag is して N (S601). If the right input flag is ON, then it is determined whether or not the scroll flag is “left to right scrolling” (S601). S602). If “Yes” in the step S602, the scroll speed detection is terminated (S603), and the scroll processing to the left or right is executed at the speed determined based on the timer value (S604). Thereafter, the scroll flag is set to "end left-to-right scroll" (S605).

[0101] If "No" in step S601, that is, if the right input flag is OFF, then it is determined whether the scroll flag is "end of left-to-right scroll" (S606), and if "Yes" Sets the scroll flag to "neutral" and terminates (S607).

If “No” in step S606, the scroll flag is set to “right to left scrolling” (S608), and the detection of the scroll speed is started (S609).

With the above processing, scrolling to the left or right is executed using the state of the left contact, the right contact, and the center button. Note that, in the above processing, when scrolling to the right, the operator presses the left contact point of the data input device 51, and then moves the finger while sliding the pressed position from the center to the right. Scroll to. Then, the scrolling speed is determined by the moving speed of the finger. The same applies when scrolling to the left.

[0103] Note that the above-described scroll processing procedure can also be used as cursor movement processing, provided that it operates when the center button 14 is turned off. The processing procedure at this time is shown in FIGS. 15 and 16 by replacing “scroll” with “cursor movement”.

[0104] Further, the method of controlling the analog amount represented by the speed processing described above can be applied to the moving speed of the cursor and other processing. Exclusively working left contact, right Since contacts are used, 〇N and OFF information obtained by sliding a finger over the data input device is taken in, so analog data such as speed can be controlled with a simple configuration without using analog data by hardware. The signal can be controlled.

[0105] Of course, instead of the above process of determining the right (left) scroll speed based on the time from when the left (right) contact changes from ON to OFF to when the right (left) contact turns 〇N, The speed may be determined according to the magnitude of the body rotation angle. Note that the scrolling process is not limited to the above-described procedure. For example, when the right contact point is pressed immediately for right scrolling, if there is no change in the contact state after waiting for a certain period of time, Adding functions as needed, such as scrolling to the right at a predetermined speed, improves the convenience for the operator.

The vertical scroll function can be realized by the same processing as described above using the data of the front contact point, rear contact point, forward movement amount, and backward movement amount.

[0106] (Link function)

Figure 13 shows a weather forecast screen as an example of content accessed via the Internet. The position of interest on the screen is indicated by an arrow (cursor) mark, and the nine link items (linked information) around the arrow are displayed with marks 41 indicating finger movement. When this arrow-shaped cursor is moved, nine link items around the cursor position are automatically detected from the content, and a mark 41 indicating finger movement is added to them. In the mark 41, a white area is provided in the black area, and the white area is moved relatively to the black area to indicate the movement of the fingertip.

[0107] Hereinafter, the processing procedure of the link function will be described based on this screen example based on the flowchart of Fig. 17.

First, it is determined whether or not the center button 14 is 〇N (S801). In the case of 次に N, a predetermined number of link items (link information) within a certain range from the position of the cursor are next determined. Extracted (S802). This extraction range may be determined in advance according to the distance from the carcare, or a link item in the window designated by the cursor may be extracted. The predetermined number corresponds to the number of mode IDs to be assigned.

[0108] Next, a mode ID based on a rotating body is assigned to each of the extracted link items, and this is temporarily stored. It is saved as an aisle (S803), and a display output corresponding to each mode ID is performed (S804). Figure 18 shows an example of a temporary file in which the mode ID is assigned to the link item (place name) around the cursor (pointer) in the screen example in Figure 13. The display of the finger movement corresponding to the mode ID is displayed below the link item.

The mark used to indicate the movement of the fingertip used here is an underline added below the item (in this case, the place name). Part of the underline is white, and this white part indicates the fingertip landing position. With the position as the starting point, move in the direction (left or right) that indicates the direction of fingertip movement. When selecting one of the items, the operator looks at the movement of the white part of the underline under the item, executes the finger motion corresponding to the movement, and operates the rotating body and the contact.

Then, the states of the rotating body and the contacts are read (S805), and it is determined whether or not the mode can be determined based on the read state information with reference to the mode table of FIG. 19 (S806). In such a case, the mode ID is saved (S807), and as the display of the mode, for example, a process of inverting the color of the selected link item in FIG. 13 is performed (S808). In step S807, instead of storing the mode ID, the selection flag may be set in association with the mode selected in the temporary file in FIG.

[0110] After that, the state of the rotating body and the contact point is read again (S809). If there is a mode change (S810), the processing from step S806 is repeated. On the other hand, if the mode has not been changed in step S810, it is next determined whether or not the center button 14 has been changed from ON to OFF (S811). If the mode has been changed, the link corresponding to the mode ID is determined. Jump to the link destination of the item (S812).

In step S811, if the state of the center button 14 has not changed and a predetermined time has elapsed (S813), an error message is output and the process ends (S814). If the predetermined time has not elapsed in step S813, the process returns to step S809 to determine whether or not the mode has been changed.

The link function is realized by the above procedure.

[0112] (User interface method)

The ability to browse text, video, and audio recorded on various sites over the Internet at present The current viewing tool (software called browser-1) Is based on the assumption that a pointing device such as a mouse is used as an input device, and menu items and link items are selected through the operation of pointing (coordinate specification). However, the display area of the menu items and link items on the screen is small.If the cursor position is not accurately controlled and moved to this small area, the menu items and link items cannot be selected. Les ,. In addition, it is necessary to watch the screen while moving the cursor, and it is not preferable for safety to continuously move the point of interest on the screen while driving a car or performing other work. Furthermore, the psychological load during positioning is large, and the work efficiency is reduced.

In order to prevent the viewpoint from being stuck on the screen and reduce the psychological load, the current browser has a shortcut function for selecting menu items and link items instantly. However, since the current shortcut function is a method in which a specific menu item is executed when a specific key is pressed, the problem is that the relationship between the key and the menu item must be stored. Also, it cannot be used to select a link item embedded in content that cannot be associated with a key.

In this embodiment, a link embedded in a menu item or content is a mark (icon, background color of the item, underline, etc.) that can intuitively correspond to the finger motion by solving the above problem. By adding a shortcut to the menu item or link item by executing the finger movement suggested by this mark by displaying it in addition to the item, it is easy to intuitively make an effort and instantaneous menu items and link items are displayed. Link items can be selected.

[0114] In general, there are an unspecified number of menu items and link items, and it is not possible to cope with limited types of finger movements. Therefore, using a combination of the means for roughly specifying the point of interest in a menu or content and the above-mentioned shortcut means, and first roughly specifying the point of interest, the number of items from the vicinity of the point of interest equal to or less than the number of finger movement types, Link items are automatically detected by the procedure of FIG. ₁₇ , and marks are automatically added to these items and link items to be displayed. The specification of the point of interest does not need to be precise. The target item or link item can be roughly specified so that it is included in the added range of the mark. Then, select one of the marked items or one of the linked items by performing the finger movement indicated by the mark. [0115] The position of interest is specified by using the cursor keys, the scroll buttons, or the pointing device. However, since it is only necessary to specify roughly, it can be specified at high speed, and the time to keep watching the screen is reduced. The focus position is set by the pointing device.Every time the cursor or the cursor key is pressed, link items embedded in the content are sent by the same number as the type of finger movement, and new link item groups are marked one after another. I'm sorry. When selecting a target item from a group of menu items or link items to which the mark has been added in this way, the finger movement corresponding to the mark can be executed and the selection can be made instantaneously, so that the selection is performed at high speed, and during the operation, This reduces the psychological burden on the user and the viewpoint is not restricted by the screen, so that safety can be maintained even when operating during work such as driving a car.

Various modifications can be made to the user interface by using the procedure in FIG.

For example, FIG. 20 shows an example in which the background color behind the item is changed to the surrounding color and used as the mark 41 indicating finger movement instead of the underline in FIG. In this example, the rectangular area behind the item is displayed in a different color from the surrounding area. Using a rectangular area with two different colors (light blue and yellow), a thin blue rectangular area suggesting the range of movement of the fingertip, and a thin rectangular area suggesting the fingertip and a yellow rectangular area in the animation (animation) Move it repeatedly to display it. The yellow area periodically repeats the movement of moving from the position corresponding to the landing point of the fingertip in the direction corresponding to the movement direction of the fingertip. The corresponding item can be selected by imitating the movement of the background color and moving the fingertip, so there is no need to memorize the correspondence between the key and the item compared to the conventional shortcut method of pressing the key and selecting the item, so it is intuitive And easy to understand.

FIG. 21 shows various design examples of the mark 41 indicating the finger motion. Step (a) in the figure shows an example of the movement of the fingertip on the rotator array. In the top view of the input device shown in Fig. 2, the landing point of the fingertip is indicated by a black circle. There are a total of three landing points either on the rotator indicated by an ellipse arranged 1J on the left or right, or at an intermediate point between the two rotators. The direction of movement of the fingertip after landing at each landing point is indicated by an arrow. The fingertip moves to the left or right after landing, and then rises without moving or from the landing position. A figure consisting of only a solid circle without an arrow suggests a movement in which the fingertip is moved to the point indicated by the solid circle without landing and moving left and right. In the figure with the arrow on the black circle, after the fingertip lands on the point of the black circle, the direction of the arrow Moving up and then moving up. Marks corresponding to the nine finger movements shown in (a) are shown in (b), (c), and (d). The (b) column shows the same marks as those used in Fig. 20. The background color behind the item is displayed differently from the surrounding background color and used as a mark. The area that changes color is rectangular, and the stationary rectangular area outside suggests the entire range of fingertip movement. A small rectangular area that repeats moving left or right inside it suggests a fingertip, the starting point of the small rectangular area's moving action indicates the fingertip landing point, and the direction of the moving action indicates the fingertip moving direction after landing. Movement where the fingertip rises without moving after landing is indicated using a small rectangular area that blinks stationary at the position corresponding to the landing point.

[0118] In the (c) stage, marks similar to those used in Fig. 13 are shown. An underline is added at the bottom of the item, and the color of one part of the underline is changed to indicate the fingertip landing point by the starting point when moving the part, and the moving direction to indicate the fingertip moving direction after landing. In addition, the movement of the fingertip rising without moving from the landing point is suggested by blinking the part that changed color in the underline at the position corresponding to the landing point while standing still. The (d) row shows an example of a static mark that indicates the direction of fingertip movement in a still image. The two open rectangles at each mark indicate two rotators, indicating that the fingertip lands on the left or right rotator, with a black oval added to the white rectangle corresponding to the rotator on the landing side. Shown. If the fingertip lands at the midpoint between the two rotators, a black ellipse is drawn between the two white rectangles. The direction of movement of the fingertip after landing is indicated by an arrow starting from the black ellipse. Movement of the fingertip, which does not move after landing and rises as it is, is indicated by simply drawing a black ellipse at the corresponding point.

[0119] Fig. 9 shows an example of a mechanism in which the rotating body is braked and stopped when the rotating body is rotated by an appropriate amount, or a repulsive force is applied to the fingertip to notify the user that the rotating body is rotated by an appropriate amount. In (a), the brake 30 is moved by an actuator such as a solenoid to contact the rotating body to stop the rotating body. Since the braking is performed electronically, the braking can be freely controlled through a program, and it is possible to electronically detect that the fingertip has moved by an appropriate amount and determine the braking timing after adjusting various conditions.

[0120] In (b), the projection 32 protruding from the rotating body is fixed to the rotating shaft of the rotating body for rotation stationary. When it hits the rod 31 and rotates to a predetermined angle, it stops, and when it stops rotating any more, it notifies the user that it has rotated the required amount. When braking in such a simple manner, there is a need to use a mechanism that allows the rotating body to return to the reference position when the finger is released.

In (c), when the corners of the side surfaces of the prisms 33 and 34 that rotate integrally with the rotating body rotate by a predetermined angle, they come into contact with the leaf springs 35 and 36 and push up the leaf springs. In the figure, the rotating body 1 is braked because the prism 33 is rotated to the angle that pushes up the leaf spring 35, and the rotating body 2 is rotated at the rotation angle of the prism 34 because the side of the prism 34 does not contact the panel 36 and there is a gap. Can rotate freely without braking. When the corner of the prism comes into contact with the panel panel and tries to push it up, the user feels the repelling force received by the fingertip, and the user can grasp that the required amount of rotation has occurred. In this method, if the corner of the side of the prism continues to rotate further after contact with the panel and the corner of the side passes through the panel, the relative relationship between the prism and the panel is reset, so the position is based on the rotating body. It is not necessary to return to. In addition, if another panel panel is added and the contact between the panel panel and the prism is detected electronically so that the timing of the contact differs depending on the rotation direction, the electronic panel is changed due to the difference in the timing at which the two panel panels contact the prism. The direction of rotation of the rotating body can be detected in a short time.

FIG. 22 shows the correspondence between the movement of the fingertip and the characters to be input when the user interface of the present invention is used for the text input operation. In this example, in order to input Hiragana characters in Roman characters, an alphabet representing a consonant shown in (b) and an alphabet representing a vowel shown in (c) are assigned to each fingertip movement shown in (a). Hiragana is input by inputting consonants and vowels alternately. Here, if the method and apparatus proposed in the present invention are used, only the memorized consonants and vowels corresponding to nine types of fingertip movements are input, and hiragana is input with a touch type without looking at the hand or the menu, and writing a sentence. Can be created. The nine exercises are simple exercises that move the thumb right and left. If you want to enter the hiragana character string “KA”, usually enter the consonant first, followed by the vowel, followed by “KA”. According to the assignment shown in Fig. 22, while only five finger movements are used for vowel input and the remaining four movements are free, other functions are added to these four free movements. In order to use the vowel consonants first and conversely, the consonants should be input first, in order to use them effectively. [0123] For example, when the user wants to input "?", He inputs it as "AK". In this way, for example, after executing the function of "no subsequent consonants" assigned to one of the four types of free exercise, inputting "A" prevents automatic switching to the consonant input function. Can be entered. Also, if you assign the function "Make sound muddy", the characters entered immediately before or after executing this function will be changed to mud sound. Furthermore, when converting the input Hiragana to Kanji or copying it, a rotary encoder that measures the rotation amount of the rotating body is used, and the range of phrase separation, registration range, and copy range is determined according to the rotation amount. Good les. Also, when selecting one of the objectives from multiple Kanji candidates, registered terms, and sentence units, it is possible to associate nine types of finger movements with candidates so that candidates corresponding to finger movements can be selected instantly. Can be created efficiently. At this time, if the candidate is marked with a mark indicating fingertip movement and displayed, the target candidate can be selected instantly by executing the movement suggested by the mark.

According to the present embodiment, the data input device has a multi-stage configuration having two or more layers in the upper and lower layers, the mode can be selected by a switch directly touching a finger, and the mode selected together with the state information of the lower switch is set to the computer device. And a control device, so that various data can be input quickly and accurately within a narrow range of finger movement.

In particular, when multiple modes are selected with a single finger, it is difficult to operate and erroneous operation is likely to occur.However, it is necessary to output the selection information on a computer or a control device together with feedback from the user's finger touch. As a result, operability can be improved and operation errors can be suppressed.

Further, according to the present embodiment, the means for detecting the position where the fingertip force and pressure are applied (pressure application position) without using a switch that changes the contact state according to the rotation angle of the rotating body is used. The fingertip is released from the constant contact with the rotating body, and jumps in the air as needed to enable high-speed data input. The input efficiency is further improved by simply using the fingertip moving direction immediately after the fingertip drop instead of the fingertip raising position (pressure release position). In addition, the rotating body can be rotated without limitation, and the rotating body can be used for the purpose of specifying coordinates with the same operability as a trackball. In return for these effects, erroneous input caused by a finger touching a nearby rotating body, trembling of the fingertip, or recoil of another finger operation The problem of incorrect input arises, but a way to overcome these problems could be provided.

[0126] Further, in addition to the conventional tactile cue force, a visual cue displayed on the screen so as to suggest finger movement, a beep sound that changes according to the fingertip position, or occurs when an area including the fingertip changes. Using audible cues due to beeping sounds and haptic cues by braking the rotating body according to the fingertip position, erroneous input is greatly reduced, and the correspondence between input information and fingertip movement is stored. Without having to do this, it is now possible to operate easily based on the clinging force and finger movements displayed on the screen. Also, specifically, in the content browser (browsing method), a means for instantly selecting an item corresponding to finger movement is introduced without having to precisely determine the cursor position, thereby improving the efficiency of item selection and reducing the psychological load. Reduced. In the sentence input method, the user can instantly select a target term from registered terms by executing the finger movement corresponding to the mark added to the term. Also, in applications to car navigation, etc., it is now possible to instantaneously select the target item of the menu without having to watch the screen while driving the car.

(Modification of Cursor Movement Processing and Scroll Processing)

In the above processing, the cursor movement processing is performed when the center button 14 is OFF, and the scroll processing is performed according to the cursor position when the center button 14 is ON. Anyway ,.

The cursor movement process is performed by turning the left and right contacts ON and pressing the center button. On the other hand, scroll processing is performed without pressing the center button, that is, with the center switch OFF, at a speed determined by the time difference between the time when one contact is separated and the time when the other contact is touched. Do it.

If the mode selection method according to the present embodiment is used, scrolling the screen may be performed more frequently than moving the cursor. In this case, this condition is more effective.

Next, a second embodiment of the present invention will be described. In the present embodiment, a means is provided for the data input device of the first embodiment so that both the left contact 6 and the right contact 7 simultaneously become 〇N, and the ON signal is taken in. It improves the operability and reliability of mode selection (item selection). [0129] Data input device>

For the data input device 51 described in the first embodiment, a conductive elastic body such as a panel 45 is provided from the base 9 to the arms 3 and 4 as shown in FIG. Arms 3 and 4 touch both contacts 6 and 7 (when not touching the finger). By applying pressure downward with a finger, the panel 45 is reduced and deformed.

In the state shown in FIG. 23 (a), the current supplied from the conductor 17 is supplied to the arms 3 and 4 through the conductor 5 and the panel 45. Then, since the signals are output to the conducting wires 19 and 18 connected to the left contact 6 and the right contact 7, respectively, the computer device 60 monitoring this electric signal detects that both contacts 6 and 7 are in the ON state. .

When the operator increases the pressure to the right as shown in FIG. 23 (b), when pressure is applied, the arm 3 separates from the left contact 6 and the arm 4 contacts the right contact 7 Only the right contact 7 turns ON. When the pressure is increased near the center as shown in FIG. 23 (c), both the contacts 3 and 4 are separated from each other, so that both the contacts 6 and 7 are detected to be OFF. Further, when pressure is applied to the left side as shown in FIG. 23 (d), the arm 4 separates from the right contact 7 and the arm 3 comes into contact with the left contact 6, so that only the left contact 6 is turned on.

[0132] With the operator applying pressure downward, the application position is shifted from right to left, and the contact state is such that only the right contact is ON, both contacts 〇FF, and only the left contact is ON. The state changes to. The same applies to the reverse direction. When the operator stops pressurizing and releases the pressurization, both contacts are turned ON.

In FIG. 23, in consideration of the force operability in which the spring 45 is provided at the center of the arms 3 and 4, for example, two or more points are connected to the arms near the left and right rotating bodies 1 and 2 May be provided separately.

[0133] Information equipment>

Next, an operation for selecting a mode by taking in contact information of the data input device 51 having such a configuration will be described below. Note that the functional configuration of the computer device 60 according to the present embodiment is basically the same as that of the first embodiment, so FIG. 8 is used, and the link function of FIG. 13 is used as an example in the first embodiment. The following description focuses on the differences between the processes.

[0134] Data input processing> The switch state input means 71 reads the data of the input unit 50 periodically or every time the state changes, and stores the data in the state file 81. FIG. 24 is an example of a data configuration of the status file according to the present embodiment. In addition to raw data of switches such as buttons and contacts, flags indicating the state of the switches are stored. For example, when the left contact 6 is 〇N and the right contact 7 is off, the left input flag is turned on (or set), and turned off (or reset) when the contact status becomes other than that. ). Similarly, when the right contact 7 is 〇N and the left contact 7 is off, the right input flag is turned on. The center input flag is ON when both contacts 6 and 7 are OFF, and the release flag is ON when both contacts 6 and 7 are OFF. At the time of this flag processing, it is desirable to perform switch chattering processing.

As described above, the setting and resetting of the input flag are processed by the switch state input means 71, that is, the lower level program called the driver program, so that the individual function (application program) Processing can be simplified, and mistakes in program creation can be reduced.

In this embodiment, since the mode is selected without using the information of the rotation amount and the movement amount, FIG. 24 does not include the data of the rotation amount and the movement amount. This information can be entered by using.

[0137] Individual function selection processing>

Next, the operation of the individual function selecting means 72 according to the present embodiment will be described with reference to FIG. When the individual function selecting means 72 is activated periodically, first, referring to the state file 81, if the center button 14 is OFF ("Yes" in S901), the cursor position information is acquired (S902). Then, based on the individual function selection file shown in FIG. 12, an individual function ID associated with the window designated by the cursor or the activated function is extracted (S903). In the present embodiment, the link function of the individual function ID A001 has been extracted, and the function will be described as an example.

Next, a predetermined number of pieces of information (mode additional information) to which a mode is assigned near the cursor position are extracted (S904). This predetermined number is a maximum value that can be determined by the combination of the switch settings of the mode table 83 and can be distinguished.

FIG. 26 shows a data configuration example of mode table 83 according to the present embodiment. Center button According to the operating conditions of the button 14, the mode is selected by a two-step procedure. Specifically, three mode IDs (M01-M03) are assigned to correspond to the left, center, and right input flag states when the center button 14 changes from OFF to ON. After that, three more mode IDs (N01 N03) are assigned to correspond to the left, center, and right input flag states when the center button 14 changes from ON to OFF.

[0140] In this embodiment, when the center button changes from OFF to ON, the first mode selection is performed, and when the center button changes from 〇N to OFF, the second mode selection is performed. By performing mode selection, it is possible to select a more detailed layered mode from among the modes selected at the first time.

[0141] A mode ID is sequentially assigned to the mode additional information extracted in step S904, and the information is stored in a temporary file (S905). FIG. 27 is an example of this temporary file. In this example, since the mode additional information corresponds to the link item to which the link information has been added, the link item is stored in association with the combination of the first and second mode IDs.

In addition, Tokyo, Kanagawa, Chiba, etc. listed as specific examples are Japanese place names indicating the area classification of the weather forecast, and simply indicate that they are link items.

[0142] Then, the state of the input flag in the state file 81 is read (S906), and the mode additional information (link item) that can be selected in the first operation is first specified as a display output corresponding to each mode ID. (S906). FIG. 28 is an example of a screen displayed based on the data of the temporary file in FIG. A mark 41 indicating finger movement is displayed below the selectable link item. This mark is displayed in black and white, and the white position indicates finger movement. When nine types of items are selected, in the first embodiment, nine items must be displayed as shown in FIG. 13, but in the present embodiment, the left and center selections are made as the first selection. , And identify and display the three right ways. The operator presses the contact at the desired position according to the mark. At this time, based on the input flag read in step S906, by referring to the temporary file in FIG. 27, the identification of the link item corresponding to the input flag is blinked or the color is changed. This allows the operator to confirm that the selection has been made correctly, and to change the pressed position if necessary. In addition, The selection may be transmitted to the operator by feedback information such as outputting a beep sound or vibrating the data input device 51 at a predetermined rhythm corresponding to the mode instead of the identification display.

[0143] The operator confirms the item selected by the feedback information, and turns on the central button 14 positioned below by pressing the item further down at the pressed position. As the processing of the individual function selecting means 72, it is determined whether or not the center button 14 has become 〇N (S908). If “No”, the cursor movement processing described in the first embodiment is executed. (S909), and returns to step S902.

On the other hand, if “Yes” in step S908, that is, if the center button 14 has become 〇N, the state of the input flag read in step S906 is latched, and it is determined whether mode determination is possible. (S910). As a method of determining whether or not the mode determination is possible, for example, referring to the mode table 83, the presence of the mode ID corresponding to the latched input flag and the determination of the mode ID in the temporary file 84 There is a way to make mode determination possible on condition that it exists.

If the mode cannot be determined (“No” in S910), an error message to that effect is output (S916).

On the other hand, if the mode can be determined (“Yes” in S910), the mode ID is stored (S911). As a method of storing the mode ID, for example, as shown in FIG. 29, the first selection flag is set at the position of the corresponding mode ID.

Next, the input flag is read from the state file 81 (S912), and the display output corresponding to the second selection mode is performed with reference to the mode table 83 (S913). FIG. 30 shows a display example instructing the second selection when mode M02 is selected at the first time. A mark indicating finger movement is displayed below the selectable item. At this time, the cursor or the mark 41 may be displayed differently from the first selection to indicate that the selection is the second selection.

[0147] Then, it is determined whether or not the center button 14 has been turned off (S914). If "No", if not time-out ("No" in S915), the process returns to step S912. If a time-out occurs, an error message is output (S916) and the selection file of the temporary file 84 is output. The first mode information such as lag information is reset (S912).

[0148] On the other hand, if "Yes" in step S914, that is, if the center button 14 is turned off, the state of the input flag read in step S912 is latched, and it is determined whether mode determination is possible or not. (S917).

If the mode determination is impossible (“No” in S917), an error message to that effect is output (S916), and the mode information such as the selection flag saved in the temporary file 84 is reset (S917).

921).

On the other hand, when the mode can be determined (“Yes” in S917), the mode ID is stored (S918), and the link item corresponding to the selected mode ID is displayed. (S918). FIG. 31 shows an example of the data in the temporary file 84 when the link item “Shizuoka” is selected through the first and second times with the second selection flag set at the position of the mode ID N01 for the second time. . On the screen, identification information indicating that Shizuoka has been selected is output.

[0151] Thereafter, within a predetermined time (for example, about 0.5 seconds), it is determined whether or not the release flag is turned on (S919, S920). If the release flag is turned on, the mode of the temporary file 84 is changed. Reset and end (S912). On the other hand, if “No” in step S920, that is, if the release flag is not turned on within a predetermined time, the individual function executing means 74 is executed (S922). This jumps to the link destination of the selected link item.

[0152] In the above processing, in steps S919 and S920, the state of the release flag after a predetermined time from when the center button 14 is turned off, or the change state of the release flag within the predetermined time is monitored. Therefore, even if the operator makes a mistake in the first selection, for example, and has already pressed the center button 14, if the operator releases the finger and immediately releases the switch, the Mode can be reset, and undesired modes can be prevented from being executed.

[0153] Normally, by displaying the mode that is finally selected, humans usually try to confirm the contents of their selection, so that they are distinguished from the operation when the switch is intentionally released. S becomes possible. It is preferable that the predetermined time can be set in advance by the operator.

[0154] The individual function executing means 74 sets the release flag to ON and sets the center button to 〇N It may be activated on condition that the time until the release flag turns ON after the force changes to OFF is shorter than the specified time.

[0155] In addition, the mode ID allocation for the second selection is reduced, and, for example, the condition of the central input flag ON may not be used. In this way, the condition of the second central input flag ON can be used as a command for mode reset.

According to the present embodiment, the state of the two contacts can be determined not only exclusively by scissoring the neutral point, but also whether or not the operation is being performed. Can be selected, and more accurate operation determination can be performed.

[0157] Further, since the mode is set in two stages, a complicated mode can be set with a small number of procedures. For example, in the first embodiment, all the mode IDs are assigned to the mode additional information and are displayed at once, so that the display of the finger motion for the mode is complicated. However, according to the present embodiment, the mode ID is Are assigned hierarchically, and the upper mode is selected in the first display, and the lower mode is selected in the next operation, so that the display of the finger motion is simplified and the operability is improved.

[0158] In particular, since the switch state is taken before the mode selection is confirmed and what is selected is displayed to the operator, the operator confirms the display and confirms the mode selection. In addition, if an incorrect mode is selected, the user can release the finger from the data input device to reset it easily, so that erroneous control due to unintended operation can be prevented.

[0159] Also, in the present embodiment, when modes are hierarchically allocated, user privilege is improved. For example, the first choice is to let the user select a menu for today's weather forecast, tomorrow's weather, regional information, and the like, and then select the area for the second choice.

[0160] The present invention is not limited to the above-described embodiment, and can be carried out in various modifications without departing from the scope of the invention. Further, the means and processes described in each of the above embodiments can be appropriately combined and executed. For example, the operation described in the second embodiment may be combined with the rotation amount and movement amount data of the first embodiment to perform detailed operation control such as mode setting and speed adjustment. In addition, the individual functions are not limited to the illustrated scroll function and link function. The present invention covers all functions of the information device.

Industrial applicability

The data input device and the user interface method according to the present invention

Not only that, it can be used for all devices such as control devices and mobile phones that require the user to input data.

Brief Description of Drawings

FIG. 1 is an explanatory diagram showing a movement direction of a fingertip operating a data input device according to the present invention.

FIG. 2 is a perspective view of a part of the data input device according to the embodiment of the present invention.

FIG. 3 shows (a) a side view and (b) a front view of an embodiment of the data input device.

FIG. 4 is an explanatory diagram showing a state in which the posture of the rotating body arrangement means changes according to the landing position (pressing position) of the fingertip according to the first embodiment of the present invention, and the contact state of the switch changes.

FIG. 5 is an explanatory diagram of a rotary encoder for detecting a rotation amount of a rotating body.

FIG. 6 is an explanatory diagram of means for realizing the forward and backward movement of the fingertip and means for detecting the amount of forward and backward movement.

FIG. 7 is an explanatory diagram of a method of switching a contact point of a switch by moving a fingertip in a forward and backward direction.

FIG. 8 is a block diagram of a computer device (information device) according to an embodiment of the present invention.

FIG. 9 is a diagram showing a method of braking a rotating body.

FIG. 10 is a data configuration diagram of the state file of FIG. 8.

FIG. 11 is a flowchart showing a processing procedure of an individual function selecting unit in FIG.

FIG. 12 is a data configuration diagram of an individual function selection file of FIG. 8.

FIG. 13 is an explanatory diagram of a method for extracting a specific item from link items embedded in content according to the first embodiment of the present invention.

FIG. 14 is a flowchart showing a processing procedure of a scroll function in the individual function executing means of FIG. 8 (center button processing).

FIG. 15 is a flowchart showing a processing procedure of a scroll function in the individual function executing means of FIG. 8 (left contact processing). Garden 16] is a flowchart showing the processing procedure of the scroll function in the individual function execution means of FIG. 8 (right contact processing).

Garden 17] is a flowchart showing the processing procedure of the link function in the individual function execution means of FIG.

FIG. 18 is a data configuration diagram of a primary file according to the first embodiment of the present invention.

FIG. 19 is a data configuration diagram of a mode table according to the first embodiment of the present invention.

Garden 20] is an explanatory diagram of a method for extracting a specific item from link items embedded in content according to another example of the first embodiment of the present invention.

FIG. 21 is an explanatory diagram of a mark indicating fingertip movement according to another example of the first embodiment of the present invention. Figure 21 (a) shows the nine types of fingertip movements on the rotating body array, and Figures 21 (b)-(d) show examples of mark design suggesting fingertip movements shown in Figure 21 (a). FIG. Garden 22] is an explanatory diagram of marks indicating fingertip movement when inputting Hiragana in a Roman character mode by combining consonants and vowels according to another example of the first embodiment of the present invention. FIG. 23 is a partial configuration diagram of a data input device according to a second embodiment of the present invention.

FIG. 24 is a data configuration diagram of a state file according to the second embodiment of the present invention.

25 is a flowchart showing a processing procedure of an individual function selecting means according to the second embodiment of the present invention.

FIG. 26 is a data configuration diagram of a mode table according to the second embodiment of the present invention.

FIG. 27 is a data configuration diagram of a primary file according to the second embodiment of the present invention.

FIG. 28 is an explanatory diagram of a mode display according to the second embodiment of the present invention. (Screen before selecting the first mode)

[FIG. 29] A data configuration diagram of a primary file according to a second embodiment of the present invention. (Explanation of the first mode selection)

FIG. 30 is an explanatory diagram of a mode display according to the second embodiment of the present invention. (Screen before selecting the second mode)

FIG. 31 is a data configuration diagram of a primary file according to the second embodiment of the present invention. (Explanation when selecting the second mode)

Explanation of reference numerals Right rotating body

Left rotating body

, 4 loop wire (arm) conductor

Left contact

Right contact

, 9 units

, 11 hinges

Axis of rotation

Insulation coating

Center button

, 16, 30 fulcrum

, 18, 19 conductor

Rotary encoder wheel

Optical detector

Contact

Rear contact

Front contact

Brake

Rotating stationary rod

Protrusion

, 34 prism

, 36 leaf spring

Mark

Spring

Input section

Data input device 1 Interface means Computer unit Processing unit

Memory

Display memory

Display

Computer device switch status input means Individual function selection means Scroll execution means Individual function execution means Scroll function

Link function

State file

Individual function selection file Mode table Temporary file

Interface cable

Claims

The scope of the claims

[1] a rotating body arrangement means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotated by the fingertip;

A pressure is provided between an upper platform supporting the rotating body arrangement means and a lower platform located below the upper platform, and a pressure accompanying a downward movement of a fingertip is applied to the rotating body arrangement means to detect a pressure application position. Pressure application position detecting means,

Pressure release position detecting means for detecting a pressure release position at which the pressure applied from the fingertip on the rotating body arrangement means is released,

Fingertip movement direction detecting means for detecting a moving direction of the fingertip to which the pressure is applied and moved by the fingertip operating the rotating body of the rotating body arrangement means,

Information to be input can be specified by combining at least one of the pressure application position detection means and the pressure release position detection means, and an output signal from the fingertip movement direction detection means. Data input device.

[2] A position detecting switch for detecting a position by changing a contact state according to a position where a weak fingertip pressure applied to the rotating body acts on the rotating body, and the pressure application position detecting means includes: A pressure detection switch for changing the contact state when a pressure higher than the pressure for changing the contact state of the switch is applied from the fingertip is provided. The data input device according to claim 1, wherein a contact state determined by the position detection switch and a contact state determined by the position detection switch are detected separately.

[3] The position detection switch is formed of a seesaw mechanism that can perform a seesaw movement on the upper table, and includes a conductive arm member that rotatably supports the rotating body. When the rotating body at the fingertip position lowers relative to other rotating bodies due to excessive pressure and changes the contact state of the position detection switch, the arm supporting the rotating body on the side to be lowered 3. The data input device according to claim 2, wherein the data input device lifts the other rotating body via the arm on the other side by landing on the upper platform and performing a seesaw movement.

[4] The movement of a fingertip that is provided on the lower platform and specifies the pressure application position, Movement is allowed in the horizontal or forward and backward movements of the fingertip that changes the application position, and finger support means is provided to support the downward movement of the fingertip that applies pressure downward so that the downward movement is immobile. 4. The data input device according to claim 3, wherein:

[5] The finger supporting means is formed by a finger supporting rotator that rotates in the direction of the moving motion but is immovable with respect to the direction of the descending motion. 5. The data input device according to claim 4, wherein the data input device supports a part of a fingertip.

[6] An information device provided with means for designating information to be input by combining a landing position or pressing position of a fingertip with a movement direction of a fingertip at the time of landing or before and after landing, and is displayed on a display screen. By displaying the mark of the background color, underline, icon, etc. of the item that is present statically or dynamically with the above-mentioned fingertip landing position or pressing position and the pattern or animation that suggests the fingertip movement direction, An information device, comprising: means for selecting a corresponding item when executing a finger movement suggested by the symbol or the animation.

7. The information device according to claim 6, further comprising: content browsing means for browsing content such as video, music, and text through an Internet communication network or a storage device, wherein the content browsing means is a target position in the content. A selection candidate detecting means for detecting a plurality of selection candidate items in the vicinity,

An information device, wherein the mark as a selection candidate item detected by the selection candidate detection means is statically or dynamically displayed on the display so as to indicate finger movement.

[8] A rotating body arrangement means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotated by the fingertip,

Pressure application position detection means for detecting a position on the rotator arrangement means at which pressure due to the downward movement of the fingertip is applied;

Pressure release position detecting means for detecting a position at which the pressure applied from the fingertip on the rotating body arrangement means is released,

Fingertip movement direction detecting means for detecting a moving direction of the fingertip to which the pressure is applied by the fingertip operating the rotating body of the rotating body arrangement means, and The information according to claim 6 or 7, wherein the fingertip landing position or the pressing position is detected by the pressure application position detection, and the fingertip movement direction is detected by the fingertip movement direction detection means. machine.

[9] A rotating body arrangement means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotated by the fingertip,

Fingertip movement direction detecting means for detecting a moving direction of the fingertip to which the pressure is applied by the fingertip operating the rotating body of the rotating body arrangement means, and

Combining the output signal of the fingertip landing position or the pressing position detected by the pressure application position detection means with the output signal of the fingertip movement direction detected by the fingertip movement direction detection means, and An information device, wherein information to be specified is specified, and a braking means for braking the rotational movement of the rotating body according to the position of the fingertip or the rotation angle of the rotating body is provided.

[10] a mode table for storing the switch state and the mode identification information in association with each other,

Creates and temporarily stores correspondence information that associates one or more selection candidate items with mode identification information, outputs switch operation information for selecting the selection candidate items, and then inputs switch state data. And extracting the mode identification information corresponding to the switch state with reference to the mode table, extracting the selection candidate item corresponding to the mode identification information based on the correspondence information, and extracting the selection candidate item. An individual function selecting means for outputting an output to notify that is selected,

An information device comprising: an individual function executing unit that executes a process related to a selection candidate item selected by the individual function selecting unit.

[11] A user interface method for specifying information to be input by combining a position of a fingertip landing position or a pressing position with a direction of movement of the fingertip at the time of landing or before and after the landing, wherein the items displayed on the display screen are specified. Background color, underline, icon, etc. When a mark is displayed statically or dynamically with a design or animation that suggests the fingertip landing position or pressing position and the fingertip movement direction, and the finger movement suggested by the design or the animation is performed. A user interface method, wherein the item corresponding to the above item is selected.

12. The user interface method according to claim 11, wherein a sound output is changed according to the fingertip position to notify the fingertip position audibly.

[13] A user interface method using a unit for designating information to be input by combining a landing position of a fingertip and a movement direction of the fingertip at the time of landing or before and after the landing, wherein the fingertip movement direction, video, A user interface method wherein the display of content such as text and the moving direction of the reproduction range are displayed on the display in association with each other.

[14] In the user interface method according to claim 11, a content browsing means for browsing contents such as video, music, text, etc. through a communication network or a storage device of the Internet, and the content browsing means includes the content browsing means. Using a selection candidate detecting means for detecting a plurality of selection candidate items near the attention position of

A user interface method, wherein the mark as a selection candidate item detected by the selection candidate detection means is statically or dynamically displayed on the display so as to indicate a finger movement.

[15] The user interface method according to claim 11,

Using a sentence registration unit that registers sentence units that appear frequently,

A user interface method, wherein the mark for each sentence registered in the sentence registration means is statically or dynamically displayed on the display so as to indicate a finger movement.

[16] An execution switch capable of discriminating at least two states of a non-pressurized state and a pressurized state, and a table positioned above the execution switch and capable of applying pressure for changing the state of the execution switch. The installed state can be distinguished from the released state and the use state. In the use state, at least three types of position states, left, right and center, can be entered, and the left and right are seesaw machines. A user interface method for inputting each of the switch states of a data input device having a mode selection switch that switches according to a structure to an information device and selecting an item for operating the information device according to the switch state,

For each non-pressurized state and pressurized state of the execution switch, each position state of the mode selection switch and mode identification information for selecting an item of the information device are stored in association with each other,

Each of the plurality of selection candidate items is uniquely assigned mode identification information including mode identification information in a non-pressurized state and mode identification information in a pressurized state,

First, finger operation information related to the mode identification information in the non-pressurized state is output, and the state of the mode selection switch is input from the data input device,

Thereafter, when the execution switch changes to the pressurized state, the mode identification information of the non-pressurized state is determined from the state of the input mode selection switch, and one or more selection candidate items corresponding to the mode identification information are determined. And extracting the finger operation information of the mode identification information at the time of pressurization for the extracted selection candidate item, inputting the data input device power and the state of the mode selection switch,

Next, when the execution switch changes to the non-pressurized state, the mode identification information of the pressurized state is determined from the state of the input mode selection switch, and the selection candidate item corresponding to the mode identification information is finally determined. If there is no release input within a predetermined time after that, the process related to the finally selected selection candidate item is executed.

A user interface method, comprising:

[17] A timer is started when the center position is reached from the left or right position of the mode selection switch, and the timer is stopped when the other position is reached, 17. The user interface method according to claim 16, wherein the timer value is used as an operation parameter of the information device.

[18] An execution switch capable of distinguishing at least two states between a non-pressurized state and a pressurized state, and a table positioned above the execution switch and capable of applying pressure for changing the state of the execution switch. Provided, when the released state and the use state can be determined and the use state At least three types of position states, that is, left, right, and center, can be input, and the left and right of each switch state of the data input device having a mode selection switch switched by a seesaw mechanism are input to an information device, and the information device is determined by the switch state. A program for controlling the operation of

A process of associating and saving each position state of the mode selection switch and mode identification information for selecting an item of the information device for each of the non-pressurized state and the pressurized state of the execution switch;

A process of uniquely assigning mode identification information including mode identification information in a non-pressurized state and mode identification information in a pressurized state to each of a plurality of selection candidate items;

A process of outputting finger operation information related to mode identification information in a non-pressurized state and inputting a state of the mode selection switch from the data input device;

When the execution switch changes to the pressurized state, the mode identification information of the non-pressurized state is determined from the state of the input mode selection switch, and one or more selection candidate items corresponding to the mode identification information are determined. Extracting the finger selection information of the mode identification information at the time of pressurization for the extracted selection candidate item, and inputting the state of the mode selection switch from the data input device;

When the execution switch changes to the non-pressurized state, the mode identification information of the pressurized state is determined from the state of the input mode selection switch, and the selection candidate item corresponding to the mode identification information is finally selected. Outputting information indicating that the selection has been made, and thereafter, if there is no release input within a predetermined time, executing a process related to the finally selected selection candidate item. program.