WO2005057395A1 - Dispositif d'entree de donnees, appareil d'information, et procede d'interface utilisateur - Google Patents

Dispositif d'entree de donnees, appareil d'information, et procede d'interface utilisateur Download PDF

Info

Publication number
WO2005057395A1
WO2005057395A1 PCT/JP2004/018586 JP2004018586W WO2005057395A1 WO 2005057395 A1 WO2005057395 A1 WO 2005057395A1 JP 2004018586 W JP2004018586 W JP 2004018586W WO 2005057395 A1 WO2005057395 A1 WO 2005057395A1
Authority
WO
WIPO (PCT)
Prior art keywords
fingertip
state
switch
rotating body
movement
Prior art date
Application number
PCT/JP2004/018586
Other languages
English (en)
Japanese (ja)
Inventor
Itsuo Kumazawa
Original Assignee
Itsuo Kumazawa
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Itsuo Kumazawa filed Critical Itsuo Kumazawa
Priority to JP2005516221A priority Critical patent/JPWO2005057395A1/ja
Publication of WO2005057395A1 publication Critical patent/WO2005057395A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G06F3/0234—Character input methods using switches operable in different directions
    • H—ELECTRICITY
    • H01—ELECTRIC ELEMENTS
    • H01H—ELECTRIC SWITCHES; RELAYS; SELECTORS; EMERGENCY PROTECTIVE DEVICES
    • H01H3/00—Mechanisms for operating contacts
    • H01H3/02—Operating parts, i.e. for operating driving mechanism by a mechanical force external to the switch
    • H01H2003/0293—Operating parts, i.e. for operating driving mechanism by a mechanical force external to the switch with an integrated touch switch

Definitions

  • the present invention relates to a multimodal user interface technology for inputting characters and instructions to information devices, and particularly to a data input device that assists a user operation by comprehensively utilizing visual, auditory, and tactile sensations. , Information equipment, and a user interface method.
  • a data input device provided with a mechanism for stimulating a user's tactile sensation
  • a device in which a pin display can protrude a pin and a device in which a vibrator or a drive unit incorporated in a mouse is operated.
  • Patent Documents 1-3 See Patent Documents 1-3).
  • the shape and size of the cursor keys are changed for each direction so that they can be distinguished by tactile sense.
  • a plurality of ball-shaped protrusions are arranged at the fingertip contact portion, and the fingertip is placed on the ball-shaped protrusion array.
  • a method of inputting information based on tactile information of the unevenness of the ball-shaped projection array while moving smoothly has also been proposed. (See Patent Documents 12-14). [0008] However, in these methods, since the unevenness is static and fixed, even when the fingertip is moved, no clear difference in the unevenness shape was obtained. In addition, since the information to be input is specified only by the lowering position of the fingertip, various information cannot be input unless the number of ball-shaped projections is increased.
  • Patent document 1 JP-A-11-161152
  • Patent Document 2 JP-A-10-55252
  • Patent Document 3 JP-A-6-102997
  • Patent Document 4 JP 2001-356862 A
  • Patent Document 5 JP-A-2000-29623
  • Patent Document 6 JP-A-2000-259333
  • Patent Document 7 JP-A-2000-47792
  • Patent Document 8 JP-A-10-143301
  • Patent Document 9 JP-A-11-224161
  • Patent Document 10 Japanese Utility Model Application No. 5-55222
  • Patent Document 11 JP-A-2002-278694
  • Patent Document 12 JP-A-3-90922
  • Patent Document 13 JP-A-11-353091
  • Patent Document 14 JP 2001-166871 A
  • the present invention has been made in view of the above-described powerful circumstances, and has a data input device, an information device, and a user interface capable of accurately inputting various instructions within a narrow finger movement range.
  • the purpose is to provide methods and the like.
  • the data input device solves the above problem by devising a method of detecting the fingertip position without using the rotation angle of the rotating body.
  • the switch position detection
  • the switch indicates the center of gravity of the pressure on the rotating body or between the rotating bodies.
  • Switch Detection was made by changing the contact state. If the rotating bodies are arranged close to each other, when applying pressure to the target rotating body, a finger accidentally touches the nearby rotating body and pressure is applied, so that an erroneous input is likely to occur.
  • a mechanism for supporting a part of a finger called a finger support base or a finger support rotating body is introduced.
  • the finger support follows the movement of the finger when changing the position of the fingertip and moves back and forth and left and right to allow the fingertip to freely change its position, but undesired positions (unintended positions)
  • the platform (height) that does not move in the direction of the movement of the finger that applies pressure (downward movement) and supports part of the finger in this direction does not move.
  • the finger applies pressure to the target position on the rotating body array by moving the finger part to be pressurized by changing the bending force and inclination of the joint.
  • Rotating body for finger support works in the same way, but this moves back and forth and left and right Instead of rotating, the fingertip on it rotates so that the position can be changed freely. Also in this case, the height is not changed, and a part of the finger is supported so as not to move in the direction in which pressure is applied to the rotating body arrangement.
  • the data input device of the present invention does not need to use the rotation angle of the rotating body for detecting the fingertip position, so that the rotating body can be rotated without limitation without being limited by the amount of rotation angle. become. Therefore, the coordinates can be designated using this rotating body like a trackball.
  • the rotating body of the present invention can rotate only in one direction, that is, left and right or back and forth, only one-dimensional coordinates can be specified.
  • the data input device is configured to slide the entire rotator array in a direction perpendicular to the rotation direction of the rotator to specify another dimension of coordinates. Alternatively, the movement amount or the rotation amount of the finger support or the finger support rotating body is detected and used for coordinate designation.
  • the interval between the rotating bodies is changed by swinging the rotating body according to the position of the fingertip, or a height difference is generated between the rotating bodies, thereby emphasizing the feeling of unevenness felt by the fingertip touching. This makes it possible to more clearly grasp the position of the fingertip from the difference in the feel of the unevenness when the fingertip is moved.
  • the input efficiency can be improved by preferentially associating characters or commands that are frequently input with the movement of the fingertip having a short distance.
  • the types of information that can be specified are the fingertip descent position (pressure application position) and the fingertip movement direction (For example, left, stationary, and right directions are limited to three combinations.) Force The input efficiency can be further improved because the information can be specified by the quick movement of the fingertip.
  • the only browser on the Internet uses a mouse.
  • the mainstream method is to move the cursor with a pointing device such as a cursor, specify an item with an underline or the like according to the cursor position, and select that item by clicking the mouse button.
  • a design icon that suggests finger movement
  • an underline or background color that is displayed as a movie that suggests finger movement.
  • a mark is displayed on a plurality of selection candidate items in the vicinity of the cursor only by roughly positioning the cursor without precisely positioning the cursor, and the finger motion indicated by the mark is executed.
  • the target item is selected immediately by just doing. Cursor positioning is time-consuming and psychologically burdensome, so even in the conventional method, a shortcut is used to select an item instantly by pressing a specific key in order to select items quickly without moving the cursor.
  • the means provided by the present invention also provides a kind of shortcut function, and after the cursor position is roughly determined, the item can be selected at high speed. At this time, since it is not necessary to keep an eye on the cursor for precise positioning, the psychological load is reduced.
  • a target word can be selected instantaneously by performing a finger motion indicated by the mark after marking each term, so that the efficiency of text creation can be improved.
  • a tactile cueing force such as a feeling of unevenness of the rotating body easily misidentifies the finger position and makes an input error easily. Therefore, in the present invention, an auditory cue is first added. Either a different beep sound is generated depending on the fingertip position, or a beep sound is generated at the moment the fingertip position changes so that the fingertip position can be grasped audibly to reduce erroneous input.
  • the finger position has changed through the beep sound by the method of generating a beep sound at the moment of moving to the left and right compartments of the center compartment force.
  • the movement of the fingertip and the input command may be intuitively related. For example, moving the content display (playback) according to the direction of movement of the fingertip, switching channels, or fast-forwarding or reverse-feeding the tape can avoid the difficulty of storing the relationship between movement and commands. . For such applications, it is better to precisely measure the amount of rotation of the rotating body with a rotary encoder, etc., and make the amount of rotation correspond to the amount of movement of the content.
  • the fingertip When the rotating body rotates smoothly, the fingertip can move smoothly while contacting the rotating body on the rotating body array, but when the fingertip comes to a predetermined position or when the rotating body rotates a predetermined angle.
  • the brake When the brake is pressed against the rotating body or a part of the rotating body collides with the anti-rotation member to brake or limit the rotation of the rotating body, the user can feel the reaction force due to the braking through force sense. For example, when the fingertip moves from the left zone to the center zone, the rotation is momentarily braked at the boundary between the two zones and the reaction force is applied to the user's fingertip. You can know that the area has changed.
  • the data input device includes a rotating body arrangement means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotating by the fingertip, and an upper part supporting the rotating body arrangement means.
  • a rotating body provided between the table and a lower table located below the upper table;
  • a pressure applied by the downward movement of the fingertip is applied to the arrangement means, and a pressure application position detection means for detecting a pressure application position, and a pressure release position at which the pressure applied from the fingertip on the rotator arrangement means is released are detected.
  • Pressure release position detecting means, and fingertip moving direction detecting means for detecting the moving direction of the fingertip which moves by applying pressure by the fingertip operating the rotating body of the rotating body arrangement means;
  • the information to be input can be specified by combining at least one of the position detecting means and the output signal from the fingertip moving direction detecting means.
  • the rotating body arrangement means is formed so as to be movable in a direction orthogonal to the rotating direction of the rotating body.
  • the fingertip moving direction detecting means is provided with a rotating direction detecting means for detecting the rotating direction of the rotating body, and the fingertip moving direction is detected based on the rotating direction of the rotating body detected by the rotating direction detecting means. It is desirable to detect the direction in which the object moves.
  • the rotation amount of the rotating body or the finger supporting rotating body or the moving amount of the finger supporting base is detected, and the coordinates are designated in an information device such as a computer device based on the rotating amount or the moving amount. This improves operability.
  • the data input device includes a position detecting switch for detecting a position by changing a contact state according to a position where a weak fingertip pressure applied to the rotating body acts, and a pressure detecting switch.
  • the applied position detecting means is provided with a pressure detecting switch for changing the contact state when a relatively stronger pressure than the pressure for changing the contact state of the position detecting switch is applied from a fingertip, and a contact state by the pressure detecting switch is provided. It is characterized in that a contact state by a position detecting switch determined according to a position of a weak pressure applied from a fingertip is detected separately.
  • the position detection switch operates with a relatively smaller force than the pressure detection switch.
  • Tactile state means a degree that does not change.
  • the position detecting switch is formed of a seesaw mechanism that can move the seesaw on the upper table, and includes a conductive arm member that rotatably supports the rotating body.
  • a seesaw mechanism that can move the seesaw on the upper table
  • the rotating body at the fingertip drops relative to the other rotating bodies due to the slight pressure applied from the fingertip and changes the contact state of the position detection switch, the rotating body on the falling side is supported.
  • the arm to be moved lands on the upper table and makes a seesaw movement, thereby lifting another rotating body via the arm on the other side.
  • the contact state is exclusively changed in the left-right direction or the front-back direction by the above-mentioned seesaw mechanism by a weak pressure, and the amount of rotation is further reduced by the rotating body on the descending side. Enable operation.
  • the arm member is lifted by a conductive elastic body attached between the arm member and the upper base, and when the pressure is released, all of the position detection switches are brought into a contact state. It is desirable that the release state be configured to be identifiable. It is possible to diversify control using this data input device and improve the reliability of data.
  • the information device is an information device provided with means for designating information to be input by combining a landing position or pressing position of a fingertip with a movement direction of a fingertip at the time of landing or before and after landing.
  • the background color, underline, icon, etc. of items displayed on the display screen are displayed statically or dynamically with a pattern or animation that suggests the fingertip landing position or pressure position and fingertip movement direction
  • means for selecting a corresponding item when performing a finger motion suggested by a symbol or an animation is provided.
  • a plurality of modes can be selected by a simple operation by performing an identification display (mark) indicating a finger movement on a selectable item.
  • the “information device” means a computer device or a device having a built-in computer, and includes a control device, a so-called control device, a mobile phone, and the like.
  • the information device is an information device provided with means for designating information to be input by combining a landing position of a fingertip and a movement direction of the fingertip at the time of landing or before and after landing. It is characterized in that the direction and the moving direction of the display / playback range of the content such as video, music, and text are displayed on the display in association with each other.
  • a plurality of modes can be easily controlled by associating fingertip movements with functions such as display and reproduction of content.
  • the information device further includes a content browsing unit for browsing contents such as video, music, and text through an Internet communication network or a storage device. It has a selection candidate detection means for detecting a plurality of selection candidate items near the position, and a mark as a selection candidate item detected by the selection candidate detection means is statically or dynamically set so as to indicate finger movement. It is displayed on a display.
  • a sentence registration unit for registering a sentence unit appearing frequently, and the display unit statically or dynamically displays on the display such that the mark of the sentence unit registered in the sentence registration unit indicates finger movement. It should be displayed.
  • the information device includes a rotating body arranging means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotating by the fingertip, and a downward movement of the fingertip on the rotating body arranging means.
  • Pressure applying position detecting means for detecting a position to which the accompanying pressure is applied, a rotating body array, a pressure releasing position detecting means for detecting a position where a pressure applied from a fingertip is released on the rotating body array means, and a rotating body array
  • Fingertip moving direction detecting means for detecting the moving direction of the fingertip that moves by applying pressure by the fingertip operating the rotating body of the means, and detects the fingertip landing position or the pressing position by detecting the pressure application position;
  • the moving direction detecting means detects a fingertip moving direction.
  • the information device includes a rotating body arranging means having a plurality of rotating bodies arranged in a movement range of the fingertip and rotating by the fingertip, and a pressure accompanying a downward movement of the fingertip on the rotating body arranging means.
  • Pressure application position detection means for detecting the position where Pressure release position detecting means for detecting the position where the pressure applied from the fingertip is released on the row means, and the fingertip which moves by applying pressure by the fingertip operating the rotating body of the rotating body arrangement means
  • a fingertip moving direction detecting means for detecting a moving direction of the fingertip, an output signal of the fingertip landing position or the pressing position detected by the pressure applying position detecting means, and a fingertip movement detected by the fingertip moving direction detecting means.
  • the braking means for braking the rotational movement of the rotating body according to the position of the fingertip or the rotating angle of the rotating body is provided.
  • the rotational movement of the rotating body is braked particularly in accordance with the position or the rotation angle of the fingertip. Therefore, the braking force is transmitted to the fingertip, and the operator can determine how much the rotation angle is. You can recognize without looking.
  • the information device includes a mode table that stores switch states and mode identification information (mode IDs) in association with each other, and a correspondence table that associates one or more selection candidate items with the mode identification information. After creating and temporarily storing information and outputting switch operation information for selecting a selection candidate item, inputting switch state data, referring to a mode table, and setting a mode corresponding to the switch state.
  • Individual function selecting means for extracting identification information, extracting a selection candidate item corresponding to the mode identification information based on the correspondence information, and outputting an output to inform that the selection candidate item is selected;
  • Individual function executing means for executing processing relating to the selection candidate item selected by the function selecting means.
  • a table in which the switch state and the mode ID are associated in advance is stored, and a mode ID is assigned to the extracted selection candidate item to correspond to the mode ID.
  • the switch operation information is notified to the operator, and then the switch state is read, the corresponding item is extracted with reference to the mode table, and the related process is executed.
  • a user interface method is a user interface method for designating information to be input by combining a position of a fingertip landing position or a pressing position with a direction of movement of a fingertip at the time of landing or before and after landing. Mark the background color, underline, icon, etc. of the item displayed on the display screen with the fingertip landing position or pressure Characteristically or dynamically displayed with a design or animation that suggests the position and fingertip movement direction, and the corresponding item is selected when performing the finger movement suggested by the design or animation.
  • the movement of the fingertip for selecting an item is represented by a mark on the screen, and the movement of the fingertip is detected to select the corresponding item.
  • the user interface method provides a content browsing means for browsing contents such as video, music, and text through a communication network or a storage device of the Internet, and a content browsing means which is located near an attention position in the content.
  • a selection candidate detection means for detecting a plurality of selection candidate items existing in the display
  • a mark as a selection candidate item detected by the selection candidate detection means is statically or dynamically displayed on the display so as to indicate finger movement. It is characterized in that it is displayed.
  • a plurality of selection candidate items near the target position in the content are detected, and information that suggests finger movement as a mark for selecting the item is detected. Display to allow the operator to select the desired item.
  • the rotating body arranging means having a plurality of rotating bodies arranged in the movement range of the fingertip and rotating by the fingertip; Pressure applying position detecting means for detecting a position to be applied, pressure releasing position detecting means for detecting a position where the pressure applied from a fingertip on the rotating body arranging means is released, and a rotating body of the rotating body arranging means And a fingertip moving direction detecting means for detecting a moving direction of the fingertip which is moved by applying pressure with the fingertip for operating the fingertip, and detects a fingertip landing position or a pressing position by the pressure applying position detecting means.
  • the moving direction detecting means detects the direction of fingertip movement.
  • the fingertip movement is detected based on the fingertip moving direction and the landing position or pressing position of the fingertip.
  • the user interface method further comprises an output signal of the fingertip landing position or the pressing position detected by the pressure application position detection, and an output signal of the fingertip movement direction detected by the fingertip movement direction detecting means.
  • an output signal of the fingertip landing position or the pressing position detected by the pressure application position detection and an output signal of the fingertip movement direction detected by the fingertip movement direction detecting means.
  • the user interface method related to mode selection includes an execution switch capable of distinguishing at least two states between a non-pressurized state and a pressurized state, and an execution switch positioned above the execution switch. It is possible to distinguish between the open state and the use state provided on the table to which pressure can be applied to change the state.
  • the use state at least three types of position states, left, right and center, can be input, and left and right Is a user interface method for inputting each switch state of a data input device having a mode selection switch switched by a seesaw mechanism to an information device, and selecting an item for operating the information device according to the switch state, the user interface method comprising: Each position of the mode selection switch and the information device The mode identification information is stored in association with the mode identification information, and the mode identification information including the mode identification information in the non-pressurized state and the mode identification information in the pressurized state is uniquely assigned to each of the plurality of selection candidate items.
  • the finger operation information related to the mode identification information in the non-pressurized state is output, the state of the mode selection switch is input from the data input device, and when the execution switch changes to the pressurized state, the input is performed.
  • the mode identification information in the non-pressurized state is determined from the state of the selected mode selection switch, and one or more selection candidate items corresponding to the mode identification information are extracted, and the extracted selection candidate items are pressurized.
  • the state of the data input device power mode selection switch is input, and then, when the execution switch changes to the non-pressurized state, The mode identification information for the pressurized state is determined from the state of the input mode selection switch, and information indicating that the selection candidate item corresponding to the mode identification information is finally selected is output. After that, if there is no release input within a predetermined time, a process related to the finally selected selection candidate item is executed.
  • a mode ID is set for each of the ⁇ N state and the OFF state of the execution switch (center button), and is assigned to the selection candidate items in the operation state of the information device, thereby providing a plurality of selection candidate items. Of the desired items can be easily selected. This also allows hierarchical mode selection.
  • the mode selection switch is shifted from the left or right position to the middle position. It is desirable to start the timer when the center position is reached, stop the timer when the other position is reached, and use the timer value as an operation parameter of the information device.
  • the binary input switch enables analog data input with simple operation.
  • a program according to the present invention includes an execution switch capable of determining at least two states of a non-pressurized state and a pressurized state, and a program for changing the state of the execution switch which is located above the executed switch. It is possible to distinguish between the open state and the use state provided on the table to which pressure can be applied.In the use state, at least three types of position states, left, right and center, can be entered, and the left and right are switched by a seesaw mechanism A program for inputting each switch state of a data input device having a mode selection switch to an information device, and controlling the operation of the information device according to the switch state.
  • one or more selection candidate items corresponding to the mode identification information are extracted, and finger operation information of the mode identification information at the time of pressurization is output for the extracted selection candidate items, and the data input device.
  • the process of inputting the state of the force mode selection switch, and when the execution switch changes to the non-pressurized state, the mode of the input mode select switch is changed to the pressurized mode.
  • the "mode” is not limited mainly to the operation mode of the information device and the power that means the processing content. It is sufficient if some selection is possible, and if there are a plurality of selectable items. The purpose is to include the item.
  • the fingertip is always kept on the rotating body. Freed from the constraining constraints, it allows rapid and accurate input of diverse data within a narrow range of finger movement.
  • the direction of movement of the fingertip is defined as shown in FIG. Figure 1 shows the relationship between the right thumb placed on the data input device and its movement direction.
  • the direction of vertical pressing with the finger pad is “down”, the reverse direction is “up”, the direction from the base of the finger to the nail is “front”, and the reverse is “rear”. Seeing as “right” or “left”. The same applies when operating with other fingers instead of the right thumb.
  • the operator operates the switch arranged on the data input device by moving the fingertip in the front, rear, left, right and up and down directions indicated by the arrows in FIG.
  • the definition of this direction is for the purpose of specifying the present invention or describing the present embodiment, and the direction is not universal, and the direction can be determined by another definition.
  • FIG. 2 is a perspective view of a part of the data input device according to the first embodiment of the present invention viewed obliquely from above and forward.
  • Reference numerals 1 and 2 denote rotating bodies, which rotate around wires 3 and 4, respectively, and the fingertips riding thereon move smoothly left and right while riding on the rotating body due to the rotation of the rotating body.
  • the fingertip has a convex portion of the rotating body and a concave portion of the rotating body as a concave portion to obtain an uneven tactile sensation, and the fingertip position can be grasped based on the tactile information. Even if the rotating bodies 1 and 2 are arranged close to each other, the positions of the fingertips can be clearly distinguished by tactile cues, so that data can be input without error.
  • FIG. 1 and 2 denote rotating bodies, which rotate around wires 3 and 4, respectively, and the fingertips riding thereon move smoothly left and right while riding on the rotating body due to the rotation of the rotating body.
  • the fingertip has a convex portion of the rotating body and a
  • wires 3 and 4 are rotating shafts of the rotating bodies 1 and 2, and are supporting columns of the rotating body that bends in the middle and lifts the rotating body from the base 9, and are made of a conductive material. Therefore, it also functions as a conduction path of a switch mechanism described later.
  • the wires 3 and 4 together form a loop, which loops through 6, 7 arches made of conductive wire.
  • a unit in which the two rotating bodies (the right rotating body 1 and the left rotating body 2) are integrated through loop wires 3 and 4 is hereinafter referred to as a rotating body arrangement.
  • the inner diameter of the arches of the arched wires 6 and 7 is sufficiently larger than the diameter of the wires 3 and 4, and the loop formed by the wires 3 and 4 is surrounded by the arched wires 6 and 7 and connected to the base 9 Because the arch is connected with play within the margin of the inner diameter of the arch, the arch can swing with respect to the base 9.
  • the platform 9 is connected to another platform 8 at the bottom through hinges 10, 11, and 12, and when the rotating bodies 1 and 2 receive a downward force from the fingertip on the platform, the platform 9 rotates the hinge. With the bending force S on the shaft 12, it descends with the rotating bodies 1 and 2 downward.
  • Reference numeral 11 denotes a joint between the part 10 of the hinge and the base 8.
  • the conductor 5 is a conductor that is arranged at a portion where the loops 3 and 4 of the wire are in contact with the base 9 and is in contact with the loops 3 and 4 and is energized.
  • the arched wires 6 and 7 are conductive, but the surface of the part that rises vertically from the base 9 is covered with insulating coating, and there is no electricity even when it comes into contact with the wires 3, 4, and 5. . However, in the horizontal part on the upper part of the arched wires 6 and 7, this insulating coating is removed to expose the inner conductor, and electricity is supplied when the wire 3 or 4 is lifted and comes into contact with it. .
  • FIG. 3 (a) shows a side view
  • FIG. 3 (b) shows a front view of a part of the data input device shown in FIG.
  • the vertically standing part of the arched wire 6 is covered with an insulating film 13, and the lower part of the base 9 is bent by the rotation axis 12 of the hinge and descends. And press it to turn on switch 14.
  • a unit in which the two rotating bodies 1 and 2 are integrated through looped wires 3 and 4 is hereinafter referred to as a rotating body arrangement.
  • the application and release of the pressure applied to the rotating body arrangement by the downward movement of the fingertip hereinafter referred to as the “pressure associated with the downward movement of the fingertip” to distinguish it from the weak pressure used to detect the position of the fingertip) Detect with switch 14.
  • FIG. 4 shows a state in which the apparatus in FIG. 2 is viewed from the front.
  • the center of gravity of the minute pressure applied from the fingertip to the rotating body array changes according to the fingertip position.
  • the position of the center of gravity is on the left side of the rotating body as viewed in the drawing, and the rotating body arrangement behaves in the same manner as the seesaw with the portion indicated by 15 as a fulcrum, and tilts to the left.
  • This energization is detected by the conductors 17 and 18. Then, it detects that the fingertip has come to the left on the drawing.
  • the center of gravity is located at the midpoint between the fulcrum 15 and the fulcrum 16, so that the rotating body arrangement is kept horizontal and there is no energizing relationship between the conductors 5, 6, and 7, so the fingertip position is at the center. Is detected.
  • FIG. 4 (b) the center of gravity is located at the midpoint between the fulcrum 15 and the fulcrum 16, so that the rotating body arrangement is kept horizontal and there is no energizing relationship between the conductors 5, 6, and 7, so the fingertip position is at the center. Is detected.
  • FIG. 4 (b) the center of gravity is located at the midpoint between the fulcrum 15
  • the position of the center of gravity comes on the right side of the rotating body, and the rotating body arrangement is inclined rightward with the portion shown in 16 as a fulcrum.
  • the left side of the loop wire (3, 4) which is a conductor, is in contact with the conductor 6, and the right side is in contact with the conductor 5, and the conductors 5 and 6 are energized.
  • This energization is detected by the conductors 17 and 19. To detect that the fingertip has come to the right on the drawing.
  • switches are formed between conductors 5 and 6, and between conductors 5 and 7, and these two switches are set to ⁇ N and OFF according to the position of the fingertip.
  • the fingertip position When one of the contacts of these two switches is turned on, the other is necessarily turned off. That is, the contact state between the two is exclusively determined.
  • Such an exclusive mechanism is effective for the purpose of turning on only the target switch reliably in a narrow range.
  • the fingertips When trying to press the target rotating body from among the closely arranged rotating bodies, the fingertips will inevitably touch the nearby rotating body and exert a slight pressure on it as well. According to this, it is possible to exclusively and selectively press down the target rotating body to detect the finger position.
  • the rotating body array is supported by two fulcrums, and the three areas are tilted in three ways by distinguishing three areas depending on which side of the fulcrum is the center of gravity of the force applied from the fingertip. It constitutes a seesaw-like mechanism that changes direction.
  • the loop wire (3, 4) plays the role of a seesaw arm, and when the fingertip comes to the right or left of the three areas, the rotating body at the fingertip position drops and the seesaw mechanism Push down the arm on the fingertip position side of the fulcrum, and as a result, push up the arm on the opposite side of the fulcrum and hold the other rotating body Raise it.
  • the fingertip is in the center area, the arm does not move and there is no height difference between the rotating bodies. Since the height difference between the rotating bodies differs depending on the fingertip position in this manner, the fingertip position can be clearly distinguished by feeling the tactile sense.
  • the contact state of the switch is devised with as little force as possible.
  • Normal switches use a panel to restore contact, but using a panel makes it impossible to detect weak pressure, so the method in Fig. 4 uses only the movement of the center of gravity without using the panel to switch the switch.
  • the conduction state is switched by changing the contact state. They change the contact state of the switch without using a panel, and use the power of the fingertips effectively to restore it. To reduce the contact resistance, it is better to solder the wires directly to the loop wires 3 and 4.However, it is also necessary to energize the loop wires 3 and 4 through the conductor 5 separately.
  • Fig. 4 is a device to make it move smoothly.
  • the method in Fig. 4 switches the switch by moving the center of gravity without applying a force in the direction of fingertip movement and pressing the switch, so that the fingertip can be moved very smoothly without requiring any force. .
  • the cost can be increased, it is also possible to switch without using force by the optical method or the capacitance method.
  • the switch for detecting the finger position changes the contact state with a relatively weaker force (extremely weak force) than the switch 14 for detecting the pressure accompanying the downward movement of the fingertip.
  • the switch that changes the contact state with a weak force is switched first, so when the switch 14 is turned on by the downward movement of the fingertip, the position of the fingertip must be moved earlier than that.
  • the contact state of the switch to be detected is determined. Therefore, the method of Fig. 4 guarantees that the position detection timing is always earlier than the descent motion (pressurization) detection, and prevents erroneous input caused by a delay in timing.
  • the switch for detecting the position and the switch for lowering the fingertip are both configured so that the contact relation (ON or OFF) of the contacts is strengthened by the force in the same direction (force acting in the downward direction). It is also important that If the two directions are the same, if one tries to apply force to ensure that one contact is made, the other contact weakens and causes erroneous input.
  • switch contact is strong unless the center of gravity of the pressure dropping the fingertip is changed. And the position of the fingertip is stably held.
  • the position detection method shown in Fig. 4 is stable against perturbation of the finger position. In other words, even if the finger moves slightly within the set area, the position detection switch is turned on and off as long as it does not move beyond the fulcrum of the seesaw mechanism (conductors 3, 4, 5, 6, 7). Contact relationship).
  • the position of the fingertip may be detected by an optical method. Without detecting the fingertip position.
  • the fingertip position When the finger position is obtained using the absolute angle of the rotating body in the conventional method, it is necessary to move the fingertip while keeping it in contact with the rotating body. However, the rotation angle of the rotating body and the movement of the fingertip are required. Since there is a certain relationship between the quantities, the fingertip position could be determined from the rotation angle of the rotating body. For example, if an appropriate switch is pressed and turned ON when the rotating body rotates a predetermined angle, it is possible to detect that the fingertip has reached a predetermined position through ⁇ N-OFF of the switch. However, constraining the fingertip to always touch the device during operation was psychologically stressful, and the operability of the input device was also reduced. On the other hand, in the method of Fig.
  • the fingertip position is detected based on the position of the center of gravity of the minute pressure applied from the fingertip on the rotating body array, so that the fingertip does not need to be kept in contact with the rotating body. Even if you move away in the air and land at a distant point, the fingertip position can be correctly detected based on the center of gravity of the pressure applied there. If the fingertip can be released freely during operation, the user can jump and move quickly to the target position, thereby improving input efficiency.
  • Fig. 5 shows a striped reflection band provided on the surface or inside of the rotator below the rotators 1 and 2, and detects the reflected light to measure the amount of rotation of the rotator. 'Indicates encoder 20.
  • the rotary encoder 20 is integrated with the rotating body arrangement, and the rotating body arrangement changes the posture. However, the relative positional relationship with the rotating body is kept constant. If the change in the attitude of the rotator array is small, the amount of rotation can be measured even if the rotary encoder 20 is installed on a table without being integrated with the rotator array. Although the method of optically detecting the rotation amount and the rotation direction is shown here, the rotation amount and the rotation direction may be detected electrically through a contact.
  • the movement amount of the fingertip can be calculated from the rotation direction and the rotation amount of the rotating body thus detected.
  • the vertical movement shown in FIG. Regarding the movement in the left-right direction the inner diameter of the arches of the arched wires 6 and 7 is sufficiently larger than the diameter of the wires 3 and 4 as described above.
  • the posture is changed according to the position (the downward pressing position), and as a result, the contact state between the wires 3 and 4 and the arched wires 6 and 7 is changed.
  • the landing position of the fingertip can be distinguished. In the example of FIG. 4, it is possible to distinguish between a case where the fingertip is on the rotating body 1 and a case where the fingertip is on the rotating body 2 and a case where the fingertip is at an intermediate point between the two.
  • FIG. 3 is a configuration diagram when the switch 14 is further introduced and the switch 14 is mounted on the table 8.
  • the table 9 bends at the hinge rotation axis 12 and descends, and the lower part of the table 9 contacts the switch 14 for vertical movement detection, and the switch 14 is turned on. I do.
  • the ON / OFF of the switch 14 the start time and the end time of the finger pressing (landing) are detected.
  • the finger position is detected through the contact state between the wires 3 and 4 and the arched wires 6 and 7, and the fingertip position from the fingertip position when the switch 14 is turned on and off is landed.
  • the position (pressing position) and the direction of movement of the fingertip after landing can be detected.
  • the movement direction of the fingertip can be determined from the rotation direction and the rotation amount of the rotating body detected by the rotary encoder 20. Since the rotating body may be erroneously moved minutely even if the finger is intended to be stationary, it is desirable to determine that the fingertip has moved only when the amount of rotation detected by the rotary encoder 20 exceeds a predetermined angle. . Since information about the direction of movement can be obtained redundantly from the contact state between the rotary encoder and the wire, one of the information may be omitted, and the redundancy can be used to improve the reliability of detecting the rotation direction and the fingertip landing position.
  • a single rotating body such as a track ball may be used instead of the rotating body array, or the fingertip may slide with the fingertip after landing. It doesn't matter if you use a moving platform or a pad that moves with your fingertips sliding with small frictional forces.
  • the conventional trackball or pad alone cannot detect the absolute position of the fingertip landing point, and cannot be used in the present invention.
  • Conventional trackballs and pads can detect the relative direction and amount of movement of the fingertip.
  • the trackballs and pads must have wires 3 and 4 and arched wires 6 and 7.
  • a mechanism to detect the absolute position of the fingertip landing by adding a mechanism for detecting the contact state, etc., and determine the information to be input by combining this absolute position with the direction of movement of the fingertip at or immediately after landing is indispensable.
  • a pad is provided with irregularities for tactilely grasping the fingertip landing position, and when the trackball is rotated by a predetermined amount to visually grasp the pressing position, the rotation is braked to rebound. It is good to introduce a mechanism to notify that the required amount of rotation has been generated by generating force.
  • the rotating body may be arranged back and forth, or a combination of the rotating body and a contact for detecting the direction of finger movement may be arranged in the front and rear, left and right, and further in the middle direction between them. .
  • FIG. 6 shows an example of this configuration.
  • the wheel 8 causes the table 8 to smoothly move in the front-rear direction following the movement of the fingertip in the front-rear direction, and the amount and direction of the movement are detected by the optical detector 22.
  • the rotation of the rotating body and the sliding movement of the device are used separately, and the left and right coordinates are specified in the former, and the coordinates in the front and rear directions are specified in the latter.
  • the difference in the feel of the slide movement is convenient because the cursor movement in the left-right direction and the movement in the front-back direction can be tactilely distinguished.
  • the seesaw-shaped mechanism having two fulcrums can detect the position of the fingertip in the front-rear direction similarly to the case of moving the fingertip in the left-right direction.
  • the center of gravity of the pressure applied from the fingertip placed on the rotating body array also moves in the front-back direction, so that the center of gravity is shifted. 7 (a), (b), and (c), depending on which side of the fulcrum 30 or 31 the fulcrum comes, the contact points 26, 27, 28, 29 is switched, and the three positions, front and rear, can be distinguished and detected.
  • the user determines the fingertip landing position while referring to the tactile cues received at the fingertip, and raises the fingertip as it is without changing the position of the fingertip after landing or powers up and down after moving left and right.
  • different information can be input by combining finger movements in the front-back direction.
  • the input device detects the fingertip landing position and the direction of movement of the fingertip at the time of landing or before and after landing, and determines information to be input based on a combination of the two.
  • the tactile cue force and the beam alone may cause the landing position or the pressing position to be incorrect, and it is difficult to memorize the relationship between the finger movement and the information to be input. It is desirable to construct a multi-modal user interface by using the visual cues together to support the user's work in multiple ways.
  • FIG. 8 is a functional block diagram of the computer device 60.
  • the computer unit main body 66 is connected to the input unit 50 including the data input device 51 via the interface cable 90.
  • the data input device 51 has a front contact 29, a rear contact 28, and an optical detector 22 for inputting a forward movement amount and a backward movement amount as shown in FIG.
  • the upper part is provided with a center button (execute button) 14, a right rotating body 1, a left rotating body 2, a right contact 7 and a left contact 6.
  • the arched wire 6 or the conductor 6 is called, but it constitutes a contact for an operator (user) to conduct when the left rotating body 2 or the arm 4 is pressed. Therefore, in the following description, it is referred to as the left contact, and similarly, the arched wire 7 or the conductor 7 is referred to as the right contact.
  • the interface means 52 converts a state signal of each switch and contact of the data input device 51 into a predetermined electric signal for computer input such as USB.
  • the computer device 60 is an interface for exchanging data with the input unit 50.
  • Means 61 a processing unit 62 for performing calculations using the input data, a storage unit 63 composed of a memory for storing data, a display unit 65 such as a display device, and for sending data to the display unit 65. It is composed of a display memory 64.
  • the processing unit 62 includes a switch state input means (function) 71 for inputting the state of a switch or a contact of the data input device 51, and an individual function for selecting a means (function) to be executed according to the state of the switch.
  • Selection means (function) 72 and one or more individual function execution means (functions) 74 which are activated by a command from individual function selection means 72 and execute predetermined processing.
  • the individual function execution means 74 includes scroll execution means (function) 75 for executing screen scroll processing, link means (function) 76 for jumping to a link added to the screen display data, and the like. ing.
  • Each means 7176 is realized by processing of a computer.
  • the storage unit 63 associates the status file storing the switch status, the window displayed on the display unit 65, and the position range of the cursor in the window with the identification information (individual function ID) of the function to be executed.
  • a mode table 83 for storing switches and contacts of the data input device 51 and mode identification information (mode ID) in association with each other.
  • the switch status input means 71 is activated periodically, reads the data of the input unit 50, and stores it in the status file 81.
  • FIG. 10 is an example of the data configuration of the state file 81.
  • the center button 14, the states of the left, right, front and rear contacts 6, 7, 29, and 28, the rotation amounts of the rotating bodies 1 and 2, and the front and rear movement amounts are sequentially updated. Also, with the change in the state of each switch, the center button flag, left input flag, right input flag, previous input flag, and rear input flag are set and reset. Each state may be converted into a predetermined code and stored for convenience of subsequent computer processing.
  • the left contact is ON, it is converted to a press signal of “8” on the USB keypad, and if the left contact is OFF, it is converted to a release signal of “8” on the USB keypad and input to the computer device .
  • the center button When the center button is ON, the signal is converted to a keyboard “backspace” press signal, and the center button is pressed. If it is off, it is converted to a keyboard “backspace” release signal and input to the computer device.
  • the state change detection may be performed on the data input device side, and the data may be input to the computer device at the timing of turning on or off.
  • the individual function selecting means 72 is activated periodically or in response to a state change notification from the switch state input means 71, and first obtains cursor position information (S101). Next, referring to the state file 81, it is determined whether or not the center button 14 is turned on (S102). If the center button 14 is turned on, based on the individual function selection file 82 in FIG. Next, an individual function ID associated with the window or the activated function indicated by the cursor is extracted (S103). The individual function ID may be provided not only for each window but also for each position range within the window. For example, when the user points to the area A in the window shown in Fig. 13, the vertical scroll function is activated; when the user points to the area B, the horizontal scroll function is activated; otherwise, the link function is activated.
  • step S102 determines whether any of the left contact, right contact, front contact, and rear contact is ON ( If any of them is ON, the cursor movement processing is executed (S106). For example, when one of the contacts is ON, the cursor is moved in the direction of the contact, or the cursor is moved according to the rotation angle of the rotating body or the amount of movement of the optical detector. There are ways to change the speed.
  • the scroll execution means 73 when the scroll execution means 73 is activated by an activation request from the individual function selection means 72, it first determines whether or not the center button flag is set to ⁇ N with reference to the state file 81. (S201) If the center button flag is ON, the scroll flag is set to "neutral" (S202). Then, the detection of the scroll speed is stopped (S203), and then, it is determined whether or not the left input flag has changed after the start-up or from the previous determination (S204). Execute (S205).
  • step S204 If there is no change in the left input flag in step S204, it is next determined whether or not the right input flag has changed (S206). S 207). If there is no change in either the left input flag or the right input flag ("No" in S206), a center pressing process is executed (S208). Then, after each process (S205, S207, S208), it is determined whether or not the scroll process is completed (S211). If not completed, the process returns to step S204 to repeat the process. Note that as the determination condition in step S211, the scroll processing ends when the center button flag changes from ON to OFF or when the cursor is out of the range of the scroll function.
  • step S201 that is, if the center button flag is OFF, the scroll flag is set to “neutral” (S209), and scroll speed detection is stopped (S210).
  • the scroll speed is obtained by a software timer that is started at the start of scroll speed detection and stopped at the end of scroll speed detection.
  • the slow speed is used when the timer value is large, and the fast speed is used when the timer value is small.
  • the scroll flag is set to “end right-to-left scroll” (S405). Note that the scrolling process also updates the coordinate range information of the individual function selection file 82 sequentially.
  • step S401 If "No" in step S401, that is, if the left input flag is OFF, it is next determined whether or not scroll flag force S is "right to left scroll end" (S406). In this case, the scroll flag is set to “neutral” and the process ends (S407).
  • step S406 If “No” in step S406, the scroll flag is set to "left to right scrolling" (S408), and the detection of the scroll speed is started (S409).
  • the right input flag is ⁇ ⁇ N (S601). If the right input flag is ON, then it is determined whether or not the scroll flag is “left to right scrolling” (S601). S602). If “Yes” in the step S602, the scroll speed detection is terminated (S603), and the scroll processing to the left or right is executed at the speed determined based on the timer value (S604). Thereafter, the scroll flag is set to "end left-to-right scroll" (S605).
  • step S601 If "No” in step S601, that is, if the right input flag is OFF, then it is determined whether the scroll flag is "end of left-to-right scroll” (S606), and if “Yes” Sets the scroll flag to "neutral” and terminates (S607).
  • step S606 If “No” in step S606, the scroll flag is set to “right to left scrolling” (S608), and the detection of the scroll speed is started (S609).
  • scrolling to the left or right is executed using the state of the left contact, the right contact, and the center button.
  • the operator presses the left contact point of the data input device 51, and then moves the finger while sliding the pressed position from the center to the right. Scroll to. Then, the scrolling speed is determined by the moving speed of the finger. The same applies when scrolling to the left.
  • scroll processing procedure can also be used as cursor movement processing, provided that it operates when the center button 14 is turned off.
  • the processing procedure at this time is shown in FIGS. 15 and 16 by replacing “scroll” with “cursor movement”.
  • the method of controlling the analog amount represented by the speed processing described above can be applied to the moving speed of the cursor and other processing.
  • the signal can be controlled.
  • the speed may be determined according to the magnitude of the body rotation angle.
  • the scrolling process is not limited to the above-described procedure. For example, when the right contact point is pressed immediately for right scrolling, if there is no change in the contact state after waiting for a certain period of time, Adding functions as needed, such as scrolling to the right at a predetermined speed, improves the convenience for the operator.
  • the vertical scroll function can be realized by the same processing as described above using the data of the front contact point, rear contact point, forward movement amount, and backward movement amount.
  • Figure 13 shows a weather forecast screen as an example of content accessed via the Internet.
  • the position of interest on the screen is indicated by an arrow (cursor) mark, and the nine link items (linked information) around the arrow are displayed with marks 41 indicating finger movement.
  • this arrow-shaped cursor is moved, nine link items around the cursor position are automatically detected from the content, and a mark 41 indicating finger movement is added to them.
  • a white area is provided in the black area, and the white area is moved relatively to the black area to indicate the movement of the fingertip.
  • ⁇ N a predetermined number of link items (link information) within a certain range from the position of the cursor are next determined. Extracted (S802). This extraction range may be determined in advance according to the distance from the carcare, or a link item in the window designated by the cursor may be extracted. The predetermined number corresponds to the number of mode IDs to be assigned.
  • a mode ID based on a rotating body is assigned to each of the extracted link items, and this is temporarily stored. It is saved as an aisle (S803), and a display output corresponding to each mode ID is performed (S804).
  • Figure 18 shows an example of a temporary file in which the mode ID is assigned to the link item (place name) around the cursor (pointer) in the screen example in Figure 13. The display of the finger movement corresponding to the mode ID is displayed below the link item.
  • the mark used to indicate the movement of the fingertip used here is an underline added below the item (in this case, the place name).
  • Part of the underline is white, and this white part indicates the fingertip landing position. With the position as the starting point, move in the direction (left or right) that indicates the direction of fingertip movement.
  • the operator looks at the movement of the white part of the underline under the item, executes the finger motion corresponding to the movement, and operates the rotating body and the contact.
  • the states of the rotating body and the contacts are read (S805), and it is determined whether or not the mode can be determined based on the read state information with reference to the mode table of FIG. 19 (S806).
  • the mode ID is saved (S807), and as the display of the mode, for example, a process of inverting the color of the selected link item in FIG. 13 is performed (S808).
  • the selection flag may be set in association with the mode selected in the temporary file in FIG.
  • step S810 After that, the state of the rotating body and the contact point is read again (S809). If there is a mode change (S810), the processing from step S806 is repeated. On the other hand, if the mode has not been changed in step S810, it is next determined whether or not the center button 14 has been changed from ON to OFF (S811). If the mode has been changed, the link corresponding to the mode ID is determined. Jump to the link destination of the item (S812).
  • step S811 if the state of the center button 14 has not changed and a predetermined time has elapsed (S813), an error message is output and the process ends (S814). If the predetermined time has not elapsed in step S813, the process returns to step S809 to determine whether or not the mode has been changed.
  • the link function is realized by the above procedure.
  • the ability to browse text, video, and audio recorded on various sites over the Internet at present The current viewing tool (software called browser-1) Is based on the assumption that a pointing device such as a mouse is used as an input device, and menu items and link items are selected through the operation of pointing (coordinate specification).
  • the display area of the menu items and link items on the screen is small. If the cursor position is not accurately controlled and moved to this small area, the menu items and link items cannot be selected. Les ,.
  • it is necessary to watch the screen while moving the cursor and it is not preferable for safety to continuously move the point of interest on the screen while driving a car or performing other work. Furthermore, the psychological load during positioning is large, and the work efficiency is reduced.
  • the current browser has a shortcut function for selecting menu items and link items instantly.
  • the current shortcut function is a method in which a specific menu item is executed when a specific key is pressed, the problem is that the relationship between the key and the menu item must be stored. Also, it cannot be used to select a link item embedded in content that cannot be associated with a key.
  • a link embedded in a menu item or content is a mark (icon, background color of the item, underline, etc.) that can intuitively correspond to the finger motion by solving the above problem.
  • a shortcut to the menu item or link item by executing the finger movement suggested by this mark by displaying it in addition to the item, it is easy to intuitively make an effort and instantaneous menu items and link items are displayed.
  • Link items can be selected.
  • the position of interest is specified by using the cursor keys, the scroll buttons, or the pointing device. However, since it is only necessary to specify roughly, it can be specified at high speed, and the time to keep watching the screen is reduced.
  • the focus position is set by the pointing device.Every time the cursor or the cursor key is pressed, link items embedded in the content are sent by the same number as the type of finger movement, and new link item groups are marked one after another. I'm sorry.
  • the finger movement corresponding to the mark can be executed and the selection can be made instantaneously, so that the selection is performed at high speed, and during the operation, This reduces the psychological burden on the user and the viewpoint is not restricted by the screen, so that safety can be maintained even when operating during work such as driving a car.
  • FIG. 20 shows an example in which the background color behind the item is changed to the surrounding color and used as the mark 41 indicating finger movement instead of the underline in FIG.
  • the rectangular area behind the item is displayed in a different color from the surrounding area.
  • a rectangular area with two different colors (light blue and yellow)
  • a thin blue rectangular area suggesting the range of movement of the fingertip
  • a thin rectangular area suggesting the fingertip and a yellow rectangular area in the animation (animation)
  • the yellow area periodically repeats the movement of moving from the position corresponding to the landing point of the fingertip in the direction corresponding to the movement direction of the fingertip.
  • the corresponding item can be selected by imitating the movement of the background color and moving the fingertip, so there is no need to memorize the correspondence between the key and the item compared to the conventional shortcut method of pressing the key and selecting the item, so it is intuitive And easy to understand.
  • FIG. 21 shows various design examples of the mark 41 indicating the finger motion.
  • Step (a) in the figure shows an example of the movement of the fingertip on the rotator array.
  • the landing point of the fingertip is indicated by a black circle.
  • the direction of movement of the fingertip after landing at each landing point is indicated by an arrow. The fingertip moves to the left or right after landing, and then rises without moving or from the landing position.
  • a figure consisting of only a solid circle without an arrow suggests a movement in which the fingertip is moved to the point indicated by the solid circle without landing and moving left and right.
  • the direction of the arrow Moving up and then moving up Marks corresponding to the nine finger movements shown in (a) are shown in (b), (c), and (d).
  • the (b) column shows the same marks as those used in Fig. 20.
  • the background color behind the item is displayed differently from the surrounding background color and used as a mark.
  • the area that changes color is rectangular, and the stationary rectangular area outside suggests the entire range of fingertip movement.
  • a small rectangular area that repeats moving left or right inside it suggests a fingertip the starting point of the small rectangular area's moving action indicates the fingertip landing point, and the direction of the moving action indicates the fingertip moving direction after landing. Movement where the fingertip rises without moving after landing is indicated using a small rectangular area that blinks stationary at the position corresponding to the landing point.
  • the two open rectangles at each mark indicate two rotators, indicating that the fingertip lands on the left or right rotator, with a black oval added to the white rectangle corresponding to the rotator on the landing side. Shown. If the fingertip lands at the midpoint between the two rotators, a black ellipse is drawn between the two white rectangles. The direction of movement of the fingertip after landing is indicated by an arrow starting from the black ellipse. Movement of the fingertip, which does not move after landing and rises as it is, is indicated by simply drawing a black ellipse at the corresponding point.
  • Fig. 9 shows an example of a mechanism in which the rotating body is braked and stopped when the rotating body is rotated by an appropriate amount, or a repulsive force is applied to the fingertip to notify the user that the rotating body is rotated by an appropriate amount.
  • the brake 30 is moved by an actuator such as a solenoid to contact the rotating body to stop the rotating body. Since the braking is performed electronically, the braking can be freely controlled through a program, and it is possible to electronically detect that the fingertip has moved by an appropriate amount and determine the braking timing after adjusting various conditions.
  • the projection 32 protruding from the rotating body is fixed to the rotating shaft of the rotating body for rotation stationary.
  • FIG. 22 shows the correspondence between the movement of the fingertip and the characters to be input when the user interface of the present invention is used for the text input operation.
  • Hiragana characters in Roman characters an alphabet representing a consonant shown in (b) and an alphabet representing a vowel shown in (c) are assigned to each fingertip movement shown in (a).
  • Hiragana is input by inputting consonants and vowels alternately.
  • the method and apparatus proposed in the present invention are used, only the memorized consonants and vowels corresponding to nine types of fingertip movements are input, and hiragana is input with a touch type without looking at the hand or the menu, and writing a sentence. Can be created.
  • the nine exercises are simple exercises that move the thumb right and left. If you want to enter the hiragana character string “KA”, usually enter the consonant first, followed by the vowel, followed by “KA”. According to the assignment shown in Fig. 22, while only five finger movements are used for vowel input and the remaining four movements are free, other functions are added to these four free movements. In order to use the vowel consonants first and conversely, the consonants should be input first, in order to use them effectively. [0123] For example, when the user wants to input "?", He inputs it as "AK".
  • the data input device has a multi-stage configuration having two or more layers in the upper and lower layers, the mode can be selected by a switch directly touching a finger, and the mode selected together with the state information of the lower switch is set to the computer device. And a control device, so that various data can be input quickly and accurately within a narrow range of finger movement.
  • the means for detecting the position where the fingertip force and pressure are applied without using a switch that changes the contact state according to the rotation angle of the rotating body is used.
  • the fingertip is released from the constant contact with the rotating body, and jumps in the air as needed to enable high-speed data input.
  • the input efficiency is further improved by simply using the fingertip moving direction immediately after the fingertip drop instead of the fingertip raising position (pressure release position).
  • the rotating body can be rotated without limitation, and the rotating body can be used for the purpose of specifying coordinates with the same operability as a trackball. In return for these effects, erroneous input caused by a finger touching a nearby rotating body, trembling of the fingertip, or recoil of another finger operation The problem of incorrect input arises, but a way to overcome these problems could be provided.
  • a visual cue displayed on the screen so as to suggest finger movement, a beep sound that changes according to the fingertip position, or occurs when an area including the fingertip changes.
  • audible cues due to beeping sounds and haptic cues by braking the rotating body according to the fingertip position, erroneous input is greatly reduced, and the correspondence between input information and fingertip movement is stored. Without having to do this, it is now possible to operate easily based on the clinging force and finger movements displayed on the screen.
  • a means for instantly selecting an item corresponding to finger movement is introduced without having to precisely determine the cursor position, thereby improving the efficiency of item selection and reducing the psychological load. Reduced.
  • the user can instantly select a target term from registered terms by executing the finger movement corresponding to the mark added to the term. Also, in applications to car navigation, etc., it is now possible to instantaneously select the target item of the menu without having to watch the screen while driving the car.
  • the cursor movement processing is performed when the center button 14 is OFF, and the scroll processing is performed according to the cursor position when the center button 14 is ON.
  • the scroll processing is performed according to the cursor position when the center button 14 is ON.
  • the cursor movement process is performed by turning the left and right contacts ON and pressing the center button.
  • scroll processing is performed without pressing the center button, that is, with the center switch OFF, at a speed determined by the time difference between the time when one contact is separated and the time when the other contact is touched. Do it.
  • scrolling the screen may be performed more frequently than moving the cursor. In this case, this condition is more effective.
  • a means is provided for the data input device of the first embodiment so that both the left contact 6 and the right contact 7 simultaneously become ⁇ N, and the ON signal is taken in. It improves the operability and reliability of mode selection (item selection).
  • a conductive elastic body such as a panel 45 is provided from the base 9 to the arms 3 and 4 as shown in FIG. Arms 3 and 4 touch both contacts 6 and 7 (when not touching the finger). By applying pressure downward with a finger, the panel 45 is reduced and deformed.
  • the switch state input means 71 reads the data of the input unit 50 periodically or every time the state changes, and stores the data in the state file 81.
  • FIG. 24 is an example of a data configuration of the status file according to the present embodiment.
  • flags indicating the state of the switches are stored. For example, when the left contact 6 is ⁇ N and the right contact 7 is off, the left input flag is turned on (or set), and turned off (or reset) when the contact status becomes other than that. ). Similarly, when the right contact 7 is ⁇ N and the left contact 7 is off, the right input flag is turned on. The center input flag is ON when both contacts 6 and 7 are OFF, and the release flag is ON when both contacts 6 and 7 are OFF. At the time of this flag processing, it is desirable to perform switch chattering processing.
  • the setting and resetting of the input flag are processed by the switch state input means 71, that is, the lower level program called the driver program, so that the individual function (application program) Processing can be simplified, and mistakes in program creation can be reduced.
  • FIG. 24 since the mode is selected without using the information of the rotation amount and the movement amount, FIG. 24 does not include the data of the rotation amount and the movement amount. This information can be entered by using.
  • the operation of the individual function selecting means 72 according to the present embodiment will be described with reference to FIG.
  • the individual function selecting means 72 is activated periodically, first, referring to the state file 81, if the center button 14 is OFF ("Yes" in S901), the cursor position information is acquired (S902). Then, based on the individual function selection file shown in FIG. 12, an individual function ID associated with the window designated by the cursor or the activated function is extracted (S903).
  • the link function of the individual function ID A001 has been extracted, and the function will be described as an example.
  • This predetermined number is a maximum value that can be determined by the combination of the switch settings of the mode table 83 and can be distinguished.
  • FIG. 26 shows a data configuration example of mode table 83 according to the present embodiment.
  • Center button According to the operating conditions of the button 14, the mode is selected by a two-step procedure. Specifically, three mode IDs (M01-M03) are assigned to correspond to the left, center, and right input flag states when the center button 14 changes from OFF to ON. After that, three more mode IDs (N01 N03) are assigned to correspond to the left, center, and right input flag states when the center button 14 changes from ON to OFF.
  • the center button changes from OFF to ON, the first mode selection is performed, and when the center button changes from ⁇ N to OFF, the second mode selection is performed.
  • mode selection it is possible to select a more detailed layered mode from among the modes selected at the first time.
  • a mode ID is sequentially assigned to the mode additional information extracted in step S904, and the information is stored in a temporary file (S905).
  • FIG. 27 is an example of this temporary file.
  • the link item is stored in association with the combination of the first and second mode IDs.
  • Japanese place names indicating the area classification of the weather forecast, and simply indicate that they are link items.
  • FIG. 28 is an example of a screen displayed based on the data of the temporary file in FIG. A mark 41 indicating finger movement is displayed below the selectable link item. This mark is displayed in black and white, and the white position indicates finger movement.
  • nine types of items are selected, in the first embodiment, nine items must be displayed as shown in FIG. 13, but in the present embodiment, the left and center selections are made as the first selection. , And identify and display the three right ways. The operator presses the contact at the desired position according to the mark.
  • the identification of the link item corresponding to the input flag is blinked or the color is changed. This allows the operator to confirm that the selection has been made correctly, and to change the pressed position if necessary.
  • the selection may be transmitted to the operator by feedback information such as outputting a beep sound or vibrating the data input device 51 at a predetermined rhythm corresponding to the mode instead of the identification display.
  • the operator confirms the item selected by the feedback information, and turns on the central button 14 positioned below by pressing the item further down at the pressed position.
  • the processing of the individual function selecting means 72 it is determined whether or not the center button 14 has become ⁇ N (S908). If “No”, the cursor movement processing described in the first embodiment is executed. (S909), and returns to step S902.
  • step S908 if “Yes” in step S908, that is, if the center button 14 has become ⁇ N, the state of the input flag read in step S906 is latched, and it is determined whether mode determination is possible. (S910).
  • a method of determining whether or not the mode determination is possible for example, referring to the mode table 83, the presence of the mode ID corresponding to the latched input flag and the determination of the mode ID in the temporary file 84 There is a way to make mode determination possible on condition that it exists.
  • the mode ID is stored (S911).
  • the first selection flag is set at the position of the corresponding mode ID.
  • FIG. 30 shows a display example instructing the second selection when mode M02 is selected at the first time. A mark indicating finger movement is displayed below the selectable item. At this time, the cursor or the mark 41 may be displayed differently from the first selection to indicate that the selection is the second selection.
  • step S914 if "Yes” in step S914, that is, if the center button 14 is turned off, the state of the input flag read in step S912 is latched, and it is determined whether mode determination is possible or not. (S917).
  • FIG. 31 shows an example of the data in the temporary file 84 when the link item “Shizuoka” is selected through the first and second times with the second selection flag set at the position of the mode ID N01 for the second time. .
  • identification information indicating that Shizuoka has been selected is output.
  • step S920 it is determined whether or not the release flag is turned on. If the release flag is turned on, the mode of the temporary file 84 is changed. Reset and end (S912). On the other hand, if “No” in step S920, that is, if the release flag is not turned on within a predetermined time, the individual function executing means 74 is executed (S922). This jumps to the link destination of the selected link item.
  • a predetermined time for example, about 0.5 seconds
  • steps S919 and S920 the state of the release flag after a predetermined time from when the center button 14 is turned off, or the change state of the release flag within the predetermined time is monitored. Therefore, even if the operator makes a mistake in the first selection, for example, and has already pressed the center button 14, if the operator releases the finger and immediately releases the switch, the Mode can be reset, and undesired modes can be prevented from being executed.
  • the individual function executing means 74 sets the release flag to ON and sets the center button to ⁇ N It may be activated on condition that the time until the release flag turns ON after the force changes to OFF is shorter than the specified time.
  • the mode ID allocation for the second selection is reduced, and, for example, the condition of the central input flag ON may not be used. In this way, the condition of the second central input flag ON can be used as a command for mode reset.
  • the state of the two contacts can be determined not only exclusively by scissoring the neutral point, but also whether or not the operation is being performed. Can be selected, and more accurate operation determination can be performed.
  • the mode is set in two stages, a complicated mode can be set with a small number of procedures.
  • all the mode IDs are assigned to the mode additional information and are displayed at once, so that the display of the finger motion for the mode is complicated.
  • the mode ID is Are assigned hierarchically, and the upper mode is selected in the first display, and the lower mode is selected in the next operation, so that the display of the finger motion is simplified and the operability is improved.
  • the first choice is to let the user select a menu for today's weather forecast, tomorrow's weather, regional information, and the like, and then select the area for the second choice.
  • the present invention is not limited to the above-described embodiment, and can be carried out in various modifications without departing from the scope of the invention. Further, the means and processes described in each of the above embodiments can be appropriately combined and executed. For example, the operation described in the second embodiment may be combined with the rotation amount and movement amount data of the first embodiment to perform detailed operation control such as mode setting and speed adjustment. In addition, the individual functions are not limited to the illustrated scroll function and link function. The present invention covers all functions of the information device.
  • FIG. 1 is an explanatory diagram showing a movement direction of a fingertip operating a data input device according to the present invention.
  • FIG. 2 is a perspective view of a part of the data input device according to the embodiment of the present invention.
  • FIG. 3 shows (a) a side view and (b) a front view of an embodiment of the data input device.
  • FIG. 4 is an explanatory diagram showing a state in which the posture of the rotating body arrangement means changes according to the landing position (pressing position) of the fingertip according to the first embodiment of the present invention, and the contact state of the switch changes.
  • FIG. 5 is an explanatory diagram of a rotary encoder for detecting a rotation amount of a rotating body.
  • FIG. 6 is an explanatory diagram of means for realizing the forward and backward movement of the fingertip and means for detecting the amount of forward and backward movement.
  • FIG. 7 is an explanatory diagram of a method of switching a contact point of a switch by moving a fingertip in a forward and backward direction.
  • FIG. 8 is a block diagram of a computer device (information device) according to an embodiment of the present invention.
  • FIG. 9 is a diagram showing a method of braking a rotating body.
  • FIG. 10 is a data configuration diagram of the state file of FIG. 8.
  • FIG. 11 is a flowchart showing a processing procedure of an individual function selecting unit in FIG.
  • FIG. 12 is a data configuration diagram of an individual function selection file of FIG. 8.
  • FIG. 13 is an explanatory diagram of a method for extracting a specific item from link items embedded in content according to the first embodiment of the present invention.
  • FIG. 14 is a flowchart showing a processing procedure of a scroll function in the individual function executing means of FIG. 8 (center button processing).
  • FIG. 15 is a flowchart showing a processing procedure of a scroll function in the individual function executing means of FIG. 8 (left contact processing).
  • Garden 16] is a flowchart showing the processing procedure of the scroll function in the individual function execution means of FIG. 8 (right contact processing).
  • FIG. 18 is a data configuration diagram of a primary file according to the first embodiment of the present invention.
  • FIG. 19 is a data configuration diagram of a mode table according to the first embodiment of the present invention.
  • Garden 20 is an explanatory diagram of a method for extracting a specific item from link items embedded in content according to another example of the first embodiment of the present invention.
  • FIG. 21 is an explanatory diagram of a mark indicating fingertip movement according to another example of the first embodiment of the present invention.
  • Figure 21 (a) shows the nine types of fingertip movements on the rotating body array
  • Figures 21 (b)-(d) show examples of mark design suggesting fingertip movements shown in Figure 21 (a).
  • FIG. Garden 22] is an explanatory diagram of marks indicating fingertip movement when inputting Hiragana in a Roman character mode by combining consonants and vowels according to another example of the first embodiment of the present invention.
  • FIG. 23 is a partial configuration diagram of a data input device according to a second embodiment of the present invention.
  • FIG. 24 is a data configuration diagram of a state file according to the second embodiment of the present invention.
  • 25 is a flowchart showing a processing procedure of an individual function selecting means according to the second embodiment of the present invention.
  • FIG. 26 is a data configuration diagram of a mode table according to the second embodiment of the present invention.
  • FIG. 27 is a data configuration diagram of a primary file according to the second embodiment of the present invention.
  • FIG. 28 is an explanatory diagram of a mode display according to the second embodiment of the present invention. (Screen before selecting the first mode)
  • FIG. 29 A data configuration diagram of a primary file according to a second embodiment of the present invention. (Explanation of the first mode selection)
  • FIG. 30 is an explanatory diagram of a mode display according to the second embodiment of the present invention. (Screen before selecting the second mode)
  • FIG. 31 is a data configuration diagram of a primary file according to the second embodiment of the present invention. (Explanation when selecting the second mode)
  • Data input device 1 Interface means Computer unit Processing unit
  • Computer device switch status input means Individual function selection means Scroll execution means Individual function execution means Scroll function

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

L'invention concerne diverses commandes que l'on peut entrer correctement moyennant une plage étroite de mouvements des doigts. L'invention concerne un dispositif à corps rotatifs placés à portée du mouvement des doigts et pouvant être tournés par un doigt, un détecteur d'emplacement d'application de pression qui permet de détecter l'emplacement de l'application de la pression exercée par un mouvement descendant du doigt sur le dispositif à corps rotatifs, un détecteur d'emplacement de dégagement de pression qui permet de détecter l'emplacement de dégagement de la pression exercée par le doigt sur le dispositif à corps rotatif, et un détecteur de direction de mouvement du doigt qui permet de détecter la direction du mouvement du doigt mobile lors de l'application de la pression qu'il exerce sur le corps rotatif du dispositif à corps rotatifs. En outre, l'invention concerne un dispositif de freinage qui permet de freiner le mouvement rotatif du corps rotatif en fonction de l'emplacement du doigt ou de l'angle de rotation du corps rotatif par combinaison d'un signal de sortie indiquant l'emplacement de la pose du doigt ou de sa position de pression détectée par le détecteur d'emplacement d'application de pression et un signal de sortie indiquant la direction du déplacement du doigt détectée par le détecteur de direction de déplacement du doigt de façon à spécifier l'information à entrer.
PCT/JP2004/018586 2003-12-12 2004-12-13 Dispositif d'entree de donnees, appareil d'information, et procede d'interface utilisateur WO2005057395A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2005516221A JPWO2005057395A1 (ja) 2003-12-12 2004-12-13 データ入力装置、情報機器、および、ユーザインターフェイス方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2003-414103 2003-12-12
JP2003414103 2003-12-12

Publications (1)

Publication Number Publication Date
WO2005057395A1 true WO2005057395A1 (fr) 2005-06-23

Family

ID=34675080

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2004/018586 WO2005057395A1 (fr) 2003-12-12 2004-12-13 Dispositif d'entree de donnees, appareil d'information, et procede d'interface utilisateur

Country Status (2)

Country Link
JP (1) JPWO2005057395A1 (fr)
WO (1) WO2005057395A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019224994A1 (fr) * 2018-05-25 2019-11-28 株式会社メルティンＭｍｉ Dispositif de détection de mouvement

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5497329A (en) * 1978-01-19 1979-08-01 Nec Corp Electronic apparatus
JPH11134157A (ja) * 1997-10-24 1999-05-21 Toshiba Corp 情報端末装置並びに情報処理方法
JPH11305938A (ja) * 1998-04-20 1999-11-05 Nippon Telegr & Teleph Corp <Ntt> 触感提示方法及び触感提示型トラックボール装置
JPH11353091A (ja) * 1998-06-09 1999-12-24 Itsuo Kumazawa キー入力装置及びその小型情報通信機器への実装方式
JP2001147762A (ja) * 1999-11-22 2001-05-29 Hitachi Ltd 情報処理装置
WO2002077786A1 (fr) * 2001-03-22 2002-10-03 Itsuo Kumazawa Dispositif d'entree de donnees
JP2002358155A (ja) * 2001-06-01 2002-12-13 Nec Viewtechnology Ltd 入力装置
JP2003029902A (ja) * 2001-07-18 2003-01-31 Shoichiro Komori 入力スイッチ、入力装置及び入力方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS5497329A (en) * 1978-01-19 1979-08-01 Nec Corp Electronic apparatus
JPH11134157A (ja) * 1997-10-24 1999-05-21 Toshiba Corp 情報端末装置並びに情報処理方法
JPH11305938A (ja) * 1998-04-20 1999-11-05 Nippon Telegr & Teleph Corp <Ntt> 触感提示方法及び触感提示型トラックボール装置
JPH11353091A (ja) * 1998-06-09 1999-12-24 Itsuo Kumazawa キー入力装置及びその小型情報通信機器への実装方式
JP2001147762A (ja) * 1999-11-22 2001-05-29 Hitachi Ltd 情報処理装置
WO2002077786A1 (fr) * 2001-03-22 2002-10-03 Itsuo Kumazawa Dispositif d'entree de donnees
JP2002358155A (ja) * 2001-06-01 2002-12-13 Nec Viewtechnology Ltd 入力装置
JP2003029902A (ja) * 2001-07-18 2003-01-31 Shoichiro Komori 入力スイッチ、入力装置及び入力方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019224994A1 (fr) * 2018-05-25 2019-11-28 株式会社メルティンＭｍｉ Dispositif de détection de mouvement
JPWO2019224994A1 (ja) * 2018-05-25 2020-12-10 株式会社メルティンＭｍｉ 動き検出装置

Also Published As

Publication number Publication date
JPWO2005057395A1 (ja) 2007-07-05

Similar Documents

Publication Publication Date Title
US7593006B2 (en) Input device for moving cursor and scrolling image on screen
US8665216B2 (en) System and method of tactile access and navigation for the visually impaired within a computer system
US8125440B2 (en) Method and device for controlling and inputting data
KR101521678B1 (ko) 통합된 햅틱 컨트롤 장치 및 터치 감지 디스플레이
US20090109069A1 (en) Input device and mobile terminal using the same
US20070247337A1 (en) Condensed keyboard for electronic devices
US20110209087A1 (en) Method and device for controlling an inputting data
JPS6336322A (ja) 片手操作用電子式キ−ボ−ド
CN105359065A (zh) 提供附加功能和各功能预览的多功能按键
US6618037B2 (en) Pointing device and information processing apparatus
EP2074492A1 (fr) Périphérie de saisie
US6163280A (en) Workstation comprising a braille reading line
US20120139841A1 (en) User Interface Device With Actuated Buttons
KR100556049B1 (ko) 정보입력장치
US7626570B2 (en) Input device
WO2005057395A1 (fr) Dispositif d&#39;entree de donnees, appareil d&#39;information, et procede d&#39;interface utilisateur
JP2006050512A (ja) データ入力方式
KR101904899B1 (ko) 전기 형태의 데이터 입력을 위한 방법 및 데이터 입력 장치
JP4203885B2 (ja) データ入力装置とユーザインターフェイス方式
JP2007249459A (ja) データ入力装置
JP2008257296A (ja) 転動型入力装置とプログラム
KR101631069B1 (ko) 멀티터치 트랙패드를 통한 심리스한 입력모드 전환을 지원하는 통합 전용 입력 플랫폼
WO2005008468A1 (fr) Dispositif de saisie de donnees, equipement d&#39;information, procede de commande d&#39;equipement d&#39;information et programme informatique
JPH10187025A (ja) マウス型触覚ディスプレイ装置
JP2005044122A (ja) データ入力装置およびユーザインターフェイス方式

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2005516221

Country of ref document: JP

122 Ep: pct application non-entry in european phase