JP2015111479A - Input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the operability of a software keyboard by using a haptic technology.SOLUTION: A software keyboard includes two predetermined home position keys, and when a pressing force against a touch sensor 22 is less than a threshold, a home position attitude has not been approved, and depressed key images are the respective home position keys, a key image determination unit 13 outputs the display areas of the key images to a vibration control unit 12, and the vibration control unit 12 vibrates an actuator in a first vibration pattern. When the depression against the home position keys has subsequently continued for a predetermined time, the vibration control unit 12 vibrates the actuator in a second vibration pattern. When two vibrators corresponding to the two home position keys have been vibrated in the second vibration pattern, a home position approval unit approves the home position attitude.

Description

  The present invention relates to an input device including a touch panel to which a haptic technology is applied.

  In recent years, many devices using a touch panel as an input means have become widespread. However, it is very difficult for a visually impaired person to input characters from the keyboard displayed on the touch panel. Therefore, Patent Document 1 describes an information input device provided with a haptic technique. Haptic technology refers to a technology that can give feedback to the user when the user operates the touch panel. Patent Document 1 describes a technique in which when a user touches a key displayed on a touch panel, the touch panel vibrates with a vibration pattern corresponding to the touched key.

JP 2006-221568 A

  For example, in the case of a general QWERTY keyboard, small protrusions and depressions are formed in a specific key such as a home position (for example, “F” or “J” key). Then, the user can increase the input efficiency by touch typing by placing the finger at the home position relying on the protrusions and depressions. However, in the case of a software keyboard displayed on the touch panel, the home position key cannot be given to the user as a tactile sensation. In the technique described in Patent Document 1, when a user touches a key, the touch panel vibrates with a vibration pattern corresponding to the key for the first time. For this reason, when the user cannot sufficiently see the software keyboard, it takes time to search for the key at the home position, and it cannot be said that the operability is high.

  The present invention has been made to solve the above problems, and an object of the present invention is to provide an input device that improves the operability of a software keyboard by using a haptic technique.

  An input device according to the present invention detects a position of a pressing point received by a display unit that displays a software keyboard composed of a plurality of key images, a press receiving unit that receives a press input to the display unit, and the press receiving unit. A pressing position detecting means for detecting, a pressing force detecting means for detecting the pressing force of the pressing point received by the pressing receiving means, and a determining means for determining a key image assigned to the position detected by the pressing position detecting means. A vibration means having a plurality of vibrators arranged over the entire pressing input surface of the press receiving means, a vibration control means for driving and controlling the vibration means, and a user predetermined to the press receiving means An authorization means for authorizing that the home position has been established, and the software keyboard has two predetermined home positions. A key image detected by the pressing force detection means is less than a predetermined threshold value, and the key image determined by the determination means is one of the two home position keys. The vibration control means vibrates the vibrator arranged in the display area of the one home position key with a predetermined first vibration pattern, and the vibration control means causes the vibrator to move to the first position. When the pressed position detection means detects a press on the one home position key continuously for a predetermined time after vibrating in one vibration pattern, the vibration control means is disposed in the display area of the one home position key. The vibrator is vibrated with a predetermined second vibration pattern, and the pressing force detected by the pressing force detecting means is less than the threshold value, and the determination When the key image determined by the stage is another home position key of the two home position keys, the vibration control means moves the vibrator arranged in the display area of the other home position key to the first position key. When the vibration control means vibrates the vibrator according to the first vibration pattern after the vibration control means vibrates in one vibration pattern, and the pressing position detection means detects pressing of the other home position key for the predetermined time. The vibration control means vibrates the vibrator arranged in the display area of the other home position key in the second vibration pattern, and the two vibrators corresponding to the two home position keys In the case of having already vibrated in two vibration patterns, the authorization means authorizes that the user has taken the home position posture.

According to this configuration, even if the user cannot sufficiently visually recognize the software keyboard displayed on the display unit, the user can easily take the posture of the home position. Specifically, when the user presses each home position key with a force less than a threshold value (for example, a force that simply puts a finger on the home position key), the vibration control means is arranged in the display area of the home position key. Since the provided vibrator is vibrated in the first vibration pattern, the user can know that the finger is at the home position key. Further, when the user presses the home position key with a force less than a threshold value for a predetermined time continuously, the vibration control means vibrates the vibrator arranged in the display area of the home position key with the second vibration pattern. The user can recognize that the home position posture is being taken, and if the two vibrators corresponding to the two home position keys have already been vibrated in the second vibration pattern, the home position posture is taken. Can be recognized.
For example, when the software keyboard is in the QWERTY layout, the user generally performs touch typing starting from the “F” key and the “J” key. That is, when two keys, “F” key and “J” key, are used as home position keys, the two home position keys are pressed by the user and then pressed continuously for a predetermined time, and the vibration control means is set to the second position. When oscillating with the vibration pattern, the certifying means can certify that the user has taken the home position posture.

  In addition, the vibration control means may change depending on the situation, such as a first vibration pattern when the user presses the home position key with a force less than a threshold, and a second vibration pattern when the user presses the home position key continuously for a predetermined time with a force less than the threshold. By vibrating the vibrator with different vibration patterns, the user can easily grasp the current operation status.

  Further, in the above-described configuration, a confirmation unit that confirms a pressing input to the key image is further provided, and the pressing point received by the pressing reception unit immediately after the recognition unit performs the recognition of the home position posture is the pressing point. When it is less than the threshold value, the determination means determines a key image assigned to the pressed point, and the vibration control means determines a predetermined third transducer in the display area of the key image. When the pressing force at the pressing point received by the pressing receiving unit is greater than or equal to the threshold value, the determining unit determines a key image assigned to the pressing point, and the vibration controlling unit The vibrator arranged in the key image display area is vibrated with a predetermined fourth vibration pattern, and the confirmation means confirms the pressing input to the key image. It is preferable to.

  In many cases, the key image that is pressed after the recognition unit has authenticated the home position posture, that is, the key image that the user pressed after taking the home position posture is the target key image that the user wants to input. Therefore, when the user presses with a force less than the threshold value, the vibration control means vibrates the vibrator arranged in the display area of the key image with the third vibration pattern, so that the user presses the key image. Can be recognized. When the force is further pressed with a force equal to or greater than the threshold value, the vibration control means vibrates the vibrator arranged in the display area of the key image with the fourth vibration pattern, and the user has confirmed the input of the key image. Can be recognized.

  Here, in the case of a user who can sufficiently view the software keyboard, the target key image can be immediately pressed with a force equal to or greater than the threshold value without performing home position recognition. Therefore, the confirming means confirms the input of the pressed key image if the pressing force at the pressing point received by the press receiving means is equal to or greater than the threshold even if the authenticating means does not authenticate the user's home position posture. To do. By doing so, the same software keyboard can be used regardless of whether or not the user can see the software keyboard sufficiently, and there is no need to switch the display method and operation method of the software keyboard for each user.

  Further, in the above configuration, after the vibrator corresponding to the one home position key is vibrated in the second vibration pattern, when the discriminating unit does not discriminate the other home position key, It is preferable to further include a notification unit that performs notification for prompting the user to press the home position key.

  According to this configuration, the user can start searching for another home position key with peace of mind.

  Further, in the above configuration, the pressed position detecting unit can detect a plurality of pressed positions, the pressing force detecting unit can detect each pressing force of the plurality of pressed positions, and the determining unit detects It is preferable that the key image displayed at the position pressed with the largest pressing force among the pressed forces is determined.

  According to this configuration, the user can search for a target key image while placing a finger on the home position key (pressing with a force less than a threshold). That is, since the target key image can be pressed from the relative position starting from the home position, the input efficiency can be increased.

  In the above configuration, the vibration control means vibrates the vibrator arranged in the display area of the key image determined by the determination means, and simultaneously notifies the character indicated by the key image by voice. It is preferable to further provide.

  According to this configuration, the user can hear the character of the currently vibrating key image with his / her ears, so that the user can easily know the type of key image being pressed.

  According to the present invention, the user can improve the input efficiency of the software keyboard regardless of whether or not the software keyboard can be sufficiently visually recognized.

The block diagram which showed the electric constitution of the input device. The figure which showed an example of the software keyboard of QWERTY arrangement | sequence. The figure which showed an example of the software keyboard of the Japanese syllabary order. The figure which showed the cross-section of the touch panel. The figure which showed the key image and actuator which were displayed on the display panel. The flowchart which showed the flow of control of an input device. The flowchart which showed the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device. The figure for demonstrating the flow of control of an input device.

  Hereinafter, an embodiment of an input device according to the present invention will be described with reference to the drawings. An input device according to the present invention is a device including a touch panel integrally formed with a display panel for displaying a key image (for example, a software keyboard). For example, the input device is based on a flat tablet PC and a personal computer function. This is a device equipped with a touch panel that mainly accepts character input, such as a multifunctional mobile phone, an electronic device such as a collection search system or a car navigation system installed in a library or bookstore.

  FIG. 1 is a block diagram illustrating an electrical configuration of the input device 1 according to the present embodiment. The input device 1 includes a touch panel controller 10 that comprehensively controls each element constituting the input device 1, a touch panel 20 on which a user accepts a touch operation and displays various messages, and a speaker 30 that announces various messages by voice (notification means) ).

  The touch panel controller 10 includes a display control unit 11, a vibration control unit 12 (vibration control unit), a key image discrimination unit 13 (discrimination unit), a home position certification unit 14 (certification unit), and an input decision unit 15 (input decision unit). Have. The display control unit 11 performs display control on the display panel 21. The vibration control unit 12 performs vibration control on the vibration unit 24. The key image determination unit 13 determines the pressed key image (one key in the software keyboard) based on the position information of the pressed point output by the touch sensor 22. The home position authorization unit 14 authorizes the user's home position posture. The input confirmation unit 15 confirms the pressing input of the key image by the user based on a predetermined condition.

  The touch panel 20 includes a display panel 21 (display means), a touch sensor 22 (press receiving means, pressed position detection means), a pressing force detection unit 23 (pressing force detection means), and a vibration unit 24 (vibration means). The display panel 21 displays a software keyboard and various keys and messages for operation based on the control from the display control unit 11, and includes a liquid crystal display, an organic EL (Organic Electro-Luminescence) panel, and the like. The FIG. 2 is a diagram illustrating an example of a software keyboard having a QWERTY layout, and FIG. 3 is a diagram illustrating an example of a software keyboard in alphabetical order.

  The touch sensor 22 receives a pressing input from the user, detects a pressing point, and outputs the pressing position information to the touch panel controller 10. Note that it is desirable that the touch sensor 22 can detect a plurality of pressed points simultaneously (multi-point detection is possible).

  The pressing force detection unit 23 detects a force (pressing force) applied to the touch sensor 22. In the present embodiment, the touch sensor 22 and the pressing force detection unit 23 are described as separate components. For example, as in the touch panel described in Japanese Patent Application Laid-Open No. 2011-3103, A component that can perform both pressing force detections (that is, a member in which the touch sensor 22 and the pressing force detection unit 23 are integrated) may be used.

  The vibration unit 24 includes a plurality of vibrators arranged in a matrix over the entire area of the touch sensor 22, and vibrates the corresponding vibrators based on the control of the vibration control unit 12. A vibration method of the touch sensor 22 using a vibrator is described in, for example, Japanese Patent Application Laid-Open No. 2012-27765, and the vibration unit 24 will be described in detail with reference to the contents described in this publication.

  FIG. 4 is a diagram showing a cross-sectional structure of the touch panel 20. The touch panel controller 10 of the present embodiment has the five components shown in FIG. 1, but only the components necessary for the description are shown in FIG.

  The touch panel 20 is configured by stacking, for example, a touch sensor 22, a pressing force detection unit 23, a vibration unit 24, and a display panel 21 in this order from the upper surface. The vibration unit 24 includes a plurality of actuators (vibrators), and the actuators are arranged in a matrix on the entire back surface of the touch sensor 22.

  When the touch sensor 22 is pressed, the touch sensor 22 outputs pressed position information (for example, XY coordinate values) indicating the position of the pressed point to the key image determination unit 13. The key image determination unit 13 determines the presence or absence of a key image at the pressed point based on the pressed position information, and if there is a key image, specifies the type.

  The pressing force detection unit 23 detects the pressing force at the pressing point and outputs the detection result to the touch panel controller 10. The touch panel controller 10 causes the vibration control unit 12, the home position recognition unit 14, and the input determination unit 15 to perform control according to the pressing force. Control according to the pressing force will be described later.

  The vibration control unit 12 applies the vibration pattern (at least four different vibration patterns (first to fourth vibration patterns)) according to the situation to the actuator arranged in the display area of the key image determined by the key image determination unit 13. ). The first to fourth vibration patterns are set in advance so that the user can recognize the difference between the vibration patterns by changing the strength and frequency of vibration, and the storage unit (not shown) included in the vibration control unit 12 is the first. The vibration intensity and frequency of the first to fourth vibration patterns are stored.

  FIG. 5 is a diagram showing the positional relationship between the key image displayed on the display panel 21 and the actuator. As shown in FIG. 5, the actuators 24 are arranged in a matrix as indicated by dotted lines. Note that the rectangles surrounded by dotted lines indicate the actuators 24 respectively.

  When the user presses the touch sensor 22, the touch sensor 22 detects the pressed position and outputs the pressed position information to the key image determination unit 13. The key image discriminating unit 13 discriminates the pressed key image based on the pressed position information, and outputs display area information on which the key image is displayed to the vibration control unit 12.

  For example, when the user presses the “F” key, the key image discriminating unit 13 calculates an area where the “F” key is displayed using the XY coordinate values, and uses the calculation result as display area information to the vibration control unit 12. Output. The vibration control unit 12 selects a plurality of actuators 24 (actuator group 240) arranged in the display area of the “F” key, and gives a vibration instruction to the selected actuator group 240. In this way, only the area of the pressed key image can be vibrated as feedback for pressing the key image.

  The arrangement relationship between the key image and the actuator 24 shown in FIG. 5 is merely an example, and the key image is arranged so that there is an actuator that does not belong to any key image display area between the key images. Is desirable. For example, when the user slides a finger immediately after pressing the “F” key and presses the lower “V” key, the actuator group 240 corresponding to the display area of the “F” key and the “V” key If the actuator group 250 corresponding to the display area is adjacent to the display area without a gap, the user always feels the vibration caused by the actuator 24 with the fingertip, making it difficult to distinguish the boundary of the key image.

  For this reason, an actuator 24 that does not belong to any display area of any key image is present between the key images. Thus, for example, when the “F” key is pressed and the finger is slid as it is and the “V” key is pressed, the actuator 24 does not vibrate while the finger is positioned between the actuator group 240 and the actuator 250 group. Therefore, the user can recognize the boundary of the key image.

Next, the operation flow of the touch panel 20 under the control of the touch panel controller 10 will be described for each type of software keyboard.
<For software keyboard with QWERTY layout>
The flow of the operation of the touch panel 20 on which a QWERTY layout software keyboard is displayed under the control of the touch panel controller 10 will be described with reference to FIGS. Hereinafter, although the home position key will be described as “F” key and “J” key, the number of home position keys may be one or three or more.

  First, while there is no touch on the touch panel 20 (step S11; NO), the touch panel controller 10 announces by voice that the software keyboard is displayed on the speaker 30 (step S10).

  FIG. 8 is a diagram illustrating a stage in which the user searches for a home position key by sliding a finger while pressing the touch sensor 22 of the touch sensor 22 with a force less than a threshold (lightly touching the touch sensor 22). Yes, L indicates the locus followed by the user's finger.

  When the touch sensor 22 outputs the pressed position information and the pressing force detection unit 23 outputs the pressing force (step S11; YES), the pressing force is less than a predetermined threshold (step S12; NO), and the home When the position recognition unit 14 has not recognized the home position posture (step S13; NO), the key image determination unit 13 determines the key image at the pressed position (step S14). If the key image determined by the key image determination unit 13 is not the home position key (step S15; NO), the touch panel controller 10 proceeds to step S11. That is, the touch panel controller 10 repeats the processing from step S11 to step S15 while the home position posture is unapproved and the user touches a key image other than the home position key with a force less than the threshold.

  Here, the “predetermined threshold value” means a pressing force necessary for the input confirmation unit 15 to confirm an input to the software keyboard. When the pressing force detected by the pressing force detector 23 is less than the threshold value, the user is not pressing the touch sensor 22 for the purpose of confirming the input to the software keyboard. That is, it is assumed that the user is in the stage of searching for a target key image while sliding his / her finger on the touch sensor 22, and the input confirmation unit 15 does not accept the user's pressing operation as an input operation.

  Conversely, when the pressing force is equal to or greater than the threshold (step S12; YES), it is assumed that the user has pressed the key image for the purpose of confirming the input, and the input confirming unit 15 Confirm the input. This process will be described later.

When the key image determined by the key image determining unit 13 is the home position (step S15; YES), that is, when the user's finger reaches the “J” key that is the home position key, as shown in FIG. The key image discriminating unit 13 outputs information indicating the display area of the key image pressed by the vibration control unit 12, and the vibration control unit 12 selects an actuator arranged in the display area and vibrates in the first vibration pattern. Let me. Furthermore, touch panel controller 1
0 announces the type of key image pressed by the speaker 30 (step S16).

  That is, as shown in FIG. 10, the “J” key vibrates in the first vibration pattern, and the speaker 30 reproduces “Jay”. Thus, it can be seen that the user is currently pressing the home position key from the fingertip, and further that the user is pressing the “J” key from the ear.

  Subsequently, when the pressing of the home position key determined in step S15 continues for a predetermined time (step S17; YES), the key image determination unit 13 indicates the display area of the home position key to the vibration control unit 12. While outputting the information, the vibration control unit 12 selects the actuator arranged in the display area and vibrates in the second vibration pattern (step S18). That is, as shown in FIG. 11, the “J” key vibrates in the second vibration pattern. Thereby, the user can recognize that it may proceed to the next input.

  When the predetermined home position key has not been confirmed yet, that is, when the key image discriminating unit 13 has not discriminated both the “F” key and the “J” key in step S15 (step S19). NO), the touch panel controller 10 makes an announcement prompting the speaker 30 to press another home position key ("F" key in the case of FIG. 11) (step S21), and proceeds to step S11. As a result, the user can start searching for another home position key at ease.

  Here, while searching for the “F” key, which is another home position key, the user may leave the finger on the “J” key (hold down with a force less than the threshold). For example, as shown in FIG. 12, while searching for the “F” key with the finger placed on the “J” key, the touch sensor 22 detects the pressing of the “F” key by the user's right hand and simultaneously detects the left hand. The pressing point is also detected. The pressing force detection unit 23 detects the pressing force of each pressing point, but the key image determination unit 13 determines the key image at the pressing point with the largest pressing force. By doing so, the user can search for another key image with the finger placed on the home position key. That is, since the position of the target key image can be grasped from the relative position from the home position key, the input efficiency can be increased.

  Next, when the touch sensor 22 outputs the pressing position information and the pressing force detector 23 outputs the pressing force (step S11; YES), the pressing force is less than a predetermined threshold (step S12; NO). ) When the home position posture is not recognized (step S13; NO), the key image determination unit 13 determines the key image at the pressed position (step S14). If the key image determined by the key image determination unit 13 is not the home position key (step S15; NO), the touch panel controller 10 proceeds to step S11. Here, as shown in FIG. 12, the user is in the stage of searching for another home position key “F”.

  On the other hand, when the key image determined by the key image determination unit 13 is the home position key (step S15; YES), that is, as shown in FIG. 13, the user's finger is on the “F” key that is the home position key. When it arrives, the key image discriminating unit 13 outputs information indicating the display area of the pressed key image to the vibration control unit 12, and the vibration control unit 12 selects the actuator arranged in the display area, and the first vibration Vibrate with a pattern. Further, the touch panel controller 10 announces the type of key image pressed by the speaker 30 (step S16).

  That is, as shown in FIG. 13, the “F” key vibrates in the first vibration pattern, and the speaker 30 reproduces “F”. Thus, it can be seen that the user is currently pressing the home position key from the fingertip, and further that the user is pressing the “F” key from the ear.

  Subsequently, when the home position key determined in step S15 continues to be pressed for a predetermined time (step S17; YES), the key image determination unit 13 provides information indicating the display area of the home position key to the vibration control unit 12. And the vibration control unit 12 selects the actuator arranged in the display area and vibrates in the second vibration pattern (step S18). That is, as shown in FIG. 14, the “F” key vibrates in the second vibration pattern. Thereby, the user can recognize that it may proceed to the next input.

  When a predetermined home position key is confirmed (in the case of a software keyboard of QWERTY layout, in step S18, the key image determination unit 13 causes the actuator corresponding to the key images of both the “F” key and the “J” key to perform the second vibration. If the pattern has already been vibrated (step S19; YES), the home position recognition unit 14 determines the home position assuming that the home position is ready (step S20). Then, the touch panel controller 10 causes the speaker 30 to make an announcement prompting the user to press the next key image (step S21). Thereby, the user can start inputting the key image with peace of mind. Thereafter, the user may search for a desired key image with the finger placed on the home position key (pressed with a force less than the threshold).

  When the touch panel controller 10 returns the process to step S11, the touch sensor 22 outputs the pressing position information, and the pressing force detection unit 23 outputs the pressing force (step S11; YES), the pressing force is less than a predetermined threshold value. If the home position posture has been certified (step S13; YES), the key image determination unit 13 determines the key image at the pressed position (step S22). When the key image determined by the key image determination unit 13 is a key image that can be input (step S23; YES), the key image determination unit 13 outputs information indicating the display area of the key image to the vibration control unit 12. Then, the vibration control unit 12 selects the actuator arranged in the display area and vibrates with the third vibration pattern. Furthermore, the touch panel controller 10 announces the type of key image pressed by the speaker 30 (step S24).

  That is, as shown in FIG. 15, when the user presses the “M” key with the thumb of the right hand while placing the index fingers of both hands on the “J” key and the “F” key, respectively, the “M” key has a third vibration pattern. It vibrates and the speaker 30 reproduces “M”. Thereby, it can be seen that the user is pressing the key image from the fingertip, and the user is pressing the “M” key from the ear.

  If the key image determined by the press determination key 11 is not a key image that can be input or there is no key image (step S23; NO), the control unit directly proceeds to step S11.

  Subsequently, when the touch sensor 22 outputs the pressing position information and the pressing force detection unit 23 outputs the pressing force (step S11; YES), when the pressing force is equal to or greater than a predetermined threshold (step S12; YES). ), The key image discriminating unit 13 discriminates the key image at the pressed position (step S25). When the key image determined by the key image determination unit 13 is a key image that can be input (step S26; YES), the input determination unit 15 determines the input of the alphabet indicated by the determined key image.

  Further, the key image discriminating unit 13 outputs information indicating the display area of the key image to the vibration control unit 12, and the vibration control unit 12 selects an actuator arranged in the display area and uses the fourth vibration pattern. Vibrate. Further, the touch panel controller 10 causes the speaker 30 to announce the type of key image whose input has been confirmed (step S27).

  That is, as shown in FIG. 16, when the user presses the “M” key with the thumb of the right hand with a force equal to or greater than the threshold, the display control unit 11 displays “M” in the input field 51, and the “M” key is the fourth key. The speaker 30 vibrates in a vibration pattern, and the speaker 30 reproduces “M input”. As a result, the user knows that the input of the key image has been confirmed from the fingertip, and knows that the “M” key has been inputted from the ear.

  If the key image determined by the press determination key 11 is not a key image that can be input or there is no key image (step S26; NO), the touch panel controller 10 proceeds directly to step S11. The user continues to input the key image. FIG. 17 is a diagram illustrating a situation in which the input of the “C” key is confirmed by pressing the “C” key with the left thumb after the input of the “M” key.

  Here, in the above description, the case where the user inputs the target key after the home position is recognized has been described. However, when the user can visually recognize the software keyboard, the target key image can be pressed from the beginning with a force equal to or greater than the threshold value, so that it is not necessary to determine the home position posture. Therefore, when the pressing force detection unit 23 outputs a pressing force equal to or greater than the threshold value regardless of whether the home position posture is certified or not (step S12; YES), the input confirmation unit 15 inputs the alphabet indicated by the pressed key image. Is determined (steps S22 to S24). By doing so, it is not necessary to provide the input device 1 with a mode for users who cannot sufficiently view the software keyboard and a mode for users who can see the software keyboard, and any user can easily use the input device 1.

In the above description, the alphabet indicated by the pressed key image has been described as a voice announcement. However, when the user can visually recognize the software keyboard, the vibration of the vibration unit 24 and the voice announcement are not necessary. Therefore, when the home position posture is not recognized and the pressing force detection unit 23 detects a pressing force equal to or greater than the threshold value, the vibration control unit 12 does not issue a vibration instruction to the vibration unit 24, and the touch panel controller 10 does not output the speaker 30. The voice announcement may not be made.
<In case of software keyboard arranged in Japanese syllabary order>
Next, with reference to FIGS. 6, 7, and 18 to 23, the control in the software keyboard with the alphabetical order will be described. In the present embodiment, the home position keys in the alphabetical order will be described as key images ("A" to "WA" keys) corresponding to the hiragana in the dan.

  First, while there is no contact with the touch panel 20 (step S11; NO), the touch panel controller 10 announces by voice that the software keyboard is displayed on the speaker 30 (step S10).

  FIG. 18 is a diagram illustrating a stage in which the user searches for a home position key by sliding a finger while pressing the touch sensor 22 of the touch sensor 22 with a force less than a threshold (lightly touching). The trajectory followed by the user's finger is shown.

  When the touch sensor 22 outputs the pressing position information and the pressing force detection unit 23 outputs the pressing force detection result (step S11; YES), the pressing force is less than a predetermined threshold (step S12; NO). ) When the home position posture by the home position recognition unit 14 is not yet recognized (step S13; NO), the key image determination unit 13 determines the key image at the pressed position (step S14). If the key image determined by the key image determination unit 13 is not the home position key (step S15; NO), the touch panel controller 10 proceeds to step S11.

  When the key image determined by the key image determination unit 13 is the home position key (step S15; YES), that is, as shown in FIG. 18, the user's finger has reached the “NA” key that is the home position key. At this time, the key image discriminating unit 13 outputs information indicating the display area of the pressed key image to the vibration control unit 12, and the vibration control unit 12 selects an actuator arranged in the display area and uses the first vibration pattern. Vibrate. Further, the touch panel controller 10 announces the type of key image pressed by the speaker 30 (step S16).

  That is, as shown in FIG. 19, the “NA” key vibrates in the first vibration pattern, and the speaker 30 reproduces “NA”. As a result, it can be seen that the user is pressing the home position key at the fingertip and the user is pressing the “NA” key from the ear.

  Subsequently, when the pressing of the home position key determined in step S15 continues for a predetermined time (step S17; YES), the key image determination unit 13 gives the vibration control unit 12 the display area information of the home position key. In addition to outputting, the vibration control unit 12 selects an actuator arranged in the display area and vibrates in the second vibration pattern (step S18). That is, as shown in FIG. 20, the “NA” key vibrates in the second vibration pattern. Thereby, the user can recognize that it may proceed to the next input.

  In the case of a software keyboard arranged in Japanese alphabetical order, if even one home position key is confirmed (step S19; YES), the home position certifying unit 14 certifies the home position stance as the home position stance is ready ( In step S20), the touch panel controller 10 causes the speaker 30 to make an announcement prompting the user to press the next key image (step S21). That is, as shown in FIG. 20, the speaker 30 makes an announcement prompting the next input.

  Here, the user first searches for the key image in the row of the kana character string of the target key image, determines the home position, and then slides the finger to the target key image. That is, when the target key image is “Nu”, the user first searches for the “NA” key and determines the home position. Since the “Nu” key is two keys below the “NA” key, the user slides his / her finger downward from the “NA” key to receive the second third vibration pattern. Is understood to be the "Nu" key. Further, the user may keep the finger on the “NA” key while searching for the target key image (ie, keep pressing with a force less than the threshold).

  When the touch panel controller 10 returns the process to step S11, the touch sensor 22 outputs the pressing position information, and the pressing force detection unit 23 outputs the pressing force (step S11; YES), the pressing force is less than a predetermined threshold value. If the home position has already been determined (step S13; YES), the key image determination unit 13 determines the key image at the pressed position (step S22). When the key image determined by the key image determination unit 13 is a key image that can be input (step S23; YES), the key image determination unit 13 outputs information indicating the display area of the key image to the vibration control unit 12. At the same time, the vibration control unit 12 selects the actuator arranged in the display area and vibrates in the third vibration pattern. Furthermore, the touch panel controller 10 announces the type of key image pressed by the speaker 30 (step S24).

  That is, as shown in FIG. 21, the “Nu” key vibrates in the third vibration pattern, and the speaker 30 reproduces “Nu”. Thereby, it can be seen from the fingertip that the user is currently pressing the key image, and that the user is pressing the “Nu” key.

  If the key image determined by the press determination key 11 is not a key image that can be input or there is no key image (step S23; NO), the control unit directly proceeds to step S11.

  Subsequently, when the touch sensor 22 outputs the pressing position information and the pressing force detection unit 23 outputs the pressing force (step S11; YES), when the pressing force is equal to or greater than a predetermined threshold (step S12; YES). ), The key image discriminating unit 13 discriminates the key image at the pressed position (step S25). When the key image determined by the key image determination unit 13 is a key image that can be input (step S26; YES), the input determination unit 15 determines the input of the hiragana indicated by the determined key image.

  Further, the key image discriminating unit 13 outputs information indicating the display area of the key image to the vibration control unit 12, and the vibration control unit 12 selects an actuator arranged in the display area and uses the fourth vibration pattern. Vibrate. Further, the touch panel controller 10 causes the speaker 30 to announce the type of key image whose input has been confirmed (step S27).

  That is, as shown in FIG. 22, the display control unit 11 displays “Nu” in the input field 51, the “Nu” key vibrates in the fourth vibration pattern, and the speaker 30 reproduces “Nu entered”. To do. As a result, the user knows that the input of the key image is confirmed from the fingertip, and knows that the input of the “Nu” key is confirmed from the ear.

  If the key image determined by the press determination key 11 is not a key image that can be input or there is no key image (step S26; NO), the touch panel controller 10 proceeds directly to step S11. The user continues to input the key image. FIG. 23 is a diagram illustrating a situation in which the input of the “mi” key is confirmed after the input of the “nu” key.

  As described above with the QWERTY layout and the software keyboard in the order of Japanese syllabary as an example, after the home position recognition unit 14 recognizes the home position posture, the touch panel 20 is pressed with a pressing force equal to or greater than a threshold value. When an input is made, the input confirmation unit 15 confirms the input of the key image, so that the user can easily search for the target key image based on the relative position from the home position key, and the input efficiency can be improved. .

  In addition, the entire touch surface of the touch panel does not vibrate in response to the user's touch operation as in the conventional input device to which the haptic technology is applied, but the vibration control unit 12 determines the key image determined by the key image determination unit 13. The actuator arranged in the display area is vibrated, that is, only the area of the key image on which the user places the finger vibrates. For this reason, it is easy for the user to grasp whether or not the key image is pressed, and the user can input efficiently.

  When the pressing force detected by the pressing force detection unit 23 is less than the threshold value, the input confirmation unit 15 does not confirm the input (while the user touches the touch surface 42 lightly to search for the target key image) The confirmation unit 15 does not confirm the input), and if it is equal to or greater than the threshold, the input confirmation unit 15 confirms the input even if the home position recognition unit 14 does not recognize the home position posture. There is no need to switch the input method or the like depending on whether or not it is possible. That is, it is not necessary to provide the input device 1 with a mode for users who cannot sufficiently view the software keyboard and a mode for users who can see the software keyboard, and any user can easily use the input device 1.

DESCRIPTION OF SYMBOLS 1 Input device 11 Display control part 12 Vibration control part 13 Key image discrimination | determination part 14 Home position recognition part 15 Input confirmation part 20 Touch panel 21 Display panel 22 Touch sensor 23 Pressing force detection part 24 Vibration part, Actuator 30 Speaker

Claims (5)

Display means for displaying a software keyboard composed of a plurality of key images;
A press receiving means for receiving a press input to the display means;
A pressing position detecting means for detecting the position of the pressing point received by the pressing receiving means;
A pressing force detecting means for detecting the pressing force at the pressing point received by the pressing receiving means;
Discriminating means for discriminating a key image assigned to the position detected by the pressed position detecting means;
A vibrating means having a plurality of vibrators arranged over the entire pressing input surface of the pressing receiving means;
Vibration control means for driving and controlling the vibration means;
Authorization means for authorizing that the user has taken a predetermined home position posture with respect to the pressing acceptance means;
With
The software keyboard includes two predetermined home position keys,
When the pressing force detected by the pressing force detection means is less than a predetermined threshold value, and the key image determined by the determination means is one of the two home position keys, The vibration control means vibrates a vibrator arranged in the display area of the one home position key with a predetermined first vibration pattern,
When the vibration control means vibrates the vibrator in the first vibration pattern and the pressed position detection means detects a press on the one home position key for a predetermined time, the vibration control means The vibrator arranged in the display area of the home position key is vibrated with a predetermined second vibration pattern,
When the pressing force detected by the pressing force detection means is less than the threshold value and the key image determined by the determination means is another home position key of the two home position keys, the vibration control means is Vibrating the vibrator arranged in the display area of the other home position key with the first vibration pattern,
When the vibration control unit vibrates the vibrator in the first vibration pattern and the pressed position detection unit detects pressing of the other home position key for the predetermined time, the vibration control unit While vibrating the vibrator arranged in the display area of the other home position key in the second vibration pattern,
When the two vibrators corresponding to the two home position keys have already vibrated in the second vibration pattern, the authorization unit recognizes that the user has taken the home position posture. A confirmation unit for confirming a pressing input to the key image;
If the pressing force at the pressing point received by the pressing receiving unit is less than the threshold immediately after the determining unit has authenticated the home position posture, the determining unit displays the key image assigned to the pressing point. Determining, and the vibration control means vibrates the vibrator arranged in the display area of the key image in a predetermined third vibration pattern,
When the pressing force of the pressing point received by the pressing receiving unit is equal to or greater than the threshold value, the determining unit determines a key image assigned to the pressing point, and the vibration control unit displays the key image in the display area of the key image. 2. The input device according to claim 1, wherein the vibrator arranged is vibrated in a predetermined fourth vibration pattern, and the confirmation unit confirms the pressing input to the key image.   After the vibrator corresponding to the one home position key is vibrated in the second vibration pattern, if the discrimination means has not discriminated the other home position key, the other home position key is pressed. The input device according to claim 1, further comprising a notification unit that performs notification for prompting.   The pressed position detecting means can detect a plurality of pressed positions, the pressing force detecting means can detect each pressing force of the plurality of pressed positions, and the discriminating means includes a detected pressing force. The input device according to any one of claims 1 to 3, wherein a key image displayed at a position pressed with the largest pressing force is determined.   2. The information processing apparatus according to claim 1, further comprising a notifying unit configured to vibrate a character indicated by the key image at the same time as the vibration control unit vibrates the vibrator arranged in the display area of the key image determined by the determining unit. The input device according to any one of 4.

Images