JP2011070603A - Input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input device which generates an operation feeling without an unpleasant feeling to an operator even if an existing application constituting a user interface is used. <P>SOLUTION: The input device 1 includes: a touch sensor 40; a load detection unit 60 for detecting a pressing load to a touch surface of the touch sensor 40; a display unit 30; a display change detection unit 16 for detecting a change of a display image; a tactile sensation presentation unit 50 for vibrating the touch surface of the touch sensor 40; and a control unit 10 which controls so as to execute predetermined processing if the load detection unit 60 detects a pressing load satisfying a load reference for presenting tactile sensation. The control unit 10 controls the tactile sensation presentation unit 50 to present tactile sensation to a pressing object that presses the touch surface if the display change detection unit 16 detects a change of the display image caused by the execution of predetermined processing. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an input device including a touch sensor.

  2. Description of the Related Art In recent years, in portable terminals such as mobile phones, there are some devices that employ an input device including a touch sensor such as a touch panel or a touch switch as an input device such as an operation unit or a switch that receives an operation input by a user. In addition to portable terminals, input devices equipped with touch sensors are widely used in information devices such as calculators and ticket machines, household appliances such as microwave ovens, televisions, and lighting equipment, and industrial equipment (FA devices). .

  As such a touch sensor, various systems such as a resistive film system, a capacitance system, and an optical system are known. However, any type of touch sensor accepts a touch input by a finger or a stylus pen, and the touch sensor itself is not physically displaced like a push button switch even when touched.

  Therefore, the operator cannot obtain feedback for the input even if the touch input is received by the input device. For this reason, the operator cannot obtain an operational feeling when performing the operation input, and is likely to repeatedly input such as touching the same position many times, which may give stress to the operator.

  Therefore, conventionally, a feedback method has been proposed in which when a touch sensor accepts an input regardless of hearing or vision, the touch sensor is vibrated to present a tactile sensation to the fingertip of the operator (for example, Patent Documents). 1 and Patent Document 2).

  According to the techniques disclosed in Patent Literature 1 and Patent Literature 2, when an operation input to the touch sensor is received, a tactile sensation due to vibration can be presented to the fingertip of the operator. Therefore, an operator who performs input using such an input device can recognize by touch that the operation input performed on the touch sensor has been properly received by the input device.

  However, in order to present a tactile sensation when an operation input is received using such an input device, a process of presenting a tactile sensation according to a predetermined condition is preliminarily described as an application program (hereinafter simply referred to as “application”). ) Must be included. In other words, in the above-described input device, if an application developed in advance for generating vibration is used, a tactile sensation can be presented according to a predetermined condition. However, even if an application that is not supposed to generate vibration is applied as it is to the above-described input device, the tactile sensation cannot be presented appropriately.

  Therefore, in order to present a tactile sensation appropriately according to a predetermined condition in the input device as described above, a new application is developed or a process for presenting a tactile sensation is added to an existing application. Need to be modified.

  Specifically, a process for the input device to present a predetermined tactile sensation when an input is made to a touch sensor corresponding to the position of an object such as a key or button displayed on the display unit of the input device. Need to be added. It is also necessary to prevent the input device from presenting a tactile sensation even when an input is made to a touch sensor corresponding to a position where an object such as a key or button is not displayed on the display unit. By controlling the presence or absence of the tactile sensation in this way, when an operation input is received by a user interface using a touch sensor and a GUI (Graphical User Interface) for input / output, the tactile sensation due to vibration is applied to the fingertip of the operator. Can be presented. That is, an input to an object such as an image-displayed key or button can be notified by presenting a tactile sensation that the input has been accepted. On the other hand, it is possible to prevent feedback even if an input is made to a position where there is no object such as a key or button.

  When performing such control, the input device cooperates with an application that manages the state of the GUI when an input is made to the touch sensor, that is, the state of an object such as a key or button displayed on the display unit. It becomes necessary to do.

  In the conventional input device, even if an application that does not support tactile sensation is applied, the tactile sensation cannot be appropriately presented as it is. Therefore, in order to effectively use various application resources developed so far without wasting them in the conventional input device, each application is modified and a tactile sensation is presented according to a predetermined condition. Processing must be added. Such modification to add processing must be performed for each of various applications, and there is a concern that it takes enormous effort and cost.

  Under such circumstances, it may become a factor that hinders vendors from entering the development of applications for input devices that present tactile sensations, and delays in the spread of platforms that use touch sensors and GUIs. Can be.

JP 2003-288158 A JP 2008-130055 A JP 2007-264862 A

  Accordingly, the applicant of the present application has developed an input device that can divert an existing application that constitutes the user interface and improves the operational feeling given to the operator (hereinafter referred to as “the previous invention”). Write down). The outline of the previous invention will be described below. In addition, the application used for operation | movement of the input device which concerns on previous invention can use the existing thing which comprises GUI, using a touch sensor, and does not respond | correspond to presentation of a tactile sensation. In addition, when an input is made to a touch sensor corresponding to the position of the image of the object displayed on the display unit, the application is assumed to display the object image with some change.

  In the previous invention, when there is a change in the image (of the object) displayed on the display unit by touch input to the touch sensor, it is based on the change of the image (that is, the input to the object is regarded as being made). , Presenting a tactile sensation. This is because, when a touch input is made to the touch sensor corresponding to the position of the image of the object displayed on the display unit, the operator visually recognizes that the touch input is accepted by the object. Based on changing and displaying the image of the object.

  In short, the previous invention changes the image of the object displayed on the display unit based on the touch input to the touch sensor, and when a predetermined pressing load is detected in that state, the tactile sensation is based on the change in the image. Present. Therefore, the operation is separated into an operation involving the application execution unit when performing the process of changing the image of the object based on the touch input, and an operation not involving the application execution unit when performing other processing. Can be captured. As described above, according to the previous invention, the operation from the detection of the input to the touch sensor to the presence / absence of tactile sensation can be considered separately in two stages. It can be set as the operation | movement which a part does not participate. Therefore, even when the running application does not support the operation related to the tactile sensation, the presence / absence of the tactile sensation is appropriately controlled based on the press input of the touch sensor corresponding to the object displayed on the display unit. be able to. Therefore, according to the input device which concerns on previous invention, while being able to show the tactile sense at the time of receiving the input with respect to a touch sensor, the existing application program which comprises a user interface can be diverted without modification.

  Thus, according to the previous invention, for example, even if an application used for a personal computer (PC) described in Patent Document 3 is used, a tactile sensation can be presented. The touch sensor that receives input in the input method described in Patent Document 3 is assumed to be employed in a general PC, an automatic teller machine (ATM), and various automatic machines. Since the operation environment of the touch sensor according to the input method described in Patent Document 3 does not include a mechanism for presenting a tactile sensation, an application developed for use in this environment also supports an operation related to the tactile sensation presentation. Absent. Even for applications that do not support the operation related to the presentation of tactile sensation as developed for such an operating environment, if the input device according to the previous invention is used, the tactile sensation is presented according to the input to the touch sensor. can do.

  However, if the above-described invention is applied to a device that detects a predetermined reference pressing load and executes an application process, there is a possibility that inconvenience may occur depending on the mode of input by the operator. This inconvenience will be described below.

  FIG. 8 is a diagram schematically showing a pressing load until an operator's finger presses an object such as a key and then releases the pressing. That is, FIG. 8 is a graph showing an example of a change over time of the pressing load on the touch surface of the touch sensor detected by the load detection unit of the input device. In FIG. 8, the “predetermined reference” of the pressing load described above is indicated as Pth. Further, in FIGS. 8A and 8B, the order of passage of time is shown by the numbers shown in parentheses. Hereinafter, for convenience of explanation, these numbers in parentheses are referred to as “time points”.

  In FIG. 8A, time point (1) indicates the moment when the operator touches (touches) an object such as a key. At this time (1), when an input is accepted for the object, the input device changes the display image of the object according to an operation based on the application. Further, at the time (2), since the pressing load detected by the load detecting unit satisfies the predetermined reference Pth when the operator strengthens the pressing while the display image of the object is changed, the application performs a predetermined process. Shows the moment to start. Furthermore, time point (3) indicates the moment when the operator releases the pressure by releasing it.

  Thus, based on the change in the display image, the input device presents a tactile sensation (time point (1)). An upward arrow (↑) shown below the time axis at the time point (1) indicates that a tactile sensation is presented when the touch surface of the touch sensor of the input device vibrates. After that, when the pressing load satisfies the predetermined reference Pth, the input device starts a predetermined process according to the operation defined in the application (time point (2)). The “predetermined process” is a process related to an operation of displaying a character related to input on the display unit when, for example, an application for inputting characters is operating. Alternatively, when an input to the key for starting the operation is received while waiting for the start of the operation based on the application, the “predetermined process” is a process for starting the operation based on the application. .

  In this way, in the case shown in FIG. 8A, the operator obtains tactile feedback before the execution of the predetermined process is started. For this reason, the operator may misunderstand the operation content. In other words, the operator may misunderstand that predetermined processing is not executed even though tactile feedback is obtained. In addition, the operator misunderstands that a process different from the predetermined process is performed at the moment when the tactile sensation is presented in order to obtain feedback of the tactile sensation before the predetermined process is performed. There is also a fear.

  On the other hand, in FIG. 8B, time point (1) indicates the moment when the operator touches (touches) an object such as a key. At this time (1), when an input is accepted for the object, the input device changes the display image of the object. Further, in FIG. 8B, for example, when the operator does not increase the pressing force, the pressing load detected by the load detecting unit does not satisfy the predetermined reference Pth. There is no time point (2) shown. Furthermore, time point (3) indicates the moment when the operator releases the pressure by releasing it.

  In this way, when the operator receives an input for pressing an object such as a key with a weak pressing load that does not satisfy the predetermined reference Pth, the input device presents a tactile sensation in accordance with the display change of the object (FIG. 8 ( B)). This application does not execute processing corresponding to the object because the pressing load does not satisfy the predetermined reference Pth, but this input device presents a tactile sensation at the time point (1).

  Therefore, in this case, the operator obtains tactile feedback even though the predetermined process is not executed. Such an operation is uncomfortable for the operator.

  Accordingly, an object of the present invention made in view of such circumstances is to provide an input device that gives an operator an uncomfortable feeling of operation even when an existing application constituting a user interface is diverted. .

The invention of the input device according to the first aspect to achieve the above object is as follows:
A touch sensor;
A load detection unit for detecting a pressing load on the touch surface of the touch sensor;
A display unit;
A display change detection unit for detecting a change in a display image of the display unit;
A tactile sensation providing unit that vibrates the touch surface of the touch sensor;
When the load detection unit detects a pressing load that satisfies a load standard that presents a tactile sensation, a control unit that controls to execute a predetermined process;
With
When the display change detection unit detects a change in the display image due to the execution of the predetermined process, the control unit causes the tactile sensation providing unit to present a tactile sensation to the pressing target pressing the touch surface. Control,
It is characterized by this.

The invention of the input device according to the second aspect is the input device according to the first aspect,
The predetermined process is a process for instructing whether or not an input position with respect to the touch sensor corresponds to a predetermined position.

  The input device according to the present invention executes a process of instructing whether or not the input position corresponds to a predetermined (object) position when the load detection unit detects a pressing load that satisfies a load criterion for presenting a tactile sensation. To do. In addition, the input device according to the present invention detects a change in the display image due to the input position corresponding to a predetermined (object) position by the display change detection unit, so that the input device presses the touch surface. Present a tactile sensation to it. Therefore, according to the present invention, it is possible to provide an input device that gives an operator a feeling of uncomfortable operation even when an existing application constituting a user interface is diverted.

It is a block diagram which shows schematic structure of the input device which concerns on embodiment of this invention. It is a figure which shows an example of the mounting structure of the input device which concerns on embodiment of this invention. It is a flowchart which shows operation | movement of the input device which concerns on embodiment of this invention. It is a flowchart which shows operation | movement of the input device which concerns on embodiment of this invention. It is a flowchart which shows operation | movement of the input device which concerns on embodiment of this invention. It is a figure explaining operation | movement of the input device which concerns on embodiment of this invention. It is a block diagram which shows schematic structure of the input device which concerns on the modification of this invention. It is a figure explaining operation | movement of the input device which concerns on previous invention by this applicant.

  Embodiments of the present invention will be described below with reference to the drawings.

  In the present invention, after detecting the touch input to the touch sensor, the position information of the touch input is notified to the application execution unit only after the pressing load satisfying a predetermined standard is detected. In addition, when the notified touch input position corresponds to the position of the object that receives the input, the application execution unit according to the present invention changes the display of the object. In this way, the present invention presents a tactile sensation when there is a change in the image of the object, based on the change in the image (that is, assuming that an input to the object has been made).

  FIG. 1 is a block diagram showing a schematic configuration of an input device according to an embodiment of the present invention.

  As illustrated in FIG. 1, the input device 1 includes a control unit 10, an application execution unit 20, a display unit 30, a touch sensor 40, a tactile sensation providing unit 50, and a load detection unit 60. The control unit 10 includes a display control unit 12, a tactile sensation control unit 14, and a display change detection unit 16.

  The control unit 10 controls the entire input device 1 including each functional unit of the input device 1. In the present embodiment, the control unit 10 mainly performs operations related to presentation of tactile sensation and predetermined processing based on an application. A description will be given assuming that the above control is performed. The application execution unit 20 reads various applications from a storage unit (not shown) and executes processing based on the applications. In the present embodiment, it is assumed that an application executed by the application execution unit 20 is not previously added with a process for presenting a predetermined tactile sensation. That is, in the present embodiment, a case will be described in which the application execution unit 20 executes an application that does not support tactile sensation.

  The application used for the operation of receiving an input in the present embodiment applies some change to the object image when a touch input is made to the touch sensor 40 corresponding to the position of the object image displayed on the display unit 30. Shall be displayed. This application activates an object when an operator's finger touches (touches), and then executes a process corresponding to the object when a pressing load by the operator's finger or the like satisfies a predetermined load standard. It is assumed.

  Further, the application used here executes the process assigned to the event when the object at the start of touch and the object at the time of touch release are equal. By processing such an application, for example, even when the operator touches an incorrect object when starting input, by dragging the touched finger as it is and releasing the contact of the finger at a position where there is no object, The same effect as canceling the input can be obtained. That is, even if touch input is started from the position of a certain object, the processing assigned to the event can be prevented from being executed by releasing the touch input at a position other than the object. As described in Patent Document 3 described above, many applications that perform such processing have been conventionally employed.

  The display unit 30 displays an input object such as an input button such as a push button switch (push button switch), a key, and the like (hereinafter simply referred to as “key etc.”) as an image. The display unit 30 is configured using, for example, a liquid crystal display panel or an organic EL display panel.

  The touch sensor 40 is usually arranged on the front surface of the display unit 30, and a touch input by the operator's finger or the like (press target) on the object displayed on the display unit 30 is touched by the corresponding touch sensor 40. Accept by surface. The touch sensor 40 detects the position of the touch input with respect to the touch surface, and notifies the application execution unit 20 and the like of the detected input position via the control unit 10. The touch sensor 40 is configured by a known method such as a resistive film method, a capacitance method, and an optical method.

  The tactile sensation providing unit 50 is configured using a piezoelectric vibrator or the like, and generates vibration on the touch surface of the touch sensor 40. The tactile sensation control unit 50 presents a tactile sensation to the pressing target that is pressing the touch surface by generating vibration on the touch surface of the touch sensor 40. The load detection unit 60 detects a pressing load on the touch surface of the touch sensor 40, and is configured using an element that reacts linearly with a load such as a strain gauge sensor or a piezoelectric element, for example. In addition, the load detection unit 60 notifies the tactile sensation control unit 14 of the detected pressing load on the touch surface of the touch sensor 40.

  Based on the display data supplied from the application execution unit 20, the display control unit 12 of the control unit 10 displays an object or the like on the display unit 30 or changes the image display. Take control. The tactile sensation control unit 14 controls the tactile sensation providing unit 50 to generate a predetermined pattern of vibration based on a predetermined condition based on an instruction from the application execution unit 20.

  The display change detection unit 16 analyzes an image displayed on the display unit 30 and detects a change in the image. As the display change detection unit 16 itself, for example, those based on various existing image analysis techniques such as comparing images at predetermined time intervals to detect changes with time can be used. Further, the parameters related to the change can be various existing parameters such as presence / absence of display in a specific region or pixel (pixel) at a specific point, a change in color, a change in luminance and brightness, and the like.

  2A and 2B show an example of the mounting structure of the input device 1 shown in FIG. 1, FIG. 2A is a cross-sectional view of the main part, and FIG. 2B is a plan view of the main part. The display unit 30 is housed and held in the housing 61. The touch sensor 40 is held on the display unit 30 via an insulator 62 made of an elastic member. In the input device 1 according to the present embodiment, the display unit 30 and the touch sensor 40 are rectangular in plan view. In addition, the input device 1 holds the touch sensor 40 on the display unit 30 via the insulators 62 disposed at the four corners deviated from the display area A of the display unit 30 indicated by virtual lines in FIG. .

  The casing 61 is provided with an upper cover 63 so as to cover the surface area of the touch sensor 40 that is out of the display area of the display unit 30, and is made of an elastic member between the upper cover 63 and the touch sensor 40. An insulator 64 is provided. In the touch sensor 40 shown in FIG. 2, the surface member having the touch surface 40a is made of, for example, a transparent film or glass, and the back member is made of glass or acrylic. The touch sensor 40 has a structure in which, when the touch surface 40a is pressed, the pressed portion is slightly bent (distorted) in accordance with the pressing force, or the structure itself is bent slightly.

  On the surface of the touch sensor 40, a strain gauge sensor 51 for detecting a load (pressing force) applied to the touch sensor 40 is provided in the vicinity of each side covered with the upper cover 63 by adhesion or the like. Further, on the back surface of the touch sensor 40, piezoelectric vibrators 52 for vibrating the touch sensor 40 are provided by adhesion or the like in the vicinity of two opposing sides. That is, in the input device 1 shown in FIG. 2, the load detection unit 60 shown in FIG. 1 is configured using four strain gauge sensors 51, and the tactile sensation providing unit 50 is configured using two piezoelectric vibrators 52. ing. The touch surface 40a is vibrated by vibrating the touch sensor 40 by the tactile sensation providing unit 50. In FIG. 2B, the casing 61, the upper cover 63, and the insulator 64 shown in FIG. 2A are not shown.

  Next, the operation of the input device according to this embodiment will be described.

  When there is a change in the image displayed on the display unit 30 due to an input to the touch sensor 40, the input device 1 according to the present embodiment presents a tactile sensation based on the change in the image. This is because when an input is made to the touch sensor 40 corresponding to the position of the image of the object displayed on the display unit 30 to make the operator visually recognize that the touch input is accepted by the object, Based on changing and displaying the object image. Such an image that changes the image of the object can be displayed by changing the color or brightness of the object depending on the application. Embodiments are possible.

  Further, the input device 1 according to the present embodiment notifies the application execution unit 20 of the position of the input to the touch sensor 40 when the pressing load of the input to the touch sensor 40 satisfies a predetermined load standard. As described above, when the input pressing load on the touch sensor 40 satisfies a predetermined standard, the application execution unit 20 is notified of the input position in such a case. This is based on the fact that it can be considered that a pressing (pushing) operation has been performed.

  3-5 is a flowchart which shows operation | movement of the input device 1 which concerns on this Embodiment. The operation of the input device 1 according to the present embodiment can be separated into an operation involving the application execution unit 20 and an operation not involving the application execution unit 20. 4 shows an operation involving the application execution unit 20, and FIGS. 3 and 5 show an operation not involving the application execution unit 20. FIG.

  In performing the operation of the input apparatus 1 according to the present embodiment, it is assumed that an image of an object such as a key is displayed on the display unit 30 in advance in order to accept an input with an operator's finger or the like. At this time, the application execution unit 20 supplies display data of each object constituting the GUI to the display control unit 12 via the display change detection unit 16. Then, the display control unit 12 controls the display unit 30 to display (draw) an image of each object based on the display data of the object supplied from the application execution unit 20. As described above, the application used in the present embodiment is an existing application that configures a GUI using a touch sensor and does not support the presentation of a tactile sensation. A case where a change corresponding to the change is used will be described.

  When starting the operation of the input device 1 according to the present embodiment, first, the control unit 10 monitors the presence or absence of touch input to the touch sensor 40. At the same time, the control unit 10 controls the display change detection unit 16 to monitor a change in an image (display image) displayed on the display unit 30.

  From the time when the input device 1 waits for the touch input of the touch surface of the touch sensor 40 by the operator's finger or the like in the state where the preparation as described above is completed, the input device 1 according to the present embodiment The operation starts.

  First, as illustrated in FIG. 3, when the operation of the input device 1 according to the present embodiment starts, the control unit 10 determines whether or not there has been a touch input to the touch surface of the touch sensor 40 by an operator's finger or the like. (Step S10). If it is determined in step S10 that there is a touch input on the touch surface of the touch sensor 40, the touch sensor 40 notifies the control unit 10 of the position of the touch input on the touch surface. Thereby, the control part 10 can detect the position of the touch input with respect to the touch sensor 40 (step S12). However, at this point, the control unit 10 does not yet notify the application execution unit 20 of the detected input position.

  When the position of the touch input is detected in step S12, the tactile sensation control unit 14 determines whether or not the pressure load detected by the load detection unit 60 satisfies a predetermined load standard while increasing due to the pressure on the touch surface of the touch sensor 40. Is determined (step S14). For example, the load detection unit 60 detects the load from the average value of the outputs of the four strain gauge sensors 51. Here, the load satisfying the predetermined load standard is set in advance to a value such as 1N (Newton) based on the pressing load when the operator performs a normal pressing operation, and the setting can be changed thereafter. Is preferred. In addition, the predetermined load standard is set so as not to set an excessively low standard in consideration of a pressing load at the time of pressing input based on the operator's intention (for example, an average value). This is to prevent the operation when the operator has touched lightly unintentionally (touch) from being accepted as a push (push) input, and to provide a pressure sensation for realistic tactile sensation described later. This is to give to the operator.

  When a pressing load satisfying the predetermined standard is not detected in step S14, the process returns to step S10, and the control unit 10 determines whether or not the touch sensor 40 still accepts a touch input. If the touch sensor 40 has received a touch input once, but the operator has removed his / her finger from the touch sensor 40, for example, when the touch input is not received without satisfying a predetermined load standard, the control unit 10 can change to FIG. End the indicated operation. That is, the application execution unit 20 is not notified of the touch input (touch input position). If the touch sensor 40 still accepts a touch input in step S10, the operation after step S12 is continued.

  On the other hand, when the load detection unit 60 detects a pressing load that satisfies the predetermined criterion in step S14, the control unit 10 indicates the detected input position and the start of execution of the predetermined process via the display change detection unit 16. To the application execution unit 20 (step S16). That is, in the above operation, the control unit 10 performs control so as to execute a predetermined process when the load detection unit 60 detects a pressing load that satisfies a predetermined load standard. Here, the “predetermined load standard” is a load standard for the tactile sensation providing unit 50 to provide a tactile sensation. The presentation of the tactile sensation will be described later. Here, “predetermined processing” refers to the application execution unit 20 that notifies the input position of the input to the touch sensor 40 and determines whether or not the input position corresponds to a predetermined position (object position). This is a process of instructing the application execution unit 20. The above-described operation illustrated in FIG. 3 is an operation that can be performed without involving the application execution unit 20.

  Next, the operation of the input device 1 shown in FIG. 4 will be described. FIG. 4 is a flowchart illustrating an operation performed subsequent to the operation illustrated in FIG. The operation illustrated in FIG. 4 starts when the position of the touch input in the touch sensor 40 is notified from the control unit 10 to the application execution unit 20. As illustrated in FIG. 4, when the position of the touch input in the touch sensor 40 is notified, the application execution unit 20 corresponds to the position where the image of an object such as a key is displayed in the current GUI. Is determined (step S20).

  In step S20, when the input position corresponds to the position where the object image is displayed, the application execution unit 20 sends display data for changing the object image to the display control unit 12 according to the setting based on the application. . When receiving this display data, the display control unit 12 controls the display unit 30 to change the image of the displayed object (step S22). That is, when there is a touch input to an object such as a key, the display image of the object is changed. When changing the display image of an object, for example, the operator makes a display as if the object is selected, or changes the color or brightness of the object, so that the operator touches (touches) a key or the like. It is preferable to make it visible. And the application execution part 20 performs a predetermined | prescribed process based on the notified position.

  On the other hand, if the input position does not correspond to the position where the object image is displayed in step S20, the application execution unit 20 ends the process without giving an instruction to change the object image. That is, when there is no touch input for an object such as a key, or when the touch input is not for an object such as a key, the application execution unit 20 does not change the display image of the object and does not execute a predetermined process. Then, the process ends. In this case, the image (display image) displayed on the display unit 30 does not change. The above-described operation illustrated in FIG. 4 is an operation performed with the application execution unit 20 involved.

  FIG. 5 is a flowchart for explaining the operation following FIG. After the operation shown in FIG. 4 is completed, as shown in FIG. 5, the display change detection unit 16 analyzes the image (display image) displayed on the display unit 30 to determine whether the display image has changed. Detect (step S30). Alternatively, at this time, the display change detection unit 16 determines, for example, whether or not the display image has changed based on display data supplied from the application execution unit 20 to the display control unit 12 via the display change detection unit 16. May be. When a change in the display image is detected in step S30 (that is, when there is a touch input to an object such as a key), the process proceeds to step S32.

  In step S30, whether or not the display image on the display unit 30 within a predetermined range has changed from the input to the touch surface of the touch sensor 40 when the display change detection unit 16 detects whether or not the display image has changed. May be detected. Here, the “predetermined range” from the input to the touch surface of the touch sensor 40 is, for example, “from the input position to the surrounding 5 mm”, depending on the input mode, and depending on the input position detection mode, A suitable value is set appropriately. The “input position” in this case can also be detected in various ways. When the touch input on the touch surface of the touch sensor 40 is detected in a state having an area, for example, the entire area can be set as the “input position”. Further, when a touch input is detected by a point, a value obtained by calculating, for example, the center of gravity of the area can be set as an “input position”. By such setting of the predetermined range, it is possible to detect only a change in the image existing around the input position.

  In step S32, the tactile sensation control unit 14 controls the tactile sensation providing unit 50 to generate a predetermined vibration on the touch surface of the touch sensor 40 under the control of the control unit 10 so as to present the tactile sensation (step S32). . By this control, the tactile sensation providing unit 50 presents a tactile sensation to the pressing target pressing the touch surface of the touch sensor 40. That is, in the above operation, when the display change detection unit 16 detects a change in the display image due to the execution of the predetermined process, the control unit 10 feels the touch target pressing the touch surface of the touch sensor 40. The tactile sensation providing unit 50 is controlled so as to present. The “predetermined process” is a process of notifying the application execution unit 20 of the input position with respect to the touch sensor 40 and determining whether or not the input position corresponds to a predetermined position (object position). This is processing for instructing the unit 20. The above-described operation illustrated in FIG. 5 is an operation that can be performed without involving the application execution unit 20.

  In the present embodiment, the tactile sensation presented by the tactile sensation providing unit 50 to the object to be pressed in step S24 is a tactile sensation similar to a click obtained when a mechanical push button switch or the like is pressed (hereinafter referred to as “click”). Can be referred to as “feel”. In order to present such a click tactile sensation to the operator, the input device 1 performs the following operation to stimulate the tactile sensation while stimulating the operator's pressure sensation. That is, the input device 1 stimulates the pressure sense until the load applied to the touch sensor 40 satisfies a reference (for example, 1N) that provides tactile sensation. The touch surface 40a is vibrated by being driven by the drive signal to stimulate the sense of touch. Thereby, the input device 1 can present to the operator a click feeling similar to that obtained when a button switch such as a push button switch (push button switch) is pressed. Therefore, even if the push button switch is drawn on the upper part of the touch sensor, the operator can perform an input operation on the touch sensor 40 while obtaining a realistic click feeling similar to that when the push button switch is operated. Can not feel uncomfortable. Further, since the input operation can be performed in conjunction with the consciousness of “pressing” the touch sensor 40, an input error due to simple pressing can be prevented.

  The drive signal when presenting the click sensation described above, that is, the constant frequency, period (wavelength), waveform, and amplitude for stimulating the sense of touch can be set as appropriate according to the click sensation presented. For example, when a tactile sensation represented by a metal dome switch used in a portable terminal is presented, for example, the tactile sensation providing unit 50 is driven by a drive signal for one cycle including a sine wave having a constant frequency of 170 Hz. The tactile sensation providing unit 50 is driven by such a drive signal, and the touch surface 40a is vibrated by about 15 μm in a state where a reference pressing load is applied. Thereby, it is possible to present the operator with a realistic click feeling as if the user had clicked on an actual key.

  On the other hand, when a change in the display image is not detected in step S30 (that is, when there is no touch input with respect to an object such as a key), the display change detection unit 16 does not issue an instruction to present the tactile sensation to the tactile sensation control unit 14. The process ends. As described above, the input device 1 according to the present embodiment provides the operator with no tactile sensation indicating that no pressing input to the object is accepted even if there is an input to a position other than the object such as a key. Can be recognized.

  FIG. 6 is a diagram for explaining the operation of the input apparatus 1 according to this embodiment. FIG. 6 is a diagram schematically showing a pressing load until an operator's finger starts touch input on an object such as a key and then cancels the touch input, similarly to FIG. 8 described above. In FIG. 6, the meanings of symbols and the like are the same as those in FIG. In FIG. 6, the “predetermined load reference” of the pressing load described above is indicated as Pth.

  FIG. 6A is a diagram illustrating the operation of the input device 1 with respect to an operation in which the operator intends to press (push) the object of the touch sensor 40.

  In FIG. 6A, time point (1) indicates the moment when the operator touches (touches) an object such as a key, that is, the moment when touch input is received. At this time (1), even if an input is received for the object, the control unit 10 of the input device 1 does not notify the application execution unit 20 of the position of the input. Thereafter, it is shown that the pressing load detected by the load detection unit 60 is increased from the time point (1) to the time point (2) because the operator increases the pressing load on the touch sensor 20.

  Since the pressing load detected by the load detection unit 60 satisfies the predetermined load reference Pth at the time (2), the control unit 10 notifies the application execution unit 20 of the input position. Since the input to the object is accepted here, when the position of the input is notified at this point (2), the application execution unit 20 changes the display image of the object and executes a predetermined process by an operation based on the application. To do. Since the display change detection unit 16 detects that the display image of the object has changed in this way, the tactile sensation providing unit 50 of the input device 1 presents a tactile sensation at the time (2). At the time point (2), the upward arrow (↑) shown below the time axis when the pressing load satisfies the predetermined load reference Pth indicates that a tactile sensation is presented by the vibration of the touch surface of the touch sensor 40. Represents. Since the operator can recognize that the predetermined processing has been executed by presenting the tactile sensation, the pressing load detected by the load detecting unit 60 is also reduced until time (3) by reducing the pressing load on the touch sensor 20. It shows that it is decreasing.

  At the time point (3), when the operator weakens the pressure, the input is canceled and the pressure load detected by the load detection unit 60 becomes zero (or the time when the input to the touch sensor 40 is not detected). Is shown. Note that the “predetermined process” at the time point (2) is a process related to an operation of displaying the input character on the display unit when, for example, an application that performs character input is operating. In addition, while waiting for the start of the operation based on the application, when an input to the key for starting the operation is received, the “predetermined process” is a process for starting the operation based on the application. .

  Therefore, in this case, the operator can obtain tactile feedback in accordance with his / her press input, and a predetermined process is started based on the press input. For this reason, the operator can confirm from his / her tactile sensation that his / her own press is properly received by the input device and the predetermined process has started.

  Even if the operator performs an input satisfying a predetermined load criterion at a position that does not correspond to the object in the touch sensor 40, the application execution unit 20 displays the display image of the object at the time (2). Do not change. Therefore, in this case, the display change detection unit 16 that does not detect a change in the display image does not issue an instruction to present the tactile sensation to the tactile sensation control unit 14, and therefore no tactile sensation is presented at the time point (2).

  On the other hand, FIG. 6B is a diagram for explaining the operation of the input apparatus 1 when the operator performs an operation of lightly touching (touching) the object of the touch sensor 40 unintentionally, for example. is there.

  In FIG. 6B, time point (1) indicates the moment when the operator touches (touches) an object such as a key. At this time point (1), even if an input is received for the object, the pressing load does not satisfy the predetermined load reference Pth, so the control unit 10 of the input device 1 sets the position of the input to the application execution unit 20. Do not notify.

  In FIG. 6B, since the pressing load detected by the load detection unit 60 does not satisfy the predetermined load reference Pth, there is no time point (2) indicating the moment when the input device 1 presents a tactile sensation. That is, in FIG. 6B, since the pressing load does not satisfy the predetermined load standard Pth, the position of the touch input with respect to the touch sensor 40 is notified to the control unit 10, but not to the application execution unit 20. . Therefore, in this case, the application execution unit 20 does not change the display image of the object by the operation based on the application. Further, in this case, since the display change detection unit 16 does not detect a change in the display image of the object, the tactile sensation providing unit 50 of the input device 1 does not present a tactile sensation.

  At the time point (3 ′), the input is released due to the operator's pressure being weakened, and the moment when the pressure load detected by the load detection unit 60 becomes zero (or the moment when the input to the touch sensor 40 is not detected). ). In this case, the position of the touch input with respect to the touch sensor 40 is not notified to the application execution unit 20 after all. Therefore, in this case, the application execution unit 20 does not determine that an input has been performed on the object until the time (3 ′), and therefore does not execute the process assigned to the object.

  As described above, when the input device 1 according to the present embodiment receives an input for pressing an object with a pressing load that does not satisfy the predetermined load reference Pth and then the pressing is released, the input device 1 presents a tactile sensation. Also, the predetermined process assigned to the object is not executed. Therefore, in this case, the inconvenience that the operator obtains tactile feedback according to his / her pressing input but the predetermined process is not executed is solved.

  In addition, when the operator unintentionally touches the position of the object lightly on the touch panel 40, the tactile sensation is not presented, and the operation when the input is accepted by the object is not performed. Therefore, an unintended tactile sensation is not presented with the operator's erroneous operation, and the operator does not misunderstand.

  In addition, this invention is not limited only to the said embodiment, Many deformation | transformation or a change is possible. For example, in the above-described embodiments, the configuration in which the display change detection unit 16 is included in the control unit 10 has been described. However, the input device according to the present invention is not limited to such a configuration, and various configurations can be adopted in accordance with a design requirement. For example, as illustrated in FIG. 7, the control unit 10 may include a display change detection unit 70 on the application execution unit 20 side without including the display change detection unit 16. Thus, the structural relationship between the display change detection unit and the control unit can be changed and designed as appropriate.

  In the above-described embodiment, the load detection unit 60 detects that the input is released at the time point (3) or (3 ′). However, the release of this input can be determined that the input has been released, for example, when the touch input detected for the touch sensor 40 is no longer detected, even if the load detection unit 60 does not detect it. .

  Moreover, in the said embodiment, although the touch input with respect to the touch surface of the said touch sensor was detected using the touch sensor 40, when the reference | standard of a predetermined pressing load was satisfy | filled using the load sensor (load detection part) It can also be determined that an input has been made. Such a load detection unit can be configured by using an arbitrary number of strain gauge sensors and the like, similarly to the load detection unit of each embodiment described above.

  Moreover, in each embodiment mentioned above, a load detection part can be comprised according to the input detection system in a touch sensor. For example, in the case of the resistance film method, if a load can be detected from a change in an output signal based on a change in resistance due to a contact area, it can be configured without using a strain gauge sensor. Alternatively, in the case of the electrostatic capacity method, even when the load can be detected from the change in the output signal based on the change in the electrostatic capacity, it can be configured without using the strain gauge sensor.

  In addition, the tactile sensation providing unit may be configured using an arbitrary number of piezoelectric vibrators, or may be configured by providing a transparent piezoelectric element on the entire surface of the touch sensor, or can express vibration that presents tactile sensation. Can be configured to rotate once in one cycle of the drive signal. Furthermore, when the load detection unit and the tactile sensation providing unit are configured using a piezoelectric element, the load detection unit and the tactile sensation providing unit can be configured by sharing the piezoelectric element.

  In each of the above-described embodiments, the description has been made assuming the configuration in which the touch sensor is disposed so as to overlap the upper surface of the display unit. However, the input device according to the present invention does not necessarily have such a configuration, and the touch sensor and the display unit may be separated.

  The present invention can also be effectively applied to an input device that functions as a touch switch in which a touch sensor performs an on / off operation.

  Further, the input device according to the present invention drives the piezoelectric element when the pressing load detected based on the output of the piezoelectric element satisfies the first criterion for presenting tactile sensation. Here, the time when the pressing load detected based on the output of the piezoelectric element satisfies the first criterion for presenting a tactile sensation is when the detected pressing load reaches a reference value for presenting a tactile sensation. Alternatively, it may be when the detected pressing load exceeds a reference value for presenting tactile sensation, or when a reference value for presenting tactile sensation is detected based on the output of the piezoelectric element. Similarly, when the second criterion described above is satisfied, the detected pressing load may reach a reference value, or the detected pressing load may be less than the reference value (or the reference). Or when the reference value is detected.

DESCRIPTION OF SYMBOLS 1 Input device 10 Control part 12 Display control part 14 Touch control part 16 Display change detection part 20 Application execution part 30 Display part 40 Touch sensor 40a Touch surface 50 Touch display part 51 Strain gauge sensor 52 Piezoelectric vibrator 60 Load detection part 61 Case Body 62 Insulator 63 Upper cover 64 Insulator

Claims (2)

A touch sensor;
A load detection unit for detecting a pressing load on the touch surface of the touch sensor;
A display unit;
A display change detection unit for detecting a change in a display image of the display unit;
A tactile sensation providing unit that vibrates the touch surface of the touch sensor;
When the load detection unit detects a pressing load that satisfies a load standard that presents a tactile sensation, a control unit that controls to execute a predetermined process;
With
When the display change detection unit detects a change in the display image due to the execution of the predetermined process, the control unit causes the tactile sensation providing unit to present a tactile sensation to the pressing target pressing the touch surface. Control,
An input device characterized by that.   The input device according to claim 1, wherein the predetermined process is a process for instructing whether or not a position of an input to the touch sensor corresponds to a predetermined position.

Images