US20190138100A1 - Input apparatus and control method for input apparatus - Google Patents

Input apparatus and control method for input apparatus Download PDF

Info

Publication number
US20190138100A1
US20190138100A1 US16/239,299 US201916239299A US2019138100A1 US 20190138100 A1 US20190138100 A1 US 20190138100A1 US 201916239299 A US201916239299 A US 201916239299A US 2019138100 A1 US2019138100 A1 US 2019138100A1
Authority
US
United States
Prior art keywords
touch
touch sensor
input
piezoelectric element
tactile sensation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US16/239,299
Inventor
Tomotake Aono
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kyocera Corp
Original Assignee
Kyocera Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kyocera Corp filed Critical Kyocera Corp
Priority to US16/239,299 priority Critical patent/US20190138100A1/en
Assigned to KYOCERA CORPORATION reassignment KYOCERA CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AONO, TOMOTAKE
Publication of US20190138100A1 publication Critical patent/US20190138100A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0414—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position
    • G06F3/04142—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using force sensing means to determine a position the force sensing means being located peripherally, e.g. disposed at the corners or at the side of a touch sensing plate
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04105—Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position

Definitions

  • the present disclosure relates to an input apparatus having a touch sensor and a control method for an input apparatus.
  • input apparatus such as operation units, switches and the like having touch sensors such as touch panels, touch switches and the like to receive input operations by users have been widely used for mobile terminals such as mobile phones, information equipment such as calculators and ticket vending machines, home electric appliances such as microwaves, TV sets and lighting equipment, industrial equipment (FA equipment) and the like.
  • touch sensors such as a resistive film type, a capacitive type, an optical type and the like.
  • touch sensors of these types receive a touch input by a finger or a stylus pen and, unlike push-button switches, the touch sensors themselves are not physically displaced even when being touched.
  • Patent Document 1 Japanese Patent Laid-Open No. 2003-288158
  • Patent Document 2 Japanese Patent Laid-Open No. 2008-130055
  • the techniques disclosed in the above Patent Documents 1 and 2 merely vibrate the touch sensor when the touch sensor receives an input. Therefore, in using the input apparatus having the button switch such as a mechanical push-button switch (push-type button switch) graphically depicted on the touch sensor having a low threshold to receive the input, a tactile sensation is provided when the finger or the like lightly contacts (touches) the touch sensor. It may trigger erroneous operations by responding to an unintentional motion (touch) before the operator pushes the touch sensor and bring a feeling of strangeness to the operator upon such an unintentional motion (touch).
  • the threshold for the touch sensor to receive a touch input is a threshold at which the touch sensor responds.
  • the threshold is a threshold of a pressure at which an upper conductive film is contacted to a lower conductive film and, for a touch sensor of the capacitive type, the threshold is a threshold for detection of an electric signal by contact.
  • the applicant has developed an input apparatus which detects the pressure load of touch to the touch face of the touch sensor and, when the detected load reaches a predetermined threshold to provide the tactile sensation, vibrates the touch face of the touch sensor such that the tactile sensation is provided to a pressing object such as the finger and the like.
  • this input apparatus since the tactile sensation is provided when the operator pushes the touch face and the pressure load reaches the predetermined threshold, it is possible to allow the operator to perceive reception of an input while reliably preventing erroneous operations triggered by the unintentional touch described above and the feeling of strangeness.
  • the input apparatus needs a load sensor to detect the pressure load on the touch sensor and an actuator to vibrate the touch sensor in addition to basic components such as the touch sensor and a control unit.
  • An object of the present disclosure in consideration of such issues, is to provide an input apparatus and a control method of the input apparatus appropriately configured to enable cost reduction and downsizing
  • an input apparatus includes:
  • a touch sensor configured to detect a touch input
  • control unit configured to detect a pressure load on a touch face of the touch sensor based on an output signal of the piezoelectric element and, when the pressure load detected satisfies a standard to provide a tactile sensation, to drive the piezoelectric element such that the tactile sensation is provided to an object pressing the touch face.
  • a second aspect of the present disclosure is the input apparatus according to the first aspect, wherein the piezoelectric element has one end mounted on the touch sensor and the other end opened.
  • a control method of an input apparatus including a touch sensor configured to detect a touch input and a piezoelectric element having one end mounted on the touch sensor and the other end opened, includes the step of: detecting a pressure load on a touch face of the touch sensor based on an output signal of the piezoelectric element and, when the pressure load detected satisfies a standard to provide a tactile sensation, driving the piezoelectric element such that the tactile sensation is provided to an object pressing the touch face.
  • the input apparatus uses the piezoelectric element as a load sensor to detect the pressure load on the touch face of the touch sensor and as an actuator to vibrate the touch face, thereby sharing one component for a plurality of functions. It is thus possible to reduce the number of components and the cost as well as to save space for the components achieving downsizing of the apparatus.
  • FIG. 1 is a functional block diagram illustrating a schematic configuration of an input apparatus according to one embodiment of the present disclosure
  • FIG. 2 illustrates a cross-sectional view of a main section and a plane view of the main section that illustrate an exemplary housing structure of a touch sensor, piezoelectric elements and a display unit illustrated in FIG. 1 ;
  • FIG. 3 is a flowchart illustrating a schematic operation of the input apparatus illustrated in FIG. 1 .
  • FIG. 1 is a functional block diagram illustrating a schematic configuration of an input apparatus according to one embodiment of the present disclosure.
  • the input apparatus has a touch sensor 11 , a piezoelectric element 12 , a display unit 13 , and a control unit 14 to control an operation of each unit.
  • the touch sensor 11 Under control of the control unit 14 , the touch sensor 11 detects a touch input to a touch face of the touch sensor 11 by a pressing object, such as a finger and the like, and provides the control unit 14 with position information of a touch position.
  • the touch sensor 11 may be of a known type, such as a resistive film type, a capacitive type, an optical type and the like, and disposed on the display unit 13 .
  • the piezoelectric element 12 is mounted on the touch sensor 11 . Under control of the control unit 14 , the piezoelectric element 12 is activated in one of a load detection mode to detect the pressure load on the touch face of the touch sensor 11 by utilizing direct piezoelectric effect or a tactile sensation providing mode to vibrate the touch face of the touch sensor 11 by utilizing converse piezoelectric effect.
  • the load detection mode the piezoelectric element 12 supplies the control unit 14 with an output signal corresponding to the pressure load on the touch face of the touch sensor 11 .
  • the tactile sensation providing mode the piezoelectric element 12 vibrates the touch face of the touch sensor 11 based on a drive signal supplied from the control unit 14 such that a predetermined tactile sensation corresponding to the drive signal is provided to the pressing object pressing the touch face.
  • the display unit 13 displays an input object of an input button and the like such as a push-button switch (push-type button switch) and may be constituted by using, for example, a liquid crystal display panel, an organic EL display panel and the like.
  • the touch input to the input object displayed on the display unit 13 is detected by the control unit 14 based on the position information output from the touch sensor 11 .
  • the control unit 14 may be, for example, a CPU and the like and controls the operation of each unit based on the position information from the touch sensor 11 , display information for the display unit 13 , the output signal corresponding to the pressure load obtained from the piezoelectric element 12 in the load detection mode, and the like.
  • FIG. 2 illustrates an exemplary housing structure of the touch sensor 11 , the piezoelectric elements 12 and the display unit 13 illustrated in FIG. 1 ;
  • FIG. 2( a ) is a cross-sectional view of a main section, and
  • FIG. 2( b ) is a plane view of the main section.
  • the display unit 13 is contained in a housing 21 .
  • the touch sensor 11 is disposed on the display unit 13 via insulators 22 made of elastic members. According to the present embodiment, the touch sensor 11 is disposed on the display unit 13 via the insulators 22 arranged at four corners outside a display area A of the display unit 13 illustrated by a chain double-dashed line in FIG. 2( b ) .
  • the housing 21 is provided with an upper cover 23 covering a surface area of the touch sensor 11 outside the display area of the display unit 13 .
  • An insulator 24 for dust-proof made of elastic member is arranged between the upper cover 23 and the touch sensor 11 .
  • the touch sensor 11 illustrated in FIG. 2 may have, for example, a surface member having a touch face 11 a and made of a transparent film or the glass, and a rear face member made of the glass or acryl.
  • the touch sensor 11 is designed such that, when the touch face 11 a is pressed down via the insulator 24 , a pushed part is slightly bent (strained) in accordance with pressure and thereby an entire touch sensor 11 including the rear face member is slightly bent.
  • Each piezoelectric element 12 is provided on the rear face of the touch sensor 11 at a position covered by the upper cover 23 and close to one or a plurality of peripheries, here it is three peripheries. These three piezoelectric elements 12 are connected to the control unit 14 in parallel. Each of the piezoelectric elements 12 detects the pressure load on the touch face 11 a of the touch sensor 11 and vibrates the touch sensor 11 such that the tactile sensation is provided to the pressing object pressing the touch face 11 a . It is to be noted that the housing 21 , the upper cover 23 and the insulator 24 illustrated in FIG. 2( a ) are omitted in FIG. 2( b ) .
  • FIG. 3 is a flowchart of a schematic operation of the input apparatus according to the present embodiment.
  • the control unit 14 sets the three piezoelectric elements 12 in the load detection mode constantly and monitors the output signals of them (step S 301 ).
  • the control unit 14 monitors output of the touch sensor 11 and detects whether the position information of the touch input by the pressing object (pressing means) such as the finger and the like obtained from the touch sensor 11 indicates an input to a position corresponding to the input object displayed on the display unit 13 (step S 302 ).
  • step S 303 when the position information from the touch sensor 11 indicates that it is an input to a position corresponding to the input object displayed on the display unit 13 (in case of “Yes”), a display state, such as color and the like, of the input object on the display unit 13 is changed (step S 303 ).
  • the control unit 14 calculates the pressure load on the touch sensor 11 based on the output of the three piezoelectric elements 12 and determines whether the pressure load satisfies a standard (for example, 1 N) to provide the tactile sensation (step S 304 ). As a result, when detecting that the pressure load satisfies the standard (in case of “Yes”), the control unit 14 switches the three piezoelectric elements 12 from the load detection mode to the tactile sensation providing mode (step S 305 ). Subsequently, the control unit 14 drives the three piezoelectric elements 12 by supplying (applying) them with respective predetermined drive signals. Thereby, the touch sensor 11 is vibrated and provides the tactile sensation to the pressing object touching the touch face 11 a (step S 306 ). Then, the control unit 14 switches the three piezoelectric elements 12 back to the load detection mode (step S 307 ) and calculates the pressure load on the touch sensor 11 .
  • a standard for example, 1 N
  • the pressure load is calculated based on the output of the three piezoelectric elements 12 , such that approximately the same calculation result is obtained when an operator feels nearly the same pressure sensation (hard feeling, soft feeling and the like) at each position on the touch face 11 a .
  • the control unit 14 calculates the pressure load based on, for example, an average value of the output of the three piezoelectric elements, a weighted additional value and the like.
  • the drive signals are applied to the respective three piezoelectric elements 12 that the operator preferably obtains nearly the same pressure sensation and nearly the same touch sensation (feeling of texture and the like) at each position on the touch face 11 a . Therefore, the control unit 14 appropriately changes amplitude, a phase and the like in accordance with a position and a location on the touch face 11 a such that an approximately the same tactile sensation in combination of the pressure sensation and the touch sensation is provided.
  • the standard of the pressure load to provide the tactile sensation may be appropriately set in accordance with a load characteristic of an intended push-button switch in pressing.
  • the standard may be set to be equal to a load at which the touch sensor 11 responds to the touch input (synchronizing a timing to provide the tactile sensation with a timing of response to the touch input by the touch sensor 11 ) or to be higher than the load at which the touch sensor 11 responds to the touch input (setting the timing to provide the tactile sensation later than the timing of response to the touch input by the touch sensor 11 ).
  • the standard is set by users as desired such that an elder user may set it heavier (slower) and a user who often writes messages may set it lighter (quicker).
  • the tactile sensation provided at step S 306 may be appropriately set based on the drive signal applied to the piezoelectric elements 12 .
  • the control unit 14 drives the piezoelectric elements 12 as follows. That is, upon application of the pressure load satisfying the standard set forth above, the drive signal, for example, a sine wave with a constant frequency of, for example, 100 Hz to 200 Hz, preferably 170 Hz, for 1 period is applied to the piezoelectric elements 12 such that the touch face 11 a is vibrated by approximately 15 ⁇ m while the pressure load satisfying the standard is applied thereto.
  • the drive signal for example, a sine wave with a constant frequency of, for example, 100 Hz to 200 Hz, preferably 170 Hz, for 1 period is applied to the piezoelectric elements 12 such that the touch face 11 a is vibrated by approximately 15 ⁇ m while the pressure load satisfying the standard is applied thereto.
  • the control unit 14 applies the drive signal, for example, a sine wave or a square wave with a frequency of, for example, approximately 200 Hz to 500 Hz, for 1 period to the piezoelectric elements 12 .
  • the control unit 14 does not drive the piezoelectric elements 12 until the load applied to the touch sensor 11 calculated based on the output of the piezoelectric elements 12 satisfies the standard to provide the tactile sensation (for example, 1 N). Thereby, a tactile sense of the operator is stimulated. Then, when the load detected satisfies the standard, the control unit 14 drives the piezoelectric elements 12 with the predetermined drive signals and vibrates the touch face 11 a . Thereby, the click sensation is provided to the operator by stimulating the touch sense of the operator such that the operator recognizes that the input operation is completed.
  • the operator inputs to the touch sensor 11 feeling the realistic click sensation similar to that obtained when operating the push-button switch.
  • the operator may not have the feeling of strangeness.
  • the operator since the operator carries out the input operation in conjunction with perception to “have pressed” the touch sensor 11 , erroneous input caused by mere tapping is prevented.
  • the control unit 14 determines an input position according to a touch operation to the touch face 11 a and changes the display state of the input object at a corresponding portion on the display unit 13 .
  • the control unit 14 drives the piezoelectric elements 12 to provide the tactile sensation and also execute a predetermined operation (for example, execution and processing of a program corresponding to the object) by confirming the input position.
  • a predetermined operation for example, execution and processing of a program corresponding to the object
  • the operator confirms that the input object is selected, by seeing a change of the display state of the input object displayed on the display unit 13 .
  • the click sensation is provided to the operator upon pressing the touch face 11 a , the operator recognizes that the input object selected is determined (executed). Thereby, it is possible to prevent erroneous inputs by a so-called wandering finger.
  • the control unit 14 In providing the click sensation of the push-button switch as described above, the control unit 14 , after switching the three piezoelectric elements 12 back in the load detection mode at step S 307 , switches them in the tactile sensation providing mode when the pressure load fails to satisfy the standard in releasing as well. Then, the control unit 14 drives the three piezoelectric elements 12 with the drive signals, the same as those in pressing, such that the click sensation described above (a release sensation, at this time) is provided. Thereby, it is possible to provide a more realistic click sensation bringing the sensation “Cli” in pressing and a sensation “Ck” in releasing. It is to be appreciated that the drive signals for the release sensation do not need to be the same as those for the click sensation.
  • the standard of the load to provide the release sensation may be set to be the same as the standard to provide the click sensation set forth above, it is preferable to set the standard of the load to provide the release sensation to be 50-80% lower than that to provide the click sensation in pressing.
  • timings to provide the tactile sensation are synchronized with timings of sequential inputs when the same position (input object) is continuously input (tapped), providing the realistic click sensation without the feeling of strangeness. That is, setting the standard of the load to provide the tactile sensation in releasing to be smaller than that to provide the tactile sensation in pressing enables to prevent the feeling of strangeness.
  • setting the standard of the load to provide the tactile sensation in releasing to be approximately 50% or more of that to provide the tactile sensation in pressing contributes to a significant improvement in operability in the continuous input.
  • setting the standard of the load to provide the tactile sensation in releasing to be approximately 80% or less of that to provide the tactile sensation in pressing enables to deal with a faint load change in a holding state in the continuous input.
  • the piezoelectric elements 12 provide not only the click sensation but also a variety of tactile sensations by changing the drive signal.
  • the drive signal for example, a sine wave with a frequency of approximately 200 Hz to 500 Hz, for two or three periods is applied.
  • the drive signal for example, a sine wave with a frequency of approximately 200 Hz to 500 Hz, for four or more periods is applied.
  • information on the drive signals to provide those various tactile sensations is stored in a memory unit (not illustrated) such that the user arbitrarily set the drive signal to provide a desired tactile sensation.
  • the tactile sensations “Cli”, “Ck”, “Click”, the “throbbing” sensation, the “jelly-like” sensation and the “vibrating” sensation set forth in the present specification are sensations obtained by the operator described in Japanese. Examples of drive signals to provide actual tactile sensations are set forth above.
  • the piezoelectric element 12 is used for a plurality of functions as a load sensor to detect the pressure load on the touch face 11 a of the touch sensor 11 and as an actuator to vibrate the touch face 11 a , the number of components and cost are reduced. In addition, reduction of the number of components saves space for the components, which leads to downsizing of the apparatus.
  • the present disclosure is not limited to the embodiment set forth above and various modifications and changes may be implemented.
  • the piezoelectric element may have a known configuration such as monomorph, unimorph, bimorph and a laminated type, based on a size, vibration amplitude and the like of the touch sensor 11 .
  • the present disclosure is effectively applicable to an input apparatus in which the touch sensor serves as a touch switch for on/off operations.
  • the input apparatus according to the present disclosure is capable of providing feelings of a multistep switch, such as a two-step switch (pressed further after pressed), by sequentially providing the click sensation on different standards (loads) while the touch sensor is being pressed.
  • a multistep switch such as a two-step switch (pressed further after pressed)
  • the input apparatus changes a display of a menu screen and the like in a variety of manners in accordance with the steps of pressing.
  • the input apparatus drives the piezoelectric element when the pressure load detected based on the output of the piezoelectric element satisfies a standard to provide the tactile sensation.
  • “when the pressure load detected based on the output of the piezoelectric element satisfies the standard to provide the tactile sensation” may include either “when the pressure load detected reaches a standard value to provide the tactile sensation”, “when the pressure load detected exceeds the standard value to provide the tactile sensation”, or “when the standard value to provide the tactile sensation is detected based on the output of the piezoelectric element”.

Abstract

An input apparatus has a touch sensor 11 configured to detect a touch input, a piezoelectric element 12 mounted on the touch sensor 11, and a control unit 15 configured to detect a pressure load on a touch face 11 a of the touch sensor 11 based on an output signal of the piezoelectric element 12 and, when the pressure load detected satisfies a standard to provide a tactile sensation, to drive the piezoelectric element 12 such that the tactile sensation is provided to an object pressing the touch face 11 a.

Description

    CROSS REFERENCE TO RELATED APPLICATION
  • This application is a Continuation Application of U.S. patent application Ser. No. 13/392,867, filed Feb. 27, 2012, which is the U.S. National Phase of International Application No. PCT/JP2010/005277 filed Aug. 26, 2010, which claims priority to and the benefit of Japanese Patent Application No. 2009-197132 filed on Aug. 27, 2009, the entire contents of which are incorporated herein by reference.
    • TECHNICAL FIELD
  • The present disclosure relates to an input apparatus having a touch sensor and a control method for an input apparatus.
    • BACKGROUND ART
  • In recent years, input apparatus such as operation units, switches and the like having touch sensors such as touch panels, touch switches and the like to receive input operations by users have been widely used for mobile terminals such as mobile phones, information equipment such as calculators and ticket vending machines, home electric appliances such as microwaves, TV sets and lighting equipment, industrial equipment (FA equipment) and the like.
  • There are known a variety of types of those touch sensors, such as a resistive film type, a capacitive type, an optical type and the like. However, touch sensors of these types receive a touch input by a finger or a stylus pen and, unlike push-button switches, the touch sensors themselves are not physically displaced even when being touched.
  • Since the touch sensors themselves are not physically displaced when touched, an operator cannot obtain feedback to an input even though the touch input is received. As a result, the operator is likely to input erroneously by touching the same spot multiple times, which may be stressful for the operator.
  • As methods to prevent such erroneous inputs, there are known methods allowing to visually or aurally confirm the input operation upon reception of the touch input by, for example, generating sounds or changing a display state such as color of input object of input button and the like graphically depicted on a display unit.
  • However, such auditory feedback may be difficult to be confirmed in a noisy environment and is not applicable when the equipment being used is in a silent mode. In addition, in using such visual feedback, when the operator is inputting by the finger, if the input object displayed on the display unit is small, the operator may not be able to confirm the change in the display state, as a view of the input object is blocked by the finger.
  • There is also suggested a feedback method relying on neither the auditory- nor visual sensation but instead generating a tactile sensation at operator's fingertip by vibrating the touch sensor when the touch sensor receives an input (for example, see Patent Documents 1, 2).
    • RELATED ART DOCUMENTS Patent Documents
  • Patent Document 1: Japanese Patent Laid-Open No. 2003-288158
  • Patent Document 2: Japanese Patent Laid-Open No. 2008-130055
    • SUMMARY OF DISCLOSURE Technical Problem
  • The techniques disclosed in the above Patent Documents 1 and 2, however, merely vibrate the touch sensor when the touch sensor receives an input. Therefore, in using the input apparatus having the button switch such as a mechanical push-button switch (push-type button switch) graphically depicted on the touch sensor having a low threshold to receive the input, a tactile sensation is provided when the finger or the like lightly contacts (touches) the touch sensor. It may trigger erroneous operations by responding to an unintentional motion (touch) before the operator pushes the touch sensor and bring a feeling of strangeness to the operator upon such an unintentional motion (touch). Here, the threshold for the touch sensor to receive a touch input is a threshold at which the touch sensor responds. For example, for a touch sensor of the resistive film type, the threshold is a threshold of a pressure at which an upper conductive film is contacted to a lower conductive film and, for a touch sensor of the capacitive type, the threshold is a threshold for detection of an electric signal by contact.
  • In order to clear such a disadvantage, the applicant has developed an input apparatus which detects the pressure load of touch to the touch face of the touch sensor and, when the detected load reaches a predetermined threshold to provide the tactile sensation, vibrates the touch face of the touch sensor such that the tactile sensation is provided to a pressing object such as the finger and the like.
  • According to this input apparatus, since the tactile sensation is provided when the operator pushes the touch face and the pressure load reaches the predetermined threshold, it is possible to allow the operator to perceive reception of an input while reliably preventing erroneous operations triggered by the unintentional touch described above and the feeling of strangeness.
  • Incidentally, the input apparatus needs a load sensor to detect the pressure load on the touch sensor and an actuator to vibrate the touch sensor in addition to basic components such as the touch sensor and a control unit. This leads to increase in the number of components and cost as well as a size of the apparatus to retain necessary space for the components. Therefore, there is room for improvement in implementation of the input apparatus described above, in terms of the cost and downsizing of the input apparatus.
  • An object of the present disclosure, in consideration of such issues, is to provide an input apparatus and a control method of the input apparatus appropriately configured to enable cost reduction and downsizing
    • Solution to Problem
  • In order to achieve the above object, an input apparatus according to a first aspect of the present disclosure includes:
  • a touch sensor configured to detect a touch input;
  • a piezoelectric element mounted on the touch sensor; and
  • a control unit configured to detect a pressure load on a touch face of the touch sensor based on an output signal of the piezoelectric element and, when the pressure load detected satisfies a standard to provide a tactile sensation, to drive the piezoelectric element such that the tactile sensation is provided to an object pressing the touch face.
  • A second aspect of the present disclosure is the input apparatus according to the first aspect, wherein the piezoelectric element has one end mounted on the touch sensor and the other end opened.
  • Moreover, in order to achieve the above object, a control method of an input apparatus according to a third aspect of the present disclosure including a touch sensor configured to detect a touch input and a piezoelectric element having one end mounted on the touch sensor and the other end opened, includes the step of: detecting a pressure load on a touch face of the touch sensor based on an output signal of the piezoelectric element and, when the pressure load detected satisfies a standard to provide a tactile sensation, driving the piezoelectric element such that the tactile sensation is provided to an object pressing the touch face.
    • Effect of the Disclosure
  • The input apparatus according to the present disclosure, utilizing direct piezoelectric effect and converse piezoelectric effect of the piezoelectric element, uses the piezoelectric element as a load sensor to detect the pressure load on the touch face of the touch sensor and as an actuator to vibrate the touch face, thereby sharing one component for a plurality of functions. It is thus possible to reduce the number of components and the cost as well as to save space for the components achieving downsizing of the apparatus.
    • BRIEF DESCRIPTION OF DRAWINGS
  • FIG. 1 is a functional block diagram illustrating a schematic configuration of an input apparatus according to one embodiment of the present disclosure;
  • FIG. 2 illustrates a cross-sectional view of a main section and a plane view of the main section that illustrate an exemplary housing structure of a touch sensor, piezoelectric elements and a display unit illustrated in FIG. 1; and
  • FIG. 3 is a flowchart illustrating a schematic operation of the input apparatus illustrated in FIG. 1.
    •  DESCRIPTION OF EMBODIMENT
  • An embodiment of the present disclosure will be described with reference to the accompanying drawings.
  • FIG. 1 is a functional block diagram illustrating a schematic configuration of an input apparatus according to one embodiment of the present disclosure. The input apparatus has a touch sensor 11, a piezoelectric element 12, a display unit 13, and a control unit 14 to control an operation of each unit.
  • Under control of the control unit 14, the touch sensor 11 detects a touch input to a touch face of the touch sensor 11 by a pressing object, such as a finger and the like, and provides the control unit 14 with position information of a touch position. The touch sensor 11 may be of a known type, such as a resistive film type, a capacitive type, an optical type and the like, and disposed on the display unit 13.
  • The piezoelectric element 12 is mounted on the touch sensor 11. Under control of the control unit 14, the piezoelectric element 12 is activated in one of a load detection mode to detect the pressure load on the touch face of the touch sensor 11 by utilizing direct piezoelectric effect or a tactile sensation providing mode to vibrate the touch face of the touch sensor 11 by utilizing converse piezoelectric effect. In the load detection mode, the piezoelectric element 12 supplies the control unit 14 with an output signal corresponding to the pressure load on the touch face of the touch sensor 11. In the tactile sensation providing mode, the piezoelectric element 12 vibrates the touch face of the touch sensor 11 based on a drive signal supplied from the control unit 14 such that a predetermined tactile sensation corresponding to the drive signal is provided to the pressing object pressing the touch face.
  • Under control of the control unit 14, the display unit 13 displays an input object of an input button and the like such as a push-button switch (push-type button switch) and may be constituted by using, for example, a liquid crystal display panel, an organic EL display panel and the like. The touch input to the input object displayed on the display unit 13 is detected by the control unit 14 based on the position information output from the touch sensor 11.
  • The control unit 14 may be, for example, a CPU and the like and controls the operation of each unit based on the position information from the touch sensor 11, display information for the display unit 13, the output signal corresponding to the pressure load obtained from the piezoelectric element 12 in the load detection mode, and the like.
  • FIG. 2 illustrates an exemplary housing structure of the touch sensor 11, the piezoelectric elements 12 and the display unit 13 illustrated in FIG. 1; FIG. 2(a) is a cross-sectional view of a main section, and FIG. 2(b) is a plane view of the main section. The display unit 13 is contained in a housing 21. The touch sensor 11 is disposed on the display unit 13 via insulators 22 made of elastic members. According to the present embodiment, the touch sensor 11 is disposed on the display unit 13 via the insulators 22 arranged at four corners outside a display area A of the display unit 13 illustrated by a chain double-dashed line in FIG. 2(b).
  • The housing 21 is provided with an upper cover 23 covering a surface area of the touch sensor 11 outside the display area of the display unit 13. An insulator 24 for dust-proof made of elastic member is arranged between the upper cover 23 and the touch sensor 11.
  • The touch sensor 11 illustrated in FIG. 2 may have, for example, a surface member having a touch face 11 a and made of a transparent film or the glass, and a rear face member made of the glass or acryl. The touch sensor 11 is designed such that, when the touch face 11 a is pressed down via the insulator 24, a pushed part is slightly bent (strained) in accordance with pressure and thereby an entire touch sensor 11 including the rear face member is slightly bent.
  • Each piezoelectric element 12 is provided on the rear face of the touch sensor 11 at a position covered by the upper cover 23 and close to one or a plurality of peripheries, here it is three peripheries. These three piezoelectric elements 12 are connected to the control unit 14 in parallel. Each of the piezoelectric elements 12 detects the pressure load on the touch face 11 a of the touch sensor 11 and vibrates the touch sensor 11 such that the tactile sensation is provided to the pressing object pressing the touch face 11 a. It is to be noted that the housing 21, the upper cover 23 and the insulator 24 illustrated in FIG. 2(a) are omitted in FIG. 2(b).
  • FIG. 3 is a flowchart of a schematic operation of the input apparatus according to the present embodiment. The control unit 14 sets the three piezoelectric elements 12 in the load detection mode constantly and monitors the output signals of them (step S301). In addition, the control unit 14 monitors output of the touch sensor 11 and detects whether the position information of the touch input by the pressing object (pressing means) such as the finger and the like obtained from the touch sensor 11 indicates an input to a position corresponding to the input object displayed on the display unit 13 (step S302). As a result, when the position information from the touch sensor 11 indicates that it is an input to a position corresponding to the input object displayed on the display unit 13 (in case of “Yes”), a display state, such as color and the like, of the input object on the display unit 13 is changed (step S303).
  • Moreover, the control unit 14 calculates the pressure load on the touch sensor 11 based on the output of the three piezoelectric elements 12 and determines whether the pressure load satisfies a standard (for example, 1 N) to provide the tactile sensation (step S304). As a result, when detecting that the pressure load satisfies the standard (in case of “Yes”), the control unit 14 switches the three piezoelectric elements 12 from the load detection mode to the tactile sensation providing mode (step S305). Subsequently, the control unit 14 drives the three piezoelectric elements 12 by supplying (applying) them with respective predetermined drive signals. Thereby, the touch sensor 11 is vibrated and provides the tactile sensation to the pressing object touching the touch face 11 a (step S306). Then, the control unit 14 switches the three piezoelectric elements 12 back to the load detection mode (step S307) and calculates the pressure load on the touch sensor 11.
  • Preferably, at step S304, the pressure load is calculated based on the output of the three piezoelectric elements 12, such that approximately the same calculation result is obtained when an operator feels nearly the same pressure sensation (hard feeling, soft feeling and the like) at each position on the touch face 11 a. Accordingly, the control unit 14 calculates the pressure load based on, for example, an average value of the output of the three piezoelectric elements, a weighted additional value and the like. Similarly, at the step S306, such the drive signals are applied to the respective three piezoelectric elements 12 that the operator preferably obtains nearly the same pressure sensation and nearly the same touch sensation (feeling of texture and the like) at each position on the touch face 11 a. Therefore, the control unit 14 appropriately changes amplitude, a phase and the like in accordance with a position and a location on the touch face 11 a such that an approximately the same tactile sensation in combination of the pressure sensation and the touch sensation is provided.
  • At step S304, in addition, the standard of the pressure load to provide the tactile sensation may be appropriately set in accordance with a load characteristic of an intended push-button switch in pressing. For example, the standard may be set to be equal to a load at which the touch sensor 11 responds to the touch input (synchronizing a timing to provide the tactile sensation with a timing of response to the touch input by the touch sensor 11) or to be higher than the load at which the touch sensor 11 responds to the touch input (setting the timing to provide the tactile sensation later than the timing of response to the touch input by the touch sensor 11). For example, when the input apparatus according to the present embodiment is applied to a mobile terminal, it is preferable to set the standard equal to or higher than the load at which the touch sensor 11 responds to the touch input (setting the timing to provide the tactile sensation later than the timing of response to the touch input by the touch sensor 11). Preferably, the standard is set by users as desired such that an elder user may set it heavier (slower) and a user who often writes messages may set it lighter (quicker).
  • In addition, the tactile sensation provided at step S306 may be appropriately set based on the drive signal applied to the piezoelectric elements 12. For example, in order to provide a click sensation “Cli”, which is obtained when a push-button switch employed by the mobile terminal is pressed, the control unit 14 drives the piezoelectric elements 12 as follows. That is, upon application of the pressure load satisfying the standard set forth above, the drive signal, for example, a sine wave with a constant frequency of, for example, 100 Hz to 200 Hz, preferably 170 Hz, for 1 period is applied to the piezoelectric elements 12 such that the touch face 11 a is vibrated by approximately 15 μm while the pressure load satisfying the standard is applied thereto. Thereby, it is possible to allow the operator to recognize that an input operation is completed, by providing a realistic click sensation to the operator through the pressing object (pressing means) pressing the touch face 11 a of the touch sensor 11. Similarly, in order to provide another click sensation “Click”, which feels harder than the click sensation “Cli”, the control unit 14 applies the drive signal, for example, a sine wave or a square wave with a frequency of, for example, approximately 200 Hz to 500 Hz, for 1 period to the piezoelectric elements 12.
  • As described above, the control unit 14 does not drive the piezoelectric elements 12 until the load applied to the touch sensor 11 calculated based on the output of the piezoelectric elements 12 satisfies the standard to provide the tactile sensation (for example, 1 N). Thereby, a tactile sense of the operator is stimulated. Then, when the load detected satisfies the standard, the control unit 14 drives the piezoelectric elements 12 with the predetermined drive signals and vibrates the touch face 11 a. Thereby, the click sensation is provided to the operator by stimulating the touch sense of the operator such that the operator recognizes that the input operation is completed. Accordingly, even if the button switch such as the push-button switch (push-type button switch) is graphically depicted on the touch sensor, the operator inputs to the touch sensor 11 feeling the realistic click sensation similar to that obtained when operating the push-button switch. Thus, the operator may not have the feeling of strangeness. Moreover, since the operator carries out the input operation in conjunction with perception to “have pressed” the touch sensor 11, erroneous input caused by mere tapping is prevented.
  • In addition, when the standard of the pressure load to provide the tactile sensation is set higher than the load at which the touch sensor 11 responds to the touch input (setting the timing to provide the tactile sensation later than the timing of response to the touch input by the touch sensor 11), the control unit 14 determines an input position according to a touch operation to the touch face 11 a and changes the display state of the input object at a corresponding portion on the display unit 13. Then, when the pressure load on the touch face 11 a detected based on the output of the piezoelectric elements 12 satisfies the standard to provide the tactile sensation, the control unit 14 drives the piezoelectric elements 12 to provide the tactile sensation and also execute a predetermined operation (for example, execution and processing of a program corresponding to the object) by confirming the input position. In this case, the operator confirms that the input object is selected, by seeing a change of the display state of the input object displayed on the display unit 13. Moreover, since the click sensation is provided to the operator upon pressing the touch face 11 a, the operator recognizes that the input object selected is determined (executed). Thereby, it is possible to prevent erroneous inputs by a so-called wandering finger.
  • In providing the click sensation of the push-button switch as described above, the control unit 14, after switching the three piezoelectric elements 12 back in the load detection mode at step S307, switches them in the tactile sensation providing mode when the pressure load fails to satisfy the standard in releasing as well. Then, the control unit 14 drives the three piezoelectric elements 12 with the drive signals, the same as those in pressing, such that the click sensation described above (a release sensation, at this time) is provided. Thereby, it is possible to provide a more realistic click sensation bringing the sensation “Cli” in pressing and a sensation “Ck” in releasing. It is to be appreciated that the drive signals for the release sensation do not need to be the same as those for the click sensation.
  • Here, although the standard of the load to provide the release sensation may be set to be the same as the standard to provide the click sensation set forth above, it is preferable to set the standard of the load to provide the release sensation to be 50-80% lower than that to provide the click sensation in pressing. Thereby, timings to provide the tactile sensation are synchronized with timings of sequential inputs when the same position (input object) is continuously input (tapped), providing the realistic click sensation without the feeling of strangeness. That is, setting the standard of the load to provide the tactile sensation in releasing to be smaller than that to provide the tactile sensation in pressing enables to prevent the feeling of strangeness. In addition, setting the standard of the load to provide the tactile sensation in releasing to be approximately 50% or more of that to provide the tactile sensation in pressing contributes to a significant improvement in operability in the continuous input. Moreover, setting the standard of the load to provide the tactile sensation in releasing to be approximately 80% or less of that to provide the tactile sensation in pressing enables to deal with a faint load change in a holding state in the continuous input.
  • In addition, the piezoelectric elements 12 provide not only the click sensation but also a variety of tactile sensations by changing the drive signal. For example, in order to provide a soft tactile sensation perceived as a “throbbing” sensation and a “jelly-like” sensation, the drive signal, for example, a sine wave with a frequency of approximately 200 Hz to 500 Hz, for two or three periods is applied. Alternatively, in order to provide a “vibrating” sensation, the drive signal, for example, a sine wave with a frequency of approximately 200 Hz to 500 Hz, for four or more periods is applied. Preferably, information on the drive signals to provide those various tactile sensations is stored in a memory unit (not illustrated) such that the user arbitrarily set the drive signal to provide a desired tactile sensation. The tactile sensations “Cli”, “Ck”, “Click”, the “throbbing” sensation, the “jelly-like” sensation and the “vibrating” sensation set forth in the present specification are sensations obtained by the operator described in Japanese. Examples of drive signals to provide actual tactile sensations are set forth above.
  • According to the input apparatus of the present embodiment, since the piezoelectric element 12 is used for a plurality of functions as a load sensor to detect the pressure load on the touch face 11 a of the touch sensor 11 and as an actuator to vibrate the touch face 11 a, the number of components and cost are reduced. In addition, reduction of the number of components saves space for the components, which leads to downsizing of the apparatus.
  • It is to be understood that the present disclosure is not limited to the embodiment set forth above and various modifications and changes may be implemented. For example, it is possible to provide any number of the piezoelectric elements 12 instead of three. In addition, the piezoelectric element may have a known configuration such as monomorph, unimorph, bimorph and a laminated type, based on a size, vibration amplitude and the like of the touch sensor 11.
  • The present disclosure is effectively applicable to an input apparatus in which the touch sensor serves as a touch switch for on/off operations. Also, the input apparatus according to the present disclosure is capable of providing feelings of a multistep switch, such as a two-step switch (pressed further after pressed), by sequentially providing the click sensation on different standards (loads) while the touch sensor is being pressed. Thereby, if the input apparatus is applied to a release button of a camera, for example, a feeling of lock focus (first step) and a feeling of release (second step) are provided. In addition, in combination with the display unit, the input apparatus changes a display of a menu screen and the like in a variety of manners in accordance with the steps of pressing. Moreover, when providing the feelings of the multistep switch, it is possible to change the drive signal to vibrate the touch face at each step in order to provide a different click sensation at each step.
  • According to the present disclosure, the input apparatus drives the piezoelectric element when the pressure load detected based on the output of the piezoelectric element satisfies a standard to provide the tactile sensation. Here, “when the pressure load detected based on the output of the piezoelectric element satisfies the standard to provide the tactile sensation” may include either “when the pressure load detected reaches a standard value to provide the tactile sensation”, “when the pressure load detected exceeds the standard value to provide the tactile sensation”, or “when the standard value to provide the tactile sensation is detected based on the output of the piezoelectric element”.
    • REFERENCE SIGNS LIST
    • 11 touch sensor
    • 11 a touch face
    • 12 piezoelectric element
    • 13 display unit
    • 14 control unit
    • 21 housing
    • 22 insulator
    • 23 upper cover
    • 24 insulator

Claims (3)

1. An input apparatus comprising:
a touch sensor configured to detect a touch input;
a piezoelectric element mounted on the touch sensor; and
a control unit configured to detect a pressure load on a touch face of the touch sensor based on an output signal of the piezoelectric element and, when the pressure load detected satisfies a standard to provide a tactile sensation, to drive the piezoelectric element such that the tactile sensation is provided to an object pressing the touch face.
2. The input apparatus according to claim 1, wherein the piezoelectric element has one end mounted on the touch sensor and the other end opened.
3. A control method of an input apparatus including
a touch sensor configured to detect a touch input; and
a piezoelectric element mounted on the touch sensor, comprising the step of:
detecting a pressure load on a touch face of the touch sensor based on an output signal of the piezoelectric element and, when the pressure load detected satisfies a standard to provide a tactile sensation, driving the piezoelectric element such that the tactile sensation is provided to an object pressing the touch face.
US16/239,299 2009-08-27 2019-01-03 Input apparatus and control method for input apparatus Pending US20190138100A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/239,299 US20190138100A1 (en) 2009-08-27 2019-01-03 Input apparatus and control method for input apparatus

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
JP2009197132A JP2011048671A (en) 2009-08-27 2009-08-27 Input device and control method of input device
JP2009-197132 2009-08-27
PCT/JP2010/005277 WO2011024462A1 (en) 2009-08-27 2010-08-26 Input device and method for controlling input device
US201213392867A 2012-02-27 2012-02-27
US16/239,299 US20190138100A1 (en) 2009-08-27 2019-01-03 Input apparatus and control method for input apparatus

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
US13/392,867 Continuation US10203755B2 (en) 2009-08-27 2010-08-26 Input apparatus and control method for input apparatus
PCT/JP2010/005277 Continuation WO2011024462A1 (en) 2009-08-27 2010-08-26 Input device and method for controlling input device

Publications (1)

Publication Number Publication Date
US20190138100A1 true US20190138100A1 (en) 2019-05-09

Family

ID=43627581

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/392,867 Active 2031-07-04 US10203755B2 (en) 2009-08-27 2010-08-26 Input apparatus and control method for input apparatus
US16/239,299 Pending US20190138100A1 (en) 2009-08-27 2019-01-03 Input apparatus and control method for input apparatus

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/392,867 Active 2031-07-04 US10203755B2 (en) 2009-08-27 2010-08-26 Input apparatus and control method for input apparatus

Country Status (6)

Country Link
US (2) US10203755B2 (en)
EP (1) EP2472369A4 (en)
JP (1) JP2011048671A (en)
KR (1) KR20120047982A (en)
CN (1) CN102498457A (en)
WO (1) WO2011024462A1 (en)

Families Citing this family (131)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8677377B2 (en) 2005-09-08 2014-03-18 Apple Inc. Method and apparatus for building an intelligent automated assistant
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US10002189B2 (en) 2007-12-20 2018-06-19 Apple Inc. Method and apparatus for searching using an active ontology
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US20120311585A1 (en) 2011-06-03 2012-12-06 Apple Inc. Organizing task items that represent tasks to perform
JP5197521B2 (en) * 2009-07-29 2013-05-15 京セラ株式会社 Input device
US10276170B2 (en) 2010-01-18 2019-04-30 Apple Inc. Intelligent automated assistant
US8682667B2 (en) 2010-02-25 2014-03-25 Apple Inc. User profiling for selecting user specific voice input processing information
US8587422B2 (en) 2010-03-31 2013-11-19 Tk Holdings, Inc. Occupant sensing system
US9007190B2 (en) 2010-03-31 2015-04-14 Tk Holdings Inc. Steering wheel sensors
DE102011006649B4 (en) 2010-04-02 2018-05-03 Tk Holdings Inc. Steering wheel with hand sensors
US9262612B2 (en) 2011-03-21 2016-02-16 Apple Inc. Device access using voice authentication
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
WO2013099743A1 (en) * 2011-12-27 2013-07-04 株式会社村田製作所 Tactile presentation device
JPWO2013105516A1 (en) * 2012-01-13 2015-05-11 京セラ株式会社 Electronic device and control method of electronic device
US10134385B2 (en) 2012-03-02 2018-11-20 Apple Inc. Systems and methods for name pronunciation
WO2013154720A1 (en) 2012-04-13 2013-10-17 Tk Holdings Inc. Pressure sensor including a pressure sensitive material for use with control systems and methods of using the same
US10417037B2 (en) 2012-05-15 2019-09-17 Apple Inc. Systems and methods for integrating third party services with a digital assistant
US9493342B2 (en) 2012-06-21 2016-11-15 Nextinput, Inc. Wafer level MEMS force dies
EP2870445A1 (en) 2012-07-05 2015-05-13 Ian Campbell Microelectromechanical load sensor and methods of manufacturing the same
JP5634462B2 (en) 2012-08-31 2014-12-03 京セラドキュメントソリューションズ株式会社 Display input device and image forming apparatus
US9696223B2 (en) 2012-09-17 2017-07-04 Tk Holdings Inc. Single layer force sensor
BR112015018905B1 (en) 2013-02-07 2022-02-22 Apple Inc Voice activation feature operation method, computer readable storage media and electronic device
US10652394B2 (en) 2013-03-14 2020-05-12 Apple Inc. System and method for processing voicemail
US10748529B1 (en) 2013-03-15 2020-08-18 Apple Inc. Voice activated device for use with a voice-based digital assistant
WO2014197335A1 (en) 2013-06-08 2014-12-11 Apple Inc. Interpreting and acting upon commands that involve sharing information with remote devices
US10176167B2 (en) 2013-06-09 2019-01-08 Apple Inc. System and method for inferring user intent from speech inputs
CN105264524B (en) 2013-06-09 2019-08-02 苹果公司 For realizing the equipment, method and graphic user interface of the session continuity of two or more examples across digital assistants
JP6163266B2 (en) 2013-08-06 2017-07-12 アップル インコーポレイテッド Automatic activation of smart responses based on activation from remote devices
US10296160B2 (en) 2013-12-06 2019-05-21 Apple Inc. Method for extracting salient dialog usage from live data
US9902611B2 (en) 2014-01-13 2018-02-27 Nextinput, Inc. Miniaturized and ruggedized wafer level MEMs force sensors
US9588616B2 (en) 2014-05-06 2017-03-07 Corning Incorporated Cantilevered displacement sensors and methods of determining touching forces on a touch screen
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9430463B2 (en) 2014-05-30 2016-08-30 Apple Inc. Exemplar-based natural language processing
EP3149728B1 (en) 2014-05-30 2019-01-16 Apple Inc. Multi-command single utterance input method
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US9633004B2 (en) 2014-05-30 2017-04-25 Apple Inc. Better resolution when referencing to concepts
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US10127911B2 (en) 2014-09-30 2018-11-13 Apple Inc. Speaker identification and unsupervised speaker adaptation techniques
US10074360B2 (en) 2014-09-30 2018-09-11 Apple Inc. Providing an indication of the suitability of speech recognition
US9668121B2 (en) 2014-09-30 2017-05-30 Apple Inc. Social reminders
US9569007B2 (en) * 2014-12-19 2017-02-14 WUJUNGHIGHTECH Co., LTD. Touch pad using piezo effect
US10152299B2 (en) 2015-03-06 2018-12-11 Apple Inc. Reducing response latency of intelligent automated assistants
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
US9721566B2 (en) 2015-03-08 2017-08-01 Apple Inc. Competing devices responding to voice triggers
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US10200824B2 (en) 2015-05-27 2019-02-05 Apple Inc. Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device
US10083688B2 (en) 2015-05-27 2018-09-25 Apple Inc. Device voice control for selecting a displayed affordance
US9578173B2 (en) 2015-06-05 2017-02-21 Apple Inc. Virtual assistant aided communication with 3rd party service in a communication session
WO2016201235A1 (en) 2015-06-10 2016-12-15 Nextinput, Inc. Ruggedized wafer level mems force sensor with a tolerance trench
US20160378747A1 (en) 2015-06-29 2016-12-29 Apple Inc. Virtual assistant for media playback
US10331312B2 (en) 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US10740384B2 (en) 2015-09-08 2020-08-11 Apple Inc. Intelligent automated assistant for media search and playback
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
US10956666B2 (en) 2015-11-09 2021-03-23 Apple Inc. Unconventional virtual assistant interactions
US10049668B2 (en) 2015-12-02 2018-08-14 Apple Inc. Applying neural network language models to weighted finite state transducers for automatic speech recognition
US10223066B2 (en) 2015-12-23 2019-03-05 Apple Inc. Proactive assistance based on dialog communication between devices
US11227589B2 (en) 2016-06-06 2022-01-18 Apple Inc. Intelligent list reading
US10049663B2 (en) 2016-06-08 2018-08-14 Apple, Inc. Intelligent automated assistant for media exploration
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
DK179415B1 (en) 2016-06-11 2018-06-14 Apple Inc Intelligent device arbitration and control
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
JP2018036959A (en) * 2016-09-01 2018-03-08 株式会社デンソーテン Control device, input device, input system, display device, and control method
US10474753B2 (en) 2016-09-07 2019-11-12 Apple Inc. Language identification using recurrent neural networks
US10043516B2 (en) 2016-09-23 2018-08-07 Apple Inc. Intelligent automated assistant
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
US11243125B2 (en) 2017-02-09 2022-02-08 Nextinput, Inc. Integrated piezoresistive and piezoelectric fusion force sensor
CN116907693A (en) 2017-02-09 2023-10-20 触控解决方案股份有限公司 Integrated digital force sensor and related manufacturing method
US10417266B2 (en) 2017-05-09 2019-09-17 Apple Inc. Context-aware ranking of intelligent response suggestions
DK201770383A1 (en) 2017-05-09 2018-12-14 Apple Inc. User interface for correcting recognition errors
DK180048B1 (en) 2017-05-11 2020-02-04 Apple Inc. MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION
US10726832B2 (en) 2017-05-11 2020-07-28 Apple Inc. Maintaining privacy of personal information
US10395654B2 (en) 2017-05-11 2019-08-27 Apple Inc. Text normalization based on a data-driven learning network
US11301477B2 (en) 2017-05-12 2022-04-12 Apple Inc. Feedback analysis of a digital assistant
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770429A1 (en) 2017-05-12 2018-12-14 Apple Inc. Low-latency intelligent automated assistant
DK179745B1 (en) 2017-05-12 2019-05-01 Apple Inc. SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT
US10403278B2 (en) 2017-05-16 2019-09-03 Apple Inc. Methods and systems for phonetic matching in digital assistant services
US20180336892A1 (en) 2017-05-16 2018-11-22 Apple Inc. Detecting a trigger of a digital assistant
US10311144B2 (en) 2017-05-16 2019-06-04 Apple Inc. Emoji word sense disambiguation
DK179549B1 (en) 2017-05-16 2019-02-12 Apple Inc. Far-field extension for digital assistant services
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
CN111448446B (en) 2017-07-19 2022-08-30 触控解决方案股份有限公司 Strain transferring stack in MEMS force sensor
US11423686B2 (en) 2017-07-25 2022-08-23 Qorvo Us, Inc. Integrated fingerprint and force sensor
WO2019023552A1 (en) 2017-07-27 2019-01-31 Nextinput, Inc. A wafer bonded piezoresistive and piezoelectric force sensor and related methods of manufacture
US11579028B2 (en) 2017-10-17 2023-02-14 Nextinput, Inc. Temperature coefficient of offset compensation for force sensor and strain gauge
WO2019090057A1 (en) 2017-11-02 2019-05-09 Nextinput, Inc. Sealed force sensor with etch stop layer
WO2019099821A1 (en) 2017-11-16 2019-05-23 Nextinput, Inc. Force attenuator for force sensor
US10733982B2 (en) 2018-01-08 2020-08-04 Apple Inc. Multi-directional dialog
US10733375B2 (en) 2018-01-31 2020-08-04 Apple Inc. Knowledge-based framework for improving natural language understanding
US10789959B2 (en) 2018-03-02 2020-09-29 Apple Inc. Training speaker recognition models for digital assistants
US10592604B2 (en) 2018-03-12 2020-03-17 Apple Inc. Inverse text normalization for automatic speech recognition
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
US10909331B2 (en) 2018-03-30 2021-02-02 Apple Inc. Implicit identification of translation payload with neural machine translation
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
US11145294B2 (en) 2018-05-07 2021-10-12 Apple Inc. Intelligent automated assistant for delivering content from user experiences
US10984780B2 (en) 2018-05-21 2021-04-20 Apple Inc. Global semantic word embeddings using bi-directional recurrent neural networks
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. Virtual assistant operation in multi-device environments
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
DK179822B1 (en) 2018-06-01 2019-07-12 Apple Inc. Voice interaction at a primary device to access call functionality of a companion device
US11386266B2 (en) 2018-06-01 2022-07-12 Apple Inc. Text correction
US10892996B2 (en) 2018-06-01 2021-01-12 Apple Inc. Variable latency device coordination
US10496705B1 (en) 2018-06-03 2019-12-03 Apple Inc. Accelerated task performance
US11010561B2 (en) 2018-09-27 2021-05-18 Apple Inc. Sentiment prediction from textual data
US11170166B2 (en) 2018-09-28 2021-11-09 Apple Inc. Neural typographical error modeling via generative adversarial networks
US11462215B2 (en) 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US10839159B2 (en) 2018-09-28 2020-11-17 Apple Inc. Named entity normalization in a spoken dialog system
US11475898B2 (en) 2018-10-26 2022-10-18 Apple Inc. Low-latency multi-speaker speech recognition
US11638059B2 (en) 2019-01-04 2023-04-25 Apple Inc. Content playback on multiple devices
US10962427B2 (en) 2019-01-10 2021-03-30 Nextinput, Inc. Slotted MEMS force sensor
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
US11423908B2 (en) 2019-05-06 2022-08-23 Apple Inc. Interpreting spoken requests
US11475884B2 (en) 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
US11140099B2 (en) 2019-05-21 2021-10-05 Apple Inc. Providing message response suggestions
US11496600B2 (en) 2019-05-31 2022-11-08 Apple Inc. Remote execution of machine-learned models
US11289073B2 (en) 2019-05-31 2022-03-29 Apple Inc. Device text to speech
DK201970511A1 (en) 2019-05-31 2021-02-15 Apple Inc Voice identification in digital assistant systems
DK180129B1 (en) 2019-05-31 2020-06-02 Apple Inc. User activity shortcut suggestions
US11360641B2 (en) 2019-06-01 2022-06-14 Apple Inc. Increasing the relevance of new available information
US11468890B2 (en) 2019-06-01 2022-10-11 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11488406B2 (en) 2019-09-25 2022-11-01 Apple Inc. Text detection using global geometry estimators
US11043220B1 (en) 2020-05-11 2021-06-22 Apple Inc. Digital assistant hardware abstraction
US11061543B1 (en) 2020-05-11 2021-07-13 Apple Inc. Providing relevant data items based on context
US11755276B2 (en) 2020-05-12 2023-09-12 Apple Inc. Reducing description length based on confidence
US11490204B2 (en) 2020-07-20 2022-11-01 Apple Inc. Multi-device audio adjustment coordination
US11438683B2 (en) 2020-07-21 2022-09-06 Apple Inc. User identification using headphones

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11212725A (en) * 1998-01-26 1999-08-06 Idec Izumi Corp Information display device and operation input device
US20050057527A1 (en) * 2003-09-17 2005-03-17 Sony Corporation Information display device and supporting frame for supporting a piezoelectric element for use in information display device
US20060050059A1 (en) * 2002-12-12 2006-03-09 Kimiyasu Satoh Input device, portable electronic apparatus, remote control device, and piezoelectric actuator driving controlling method in input device
US20060192657A1 (en) * 2005-02-15 2006-08-31 Nec Infrontia Corporation Electronic apparatus

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FI112415B (en) 2001-11-28 2003-11-28 Nokia Oyj Piezoelectric user interface
JP2003288158A (en) 2002-01-28 2003-10-10 Sony Corp Mobile apparatus having tactile feedback function
WO2005008444A2 (en) * 2003-07-14 2005-01-27 Matt Pallakoff System and method for a portbale multimedia client
JP2006048302A (en) 2004-08-03 2006-02-16 Sony Corp Piezoelectric complex unit, its manufacturing method, its handling method, its control method, input/output device and electronic equipment
JP4543863B2 (en) 2004-10-05 2010-09-15 ソニー株式会社 I / O device with tactile function and electronic device
US8264465B2 (en) * 2004-10-08 2012-09-11 Immersion Corporation Haptic feedback for button and scrolling action simulation in touch input devices
JP2007086990A (en) * 2005-09-21 2007-04-05 Smk Corp Touch panel
JP2008033739A (en) 2006-07-31 2008-02-14 Sony Corp Touch screen interaction method and apparatus based on tactile force feedback and pressure measurement
JP2008130055A (en) 2006-11-27 2008-06-05 Sony Corp Touch panel display unit, drive method, and electronic apparatus
KR20080109109A (en) 2007-06-12 2008-12-17 오의진 Data input device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11212725A (en) * 1998-01-26 1999-08-06 Idec Izumi Corp Information display device and operation input device
US20060050059A1 (en) * 2002-12-12 2006-03-09 Kimiyasu Satoh Input device, portable electronic apparatus, remote control device, and piezoelectric actuator driving controlling method in input device
US20050057527A1 (en) * 2003-09-17 2005-03-17 Sony Corporation Information display device and supporting frame for supporting a piezoelectric element for use in information display device
US20060192657A1 (en) * 2005-02-15 2006-08-31 Nec Infrontia Corporation Electronic apparatus

Also Published As

Publication number Publication date
US20120154317A1 (en) 2012-06-21
KR20120047982A (en) 2012-05-14
EP2472369A4 (en) 2015-06-10
US10203755B2 (en) 2019-02-12
CN102498457A (en) 2012-06-13
WO2011024462A1 (en) 2011-03-03
EP2472369A1 (en) 2012-07-04
JP2011048671A (en) 2011-03-10

Similar Documents

Publication Publication Date Title
US20190138100A1 (en) Input apparatus and control method for input apparatus
US10705617B2 (en) Tactile sensation providing apparatus and control method for tactile sensation providing apparatus
US9436312B2 (en) Input apparatus and control method for input apparatus
US8823662B2 (en) Input apparatus
US10386925B2 (en) Tactile sensation providing apparatus and control method for tactile sensation providing apparatus
US9354730B2 (en) Tactile sensation providing apparatus
EP2472364B1 (en) Input device
US8947388B2 (en) Input apparatus
US9208663B2 (en) Input apparatus and control method for input apparatus
JP2011187087A (en) Input device and control method for the same
JP5143881B2 (en) Tactile sensation presentation apparatus and control method of tactile sensation presentation apparatus

Legal Events

Date Code Title Description
AS Assignment

Owner name: KYOCERA CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AONO, TOMOTAKE;REEL/FRAME:047895/0605

Effective date: 20181221

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STCV Information on status: appeal procedure

Free format text: NOTICE OF APPEAL FILED

STCV Information on status: appeal procedure

Free format text: EXAMINER'S ANSWER TO APPEAL BRIEF MAILED

STCV Information on status: appeal procedure

Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS