EP2659337B1 - A display apparatus producing audio and haptic output - Google Patents
A display apparatus producing audio and haptic output Download PDFInfo
- Publication number
- EP2659337B1 EP2659337B1 EP10861477.7A EP10861477A EP2659337B1 EP 2659337 B1 EP2659337 B1 EP 2659337B1 EP 10861477 A EP10861477 A EP 10861477A EP 2659337 B1 EP2659337 B1 EP 2659337B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- actuator
- display
- flexible membrane
- signal
- frequency component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000012528 membrane Substances 0.000 claims description 87
- 230000005236 sound signal Effects 0.000 claims description 35
- 229920000139 polyethylene terephthalate Polymers 0.000 claims description 26
- 239000005020 polyethylene terephthalate Substances 0.000 claims description 26
- 238000000034 method Methods 0.000 claims description 12
- 229920001971 elastomer Polymers 0.000 claims description 11
- 230000008878 coupling Effects 0.000 claims description 10
- 238000010168 coupling process Methods 0.000 claims description 10
- 238000005859 coupling reaction Methods 0.000 claims description 10
- 239000000725 suspension Substances 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 8
- 238000006073 displacement reaction Methods 0.000 claims description 5
- 239000011888 foil Substances 0.000 claims description 5
- 239000000806 elastomer Substances 0.000 claims description 3
- -1 polyethylene terephthalate Polymers 0.000 claims description 3
- 229920006267 polyester film Polymers 0.000 claims description 2
- 229920001296 polysiloxane Polymers 0.000 claims description 2
- 229920006289 polycarbonate film Polymers 0.000 claims 1
- 239000010410 layer Substances 0.000 description 61
- 108091006146 Channels Proteins 0.000 description 34
- 230000033001 locomotion Effects 0.000 description 16
- 238000005516 engineering process Methods 0.000 description 12
- 230000000694 effects Effects 0.000 description 11
- 239000000463 material Substances 0.000 description 11
- 238000012545 processing Methods 0.000 description 9
- 238000013016 damping Methods 0.000 description 8
- 230000004044 response Effects 0.000 description 8
- 239000005060 rubber Substances 0.000 description 8
- 239000000853 adhesive Substances 0.000 description 6
- 230000001070 adhesive effect Effects 0.000 description 6
- 239000012790 adhesive layer Substances 0.000 description 6
- 239000011521 glass Substances 0.000 description 6
- 238000001514 detection method Methods 0.000 description 5
- 239000000428 dust Substances 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- AMGQUBHHOARCQH-UHFFFAOYSA-N indium;oxotin Chemical compound [In].[Sn]=O AMGQUBHHOARCQH-UHFFFAOYSA-N 0.000 description 4
- 239000004033 plastic Substances 0.000 description 4
- 229920003023 plastic Polymers 0.000 description 4
- 230000003068 static effect Effects 0.000 description 4
- 238000005452 bending Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 239000000356 contaminant Substances 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000010355 oscillation Effects 0.000 description 3
- 229920000515 polycarbonate Polymers 0.000 description 3
- 239000004417 polycarbonate Substances 0.000 description 3
- 230000001681 protective effect Effects 0.000 description 3
- 229920001621 AMOLED Polymers 0.000 description 2
- 229920002799 BoPET Polymers 0.000 description 2
- XEEYBQQBJWHFJM-UHFFFAOYSA-N Iron Chemical compound [Fe] XEEYBQQBJWHFJM-UHFFFAOYSA-N 0.000 description 2
- 239000004020 conductor Substances 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 239000012212 insulator Substances 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000000465 moulding Methods 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 244000043261 Hevea brasiliensis Species 0.000 description 1
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 1
- 235000013290 Sagittaria latifolia Nutrition 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 235000015246 common arrowhead Nutrition 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000003989 dielectric material Substances 0.000 description 1
- 238000010292 electrical insulation Methods 0.000 description 1
- 229920001746 electroactive polymer Polymers 0.000 description 1
- 230000005686 electrostatic field Effects 0.000 description 1
- 238000001125 extrusion Methods 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 230000004313 glare Effects 0.000 description 1
- 239000003292 glue Substances 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 229910052742 iron Inorganic materials 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 229910052744 lithium Inorganic materials 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229910052751 metal Inorganic materials 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 229920003052 natural elastomer Polymers 0.000 description 1
- 229920001194 natural rubber Polymers 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000001902 propagating effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 229920003051 synthetic elastomer Polymers 0.000 description 1
- 239000005061 synthetic rubber Substances 0.000 description 1
- 230000008719 thickening Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R7/00—Diaphragms for electromechanical transducers; Cones
- H04R7/02—Diaphragms for electromechanical transducers; Cones characterised by the construction
- H04R7/04—Plane diaphragms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04103—Manufacturing, i.e. details related to manufacturing processes specially suited for touch sensitive devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/0202—Constructional details or processes of manufacture of the input device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/003—Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/007—Teaching or communicating with blind persons using both tactile and audible presentation of the information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2400/00—Loudspeakers
- H04R2400/03—Transducers capable of generating both sound as well as tactile vibration, e.g. as used in cellular phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
- H04R2499/10—General applications
- H04R2499/11—Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
Definitions
- the present invention relates to a display apparatus providing speaker functionality.
- the invention further relates to, but is not limited to, display apparatus providing speaker functionality for use in mobile devices.
- a touch sensitive input with the display has the advantage over a mechanical keypad in that the display may be configured to show a range of different inputs depending on the operating mode of the device. For example, in a first mode of operation the display may be enabled to enter a phone number by displaying a simple numeric keypad arrangement and in a second mode the display may be enabled for text input by displaying an alphanumeric display configuration such as a simulated Qwerty keyboard display arrangement.
- touchscreen inputs have a disadvantage with respect to mechanical keys in that the user does not experience the usual expected click or mechanical switch feedback to indicate that an input has been detected.
- some equipment has been provided with a mechanical or audible simulation of a key press.
- Some touch screen devices are equipped with device haptic feedback, in other words an ordinary vibration is used to make the whole device shake (and also provide an audio cue of the key press) as the user touches the screen and is detected.
- device-haptic devices however are themselves problematic as they require significant current to operate in order to generate significant feedback force. This is generally because the construction of the device often requires that the front window is firmly located or fixed to the surrounding frame or connected in such a way to significantly damp the force generated by the actuator before it is applied.
- Some devices use electro-acoustic transducers to produce audio for earpiece and integrated hands free (IHF) operations as well as for alert tones.
- the moving coil dynamic speaker configuration used is typically relatively large in relation to the volume within the device and require specific signal processing considerations in order that the acoustic frequency response is acceptable.
- moving coil transducers can attract contaminants such as small iron particles from within the internal volume of the device and also through ports provided to enable acoustic wave transmission from the speaker to the external environment. These contaminants can cause distortion and faults within the speakers significantly reducing the lifetime of the device.
- a typical device configured to produce both audio and haptic outputs would typically require a vibrator component and an electro-acoustic transducer which incurs both cost of component, and also volume cost as they are relatively difficult to fit into a modern device and need to be located far from the mass centric point in order to generate a good performance. Furthermore in devices generating a multi-channel audio signal these modern devices require additional volume and component cost as additional transducers are required to generate each of the audio channels.
- WO 2009/067708 discusses electroactive transducers as well as methods of producing a haptic effect in a user interface device simultaneously with a sound generated by a separately generated audio signal and electroactive polymer transducers for sensory feedback applications in user interface devices.
- US 2010/156818 discusses methods and systems for processing touch inputs.
- the invention in one respect includes reading data from a multi-touch sensing device such as a multi-touch touch screen where the data pertains to touch input with respect to the multi-touch sensing device, and identifying at least one multi-touch gesture based on the data from the multi-touch sensing device and providing an appropriate multi-haptic response.
- US 2010/141408 discusses a control panel apparatus which includes a control panel that is vibrated to generate sound and/or haptic feedback.
- the control panel apparatus is configured to receive tactile input, such as a touchscreen, and to provide tactile feedback so as to function like a haptic panel, in response to a haptic signal component of a driving signal.
- the control panel is also configured to function as an audio speaker in response to an audio signal component of the driving signal.
- the haptic signal has a wider bandwidth, in the range of approximately 100-400 Hz, and the audio signal has a narrower bandwidth, in the range of approximately 20 Hz-20 kHz.
- the driving signal is configured to include either or both of the haptic signal and the audio signal.
- One or more drive elements are coupled to a control panel, each drive element driven by a driving signal. Each drive element converts the electrical driving signal to mechanical movement, thereby vibrating the control panel. In the case of multiple drive elements, each drive element is coupled to a different portion of the control panel.
- WO 2007/049091 discusses a portable electronic device, such as a pager or a mobile station, has a housing and a vibration motor coupled to the housing for imparting vibration to it.
- an electronic audio signal is preferably split into high and low frequency components by parallel filters. Pulses of the low frequency component are rectified, voltages of those rectified pulses are quantified and at least some are converted to pulse widths, and the train of pulse widths is amplified to drive the vibration motor, resonating the housing at in correspondence with the pulse amplitudes of at least some pulses of the original electronic audio signal.
- Various adaptive schemes are presented to control the number of modulated pulses that drive the vibration motor to enhance the user experience.
- the vibration motor may act as an audible sub-woofer and/or may provide a bass effect vibration within or beyond the audible range in correspondence to certain spaced pulses of the original audio signal.
- the application describes apparatus and methods of construction for apparatus suitable for generating touch screen devices capable of creating a more interactive user experience and audio generation through the screen.
- a flexible membrane for connecting the display with the cover or case enables the display to be driven substantially in a manner suitable for combining both haptic and audio signals and also in some embodiments in a manner suitable for multichannel audio signals.
- Driving the display in such ways greatly enhances the user haptic experience and generates acoustic waves suitable for earpiece or speaker replacement.
- the construction of such a display module and some examples of its implementation within apparatus is described in further detail hereafter.
- FIG. 1 a schematic block diagram of an example electronic device 10 or apparatus on which embodiments of the application can be implemented.
- the apparatus 10 is such embodiments configured to provide improved haptic feedback and audio generation.
- the apparatus 10 is in some embodiments a mobile terminal, mobile phone or user equipment for operation in a wireless communication system.
- the electronic device is any suitable electronic device configured to provide a image display, such as for example a digital camera, a portable audio player (mp3 player), a portable video player (mp4 player).
- the apparatus can be any suitable electronic device with touch interface (which may or may not display information) such as a touch-screen or touch-pad configured to provide feedback when the touch-screen or touch-pad is touched.
- the touch-pad can be a touch-sensitive keypad which can in some embodiments have no markings on it and in other embodiments have physical markings or designations on the front window.
- An example of such a touch sensor can be a touch sensitive user interface to replace keypads in automatic teller machines (ATM) that does not require a screen mounted underneath the front window projecting a display.
- ATM automatic teller machines
- the user can in such embodiments be notified of where to touch by a physical identifier - such as a raised profile, or a printed layer which can be illuminated by a light guide.
- the apparatus 10 comprises a touch input module or user interface 11, which is linked to a processor 15.
- the processor 15 is further linked to a display 12.
- the processor 15 is further linked to a transceiver (TX/RX) 13 and to a memory 16.
- the touch input module 11 and/or the display 12 are separate or separable from the electronic device and the processor receives signals from the touch input module 11 and/or transmits and signals to the display 12 via the transceiver 13 or another suitable interface. Furthermore in some embodiments the touch input module 11 and display 12 are parts of the same component. In such embodiments the touch interface module 11 and display 12 can be referred to as the display part or touch display part.
- the processor 15 can in some embodiments be configured to execute various program codes.
- the implemented program codes in some embodiments can comprise such routines as touch capture digital processing or configuration code where the touch input module inputs are detected and processed, display image processing and image interaction code where the data to be passed to generate the display images is generated for example based on the detection of the input, or actuator processing generating an actuator signal for driving an actuator.
- the implemented program codes can in some embodiments be stored for example in the memory 16 and specifically within a program code section 17 of the memory 16 for retrieval by the processor 15 whenever needed.
- the memory 15 in some embodiments can further provide a section 18 for storing data, for example data that has been processed in accordance with the application, for example display information data.
- the touch input module 11 can in some embodiments implement any suitable touch screen interface technology.
- the touch screen interface can comprise a capacitive sensor configured to be sensitive to the presence of a finger above or on the touch screen interface.
- the capacitive sensor can comprise an insulator (for example glass or plastic), coated with a transparent conductor (for example indium tin oxide - ITO).
- a transparent conductor for example indium tin oxide - ITO.
- Any suitable technology may be used to determine the location of the touch. The location can be passed to the processor which may calculate how the user's touch relates to the device.
- the insulator protects the conductive layer from dirt, dust or residue from the finger.
- the touch input module can be a resistive sensor comprising of several layers of which two are thin, metallic, electrically conductive layers separated by a narrow gap.
- two metallic, electrically conductive layers separated by a narrow gap.
- the touch input module can further determine a touch using technologies such as visual detection for example a camera either located below the surface or over the surface detecting the position of the finger or touching object, projected capacitance detection, infra-red detection, surface acoustic wave detection, dispersive signal technology, and acoustic pulse recognition.
- the apparatus 10 can in some embodiments be capable of implementing the processing techniques at least partially in hardware, in other words the processing carried out by the processor 15 may be implemented at least partially in hardware without the need of software or firmware to operate the hardware.
- the transceiver 13 in some embodiments enables communication with other electronic devices, for example in some embodiments via a wireless communication network.
- the display 12 may comprise any suitable display technology.
- the display element can be located below the touch input module and project an image through the touch input module to be viewed by the user.
- the display 12 can employ any suitable display technology such as liquid crystal display (LCD), light emitting diodes (LED), organic light emitting diodes (OLED), plasma display cells, Field emission display (FED), surface-conduction electron-emitter displays (SED), and Electophoretic displays (also known as electronic paper, e-paper or electronic ink displays).
- the display 12 employs one of the display technologies projected using a light guide to the display window.
- the display 12 in some embodiments can be implemented as a physical fixed display.
- the display can be a physical decal or transfer on the front window.
- the display can be located on a physically different level from the rest of the surface, such a raised or recessed marking on the front window.
- the display can be a printed layer illuminated by a light guide under the front window.
- the apparatus 10 can comprise a body part 311 or outer frame which can be constructed from any suitable material and is configured to provide a structure to which other components may be coupled and/or may protect other components from damage.
- the body part 311 can comprise an inner surface to which internal components are located and an outer surface to which external components are located and which is exposed to the elements.
- the junction between the inner surface and the outer surface is connected via a filet or chamfer to smooth the junction. In such embodiments by smoothing the junction there is less chance of damaging other components.
- the apparatus 10 in some embodiments comprises a battery 309.
- the battery 309 can be any suitable electrical power generating means and can employ any suitable electrical charge storage or generating technology, for example but not exclusively lithium polymer cells, fuel cell, solar cell or a combination of suitable technologies.
- the battery 309 is rechargeable or refillable and is connected via a port in the body part 311 to be able to receive a recharging or refilling coupling, for example a recharger plug to couple to a recharging socket for supplying power to recharge the battery 309.
- the battery 309 is configured to be located within the body part 311.
- the body part 311 can in some embodiments employs moulding tabs or other locating means on the inner surface to fix or locate the battery in position.
- the apparatus 10 further employs a printed wiring board (PWB) 307.
- the printed wiring board 307 is configured to provide a suitable structure for locating electrical components.
- the processor 15, transceiver 13 and memory 16 shown in Figure 1 can be located on the printed wiring board.
- the printed wiring board 307 can be replaced by a printed circuit board (PCB) or surface mounted board suitable for locating surface mounted electrical components on it.
- the printed wiring board 307 is configured to be coupled to the battery 309 whereby the battery 309 is configured to supply the printed wiring board 307 with power to operate the electrical components located on it.
- the printed wiring board is located over the battery and within the body part 311. It would be understood that in some embodiments the body part 311 can employ moulding tabs or other locating means on the inner surface to fix or locate the printed wiring board in position.
- the apparatus 10 further comprises at least one piezoelectric actuator 305.
- the apparatus employs a first piezoelectric actuator 305 located towards one end of body part 311 and a second piezoelectric actuator 305 located at the opposite end of the body part 311.
- the piezoelectric actuator 305 is in some embodiments coupled to receive power from the battery 309 via the printed wiring board 307 and to produce a physical moment or force in response to a current passed through the piezoelectric actuator 305.
- Each piezoelectric actuator 305 furthermore can in some embodiments be located within the case body by an inner recess which is configured to receive the piezoelectric actuator 305.
- the inner recess 511 is configured to locate either end of the piezoelectric actuator 305 in position such that in some embodiments when the piezoelectric actuator 305 is operated the ends of the piezoelectric actuator are fixed nodes.
- the piezoelectric actuator 305 in some embodiments is suspended at each end by the body part 311 recess 511 such that when a current is applied the piezoelectric actuator 305 flexes and can 'push' against the case body thus producing a motion in and away from the direction of the display.
- the display is considered to be in a plane designated the X-Y axis the actuations of the piezoelectric actuator to actuate or produce a force in a "Z" dimension or direction.
- piezoelectric actuator 305 any suitable actuator capable of producing a translational force to a display could be implemented in some further embodiments.
- an eccentric mass can be employed to produce a force which may be passed.
- a moving coil or moving magnet actuator can generate the force.
- the display can directly experience the force which is transmitted from the piezoelectric actuator to the display assembly 304 in such a manner to permit a planar motion of the display assembly.
- the piezoelectric actuator is shaped with a suitable thickening to in a central portion to provide a projection through which force can be passed to a display.
- the piezoelectric actuator 305 is further coupled via a conductive soft surface mounted technology (SMT) pad to the printed wiring board (PWB) which provides an electrical coupling between the piezoelectric actuator 305 and the printed wiring board 307.
- SMT conductive soft surface mounted technology
- PWB printed wiring board
- the apparatus 10 can in some embodiments comprise a rubber force contact 501.
- the rubber force contact 501 is configured to be located on or be in contact with the piezoelectric actuator 305 approximately half way along the length of the actuator and translate the bending motion of the piezoelectric actuator to affect a movement of a display assembly.
- the rubber force contact 501 can be manufactured from any suitable material, such as natural rubber, synthetic rubber, or plastic being capable of transmission of force in a direction.
- the rubber force contact 501 can be designed to provide a degree of buffering of force or 'damping' between the piezoelectric actuator 305 and the display so to prevent the display experiencing shock and/or damage when the piezoelectric actuator 305 is driven.
- the apparatus 10 can in some embodiments further comprise a display 304 or display assembly.
- the display 304 can comprise any suitable display technology as described herein.
- the display 304 is configured to employ a flexible membrane or plate suspension membrane 507.
- FIG. 2b an example according to some embodiments is shown detailing the plate suspension membrane 507 characteristics.
- the body part 311 and the frame part 301 as shown in Figure 2b can form a supporting frame which is configured not only to protect the components of the apparatus but also provide a supporting frame against which the components of the apparatus can be located or react against.
- the flexible membrane 507 locates the display assembly 304 and the front window 303 with respect to the supporting frame.
- the flexible membrane 507 in some embodiments can be configured such that it possesses differing characteristics for differing regions.
- a first region or regions 507b of the flexible membrane 507 can present a more rigid characteristic or have a higher degree of inertia when experiencing a force.
- the first region 507b of the flexible membrane 507 can be located approximately in the region of flexible membrane between at least two actuators so that the effect of actuation on the display assembly 304 and/or front window 303 is damped before it can reach another actuator region of the display assembly 304 and/or front window 303.
- a second region or regions 507a of the flexible membrane can present a less rigid characteristic or have a lover degree of inertia when experiencing a force.
- the second region 507a can be located approximately in the same location as any transducer so that the transducer can actuate the display assembly 304 and/or front window 303 with less damping effect.
- FIG. 2c a cross-section of the example apparatus shown in Figure 2b is shown.
- the cross-section shown is the view taken along the short axis of the apparatus.
- the second region or regions 507a of the flexible membrane is shown coupling the display assembly 304 to the supporting frame comprising the body part 311 and the frame part 301, with the front window 303 overlying both the display assembly and the flexible membrane 507 or suspension.
- FIG. 2d a further example according to some embodiments is shown detailing further controlling of the plate suspension membrane 507 characteristics.
- the body part 311 and the frame part 301 forms the supporting frame which is configured not only to protect the components of the apparatus but also provide a supporting frame against which the components of the apparatus can be located or react against.
- the flexible membrane 507 locates the display assembly 304 and the front window 303 with respect to the supporting frame.
- the flexible membrane 507 in these embodiments can be configured such that it possesses a substantially uniform characteristic throughout the range of the flexible membrane.
- FIG. 2e a cross-section of the example apparatus shown in Figure 2d is shown.
- the cross-section shown is the view taken along the long axis of the apparatus.
- the display assembly 304 is coupled to a part of the supporting frame or other supporting structure (such as pcb or battery) via a substantially resilient member.
- the substantially resilient member can comprise a layer of tape or glue 390.
- the substantially resilient member 390 can therefore in these embodiments damp the motion of the display assembly 304 and/or front window 303 overlying the display assembly 304 in such a manner that any motion propagating transversely along the display assembly 304 and/or front window 303 is stopped or substantially stopped by the resilient member 390. This therefore produces an effect of significantly increasing the inertia to motion of the display assembly 304 and/or front window 303 coupled to the resilient member 390.
- FIG. 2f a further cross-section of the example apparatus shown in Figure 2d is shown.
- the cross-section shown is the view taken along the short axis of the apparatus.
- the display assembly 304 is coupled to a part of the supporting frame or other supporting structure rigidly coupled to the supporting frame.
- the example shown in Figure 3 shows the flexible membrane being located in contact or substantially in contact with the rubber force contact and suspended at least partially at a periphery of the flexible membrane 507 between the frame part 301 and body part 311.
- the flexible membrane 507 is sandwiched at the periphery of the membrane between the body part 311 and the frame part 301 and located by a suspension ring 509 attached to the flexible membrane 507 and located within a suspension ring recess 513 formed on the inner surface of the body part 311.
- the suspension ring 509 can be formed as a substantially thickened section of the flexible membrane 507.
- the inner surface of the body part 311 can be attached to the flexible membrane 507 via an adhesive layer.
- the adhesive layer extends beyond the static area of contact between the inner surface of the body part 311 and the flexible membrane 507 in order to provide additional protection at any dynamic area of contact between the inner surface of the body part 311 and the flexible membrane 507.
- the flexible membrane 507 in some embodiments may be manufactured from an elastomer.
- the elastomer in some embodiments may be any suitable film or foil.
- the suitable film or foil may be in various embodiments a polyethylene terephthalate (PET) film, a polycarbonate (PC) foil, or a silicone foil.
- the flexible membrane 507 in such embodiments can furthermore be attached via a further adhesive layer to a surface of the frame part 301.
- the body part 311 and the frame part 301 thus in these embodiments locates at least some of the flexible membrane.
- the junction between the surfaces of body part 311 and the frame part 301 are configured with a fillet or chamfer to smooth the junction for a similar reason as above for protecting the membrane while the membrane is dynamic.
- the further adhesive layer may extend beyond the static area of contact to provide additional protection at any dynamic area of contact.
- the flexible membrane 507 can be constructed out of polyethylene terephthalate (PET) polyester film.
- PET polyethylene terephthalate
- the film can be biaxially oriented polyethylene terephthalate which may be used because of its high tensile strength, chemical and dimensional stability, transparency and also electrical insulation properties.
- the PET flexible membrane layer can in some embodiments be approximately 0.01 to approximately 1 mm thick as this thickness has been shown to provide both the flexibility in response to forces from the user and from the actuator but also has sufficient tensile strength not to break under such forces.
- the PET flexible membrane 211 can be constructed by any suitable means.
- the PET layer may be constructed by extrusion onto a chill roll which quenches it into an amorphous state.
- the PET flexible membrane layer furthermore in some embodiments can be constructed in such a way that the crystallites grow rapidly but reach the boundary of neighbouring crystallites and remain smaller than the wavelength of visible light and thus produce a film having excellent clarity.
- the display assembly 304 can further comprise a display element.
- the display element can in some embodiments comprise a static display array located beneath the front window 303 and projected up to the user through the front window 303.
- the graphic layer can comprise any suitable material for blocking projected light.
- the graphic layer can be approximately 0.05 to approximately 0.07 mm thick.
- the graphic layer can be printed directly onto the underside of the front window 303.
- the graphic layer can comprise any suitable material for permitting the controllable and selectable projection of light - for example a liquid crystal display element and colour filter layer, E-ink etc.
- the graphic layer can in some embodiments be coupled to the flexible membrane 507 via an optically clear adhesive (OCA) layer.
- OCA optically clear adhesive
- the optically clear adhesive layer can be approximately 0.025 to approximately 0.05 mm thick and can be the same material as other OCA layers.
- the static display array in some embodiments can also comprise a graphic layer which may be connected to the front window 303 by a first optically clear adhesive (OCA) layer.
- the first optically clear adhesive layer may be approximately 0.025 to approximately 0.05 mm thick and be any suitable OCA material.
- the display assembly 304 in some embodiments further comprises a touch sensor for example a capacitive touch sensor located over the display element.
- the capacitive touch sensor can in some embodiments comprise a series of layers.
- the layers in the capacitive touch sensor can comprise at least one Indium Tin Oxide on PET layer, and a protective hard coated PET layer.
- Each layer can in some embodiments be fixed to the neighbouring layers by the use of an optically clear adhesive to form a sandwich of layers.
- the display element for example can in some embodiments be connected via a second layer of optically clear adhesive (OCA) to a first layer of indium tin oxide (ITO) on PET.
- OCA optically clear adhesive
- ITO indium tin oxide
- the second layer of OCA can in some embodiments be approximately 0.025 to approximately 0.05 mm thick.
- the first layer of indium tin oxide (ITO) on PET in some embodiments is the first of the capacitive touch interface layers.
- the first ITO on PET layer provides a first layer capable of detecting the capacitive coupling produced by the user's finger when it touches the front window 303.
- the first layer of ITO on PET can in some embodiments be approximately 0.05 to 0.2 mm thick.
- the first layer of ITO on PET layer can be connected to a second ITO on PET layer via a third layer of optically clear adhesive (OCA).
- OCA optically clear adhesive
- the third layer of OCA can in some embodiments be approximately 0.025 to approximately 0.05 millimetres thick.
- the second layer of ITO on PET can in some embodiments be a further layer capable of detecting the capacitive coupling produced by the user's finger when it touches the front window 303.
- the second ITO on PET layer can in some embodiments be approximately 0.05 to approximately 0.2 mm thick.
- the capacitive touch interface layers have been described as being ITO on PET layers it would be understood that the capacitive touch interface layers may comprise any suitable material, for example ITO on glass.
- the display comprises a protective or front window 303.
- the front window 303 can in some embodiments be manufactured from glass.
- the glass may be coated with optical (to reduce glare) or oleophobic (to resist fingerprints) films to enhance the characteristics of the front window.
- the front window 303 can in some embodiments overlay the other display components and is configured to protect the other display components.
- the front window 303 made from glass can be approximately 0.5 to approximately 1.2 millimetres thick.
- the front window 303 can be manufactured from a plastic or other protective screen material suitable for both enabling the other components from performing their tasks and protecting the other components from physical or other damage.
- the front window 303 can in some embodiments provide a dielectric material between a capacitive touch interface touch sensor and the user's finger, while the front window 303 is also sufficiently transparent to permit any display elements under the window being seen by the user.
- the front window 303 for example as shown in Figure 3 covers the touch sensor 503 and in some embodiments can be connected by a further layer of optically clear adhesive.
- the touch sensor covers the display element which lies on the flexible membrane layer 507 it would be understood that the layers could be reordered into any suitable arrangement.
- the display element can employ further layers such as a light guide layer for projecting a light towards the user.
- the light guide layer can be formed from any suitable material for conveying a light from a light source (not shown) and projecting the light to the user.
- the light guide can diffuse the light to produce a more pleasing display image.
- the display element can employ a hard coated PET layer which can provide both support for and protect the display and/or flexible membrane from physical damage.
- the display element is not a filtering display where a uniform (or generally uniform) light source is filtered to produce an image but may be a generated display such as an light emitting diode (LED) or active matrix organic light emitting diode (AMOLED) display.
- LED light emitting diode
- AMOLED active matrix organic light emitting diode
- the flexible membrane layer 507 can be manufactured as one of the other above described PET films.
- the flexible PET membrane may be an extension of one of the ITO on PET layers extended beyond the shape of the touch sensor to enable it to be fixed to the case.
- the ITO on PET layer may thus be both the flexible membrane and be sensitive to capacitive changes.
- the flexible membrane may be formed by a polycarbonate layer.
- a thickness of approximately 0.1mm polycarbonate may provide sufficient tensile strength and flexibility.
- the flexible membrane 507 can be in some embodiments considered to be a laminar film or layer which is located at least at some contact area to an inner part comprising at least one of the window, touch sensor and display element and at least at some other contact area to the outer part comprising at least one of the frame or body part.
- the flexible membrane 507 furthermore in these embodiments maintains a flexible connection between the inner part and the outer part.
- the flexible membrane 507 is configured in these embodiments to be flexible in that it is elastic in nature such that when pressure is applied to the front window 303 the flexible membrane 507 can move or flex relative to the frame or body part and thus the inner part can move relative to the outer part.
- the flexible membrane layer 507 in such embodiments can permit without undue damping the transmission of force generated by a piezoelectric actuator 305 such as a force of 1 to 2 N to the display assembly 304 can be sensed by the user.
- the flexible membrane 507 together with the rubber force contact 501 in some embodiments can further limit the motion of the inner part relative to the outer or peripheral part.
- the flexible membrane 507 and the rubber force contact 501 may therefore prevent the inner part from 'hovering'.
- Hovering is an effect experienced by a user where when the inner and outer parts can move laterally as well as vertically with respect to each other. This for example is found in systems where gaskets wear or are loose and thus produce a slipping, tipping or rolling motion of the inner part relative to the peripheral part. This effect is especially noticeable in large touch interfaces and touch screen displays. This hovering may not only be unpleasant to interact with as the button press feels broken, but may vibrate and generate a buzzing or noise which would lead the user to think that the product was faulty or sub-standard.
- the flexible membrane 507 is irregular in thickness along at least one of the axis of the membrane. This can for example produce the result of defining the first region of the flexible membrane and the second region of the flexible membrane as shown in Figures 2b and 2c .
- the thickness of the flexible membrane 507 in such embodiments can be configured such that the flexible membrane 507 has a narrowing profile which has a maximum thickness approximately at the centre of the longest axis of the flexible membrane/display assembly.
- the flexible membrane is configured to be thickest 521 at a region close to the centre of the major axis of the device and thinnest 353 at the ends of the major axis.
- the profile thickness changes for the periphery of the flexible membrane 507, in other words at the interface between the display assembly and case so to reduce the mass of the membrane.
- the flexible membrane 507 profile changes for the complete 'width' of the flexible membrane 507 for manufacturing simplicity.
- the effect of the changing profile of the flexible membrane 507 is such that the thicker the membrane the greater inertia the display assembly has because of the reduction in flexibility of the membrane at that point. In other words the thicker the membrane the greater damping effect the flexible membrane produces. In such embodiments where the thickness is greatest at the approximate centre point between two actuators 305 as can be seen with respect to Figure 5 , by the arrow head and the green line.
- the flexible membrane 507 is thus in embodiments when thin is light and does not therefore produce significantly more undamped weight in addition to the mass of the suspended display assembly to be moved by the piezoelectric actuator 305.
- the flexible membrane 507 is thus in embodiments when thicker is heavier and produces more undamped weight in addition to the mass of the suspended display assembly to be moved by the piezoelectric actuator 305.
- the elasticity or flexibility of the flexible membrane 507 is such that it enables a vertical or sheer displacement of the display assembly with respect to the body part 311/frame part 301 such that the user experiences a response similar to that of pressing a physical key or button.
- the flexible membrane 507 is applied across the apparatus extending to thus provide a dust and moisture proof seal protecting the delicate electronic circuitry and mechanical components from water, dust, or other materials.
- the apparatus 10 comprises a frame part 301 configured to locate the display assembly 304 in relation to the body part 311 as described herein.
- the piezoelectric actuator 305 can be modulated in such a way that the modulation transmitted via the flexible membrane laminar to the display 304 causes the display 304 to generate audible oscillations.
- the display can be used as a flat panel speaker structure where the flexible membrane 305 provides sufficient damping (but not under-damping or over-damping) in the transmission of the piezoelectric actuated vibration to the display 304.
- the operation of the transducers on the display can be employed not only to generate audible oscillations but also to provide haptic feedback.
- an example actuator system is shown suitable for generating both audible oscillations and also haptic feedback.
- Figure 6a a schematic view of such an actuator system 400 is shown.
- the actuator system 400 can in some embodiments be configured to receive both haptic or vibration input signals for generating haptic movement of the actuators 305 and thus the display 304 assembly and also to receive an audio input signal for generating acoustic movement of the actuators 305 and thus the display 304.
- the haptic or vibration input signal can in some embodiments be a sine wave (or series of sine waves) which are tuned to the mass/spring resonance characteristics of actuator 305 and display 304. Furthermore in some embodiments the haptic or vibration input signal can in some embodiments be a sine wave (or series of sine waves) with a frequency of less than 500 Hz such that they do not fall within the sensitive region of human hearing.
- the actuator system 400 furthermore in some embodiments comprises a low pass filter 401 configured to receive the haptic or vibration input signal and output a frequency limited signal to a summation device 405 or summer.
- the cut off frequency of the signal should be chosen such that the output of the low pass filter 401 has a cut off region from 100 to 500 Hz.
- the actuator system 400 furthermore in some embodiments comprises a high pass filter 403 configured to receive the audio input signal and output a frequency limited signal to a summation device 405 or summer.
- the cut off frequency of the signal should be chosen such that the output of the high pass filter 403 has a cut off region from 100 to 500 Hz.
- the cut off region of the high pass filter 403 is chosen to be higher than the cut off region of the low pass filter 401 such that the output filtered haptic signals and the output filtered audio signals do not have significant content on the same frequencies. This can be seen for example in Figure 6b where the filtered vibra 421 and audio 423 signals do not significantly overlap in frequency.
- the actuator system 400 in some embodiments further comprises a summation device configured to receive output filtered haptic signals and the output filtered audio signals and combine them before outputting them to an actuator amplifier 407.
- a summation device configured to receive output filtered haptic signals and the output filtered audio signals and combine them before outputting them to an actuator amplifier 407.
- the combined output filtered haptic signals and the output filtered audio signals having been filtered such that they have little or no content on the same frequencies produce an output with an improved sensitivity and clearness of vibration.
- the actuator system 400 in some embodiments can further comprise an actuator amplifier 407 configured to receive the combined filtered audio and haptic signals and generate a signal suitable for driving the actuator or actuators 305.
- an actuator amplifier 407 configured to receive the combined filtered audio and haptic signals and generate a signal suitable for driving the actuator or actuators 305.
- the actuator system 400 furthermore comprises an actuator 305 configured to receive the output of the actuator amplifier 407 and generate movement of the display 304 suitable for generating both an audible output and also haptic output.
- the user can at the same time listen to music using the display and get haptic feedback from the device to support a text type input. Furthermore as the audio playback contains no or little frequency components in the vibration frequency area and the vibration signal contains no or little frequency components in the audio frequency area, the user can easily distinguish the vibration/haptic feedback from the music playback. In other words by using the high and low pass filtering in such embodiments the fidelity of these two simultaneous signals reproduced by the display is improved.
- a multichannel actuator system is shown which can be used either in combination with the example actuator system shown in Figure 6a or can be used separately from.
- the each of the left actuator signal and right actuator signals can be the audio signal input to the high pass filter.
- any suitable re-arrangement or merging of components could be furthermore be implemented by the person skilled in the art when combining the two example actuator systems.
- the multichannel system is a stereo or two channel system. However it would be appreciated that any suitable number of channels can be implemented by applying minor modifications to the examples shown.
- the multichannel actuator system 500 in some embodiments can comprise a first filter 551 configured to receive the first audio channel signal, which in the example shown in Figure 7 is the left channel audio signal.
- the first filter is configured to generate a lower frequency (LF) band output and a higher frequency (HF) band output.
- the first filter 551 comprises a quadrature mirror filter structure.
- the lower frequency - higher frequency cut off is in the range from 500 to 1000 Hz.
- the higher frequency (HF) output components are passed to a first channel summation device (sum) 557 or signal combiner.
- the lower frequency (LF) output components are passed to a central summation device (sum) 555.
- the multichannel actuator system 500 furthermore in some embodiments can comprise a second filter 553 configured to receive the second audio channel signal, which in the example shown in Figure 7 is the right channel audio signal.
- the second filter 553 is configured to generate a lower frequency (LF) band output and a higher frequency (HF) band output.
- the second filter 553 comprises a quadrature mirror filter structure.
- the lower frequency - higher frequency cut off is the same as the first filter 551 cut off, in other words in the range from 500 to 1000 Hz.
- the higher frequency (HF) output components are passed to a second channel summation device (sum) 559 or signal combiner.
- the lower frequency (LF) output components are passed to the central summation device (sum) 555.
- the multichannel actuator system 500 furthermore comprises a central summation device 555.
- the central summation device receives the lower frequency band components from each audio channel and generates a combined lower frequency component signal.
- the combined lower frequency signal is passed to each of the channel summation devices.
- the combined lower frequency signal is passed to the first channel summation device 557 and the second channel summation device 559.
- the multichannel actuator system 500 furthermore in some embodiments comprises a first channel summation device 557.
- the first channel summation device 557 is configured to receive the first channel higher frequency signal from the first channel filter 551 and the combined lower frequency signal from the central summation device 555 and combine them to produce a first (left) actuator audio signal.
- the first actuator audio signal can then in some embodiments be output to a first (left) actuator amplifier 407 L .
- the multichannel actuator system 500 comprises a first (left) actuator amplifier 407 L .
- the first actuator amplifier 407 L can in such embodiments be configured to receive the first actuator audio signal and generate a signal suitable for driving the first (left) actuator 305 L .
- the multichannel actuator system 500 furthermore in such embodiments comprises a first (left) actuator 305 L configured to receive the output of the first actuator amplifier 407 L and generate movement of the display 304 suitable for generating an audible output dependent on the first channel audio signal.
- the multichannel actuator system 500 furthermore in some embodiments comprises a second channel summation device 559.
- the second channel summation device 559 is configured to receive the second channel higher frequency signal from the second channel filter 553 and the combined lower frequency signal from the central summation device 555 and combine them to produce a second (right) actuator audio signal.
- the second actuator audio signal can then in some embodiments be output to a second (right) actuator amplifier 407 R .
- the multichannel actuator system 500 further comprises a second (right) actuator amplifier 407 R .
- the second actuator amplifier 407 R can in such embodiments be configured to receive the second actuator audio signal and generate a signal suitable for driving the second (right) actuator 305 R .
- the multichannel actuator system 500 furthermore in such embodiments comprises a second (right) actuator 305 R configured to receive the output of the second actuator amplifier 407 R and generate movement of the display 304 suitable for generating an audible output dependent on the second channel audio signal.
- a second (right) actuator 305 R configured to receive the output of the second actuator amplifier 407 R and generate movement of the display 304 suitable for generating an audible output dependent on the second channel audio signal.
- each piezoelectric actuator 305 is configured to vibrate in such a way that the bending moment of the piezoelectric actuator 305 transfers a force via the rubber force contact 501 to the display assembly 304 attempting to cause the display to move 1003 substantially in translational mode of displacement.
- the display assembly 304 moves such that the force causes a bending or pivoting about the thickened profile region display assembly 304.
- the vibration caused by each transducer is relatively isolated from the vibration caused by the other transducers separated by the thickened membrane. It is therefore in such embodiments possible to produce stereo or other multi-channel sound images using a single display assembly without the problem of unclear sound imagery caused where the vibration from one channel propagates to the other audio channel areas of the display assembly.
- the lower frequency audio signals which are generally not directionally determined by the user, by being generated by all of the actuators can generate an audio signal of suitable volume.
- the driving signals received by each actuator are modified so that the highest frequencies components carry the different content (left and right).
- the lower frequencies components (cut-off somewhere in 500-1000 Hz) having been summed together can be output as a mono (or single channel signal) so that the display assembly/plate movement is similar on both sides for lower frequencies. In such embodiments therefore the higher frequency components (higher than the cut-off) give the stereo sound 'feeling' .
- the display assembly 304 thus can produce a sufficient air displacement to generate audio signals with sufficient amplitude to implement not only earpiece operations but also to provide speaker operations such as for example integrated hands free speaker operations.
- the flexible membrane, frame part and body part can in some embodiments form a seal the whole system is easy to seal from moisture and dust as no sound holes are required and apparatus can be easily weather proofed.
- the display assembly as both display and air mass driver no internal audio transducers are required thus reducing required volumes and space and allowing thinner and more aesthetically pleasing products to be designed.
- acoustic sound channels is intended to cover sound outlets, channels and cavities, and that such sound channels may be formed integrally with the transducer, or as part of the mechanical integration of the transducer with the device.
- the design of various embodiments of the invention may be implemented in hardware or special purpose circuits, software, logic or any combination thereof.
- some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto.
- firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto.
- While various aspects of the invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
- the design of embodiments of this invention may be implemented by computer software executable by a data processor of the mobile device, such as in the processor entity, or by hardware, or by a combination of software and hardware.
- any blocks of the logic flow as in the Figures may represent program steps, or interconnected logic circuits, blocks and functions, or a combination of program steps and logic circuits, blocks and functions.
- the software may be stored on such physical media as memory chips, or memory blocks implemented within the processor, magnetic media such as hard disk or floppy disks, and optical media such as for example DVD and the data variants thereof, CD.
- the memory used in the design of embodiments of the application may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory.
- the data processors may be of any type suitable to the local technical environment, and may include one or more of general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASIC), gate level circuits and processors based on multi-core processor architecture, as non-limiting examples.
- Embodiments of the inventions may be designed by various components such as integrated circuit modules.
- circuitry refers to all of the following:
- circuitry' applies to all uses of this term in this application, including any claims.
- the term 'circuitry' would also cover an implementation of merely a processor (or multiple processors) or portion of a processor and its (or their) accompanying software and/or firmware.
- the term 'circuitry' would also cover, for example and if applicable to the particular claim element, a baseband integrated circuit or applications processor integrated circuit for a mobile phone or similar integrated circuit in server, a cellular network device, or other network device.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
Description
- The present invention relates to a display apparatus providing speaker functionality. The invention further relates to, but is not limited to, display apparatus providing speaker functionality for use in mobile devices.
- Many portable devices, for example mobile telephones, are equipped with a display such as a glass or plastic display window for providing information to the user. Furthermore such display windows are now commonly used as touch sensitive inputs. The use of a touch sensitive input with the display has the advantage over a mechanical keypad in that the display may be configured to show a range of different inputs depending on the operating mode of the device. For example, in a first mode of operation the display may be enabled to enter a phone number by displaying a simple numeric keypad arrangement and in a second mode the display may be enabled for text input by displaying an alphanumeric display configuration such as a simulated Qwerty keyboard display arrangement.
- However such touchscreen inputs have a disadvantage with respect to mechanical keys in that the user does not experience the usual expected click or mechanical switch feedback to indicate that an input has been detected. To attempt to overcome this some equipment has been provided with a mechanical or audible simulation of a key press. Some touch screen devices are equipped with device haptic feedback, in other words an ordinary vibration is used to make the whole device shake (and also provide an audio cue of the key press) as the user touches the screen and is detected. These device-haptic devices however are themselves problematic as they require significant current to operate in order to generate significant feedback force. This is generally because the construction of the device often requires that the front window is firmly located or fixed to the surrounding frame or connected in such a way to significantly damp the force generated by the actuator before it is applied.
- Furthermore some devices use electro-acoustic transducers to produce audio for earpiece and integrated hands free (IHF) operations as well as for alert tones. The moving coil dynamic speaker configuration used is typically relatively large in relation to the volume within the device and require specific signal processing considerations in order that the acoustic frequency response is acceptable. Furthermore moving coil transducers can attract contaminants such as small iron particles from within the internal volume of the device and also through ports provided to enable acoustic wave transmission from the speaker to the external environment. These contaminants can cause distortion and faults within the speakers significantly reducing the lifetime of the device.
- Therefore a typical device configured to produce both audio and haptic outputs would typically require a vibrator component and an electro-acoustic transducer which incurs both cost of component, and also volume cost as they are relatively difficult to fit into a modern device and need to be located far from the mass centric point in order to generate a good performance. Furthermore in devices generating a multi-channel audio signal these modern devices require additional volume and component cost as additional transducers are required to generate each of the audio channels.
-
WO 2009/067708 discusses electroactive transducers as well as methods of producing a haptic effect in a user interface device simultaneously with a sound generated by a separately generated audio signal and electroactive polymer transducers for sensory feedback applications in user interface devices. -
US 2010/156818 discusses methods and systems for processing touch inputs. The invention in one respect includes reading data from a multi-touch sensing device such as a multi-touch touch screen where the data pertains to touch input with respect to the multi-touch sensing device, and identifying at least one multi-touch gesture based on the data from the multi-touch sensing device and providing an appropriate multi-haptic response. -
US 2010/141408 discusses a control panel apparatus which includes a control panel that is vibrated to generate sound and/or haptic feedback. The control panel apparatus is configured to receive tactile input, such as a touchscreen, and to provide tactile feedback so as to function like a haptic panel, in response to a haptic signal component of a driving signal. The control panel is also configured to function as an audio speaker in response to an audio signal component of the driving signal. The haptic signal has a wider bandwidth, in the range of approximately 100-400 Hz, and the audio signal has a narrower bandwidth, in the range of approximately 20 Hz-20 kHz. The driving signal is configured to include either or both of the haptic signal and the audio signal. One or more drive elements are coupled to a control panel, each drive element driven by a driving signal. Each drive element converts the electrical driving signal to mechanical movement, thereby vibrating the control panel. In the case of multiple drive elements, each drive element is coupled to a different portion of the control panel. -
WO 2007/049091 discusses a portable electronic device, such as a pager or a mobile station, has a housing and a vibration motor coupled to the housing for imparting vibration to it. Within the device, an electronic audio signal is preferably split into high and low frequency components by parallel filters. Pulses of the low frequency component are rectified, voltages of those rectified pulses are quantified and at least some are converted to pulse widths, and the train of pulse widths is amplified to drive the vibration motor, resonating the housing at in correspondence with the pulse amplitudes of at least some pulses of the original electronic audio signal. Various adaptive schemes are presented to control the number of modulated pulses that drive the vibration motor to enhance the user experience. The vibration motor may act as an audible sub-woofer and/or may provide a bass effect vibration within or beyond the audible range in correspondence to certain spaced pulses of the original audio signal. - This application proceeds from the consideration that the provision of a flexible membrane connecting a display to the cover or main body of the device and capable of transferring the force provided by an actuator to the user by flexing and not significantly damping the force may provide both the physical and mechanical support for the display without unduly limiting the action of the display in producing tactile or haptic feedback and audio speaker functionality.
- It is an aim of at least some embodiments of the invention to address one or more of these problems.
- The invention is set out in the appended set of claims.
- For better understanding of the present invention, reference will now be made by way of example to the accompanying drawings in which:
-
Figure 1 shows schematically an apparatus suitable for employing embodiments of the application; -
Figure 2a shows a schematic exploded elevation view of example topology for apparatus according to some embodiments; -
Figure 2b shows a schematic view of apparatus according to some embodiments; -
Figure 2c shows a schematic cross section view of the apparatus shown inFigure 2b according to some embodiments; -
Figure 2d shows a schematic view of apparatus according to some further embodiments; -
Figure 2e shows a schematic first cross section view of the apparatus shown inFigure 2d according to some embodiments; -
Figure 2f shows a schematic second cross section view of the apparatus shown inFigure 2d according to some embodiments; -
Figure 3 shows a further schematic sectioned view of the example topology for apparatus according to some embodiments; -
Figure 4 shows a schematic view of the profile of the flexible membrane thickness as shown inFigures 2 and3 according to some embodiments; -
Figure 5 shows a schematic view of the effect of the changing profile according to some embodiments; -
Figure 6a shows a schematic view of a signal combiner according to some embodiments; -
Figure 6b shows a schematic view of a frequency response for the signal combiner according to some embodiments; and -
Figure 7 shows a schematic view of a channel separator according to some embodiments. - The application describes apparatus and methods of construction for apparatus suitable for generating touch screen devices capable of creating a more interactive user experience and audio generation through the screen. Thus as described herein in embodiments of the application, the use of a flexible membrane for connecting the display with the cover or case enables the display to be driven substantially in a manner suitable for combining both haptic and audio signals and also in some embodiments in a manner suitable for multichannel audio signals. Driving the display in such ways greatly enhances the user haptic experience and generates acoustic waves suitable for earpiece or speaker replacement. The construction of such a display module and some examples of its implementation within apparatus is described in further detail hereafter.
- With respect to
Figure 1 a schematic block diagram of an exampleelectronic device 10 or apparatus on which embodiments of the application can be implemented. Theapparatus 10 is such embodiments configured to provide improved haptic feedback and audio generation. - The
apparatus 10 is in some embodiments a mobile terminal, mobile phone or user equipment for operation in a wireless communication system. In other embodiments, the electronic device is any suitable electronic device configured to provide a image display, such as for example a digital camera, a portable audio player (mp3 player), a portable video player (mp4 player). In other embodiments the apparatus can be any suitable electronic device with touch interface (which may or may not display information) such as a touch-screen or touch-pad configured to provide feedback when the touch-screen or touch-pad is touched. For example in some embodiments the touch-pad can be a touch-sensitive keypad which can in some embodiments have no markings on it and in other embodiments have physical markings or designations on the front window. An example of such a touch sensor can be a touch sensitive user interface to replace keypads in automatic teller machines (ATM) that does not require a screen mounted underneath the front window projecting a display. The user can in such embodiments be notified of where to touch by a physical identifier - such as a raised profile, or a printed layer which can be illuminated by a light guide. - The
apparatus 10 comprises a touch input module oruser interface 11, which is linked to aprocessor 15. Theprocessor 15 is further linked to adisplay 12. Theprocessor 15 is further linked to a transceiver (TX/RX) 13 and to amemory 16. - In some embodiments, the
touch input module 11 and/or thedisplay 12 are separate or separable from the electronic device and the processor receives signals from thetouch input module 11 and/or transmits and signals to thedisplay 12 via thetransceiver 13 or another suitable interface. Furthermore in some embodiments thetouch input module 11 anddisplay 12 are parts of the same component. In such embodiments thetouch interface module 11 anddisplay 12 can be referred to as the display part or touch display part. - The
processor 15 can in some embodiments be configured to execute various program codes. The implemented program codes, in some embodiments can comprise such routines as touch capture digital processing or configuration code where the touch input module inputs are detected and processed, display image processing and image interaction code where the data to be passed to generate the display images is generated for example based on the detection of the input, or actuator processing generating an actuator signal for driving an actuator. The implemented program codes can in some embodiments be stored for example in thememory 16 and specifically within aprogram code section 17 of thememory 16 for retrieval by theprocessor 15 whenever needed. Thememory 15 in some embodiments can further provide asection 18 for storing data, for example data that has been processed in accordance with the application, for example display information data. - The
touch input module 11 can in some embodiments implement any suitable touch screen interface technology. For example in some embodiments the touch screen interface can comprise a capacitive sensor configured to be sensitive to the presence of a finger above or on the touch screen interface. The capacitive sensor can comprise an insulator (for example glass or plastic), coated with a transparent conductor (for example indium tin oxide - ITO). As the human body is also a conductor, touching the surface of the screen results in a distortion of the local electrostatic field, measurable as a change in capacitance. Any suitable technology may be used to determine the location of the touch. The location can be passed to the processor which may calculate how the user's touch relates to the device. The insulator protects the conductive layer from dirt, dust or residue from the finger. - In some other embodiments the touch input module can be a resistive sensor comprising of several layers of which two are thin, metallic, electrically conductive layers separated by a narrow gap. When an object, such as a finger, presses down on a point on the panel's outer surface the two metallic layers become connected at that point: the panel then behaves as a pair of voltage dividers with connected outputs. This physical change therefore causes a change in the electrical current which is registered as a touch event and sent to the processor for processing.
- In some other embodiments the touch input module can further determine a touch using technologies such as visual detection for example a camera either located below the surface or over the surface detecting the position of the finger or touching object, projected capacitance detection, infra-red detection, surface acoustic wave detection, dispersive signal technology, and acoustic pulse recognition.
- The
apparatus 10 can in some embodiments be capable of implementing the processing techniques at least partially in hardware, in other words the processing carried out by theprocessor 15 may be implemented at least partially in hardware without the need of software or firmware to operate the hardware. - The
transceiver 13 in some embodiments enables communication with other electronic devices, for example in some embodiments via a wireless communication network. - The
display 12 may comprise any suitable display technology. For example the display element can be located below the touch input module and project an image through the touch input module to be viewed by the user. Thedisplay 12 can employ any suitable display technology such as liquid crystal display (LCD), light emitting diodes (LED), organic light emitting diodes (OLED), plasma display cells, Field emission display (FED), surface-conduction electron-emitter displays (SED), and Electophoretic displays (also known as electronic paper, e-paper or electronic ink displays). In some embodiments thedisplay 12 employs one of the display technologies projected using a light guide to the display window. As described herein thedisplay 12 in some embodiments can be implemented as a physical fixed display. For example the display can be a physical decal or transfer on the front window. In some other embodiments the display can be located on a physically different level from the rest of the surface, such a raised or recessed marking on the front window. In some other embodiments the display can be a printed layer illuminated by a light guide under the front window. - With respect to
Figure 2a an exploded view of an example apparatus or device according to some embodiments of the application are shown. Further exemplary views are shown with respect toFigures 2b to 2f . Furthermore with respect toFigure 3 an assembled sectioned view of the example apparatus is shown. Theapparatus 10 can comprise abody part 311 or outer frame which can be constructed from any suitable material and is configured to provide a structure to which other components may be coupled and/or may protect other components from damage. In some embodiments thebody part 311 can comprise an inner surface to which internal components are located and an outer surface to which external components are located and which is exposed to the elements. In some embodiments the junction between the inner surface and the outer surface is connected via a filet or chamfer to smooth the junction. In such embodiments by smoothing the junction there is less chance of damaging other components. - The
apparatus 10 in some embodiments comprises abattery 309. Thebattery 309 can be any suitable electrical power generating means and can employ any suitable electrical charge storage or generating technology, for example but not exclusively lithium polymer cells, fuel cell, solar cell or a combination of suitable technologies. In some embodiments thebattery 309 is rechargeable or refillable and is connected via a port in thebody part 311 to be able to receive a recharging or refilling coupling, for example a recharger plug to couple to a recharging socket for supplying power to recharge thebattery 309. In some embodiments thebattery 309 is configured to be located within thebody part 311. For example thebody part 311 can in some embodiments employs moulding tabs or other locating means on the inner surface to fix or locate the battery in position. - In some embodiments the
apparatus 10 further employs a printed wiring board (PWB) 307. The printedwiring board 307 is configured to provide a suitable structure for locating electrical components. For example in some embodiments theprocessor 15,transceiver 13 andmemory 16 shown inFigure 1 can be located on the printed wiring board. In some embodiments there can be employed more than one printedwiring board 307 layer. Furthermore in some embodiments the printedwiring board 307 can be replaced by a printed circuit board (PCB) or surface mounted board suitable for locating surface mounted electrical components on it. In some embodiments the printedwiring board 307 is configured to be coupled to thebattery 309 whereby thebattery 309 is configured to supply the printedwiring board 307 with power to operate the electrical components located on it. In the example shown inFigures 2a and3 the printed wiring board is located over the battery and within thebody part 311. It would be understood that in some embodiments thebody part 311 can employ moulding tabs or other locating means on the inner surface to fix or locate the printed wiring board in position. - The
apparatus 10 further comprises at least onepiezoelectric actuator 305. In the example shown inFigure 2a the apparatus employs a firstpiezoelectric actuator 305 located towards one end ofbody part 311 and a secondpiezoelectric actuator 305 located at the opposite end of thebody part 311. Thepiezoelectric actuator 305 is in some embodiments coupled to receive power from thebattery 309 via the printedwiring board 307 and to produce a physical moment or force in response to a current passed through thepiezoelectric actuator 305. - Each
piezoelectric actuator 305 furthermore can in some embodiments be located within the case body by an inner recess which is configured to receive thepiezoelectric actuator 305. The inner recess 511 is configured to locate either end of thepiezoelectric actuator 305 in position such that in some embodiments when thepiezoelectric actuator 305 is operated the ends of the piezoelectric actuator are fixed nodes. Furthermore as thepiezoelectric actuator 305 in some embodiments is suspended at each end by thebody part 311 recess 511 such that when a current is applied thepiezoelectric actuator 305 flexes and can 'push' against the case body thus producing a motion in and away from the direction of the display. In other words where the display is considered to be in a plane designated the X-Y axis the actuations of the piezoelectric actuator to actuate or produce a force in a "Z" dimension or direction. In some embodiments there is configured to be a suitable air gap between thepiezoelectric actuator 305 and the printedwiring board 307 in order to prevent 'clipping' of the actuation of thepiezoelectric actuator 305. - Although the following examples are described with respect to the use of a
piezoelectric actuator 305 it would be understood that any suitable actuator capable of producing a translational force to a display could be implemented in some further embodiments. For example in some other embodiments an eccentric mass can be employed to produce a force which may be passed. In further examples a moving coil or moving magnet actuator can generate the force. - In some further embodiments the display can directly experience the force which is transmitted from the piezoelectric actuator to the
display assembly 304 in such a manner to permit a planar motion of the display assembly. For example in some embodiments the piezoelectric actuator is shaped with a suitable thickening to in a central portion to provide a projection through which force can be passed to a display. - In some embodiments the
piezoelectric actuator 305 is further coupled via a conductive soft surface mounted technology (SMT) pad to the printed wiring board (PWB) which provides an electrical coupling between thepiezoelectric actuator 305 and the printedwiring board 307. - The
apparatus 10 can in some embodiments comprise arubber force contact 501. Therubber force contact 501 is configured to be located on or be in contact with thepiezoelectric actuator 305 approximately half way along the length of the actuator and translate the bending motion of the piezoelectric actuator to affect a movement of a display assembly. In such embodiments therubber force contact 501 can be manufactured from any suitable material, such as natural rubber, synthetic rubber, or plastic being capable of transmission of force in a direction. In some embodiments therubber force contact 501 can be designed to provide a degree of buffering of force or 'damping' between thepiezoelectric actuator 305 and the display so to prevent the display experiencing shock and/or damage when thepiezoelectric actuator 305 is driven. - The
apparatus 10 can in some embodiments further comprise adisplay 304 or display assembly. Thedisplay 304 can comprise any suitable display technology as described herein. - In some embodiments the
display 304 is configured to employ a flexible membrane orplate suspension membrane 507. - With respect to
Figure 2b , an example according to some embodiments is shown detailing theplate suspension membrane 507 characteristics. Thebody part 311 and theframe part 301 as shown inFigure 2b can form a supporting frame which is configured not only to protect the components of the apparatus but also provide a supporting frame against which the components of the apparatus can be located or react against. - Furthermore in some embodiments the
flexible membrane 507 locates thedisplay assembly 304 and thefront window 303 with respect to the supporting frame. Theflexible membrane 507 in some embodiments can be configured such that it possesses differing characteristics for differing regions. For example a first region orregions 507b of theflexible membrane 507 can present a more rigid characteristic or have a higher degree of inertia when experiencing a force. Thefirst region 507b of theflexible membrane 507 can be located approximately in the region of flexible membrane between at least two actuators so that the effect of actuation on thedisplay assembly 304 and/orfront window 303 is damped before it can reach another actuator region of thedisplay assembly 304 and/orfront window 303. Furthermore a second region orregions 507a of the flexible membrane can present a less rigid characteristic or have a lover degree of inertia when experiencing a force. Thesecond region 507a can be located approximately in the same location as any transducer so that the transducer can actuate thedisplay assembly 304 and/orfront window 303 with less damping effect. - With respect to
Figure 2c a cross-section of the example apparatus shown inFigure 2b is shown. The cross-section shown is the view taken along the short axis of the apparatus. In such embodiments the second region orregions 507a of the flexible membrane is shown coupling thedisplay assembly 304 to the supporting frame comprising thebody part 311 and theframe part 301, with thefront window 303 overlying both the display assembly and theflexible membrane 507 or suspension. - With respect to
Figure 2d , a further example according to some embodiments is shown detailing further controlling of theplate suspension membrane 507 characteristics. Thebody part 311 and theframe part 301 forms the supporting frame which is configured not only to protect the components of the apparatus but also provide a supporting frame against which the components of the apparatus can be located or react against. Furthermore in some embodiments and similar toFigures 2b and2c theflexible membrane 507 locates thedisplay assembly 304 and thefront window 303 with respect to the supporting frame. Theflexible membrane 507 in these embodiments can be configured such that it possesses a substantially uniform characteristic throughout the range of the flexible membrane. - With respect to
Figure 2e a cross-section of the example apparatus shown inFigure 2d is shown. The cross-section shown is the view taken along the long axis of the apparatus. In such embodiments thedisplay assembly 304 is coupled to a part of the supporting frame or other supporting structure (such as pcb or battery) via a substantially resilient member. In some embodiments the substantially resilient member can comprise a layer of tape orglue 390. The substantiallyresilient member 390 can therefore in these embodiments damp the motion of thedisplay assembly 304 and/orfront window 303 overlying thedisplay assembly 304 in such a manner that any motion propagating transversely along thedisplay assembly 304 and/orfront window 303 is stopped or substantially stopped by theresilient member 390. This therefore produces an effect of significantly increasing the inertia to motion of thedisplay assembly 304 and/orfront window 303 coupled to theresilient member 390. - With respect to
Figure 2f a further cross-section of the example apparatus shown inFigure 2d is shown. The cross-section shown is the view taken along the short axis of the apparatus. In such embodiments thedisplay assembly 304 is coupled to a part of the supporting frame or other supporting structure rigidly coupled to the supporting frame. - The example shown in
Figure 3 shows the flexible membrane being located in contact or substantially in contact with the rubber force contact and suspended at least partially at a periphery of theflexible membrane 507 between theframe part 301 andbody part 311. In some embodiments as shown inFigure 3 theflexible membrane 507 is sandwiched at the periphery of the membrane between thebody part 311 and theframe part 301 and located by a suspension ring 509 attached to theflexible membrane 507 and located within asuspension ring recess 513 formed on the inner surface of thebody part 311. In some embodiments the suspension ring 509 can be formed as a substantially thickened section of theflexible membrane 507. - In some embodiments the inner surface of the
body part 311 can be attached to theflexible membrane 507 via an adhesive layer. In some embodiments the adhesive layer extends beyond the static area of contact between the inner surface of thebody part 311 and theflexible membrane 507 in order to provide additional protection at any dynamic area of contact between the inner surface of thebody part 311 and theflexible membrane 507. Theflexible membrane 507 in some embodiments may be manufactured from an elastomer. The elastomer in some embodiments may be any suitable film or foil. For example the suitable film or foil may be in various embodiments a polyethylene terephthalate (PET) film, a polycarbonate (PC) foil, or a silicone foil. - The
flexible membrane 507 in such embodiments can furthermore be attached via a further adhesive layer to a surface of theframe part 301. Thebody part 311 and theframe part 301 thus in these embodiments locates at least some of the flexible membrane. In some embodiments the junction between the surfaces ofbody part 311 and theframe part 301 are configured with a fillet or chamfer to smooth the junction for a similar reason as above for protecting the membrane while the membrane is dynamic. Similarly in some embodiments the further adhesive layer may extend beyond the static area of contact to provide additional protection at any dynamic area of contact. - The
flexible membrane 507 can be constructed out of polyethylene terephthalate (PET) polyester film. In some embodiments the film can be biaxially oriented polyethylene terephthalate which may be used because of its high tensile strength, chemical and dimensional stability, transparency and also electrical insulation properties. The PET flexible membrane layer can in some embodiments be approximately 0.01 to approximately 1 mm thick as this thickness has been shown to provide both the flexibility in response to forces from the user and from the actuator but also has sufficient tensile strength not to break under such forces. The PET flexible membrane 211 can be constructed by any suitable means. For example the PET layer may be constructed by extrusion onto a chill roll which quenches it into an amorphous state. The PET flexible membrane layer furthermore in some embodiments can be constructed in such a way that the crystallites grow rapidly but reach the boundary of neighbouring crystallites and remain smaller than the wavelength of visible light and thus produce a film having excellent clarity. - In some embodiments the
display assembly 304 can further comprise a display element. The display element can in some embodiments comprise a static display array located beneath thefront window 303 and projected up to the user through thefront window 303. - The graphic layer can comprise any suitable material for blocking projected light. In such embodiments the graphic layer can be approximately 0.05 to approximately 0.07 mm thick. Furthermore in some embodiments the graphic layer can be printed directly onto the underside of the
front window 303. In some other embodiments, for example where the display element is a dynamic display, the graphic layer can comprise any suitable material for permitting the controllable and selectable projection of light - for example a liquid crystal display element and colour filter layer, E-ink etc. - The graphic layer can in some embodiments be coupled to the
flexible membrane 507 via an optically clear adhesive (OCA) layer. The optically clear adhesive layer can be approximately 0.025 to approximately 0.05 mm thick and can be the same material as other OCA layers. - The static display array in some embodiments can also comprise a graphic layer which may be connected to the
front window 303 by a first optically clear adhesive (OCA) layer. The first optically clear adhesive layer may be approximately 0.025 to approximately 0.05 mm thick and be any suitable OCA material. - The
display assembly 304 in some embodiments further comprises a touch sensor for example a capacitive touch sensor located over the display element. - The capacitive touch sensor can in some embodiments comprise a series of layers. The layers in the capacitive touch sensor can comprise at least one Indium Tin Oxide on PET layer, and a protective hard coated PET layer. Each layer can in some embodiments be fixed to the neighbouring layers by the use of an optically clear adhesive to form a sandwich of layers.
- The display element for example can in some embodiments be connected via a second layer of optically clear adhesive (OCA) to a first layer of indium tin oxide (ITO) on PET. The second layer of OCA can in some embodiments be approximately 0.025 to approximately 0.05 mm thick.
- The first layer of indium tin oxide (ITO) on PET in some embodiments is the first of the capacitive touch interface layers. In other words the first ITO on PET layer provides a first layer capable of detecting the capacitive coupling produced by the user's finger when it touches the
front window 303. The first layer of ITO on PET can in some embodiments be approximately 0.05 to 0.2 mm thick. - The first layer of ITO on PET layer can be connected to a second ITO on PET layer via a third layer of optically clear adhesive (OCA). The third layer of OCA can in some embodiments be approximately 0.025 to approximately 0.05 millimetres thick.
- The second layer of ITO on PET can in some embodiments be a further layer capable of detecting the capacitive coupling produced by the user's finger when it touches the
front window 303. The second ITO on PET layer can in some embodiments be approximately 0.05 to approximately 0.2 mm thick. - Although the capacitive touch interface layers have been described as being ITO on PET layers it would be understood that the capacitive touch interface layers may comprise any suitable material, for example ITO on glass.
- In some embodiments the display comprises a protective or
front window 303. - The
front window 303 can in some embodiments be manufactured from glass. In some embodiments the glass may be coated with optical (to reduce glare) or oleophobic (to resist fingerprints) films to enhance the characteristics of the front window. Thefront window 303 can in some embodiments overlay the other display components and is configured to protect the other display components. In such embodiments, thefront window 303 made from glass can be approximately 0.5 to approximately 1.2 millimetres thick. - In some other embodiments the
front window 303 can be manufactured from a plastic or other protective screen material suitable for both enabling the other components from performing their tasks and protecting the other components from physical or other damage. For example thefront window 303 can in some embodiments provide a dielectric material between a capacitive touch interface touch sensor and the user's finger, while thefront window 303 is also sufficiently transparent to permit any display elements under the window being seen by the user. - The
front window 303 for example as shown inFigure 3 covers the touch sensor 503 and in some embodiments can be connected by a further layer of optically clear adhesive. - Although the above example is described where the touch sensor covers the display element which lies on the
flexible membrane layer 507 it would be understood that the layers could be reordered into any suitable arrangement. - Furthermore in some embodiments the display element can employ further layers such as a light guide layer for projecting a light towards the user. The light guide layer can be formed from any suitable material for conveying a light from a light source (not shown) and projecting the light to the user. In some embodiments the light guide can diffuse the light to produce a more pleasing display image.
- Furthermore in some embodiments the display element can employ a hard coated PET layer which can provide both support for and protect the display and/or flexible membrane from physical damage.
- In some other embodiments the display element is not a filtering display where a uniform (or generally uniform) light source is filtered to produce an image but may be a generated display such as an light emitting diode (LED) or active matrix organic light emitting diode (AMOLED) display.
- In some embodiments the
flexible membrane layer 507 can be manufactured as one of the other above described PET films. For example the flexible PET membrane may be an extension of one of the ITO on PET layers extended beyond the shape of the touch sensor to enable it to be fixed to the case. In such embodiments the ITO on PET layer may thus be both the flexible membrane and be sensitive to capacitive changes. - Although the above examples feature the flexible membrane as a PET layer it would be understood that any suitable material may be employed. For example in some embodiments the flexible membrane may be formed by a polycarbonate layer. In such embodiments a thickness of approximately 0.1mm polycarbonate may provide sufficient tensile strength and flexibility.
- The
flexible membrane 507 can be in some embodiments considered to be a laminar film or layer which is located at least at some contact area to an inner part comprising at least one of the window, touch sensor and display element and at least at some other contact area to the outer part comprising at least one of the frame or body part. Theflexible membrane 507 furthermore in these embodiments maintains a flexible connection between the inner part and the outer part. In other words theflexible membrane 507 is configured in these embodiments to be flexible in that it is elastic in nature such that when pressure is applied to thefront window 303 theflexible membrane 507 can move or flex relative to the frame or body part and thus the inner part can move relative to the outer part. - Furthermore the
flexible membrane layer 507 in such embodiments can permit without undue damping the transmission of force generated by apiezoelectric actuator 305 such as a force of 1 to 2 N to thedisplay assembly 304 can be sensed by the user. - Furthermore the
flexible membrane 507 together with therubber force contact 501 in some embodiments can further limit the motion of the inner part relative to the outer or peripheral part. Theflexible membrane 507 and therubber force contact 501 may therefore prevent the inner part from 'hovering'. Hovering is an effect experienced by a user where when the inner and outer parts can move laterally as well as vertically with respect to each other. This for example is found in systems where gaskets wear or are loose and thus produce a slipping, tipping or rolling motion of the inner part relative to the peripheral part. This effect is especially noticeable in large touch interfaces and touch screen displays. This hovering may not only be unpleasant to interact with as the button press feels broken, but may vibrate and generate a buzzing or noise which would lead the user to think that the product was faulty or sub-standard. - In some embodiments the
flexible membrane 507 is irregular in thickness along at least one of the axis of the membrane. This can for example produce the result of defining the first region of the flexible membrane and the second region of the flexible membrane as shown inFigures 2b and2c . For example as shown inFigure 3 and Figure 4 the thickness of theflexible membrane 507 in such embodiments can be configured such that theflexible membrane 507 has a narrowing profile which has a maximum thickness approximately at the centre of the longest axis of the flexible membrane/display assembly. In other words the flexible membrane is configured to be thickest 521 at a region close to the centre of the major axis of the device and thinnest 353 at the ends of the major axis. In some embodiments the profile thickness changes for the periphery of theflexible membrane 507, in other words at the interface between the display assembly and case so to reduce the mass of the membrane. In some other embodiments theflexible membrane 507 profile changes for the complete 'width' of theflexible membrane 507 for manufacturing simplicity. - The effect of the changing profile of the
flexible membrane 507 is such that the thicker the membrane the greater inertia the display assembly has because of the reduction in flexibility of the membrane at that point. In other words the thicker the membrane the greater damping effect the flexible membrane produces. In such embodiments where the thickness is greatest at the approximate centre point between twoactuators 305 as can be seen with respect toFigure 5 , by the arrow head and the green line. - The
flexible membrane 507 is thus in embodiments when thin is light and does not therefore produce significantly more undamped weight in addition to the mass of the suspended display assembly to be moved by thepiezoelectric actuator 305. - However the
flexible membrane 507 is thus in embodiments when thicker is heavier and produces more undamped weight in addition to the mass of the suspended display assembly to be moved by thepiezoelectric actuator 305. In some embodiments the elasticity or flexibility of theflexible membrane 507 is such that it enables a vertical or sheer displacement of the display assembly with respect to thebody part 311/frame part 301 such that the user experiences a response similar to that of pressing a physical key or button. - In some further embodiments, the
flexible membrane 507 is applied across the apparatus extending to thus provide a dust and moisture proof seal protecting the delicate electronic circuitry and mechanical components from water, dust, or other materials. - Furthermore the
apparatus 10 comprises aframe part 301 configured to locate thedisplay assembly 304 in relation to thebody part 311 as described herein. - In some embodiments the
piezoelectric actuator 305 can be modulated in such a way that the modulation transmitted via the flexible membrane laminar to thedisplay 304 causes thedisplay 304 to generate audible oscillations. In other words in some embodiments the display can be used as a flat panel speaker structure where theflexible membrane 305 provides sufficient damping (but not under-damping or over-damping) in the transmission of the piezoelectric actuated vibration to thedisplay 304. - In some embodiment the operation of the transducers on the display can be employed not only to generate audible oscillations but also to provide haptic feedback. With respect to
Figures 6a and 6b an example actuator system is shown suitable for generating both audible oscillations and also haptic feedback. With respect toFigure 6a a schematic view of such an actuator system 400 is shown. The actuator system 400 can in some embodiments be configured to receive both haptic or vibration input signals for generating haptic movement of theactuators 305 and thus thedisplay 304 assembly and also to receive an audio input signal for generating acoustic movement of theactuators 305 and thus thedisplay 304. The haptic or vibration input signal can in some embodiments be a sine wave (or series of sine waves) which are tuned to the mass/spring resonance characteristics ofactuator 305 anddisplay 304. Furthermore in some embodiments the haptic or vibration input signal can in some embodiments be a sine wave (or series of sine waves) with a frequency of less than 500 Hz such that they do not fall within the sensitive region of human hearing. - The actuator system 400 furthermore in some embodiments comprises a
low pass filter 401 configured to receive the haptic or vibration input signal and output a frequency limited signal to asummation device 405 or summer. In some embodiments the cut off frequency of the signal should be chosen such that the output of thelow pass filter 401 has a cut off region from 100 to 500 Hz. - The actuator system 400 furthermore in some embodiments comprises a
high pass filter 403 configured to receive the audio input signal and output a frequency limited signal to asummation device 405 or summer. In some embodiments the cut off frequency of the signal should be chosen such that the output of thehigh pass filter 403 has a cut off region from 100 to 500 Hz. Furthermore in some embodiments the cut off region of thehigh pass filter 403 is chosen to be higher than the cut off region of thelow pass filter 401 such that the output filtered haptic signals and the output filtered audio signals do not have significant content on the same frequencies. This can be seen for example inFigure 6b where the filteredvibra 421 and audio 423 signals do not significantly overlap in frequency. - The actuator system 400 in some embodiments further comprises a summation device configured to receive output filtered haptic signals and the output filtered audio signals and combine them before outputting them to an
actuator amplifier 407. In such embodiments the combined output filtered haptic signals and the output filtered audio signals having been filtered such that they have little or no content on the same frequencies produce an output with an improved sensitivity and clearness of vibration. - The actuator system 400 in some embodiments can further comprise an
actuator amplifier 407 configured to receive the combined filtered audio and haptic signals and generate a signal suitable for driving the actuator oractuators 305. - The actuator system 400 furthermore comprises an
actuator 305 configured to receive the output of theactuator amplifier 407 and generate movement of thedisplay 304 suitable for generating both an audible output and also haptic output. - It would be understood that although the above system is described with respect to a single channel audio signal that a multichannel audio signal could be implemented using the similar apparatus and methods. For example for each audio channel a separate channel pathway of high pass filter, summer, amplifier and actuator could be used with a common vibration low pass filter for the vibration signal outputting a filtered vibration signal to each audio channel summation device.
- Furthermore it would be understood that although the filters as described herein as low pass or high pass filters with respect to the actuator system 400 and multi-channel actuator system 500 they could be implemented as any suitable bandpass filter configuration.
- In such embodiments the user can at the same time listen to music using the display and get haptic feedback from the device to support a text type input. Furthermore as the audio playback contains no or little frequency components in the vibration frequency area and the vibration signal contains no or little frequency components in the audio frequency area, the user can easily distinguish the vibration/haptic feedback from the music playback. In other words by using the high and low pass filtering in such embodiments the fidelity of these two simultaneous signals reproduced by the display is improved.
- With respect to
Figure 7 a multichannel actuator system is shown which can be used either in combination with the example actuator system shown inFigure 6a or can be used separately from. In such embodiments where theactuator system 4 shown inFigure 6a is combined with the multi-channel actuator system 500 shown inFigure 7 the each of the left actuator signal and right actuator signals can be the audio signal input to the high pass filter. In some further embodiments any suitable re-arrangement or merging of components could be furthermore be implemented by the person skilled in the art when combining the two example actuator systems. With respect to the example shown inFigure 7 the multichannel system is a stereo or two channel system. However it would be appreciated that any suitable number of channels can be implemented by applying minor modifications to the examples shown. - The multichannel actuator system 500 in some embodiments can comprise a first filter 551 configured to receive the first audio channel signal, which in the example shown in
Figure 7 is the left channel audio signal. The first filter is configured to generate a lower frequency (LF) band output and a higher frequency (HF) band output. In some embodiments the first filter 551 comprises a quadrature mirror filter structure. In some embodiments the lower frequency - higher frequency cut off is in the range from 500 to 1000 Hz. The higher frequency (HF) output components are passed to a first channel summation device (sum) 557 or signal combiner. The lower frequency (LF) output components are passed to a central summation device (sum) 555. - The multichannel actuator system 500 furthermore in some embodiments can comprise a
second filter 553 configured to receive the second audio channel signal, which in the example shown inFigure 7 is the right channel audio signal. Thesecond filter 553 is configured to generate a lower frequency (LF) band output and a higher frequency (HF) band output. In some embodiments thesecond filter 553 comprises a quadrature mirror filter structure. In some embodiments the lower frequency - higher frequency cut off is the same as the first filter 551 cut off, in other words in the range from 500 to 1000 Hz. The higher frequency (HF) output components are passed to a second channel summation device (sum) 559 or signal combiner. The lower frequency (LF) output components are passed to the central summation device (sum) 555. - In such embodiments the multichannel actuator system 500 furthermore comprises a
central summation device 555. The central summation device receives the lower frequency band components from each audio channel and generates a combined lower frequency component signal. The combined lower frequency signal is passed to each of the channel summation devices. Thus for example as shown inFigure 7 the combined lower frequency signal is passed to the firstchannel summation device 557 and the second channel summation device 559. - The multichannel actuator system 500 furthermore in some embodiments comprises a first
channel summation device 557. The firstchannel summation device 557 is configured to receive the first channel higher frequency signal from the first channel filter 551 and the combined lower frequency signal from thecentral summation device 555 and combine them to produce a first (left) actuator audio signal. The first actuator audio signal can then in some embodiments be output to a first (left)actuator amplifier 407L. - In some embodiments the multichannel actuator system 500 comprises a first (left)
actuator amplifier 407L. Thefirst actuator amplifier 407L can in such embodiments be configured to receive the first actuator audio signal and generate a signal suitable for driving the first (left)actuator 305L. - The multichannel actuator system 500 furthermore in such embodiments comprises a first (left)
actuator 305L configured to receive the output of thefirst actuator amplifier 407L and generate movement of thedisplay 304 suitable for generating an audible output dependent on the first channel audio signal. - The multichannel actuator system 500 furthermore in some embodiments comprises a second channel summation device 559. The second channel summation device 559 is configured to receive the second channel higher frequency signal from the
second channel filter 553 and the combined lower frequency signal from thecentral summation device 555 and combine them to produce a second (right) actuator audio signal. The second actuator audio signal can then in some embodiments be output to a second (right)actuator amplifier 407R. - In some embodiments the multichannel actuator system 500 further comprises a second (right)
actuator amplifier 407R. Thesecond actuator amplifier 407R can in such embodiments be configured to receive the second actuator audio signal and generate a signal suitable for driving the second (right)actuator 305R. - The multichannel actuator system 500 furthermore in such embodiments comprises a second (right)
actuator 305R configured to receive the output of thesecond actuator amplifier 407R and generate movement of thedisplay 304 suitable for generating an audible output dependent on the second channel audio signal. - With respect to
Figure 5 an example of the operation of thepiezoelectric actuators 305 are shown with respect to the multichannel actuator system and the variable profile flexible membrane embodiments. InFigure 5 eachpiezoelectric actuator 305 is configured to vibrate in such a way that the bending moment of thepiezoelectric actuator 305 transfers a force via therubber force contact 501 to thedisplay assembly 304 attempting to cause the display to move 1003 substantially in translational mode of displacement. However because of the effect of the variable profile flexible membrane thedisplay assembly 304 moves such that the force causes a bending or pivoting about the thickened profileregion display assembly 304. - Thus in such embodiments the vibration caused by each transducer is relatively isolated from the vibration caused by the other transducers separated by the thickened membrane. It is therefore in such embodiments possible to produce stereo or other multi-channel sound images using a single display assembly without the problem of unclear sound imagery caused where the vibration from one channel propagates to the other audio channel areas of the display assembly.
- Furthermore by employing in some embodiments the multichannel actuator system 500 the lower frequency audio signals, which are generally not directionally determined by the user, by being generated by all of the actuators can generate an audio signal of suitable volume. In other words the driving signals received by each actuator are modified so that the highest frequencies components carry the different content (left and right). The lower frequencies components (cut-off somewhere in 500-1000 Hz) having been summed together can be output as a mono (or single channel signal) so that the display assembly/plate movement is similar on both sides for lower frequencies. In such embodiments therefore the higher frequency components (higher than the cut-off) give the stereo sound 'feeling' .
- The
display assembly 304 thus can produce a sufficient air displacement to generate audio signals with sufficient amplitude to implement not only earpiece operations but also to provide speaker operations such as for example integrated hands free speaker operations. - Furthermore as in some embodiments there are no magnetic parts required there are no issues concerning metal dust or other contaminants. Furthermore as the flexible membrane, frame part and body part can in some embodiments form a seal the whole system is easy to seal from moisture and dust as no sound holes are required and apparatus can be easily weather proofed. Furthermore in embodiments by using the display assembly as both display and air mass driver no internal audio transducers are required thus reducing required volumes and space and allowing thinner and more aesthetically pleasing products to be designed.
- It shall be appreciated that the term user equipment is intended to cover any suitable type of wireless user equipment, such as mobile telephones, portable data processing devices or portable web browsers. Furthermore, it will be understood that the term acoustic sound channels is intended to cover sound outlets, channels and cavities, and that such sound channels may be formed integrally with the transducer, or as part of the mechanical integration of the transducer with the device.
- In general, the design of various embodiments of the invention may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto. While various aspects of the invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
- The design of embodiments of this invention may be implemented by computer software executable by a data processor of the mobile device, such as in the processor entity, or by hardware, or by a combination of software and hardware. Further in this regard it should be noted that any blocks of the logic flow as in the Figures may represent program steps, or interconnected logic circuits, blocks and functions, or a combination of program steps and logic circuits, blocks and functions. The software may be stored on such physical media as memory chips, or memory blocks implemented within the processor, magnetic media such as hard disk or floppy disks, and optical media such as for example DVD and the data variants thereof, CD.
- The memory used in the design of embodiments of the application may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory. The data processors may be of any type suitable to the local technical environment, and may include one or more of general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASIC), gate level circuits and processors based on multi-core processor architecture, as non-limiting examples.
- Embodiments of the inventions may be designed by various components such as integrated circuit modules.
- As used in this application, the term 'circuitry' refers to all of the following:
- (a) hardware-only circuit implementations (such as implementations in only analog and/or digital circuitry) and
- (b) to combinations of circuits and software (and/or firmware), such as: (i) to a combination of processor(s) or (ii) to portions of processor(s)/software (including digital signal processor(s)), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions and
- (c) to circuits, such as a microprocessor(s) or a portion of a microprocessors), that require software or firmware for operation, even if the software or firmware is not physically present.
- This definition of 'circuitry' applies to all uses of this term in this application, including any claims. As a further example, as used in this application, the term 'circuitry' would also cover an implementation of merely a processor (or multiple processors) or portion of a processor and its (or their) accompanying software and/or firmware. The term 'circuitry' would also cover, for example and if applicable to the particular claim element, a baseband integrated circuit or applications processor integrated circuit for a mobile phone or similar integrated circuit in server, a cellular network device, or other network device.
Claims (15)
- An apparatus (10) comprising:a first part configured to form at least part of a case of the apparatus;a second part configured to form at least part of a display (12) for the apparatus;a first and a second actuator (305) coupled to the second part at substantially different regions and configured to apply a force to the second part to generate a displacement of the second part wherein the substantially different regions are isolated from each other;a drive circuitry coupled to the first and second actuators and configured to drive the first and second actuator separately to produce at least audio outputs; anda flexible membrane (507) configured to couple to the first part and the second part; andwherein the coupling of the second part to the first part is such that the flexible membrane is configured to be less flexible at the centre of the longest axis of the display than at the end of the longest axis of the display, and wherein the first and second actuators are located on opposite sides of the centre of the longest axis of the display.
- The apparatus as claimed in claim 1, wherein the drive circuitry comprises:an audio signal filter configured to receive an audio signal;a vibration signal filter configured to receive a vibration signal; anda combiner configured to combine an output of the audio signal filter and the vibration signal filter.
- The apparatus as claimed in claim 2, wherein the audio signal filter comprises a high pass filter.
- The apparatus as claimed in claim 2, wherein the vibration signal filter comprises a low pass filter.
- The apparatus as claimed in claim 1, wherein the drive circuitry comprises:a first channel filter (551) configured to receive a first actuator channel signal and generate a first higher frequency component and first lower frequency component;a second channel filter configured to receive a second actuator channel signal and generate a second higher frequency component and second lower frequency component;a first combiner (555) configured to combine the first and second lower frequency components to produce a combined signal;a first channel combiner (557) configured to combine the combined signal and the first higher frequency component; anda second channel combiner (559) configured to combine the combined signal and the second higher frequency component.
- The apparatus as claimed in any previous claim, wherein the flexible membrane is configured to be non-uniform in thickness and comprises a maximum thickness at an area approximately at the centre of the longest axis of the flexible membrane.
- The apparatus as claimed in any previous claim, wherein the first part comprises:a body part; anda frame part, wherein the flexible membrane is configured to be attached between the body part and the frame part.
- The apparatus as claimed in any previous claim, wherein the second part comprises at least one of:a front window layer;at least one display layer; andat least one touch interface layer.
- The apparatus as claimed in any previous claim wherein the flexible membrane comprises a suspension ring configured to be located within a recess of the first part, wherein the suspension ring and recess form a first area of contact.
- The apparatus as claimed in any previous claim, wherein each of the first and second actuator are at least one of:a piezoelectric actuator;a dynamic eccentric mass actuator;a moving coil actuator; anda moving magnet actuator.
- The apparatus as claimed in any previous claim, wherein the flexible membrane comprises at least one of:an elastomer;a silicone foil;a polyethylene terephthalate (PET) polyester film; anda polycarbonate film.
- A method of operating an apparatus (10) comprising a first part configured to form at least part of a case of the apparatus and a second part configured to form at least part of a display (12) for the apparatus, the method comprising:coupling a first and a second actuator (305) to the second part at substantially different regions;applying a force, via the first and second actuators, to the second part to generate a displacement of the second part, wherein the substantially different regions are isolated from each other;coupling a drive circuitry to the first and second actuator for driving the first and second actuator separately to produce at least audio outputs; andcoupling via a flexible membrane (507) the first part and the second part;wherein the coupling of the second part to the first part is such that the flexible membrane is configured to be less flexible at the centre of the longest axis of the display than at the end of the longest axis of the display, and wherein the first and second actuators are located on opposite sides of the centre of the longest axis of the display.
- The method as claimed in claim 12, wherein driving first and second actuator comprises:filtering an audio signal;filtering a vibration signal; andcombining an output of the audio signal filtering and the vibration signal filtering.
- The method as claimed in claim 12, wherein driving the first and second actuator comprises:filtering a first channel associated with the first actuator to generate a first higher frequency component and first lower frequency component;filtering a second channel associated with the second actuator to generate a second higher frequency component and second lower frequency component;combining the first and second lower frequency components to produce a combined signal;combining the combined signal and the first higher frequency component; andcombining the combined signal and the second higher frequency component.
- The method as claimed in any of claims 12 to 14, wherein each of the first and second actuator are at least one of:a piezoelectric actuator;a dynamic eccentric mass actuator;a moving coil actuator; anda moving magnet actuator
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/IB2010/056149 WO2012090031A1 (en) | 2010-12-31 | 2010-12-31 | A display apparatus producing audio and haptic output |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2659337A1 EP2659337A1 (en) | 2013-11-06 |
EP2659337A4 EP2659337A4 (en) | 2017-02-15 |
EP2659337B1 true EP2659337B1 (en) | 2021-07-28 |
Family
ID=46382369
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP10861477.7A Active EP2659337B1 (en) | 2010-12-31 | 2010-12-31 | A display apparatus producing audio and haptic output |
Country Status (3)
Country | Link |
---|---|
US (1) | US9389688B2 (en) |
EP (1) | EP2659337B1 (en) |
WO (1) | WO2012090031A1 (en) |
Families Citing this family (51)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10645834B2 (en) * | 2010-08-23 | 2020-05-05 | Nokia Technologies Oy | Apparatus and method for providing haptic and audio feedback in a touch sensitive user interface |
EP2630554B1 (en) * | 2010-10-19 | 2020-01-08 | Nokia Technologies Oy | A display apparatus |
WO2012111349A1 (en) * | 2011-02-18 | 2012-08-23 | 京セラ株式会社 | Electronic device |
US9715276B2 (en) * | 2012-04-04 | 2017-07-25 | Immersion Corporation | Sound to haptic effect conversion system using multiple actuators |
EP2839360A4 (en) | 2012-04-19 | 2016-01-20 | Nokia Technologies Oy | A display apparatus |
JP5720851B2 (en) * | 2012-04-27 | 2015-05-20 | 株式会社村田製作所 | Operation input device and information display device |
CN104412201B (en) | 2012-05-09 | 2018-09-21 | 苹果公司 | Change the output of computing device based on tracking window |
WO2013170099A1 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Calibration of haptic feedback systems for input devices |
US9445200B2 (en) * | 2012-05-14 | 2016-09-13 | Electronics And Telecommunications Research Institute | Piezoelectric speaker having weight and method of producing the same |
WO2013188307A2 (en) | 2012-06-12 | 2013-12-19 | Yknots Industries Llc | Haptic electromagnetic actuator |
US9886116B2 (en) | 2012-07-26 | 2018-02-06 | Apple Inc. | Gesture and touch input detection through force sensing |
US9149998B2 (en) * | 2012-10-24 | 2015-10-06 | Nokia Technologies Oy | Attaching window assembly using optical welding |
KR101383702B1 (en) | 2012-12-12 | 2014-04-09 | 삼성디스플레이 주식회사 | Display device unit |
WO2014132104A1 (en) * | 2013-03-01 | 2014-09-04 | Nokia Corporation | Control apparatus for a tactile audio display |
US9992491B2 (en) * | 2013-03-15 | 2018-06-05 | Immersion Corporation | Method and apparatus for encoding and decoding haptic information in multi-media files |
EP2976694B1 (en) * | 2013-03-20 | 2019-10-09 | Nokia Technologies Oy | A touch display device with tactile feedback |
US9954990B2 (en) | 2013-05-30 | 2018-04-24 | Nokia Technologies Oy | Panel speaker ear location |
US9912797B2 (en) | 2013-06-27 | 2018-03-06 | Nokia Technologies Oy | Audio tuning based upon device location |
JOP20140215B1 (en) * | 2013-07-10 | 2023-03-28 | Esco Group Llc | Connector to facilitate lifting of wear parts |
US9213434B2 (en) | 2013-07-17 | 2015-12-15 | Nokia Technologies Oy | Piezoelectric actuator and method |
JP5707454B2 (en) * | 2013-07-22 | 2015-04-30 | 京セラ株式会社 | Electronics |
US9137592B2 (en) | 2014-01-09 | 2015-09-15 | Nokia Technologies Oy | Speaker suspension |
US20150242037A1 (en) | 2014-01-13 | 2015-08-27 | Apple Inc. | Transparent force sensor with strain relief |
FR3017220B1 (en) * | 2014-01-31 | 2017-11-03 | Dav | SENSITIVE RETURN DEVICE FOR MOTOR VEHICLE AND METHOD FOR GENERATING A SENSITIVE RETURN |
US9838781B2 (en) | 2014-05-27 | 2017-12-05 | Nokia Technologies Oy | Apparatus and method for reducing sound coupling |
US10069954B2 (en) | 2014-07-09 | 2018-09-04 | Nokia Technologies Oy | Audio device with a stiffening structure |
US10149044B2 (en) | 2014-07-21 | 2018-12-04 | Nokia Technologies Oy | Vibration damping structure for audio device |
US10297119B1 (en) | 2014-09-02 | 2019-05-21 | Apple Inc. | Feedback device in an electronic device |
US9939901B2 (en) | 2014-09-30 | 2018-04-10 | Apple Inc. | Haptic feedback assembly |
CN104460089B (en) * | 2014-12-12 | 2018-02-16 | 京东方科技集团股份有限公司 | A kind of Multiside displaying device part |
US9798409B1 (en) | 2015-03-04 | 2017-10-24 | Apple Inc. | Multi-force input device |
EP3179341B1 (en) * | 2015-12-11 | 2022-07-27 | Vestel Elektronik Sanayi ve Ticaret A.S. | Method and device for sensing pressure applied to a screen with at least one sensor means |
DE102015225722A1 (en) | 2015-12-17 | 2017-06-22 | Continental Automotive Gmbh | Touch screen with a haptic feedback device |
KR102663406B1 (en) | 2016-04-04 | 2024-05-14 | 엘지디스플레이 주식회사 | Sound generation actuator of panel vibration type and double faced display device with the same |
US10237656B2 (en) | 2016-03-28 | 2019-03-19 | Lg Display Co., Ltd. | Panel vibration type sound generating display device |
KR101704517B1 (en) * | 2016-03-28 | 2017-02-09 | 엘지디스플레이 주식회사 | Display device for generating sound by panel vibration type |
KR20170114471A (en) | 2016-04-05 | 2017-10-16 | 엘지디스플레이 주식회사 | Organic light emitting display device |
US9942635B1 (en) | 2016-09-21 | 2018-04-10 | Microsoft Technology Licensing, Llc | Audio device with movable display |
US10003872B2 (en) | 2016-10-06 | 2018-06-19 | Microsoft Technology Licensing, Llc | Speaker arrangement |
KR102588423B1 (en) * | 2016-12-22 | 2023-10-12 | 삼성전자주식회사 | Electronic device including component mounting structure through bended display |
US10497227B2 (en) * | 2018-04-17 | 2019-12-03 | California Institute Of Technology | Haptic devices using structured metasurfaces |
CN109025921B (en) * | 2018-08-16 | 2020-06-23 | 陕西延长石油(集团)有限责任公司研究院 | Cover layer sealing performance prediction method for Ordos basin |
CN112534380B (en) * | 2018-08-29 | 2024-05-17 | 阿尔卑斯阿尔派株式会社 | Input device, control method, and storage medium |
US11812218B1 (en) * | 2018-10-12 | 2023-11-07 | Cirrus Logic Inc. | Concurrent audio and haptics from a single mechanical transducer |
KR102689721B1 (en) * | 2019-07-22 | 2024-07-29 | 엘지디스플레이 주식회사 | Display apparatus and vehicle comprising the same |
JPWO2022034663A1 (en) | 2020-08-12 | 2022-02-17 | ||
US11334176B2 (en) * | 2020-09-17 | 2022-05-17 | Dell Products L.P. | Ultrathin touchpad with lightguide |
US11669167B2 (en) * | 2020-11-06 | 2023-06-06 | Synaptics Incorporated | Single-bracket support structure for force sensing and haptic feedback |
CN112384015B (en) * | 2020-11-06 | 2021-07-13 | 浙江大学 | Children mental health growth evaluation instrument |
US11892885B2 (en) * | 2021-07-12 | 2024-02-06 | Dell Products L.P. | Information handling system housing with integrated planar speaker |
EP4198692A1 (en) * | 2021-12-15 | 2023-06-21 | Nokia Technologies Oy | Tactile audio display |
Family Cites Families (63)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5416494A (en) * | 1991-12-24 | 1995-05-16 | Nippondenso Co., Ltd. | Electroluminescent display |
US6118435A (en) * | 1997-04-10 | 2000-09-12 | Idec Izumi Corporation | Display unit with touch panel |
JP2002162652A (en) * | 2000-01-31 | 2002-06-07 | Fujitsu Ltd | Sheet-like display device, resin spherical body and microcapsule |
EP1290705B1 (en) * | 2000-05-22 | 2005-02-09 | Digit Wireless, Llc | Input devices and their use |
US6586889B1 (en) * | 2000-06-21 | 2003-07-01 | Si Diamond Technology, Inc. | MEMS field emission device |
US20020084721A1 (en) * | 2001-01-03 | 2002-07-04 | Walczak Thomas J. | Piezo electric keypad assembly with tactile feedback |
KR100822185B1 (en) * | 2001-10-10 | 2008-04-16 | 삼성에스디아이 주식회사 | Touch panel |
JP3798287B2 (en) * | 2001-10-10 | 2006-07-19 | Smk株式会社 | Touch panel input device |
JP4191407B2 (en) * | 2001-12-27 | 2008-12-03 | 富士通株式会社 | Display device and driving method thereof |
JP3937982B2 (en) * | 2002-08-29 | 2007-06-27 | ソニー株式会社 | INPUT / OUTPUT DEVICE AND ELECTRONIC DEVICE HAVING INPUT / OUTPUT DEVICE |
JP3871991B2 (en) * | 2002-09-30 | 2007-01-24 | Smk株式会社 | Touch panel |
US7109976B2 (en) * | 2003-04-01 | 2006-09-19 | 3M Innovative Properties Company | Display screen seal |
JP4198527B2 (en) * | 2003-05-26 | 2008-12-17 | 富士通コンポーネント株式会社 | Touch panel and display device |
JP2005117313A (en) * | 2003-10-07 | 2005-04-28 | Fujitsu Ltd | Piezo-electric element and touch panel device |
US8177942B2 (en) * | 2003-11-05 | 2012-05-15 | E Ink Corporation | Electro-optic displays, and materials for use therein |
JP4784041B2 (en) * | 2003-11-07 | 2011-09-28 | パナソニック株式会社 | Input device using touch panel |
US7148789B2 (en) * | 2004-09-09 | 2006-12-12 | Motorola, Inc. | Handheld device having multiple localized force feedback |
JP4056528B2 (en) * | 2005-02-03 | 2008-03-05 | Necインフロンティア株式会社 | Electronics |
JP2006227712A (en) * | 2005-02-15 | 2006-08-31 | Nec Infrontia Corp | Electronic equipment |
CN101326852B (en) * | 2005-10-27 | 2012-01-25 | 诺基亚公司 | Oscillation motor as audio converter |
US7684953B2 (en) * | 2006-02-10 | 2010-03-23 | Authentec, Inc. | Systems using variable resistance zones and stops for generating inputs to an electronic device |
US8210942B2 (en) * | 2006-03-31 | 2012-07-03 | Wms Gaming Inc. | Portable wagering game with vibrational cues and feedback mechanism |
US7979146B2 (en) * | 2006-04-13 | 2011-07-12 | Immersion Corporation | System and method for automatically producing haptic events from a digital audio signal |
US7492602B2 (en) * | 2006-07-14 | 2009-02-17 | Lg Electronics Inc. | Mobile terminal |
US9235274B1 (en) * | 2006-07-25 | 2016-01-12 | Apple Inc. | Low-profile or ultra-thin navigation pointing or haptic feedback device |
US20080218488A1 (en) * | 2006-11-30 | 2008-09-11 | Electronics And Telecommunications Research Institute | Active driving type visual-tactile display device |
US20080204417A1 (en) * | 2007-02-27 | 2008-08-28 | Pierce Paul M | Multimodal Adaptive User Interface for a Portable Electronic Device |
US7952498B2 (en) * | 2007-06-29 | 2011-05-31 | Verizon Patent And Licensing Inc. | Haptic computer interface |
KR100896812B1 (en) * | 2007-11-12 | 2009-05-11 | 한국과학기술원 | Haptic module using magnetic force, electronic apparatuses having the module |
US10488926B2 (en) * | 2007-11-21 | 2019-11-26 | Immersion Corporation | Method and apparatus for providing a fixed relief touch screen with locating features using deformable haptic surfaces |
SG186011A1 (en) | 2007-11-21 | 2012-12-28 | Artificial Muscle Inc | Electroactive polymer transducers for tactile feedback devices |
US9857872B2 (en) * | 2007-12-31 | 2018-01-02 | Apple Inc. | Multi-touch display screen with localized tactile feedback |
US8154527B2 (en) * | 2008-01-04 | 2012-04-10 | Tactus Technology | User interface system |
US20100250071A1 (en) * | 2008-03-28 | 2010-09-30 | Denso International America, Inc. | Dual function touch switch with haptic feedback |
US9829977B2 (en) * | 2008-04-02 | 2017-11-28 | Immersion Corporation | Method and apparatus for providing multi-point haptic feedback texture systems |
KR101474963B1 (en) * | 2008-07-01 | 2014-12-19 | 엘지전자 주식회사 | Controlling a Mobile Terminal |
CN101685212B (en) * | 2008-09-26 | 2012-08-29 | 群康科技(深圳)有限公司 | Liquid crystal display panel |
JP2010086471A (en) * | 2008-10-02 | 2010-04-15 | Sony Corp | Operation feeling providing device, and operation feeling feedback method, and program |
US8339250B2 (en) * | 2008-10-10 | 2012-12-25 | Motorola Mobility Llc | Electronic device with localized haptic response |
US7999660B2 (en) * | 2008-10-10 | 2011-08-16 | Motorola Mobility, Inc. | Electronic device with suspension interface for localized haptic response |
US20100141408A1 (en) * | 2008-12-05 | 2010-06-10 | Anthony Stephen Doy | Audio amplifier apparatus to drive a panel to produce both an audio signal and haptic feedback |
JP5181093B2 (en) * | 2008-12-08 | 2013-04-10 | 韓國電子通信研究院 | Touch screen and operation method thereof |
US20100156823A1 (en) * | 2008-12-23 | 2010-06-24 | Research In Motion Limited | Electronic device including touch-sensitive display and method of controlling same to provide tactile feedback |
US8686952B2 (en) * | 2008-12-23 | 2014-04-01 | Apple Inc. | Multi touch with multi haptics |
US8384679B2 (en) * | 2008-12-23 | 2013-02-26 | Todd Robert Paleczny | Piezoelectric actuator arrangement |
TWI478016B (en) * | 2008-12-24 | 2015-03-21 | Prime View Int Co Ltd | Display device with touch panel and fabricating method thereof |
US8345013B2 (en) * | 2009-01-14 | 2013-01-01 | Immersion Corporation | Method and apparatus for generating haptic feedback from plasma actuation |
KR20110110212A (en) * | 2009-01-21 | 2011-10-06 | 바이엘 머티리얼사이언스 아게 | Electroactive polymer transducers for tactile feedback devices |
US20100225600A1 (en) * | 2009-03-09 | 2010-09-09 | Motorola Inc. | Display Structure with Direct Piezoelectric Actuation |
US9874935B2 (en) * | 2009-03-12 | 2018-01-23 | Immersion Corporation | Systems and methods for a texture engine |
US9927873B2 (en) * | 2009-03-12 | 2018-03-27 | Immersion Corporation | Systems and methods for using textures in graphical user interface widgets |
US20100245254A1 (en) * | 2009-03-24 | 2010-09-30 | Immersion Corporation | Planar Suspension Of A Haptic Touch Screen |
US8125347B2 (en) * | 2009-04-09 | 2012-02-28 | Samsung Electronics Co., Ltd. | Text entry system with depressable keyboard on a dynamic display |
US8493364B2 (en) * | 2009-04-30 | 2013-07-23 | Motorola Mobility Llc | Dual sided transparent display module and portable electronic device incorporating the same |
US8310457B2 (en) * | 2009-06-30 | 2012-11-13 | Research In Motion Limited | Portable electronic device including tactile touch-sensitive input device and method of protecting same |
US8730182B2 (en) * | 2009-07-30 | 2014-05-20 | Immersion Corporation | Systems and methods for piezo-based haptic feedback |
KR200455084Y1 (en) * | 2009-09-04 | 2011-08-16 | 주식회사 비에스이 | Multifunction micro speaker |
KR101133348B1 (en) * | 2009-10-12 | 2012-04-09 | 삼성전기주식회사 | Haptic feedback device and electronic device |
KR101443471B1 (en) * | 2009-11-04 | 2014-09-22 | 노키아 코포레이션 | An apparatus |
JP2011242386A (en) * | 2010-04-23 | 2011-12-01 | Immersion Corp | Transparent compound piezoelectric material aggregate of contact sensor and tactile sense actuator |
US8279623B2 (en) * | 2010-12-22 | 2012-10-02 | Research In Motion Limited | Apparatus for vibrating a portable electronic device |
US9160331B2 (en) * | 2011-10-28 | 2015-10-13 | Atmel Corporation | Capacitive and inductive sensing |
US8711118B2 (en) * | 2012-02-15 | 2014-04-29 | Immersion Corporation | Interactivity model for shared feedback on mobile devices |
-
2010
- 2010-12-31 US US13/976,268 patent/US9389688B2/en active Active
- 2010-12-31 EP EP10861477.7A patent/EP2659337B1/en active Active
- 2010-12-31 WO PCT/IB2010/056149 patent/WO2012090031A1/en active Application Filing
Non-Patent Citations (1)
Title |
---|
None * |
Also Published As
Publication number | Publication date |
---|---|
EP2659337A4 (en) | 2017-02-15 |
US20140145836A1 (en) | 2014-05-29 |
US9389688B2 (en) | 2016-07-12 |
EP2659337A1 (en) | 2013-11-06 |
WO2012090031A1 (en) | 2012-07-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2659337B1 (en) | A display apparatus producing audio and haptic output | |
CA2808716C (en) | Apparatus and method for providing haptic and audio feedback in a touch sensitive user interface | |
EP2630554B1 (en) | A display apparatus | |
US9836270B2 (en) | Method and apparatus for handling the display and audio component based on the orientation of the display for a portable device | |
EP2496998B1 (en) | Apparatus for providing haptic feedback | |
WO2012117738A1 (en) | Electronic apparatus and manufacturing method for electronic apparatus | |
WO2012114750A1 (en) | Electronic device | |
US9444370B2 (en) | Electronic device | |
JP5563106B2 (en) | Electronics | |
WO2012114763A1 (en) | Electronic device | |
WO2012111352A1 (en) | Electronic device | |
WO2012137440A1 (en) | Electronic device | |
RU2709646C2 (en) | Apparatus and method for providing tactile and audio feedback in sensor user interface | |
RU2574850C2 (en) | Apparatus and method for providing haptic and audio feedback in touch-sensitive user interface |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130614 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: NOKIA CORPORATION |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: NOKIA TECHNOLOGIES OY |
|
RA4 | Supplementary search report drawn up and despatched (corrected) |
Effective date: 20170118 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06F 3/01 20060101AFI20170112BHEP |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20171027 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: NOKIA TECHNOLOGIES OY |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20200825 |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
INTC | Intention to grant announced (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
INTG | Intention to grant announced |
Effective date: 20210204 |
|
INTG | Intention to grant announced |
Effective date: 20210209 |
|
INTG | Intention to grant announced |
Effective date: 20210224 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: G06F 3/01 20060101AFI20210216BHEP |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1415288 Country of ref document: AT Kind code of ref document: T Effective date: 20210815 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602010067346 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1415288 Country of ref document: AT Kind code of ref document: T Effective date: 20210728 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211028 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211129 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211028 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211029 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602010067346 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20220429 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20211231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211231 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20101231 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230527 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20231116 Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20231109 Year of fee payment: 14 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20231107 Year of fee payment: 14 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210728 |