Classifications

• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/163—Wearable computers, e.g. on a belt
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
  • G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
  • G06F1/1641—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being formed by a plurality of foldable display components
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
  • G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
  • G06F1/1643—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being associated to a digitizer, e.g. laptops that can be used as penpads
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
  • G06F1/16—Constructional details or arrangements
  • G06F1/1613—Constructional details or arrangements for portable computers
  • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
  • G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
  • G06F1/1652—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being flexible, e.g. mimicking a sheet of paper, or rollable
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
  • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
  • G06F3/0412—Digitisers structurally integrated in a display
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
  • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
  • G06F3/0416—Control or interface arrangements specially adapted for digitisers
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
  • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
  • G06F3/045—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
  • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
  • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
  • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
  • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
  • G06F2203/04102—Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
  • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
  • G06F2203/04104—Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger

Definitions

• the present invention relates to passive stiffness and active deformation haptic output devices for flexible displays.
• Flexible displays which include digital displays that are bendable, foldable and/or reliable are being developed and may enable more intuitive and realistic digital user interface interactions, similar to those occurring in the real world.
• haptics to augment and enhance such interactions has been limited.
• Most of the interactions involving flexible displays are characterized by a continuous input in the form of deformation gesture on the display, but such interactions provide the user with only passive haptics, which does not necessarily correspond to, or correlate with the user interface events in the digital environment.
• a system that includes a flexible display configured to display an image and a sensor connected to the flexible display.
• the sensor is configured to sense an amount of flexure of the flexible display.
• a haptic output device is connected to the flexible display and is configured to change a resistance to movement of a first portion of the flexible display relative to a second portion of the flexible display upon receipt of a haptic control signal.
• the system includes a processor in signal communication with the flexible display, the sensor and the haptic output device.
• the processor is configured to receive an output signal from the sensor based on the amount of flexure and generate the haptic control signal based on the output signal from the sensor.
• the haptic output device is constructed and arranged to change a stiffness of a hinge formed between the first portion and the second portion of the flexible display when at least one of the two portions is moved towards the other of the two portions.
• the haptic output device is configured to lock the hinge when the first portion and the second portion are separated by a predetermined amount of space so that the two portions cannot move relative to each other.
• the haptic output device is constructed and arranged to assist with movement of the first portion relative to the second portion when the sensor senses that the flexible display has been flexed.
• the haptic output device is constructed and arranged to oppose movement of the first portion relative to the second portion when the sensor senses that the flexible display has been flexed.
• the haptic output device includes a smart gel and an activation element constructed and arranged to change a stiffness of the smart gel upon receipt of the haptic control signal.
• the haptic output device includes a rheological fluid and an activation element constructed and arranged to change a viscosity or damping property of the rheological fluid upon receipt of the haptic control signal.
• the haptic output device includes a shape memory alloy and an activation element configured to change a temperature of the shape memory alloy to return the shape memory alloy to its original shape upon receipt of the haptic control signal.
• a method that includes sensing an amount of flexure of a flexible display configured to display an image with a sensor, generating a haptic control signal based on the sensed amount of flexure with a processor, and changing a resistance to movement of a first portion of the flexible display relative to a second portion of the flexible display with a haptic output device upon receipt of a haptic control signal.
• changing a resistance to movement includes changing a stiffness of a hinge formed between the first portion and the second portion of the flexible display when at least one of the two portions is moved towards the other of the two portions.
• the haptic output device is configured to lock the hinge when the first portion and the second portion are separated by a predetermined amount of space so that the two portions cannot move relative to each other.
• changing a resistance to movement includes reducing the resistance and assisting with movement of the first portion relative to the second portion when the sensor senses that the flexible display has been flexed.
• changing a resistance to movement includes increasing the resistance to oppose movement of the first portion relative to the second portion when the sensor senses that the flexible display has been flexed.
• the haptic output device includes a smart gel and an activation element, and changing a resistance to movement includes causing the smart gel to stiffen upon receipt of the haptic control signal by the activation element.
• the haptic output device includes a rheological fluid and an activation element, and changing a resistance to movement includes causing a viscosity or damping property of the rheological fluid to change upon receipt of the haptic control signal by the activation element.
• the haptic output device includes a shape memory alloy and an activation element, and changing a resistance to movement comprises causing the shape memory alloy to return to its original shape upon receipt of the haptic control signal by the activation element.
• Figure 1 schematically illustrates a system in accordance with an embodiment of the invention
• Figure 2 schematically illustrates a perspective view of an embodiment of the system of Figure 1 in the form of a flexible user interface device having a flexible display in a flat configuration;
• Figure 3 schematically illustrates a perspective view of the flexible user interface device of Figure 2 in a bent configuration
• Figure 4 schematically illustrates a perspective view of the flexible user interface device of Figure 2 in a folded configuration
• Figure 5 schematically illustrates a processor of the system of Figure 1 ;
• Figure 6 schematically illustrates a cross-sectional view of an embodiment of the system of Figure 1 in the form of a flexible user interface device having a flexible display in a bent configuration
• Figure 7 schematically illustrates a cross-sectional view of an embodiment of the flexible user interface device of Figure 6;
• Figure 8 schematically illustrates a perspective view of an embodiment of the system of Figure 1 in the form of a flexible user interface device having a flexible display in a bent configuration
• Figure 9 schematically illustrates a perspective view of an embodiment of the system of Figure 1 in the form of a foldable user interface device having a flexible display and a rigid housing in an open position;
• Figure 10 schematically illustrates a perspective view of an embodiment of the user interface device of Figure 9 in a closed position.
• FIG. 1 is a schematic illustration of a system 100 in accordance with an embodiment of the invention.
• the system 100 includes a processor 1 10, a memory device 120, and input/output devices 130, which are interconnected via a bus 140.
• the input/output devices 130 may include a touch screen device 150, a haptic output device 160 and/or other input devices that receive input from a user of the system 100 and output devices that output information to the user of the system 100.
• the system 100 may be a user interface device in the form of a touch mobile or tablet device that includes all of the components illustrated in Figure 1 in a single integrated device.
• the system 100 is a single, integrated, flexible device that may be flexed, bent, rolled, folded, etc., as discussed in further detail below.
• the touch screen device 150 may be configured as any suitable user interface or touch/contact surface assembly and may be configured for physical interaction with a user-controlled device, such as a stylus, finger, etc.
• the touch screen device 150 may include at least one output device and at least one input device.
• the touch screen device 150 includes a visual display 152 configured to display, for example, images and a touch sensitive screen comprising at least one sensor 154 superimposed thereon to receive inputs from a user's finger or stylus controlled by the user.
• the visual display 152 may include a high definition display screen.
• the haptic output device 160 is configured to provide haptic feedback to the user of the system 100 while the user is in contact with a least a portion of the system 100.
• the haptic output device 160 may provide haptic feedback to the touch screen device 150 itself to impose a haptic effect when the user is in contact with the touch screen device 150 and/or to another part of the system 100, such as a housing containing at least the input/output devices 130.
• the haptic effects may be used to enhance the user experience when interacting with the system 100.
• the haptic feedback provided by the haptic output device 160 may be created with any of the methods of creating haptic effects, such as vibration, deformation, kinesthetic sensations, electrostatic or ultrasonic friction, etc.
• the haptic output device 160 may include non-mechanical or non-vibratory devices such as those that use electrostatic friction (“ESF”), ultrasonic surface friction (“USF”), or those that induce acoustic radiation pressure with an ultrasonic haptic transducer, or those that use a haptic substrate and a flexible or deformable surface, or those that provide thermal effects, or those that provide projected haptic output such as a puff of air using an air jet, and so on.
• ESF electrostatic friction
• USF ultrasonic surface friction
• the haptic output device 160 may include an actuator, for example, an electromagnetic actuator such as an Eccentric Rotating Mass (“ERM”) in which an eccentric mass is moved by a motor, a Linear Resonant Actuator (“LRA”) in which a mass attached to a spring is driven back and forth, or a "smart material” such as piezoelectric materials, electro-active polymers or shape memory alloys, a macro- composite fiber actuator, an electro-static actuator, an electro-tactile actuator, and/or another type of actuator that provides a physical feedback such as vibrotactile feedback.
• ECM Eccentric Rotating Mass
• LRA Linear Resonant Actuator
• a “smart material” such as piezoelectric materials, electro-active polymers or shape memory alloys
• macro- composite fiber actuator such as an electro-static actuator, an electro-tactile actuator, and/or another type of actuator that provides a physical feedback such as vibrotactile feedback.
• Multiple haptic output devices 160 may be used to generate different
• the processor 1 10 may be a general-purpose or specific-purpose processor or microcontroller for managing or controlling the operations and functions of the system 100.
• the processor 1 10 may be specifically designed as an application- specific integrated circuit ("ASIC") to control output signals to the haptic output device 160 to provide haptic effects.
• ASIC application- specific integrated circuit
• the processor 1 10 may be configured to decide, based on predefined factors, what haptic effects are to be generated based on a haptic signal received or determined by the processor 1 10, the order in which the haptic effects are generated, and the magnitude, frequency, duration, and/or other parameters of the haptic effects.
• the processor 1 10 may also be configured to provide streaming commands that can be used to drive the haptic output device 160 for providing a particular haptic effect.
• the processor 1 10 may actually include a plurality of processors, each configured to perform certain functions within the system 100. The processor 1 10 is described in further detail below.
• the memory device 120 may include one or more internally fixed storage units, removable storage units, and/or remotely accessible storage units.
• the various storage units may include any combination of volatile memory and non-volatile memory.
• the storage units may be configured to store any combination of information, data, instructions, software code, etc. More particularly, the storage units may include haptic effect profiles, instructions for how the haptic output device 160 is to be driven, or other information for generating haptic effects.
• Figure 2 illustrates an embodiment of the system 100 in the form of a user interface device 200 that includes a flexible display 210.
• the entire user interface device 200 is flexible and can be bent with the flexible display 210.
• the user interface device 200 may be bent at a hinge 220 and folded such that a first portion 212 of the flexible display 210 and a second portion 214 of the flexible display 210 may contact each other or come close to contacting each other, as illustrated in Figure 4.
• a sensor 230 embedded in or otherwise connected to the flexible display 210 is configured to sense the flexure of the flexible display 210.
• the sensor 230 may include a strain gauge or any other type of sensor that is configured to sense the flexure of the flexible display 210 and/or movement of the first portion 212 of the flexible display 210 relative to the second portion 214 of the flexible display 210.
• FIG. 5 illustrates an embodiment of the processor 1 10 described above in more detail.
• the processor 1 10 may be configured to execute one or more computer program modules.
• the one or more computer program modules may include one or more of a sensor module 1 12, a determination module 1 14, a haptic output device control module 1 16, and/or other modules.
• the processor 1 10 may also include electronic storage 1 18, which may be the same as the memory device 120 or in addition to the memory device 120.
• the processor 1 10 may be configured to execute the modules 1 12, 1 14, and/or 1 16 by software, hardware, firmware, some combination of software, hardware, and/or firmware, and/or other mechanisms for configuring processing capabilities on processor 1 10.
• modules 1 12, 1 14, and 1 16 are illustrated in Figure 2 as being co-located within a single processing unit, in embodiments in which the processor 1 10 includes multiple processing units, one or more of modules 1 12, 1 14, and/or 1 16 may be located remotely from the other modules.
• the description of the functionality provided by the different modules 1 12, 1 14, and/or 1 16 described below is for illustrative purposes, and is not intended to be limiting, as any of the modules 1 12, 1 14, and/or 1 16 may provide more or less functionality than is described.
• one or more of the modules 1 12, 1 14, and/or 1 16 may be eliminated, and some or all of its functionality may be provided by other ones of the modules 1 12, 1 14, and/or 1 16.
• the processor 1 10 may be configured to execute one or more additional modules that may perform some or all of the functionality attributed below to one of the modules 1 12, 1 14, and/or 1 16.
• the sensor module 1 12 is configured to receive an input signal from the sensor 154 that is generated when the sensor 154 detects an input from a user of the system 100. In embodiments in which there are multiple sensors, the sensor module 1 12 is configured to receive and process input signals from the multiple sensors. The sensor module 1 12 may be configured to determine whether the sensed input is an intentional input or merely an inadvertent touch to the touch screen device 150 by comparing the strength of the input signal or the pattern or location of the input signal to a predetermined threshold strength that corresponds to an intentional input.
• the sensor module 1 12 is configured to receive an input signal from the sensor 230 that is generated when the flexible user interface device 200 is flexed, which may occur when the user interface device 200 is bent, folded or rolled, for example.
• the sensor module 1 12 is also configured to send a signal to the determination module 1 14 for further processing.
• the determination module 1 14 is configured to determine what was intended by the user when providing an input to the sensor 154. For example, the user may touch a certain location of the touch screen device 150 or provide a particular gesture to the touch screen device 150, or bend the user interface device 200 in a certain manner that indicates that a certain function is to be performed by the user interface device 200.
• the determination module 1 14 may be programmed with a library of predetermined gestures and touch locations on the touch screen device 150 so that when the user touches a particular location on the touch screen device 150 or provides a gesture to the touch screen device 150, the determination module 1 14 may determine a corresponding output.
• the determination module 1 14 may also output a signal to the haptic output device control module 1 16 so that a haptic effect in accordance with embodiments of the invention described below may be provided to the user.
• the haptic output device control module 1 16 is configured to receive the output signal from the determination module 1 14 and determine the haptic effect to be generated by the haptic output device 160, based on the signal generated by the determination module 1 14.
• the system 100 may be a flexible user interface device 600, as illustrated in Figure 6 that includes a haptic output device 610 that is embedded within a hinge 620 of the flexible user interface device 600.
• the hinge 620 of the flexible user interface device 600 may be considered to be the location where a first portion 630 and a second portion 640 of the flexible user interface device 600 may pivot or rotate and move towards each other, or away from each other, as the flexible user interface device 600 is flexed or bent or folded, as illustrated in Figure 6.
• the flexible user interface device 600 may be configured to fold at the hinge 620 when the two portions 630, 640 of the device 600 located on opposite sides of the hinge 620 are brought towards each other.
• the haptic output device 610 may be embedded within a body or housing 650 of the device 600 that supports a flexible display 660 or may be coupled to the body or housing 650 of the device 600.
• the haptic output device 610 may be in the form of a fluidic actuator that includes a smart gel or rheological fluid and an activation element, as discussed in further detail below.
• a smart gel which includes a fluid basis (typically water) within or surrounding a matrix of polymer, is characterized by its ability to quickly change mechanical and/or structural properties upon exposure to certain physical and/or chemical external stimuli, such as an electric or magnetic field, temperature, (UV-) light, shaking, pH variation, etc.
• the response or reaction of smart gels to such stimuli is expansion or contraction, which is typically caused by the polymer matrix becoming more or less hydrophilic and absorbing or releasing more molecules from or to the gel.
• a controlled stimulus e.g. voltage-controlled electric field
• a subclass of smart gels is so-called shake gels, which stiffen when exposed to mechanical impact or when strongly shaken.
• a smart gel may comprise a temperature-sensitive hydrogel that is configured to expand and stiffen when heated above a threshold temperature, and contract and relax when cooled down below the threshold temperature.
• the smart gel may be configured to respond to another stimulus besides temperature, such as electrical current, light, salt, and chemical stimuli.
• the system 100 may include activating elements to introduce an appropriate stimulus to achieve a desired response by the smart gel. For example, if the smart gel is configured to deform as a function of light, the system 100 may include an element to stimulate the smart gel by directing light toward the smart gel.
• an injection device may be used to introduce a chemical agent to the smart gel, such as an agent that changes the smart gel pH, a salt, glucose, ions, etc.
• a chemical agent such as an agent that changes the smart gel pH, a salt, glucose, ions, etc.
• wires or other elements may be embedded in the smart gel or electrodes may be used to direct current through the smart gel and/or to apply an electric field to the smart gel.
• Rheological fluids are another category of fluidic actuators and typically include iron particles suspended in oil or watery fluid. Upon exposure to electric (for electro-rheological fluids) or magnetic (for magneto-rheological fluids) fields, the order of molecules in the liquid aligns itself to the field main axis. This phenomenon causes the overall damping and/or viscosity of the fluid to change, up to the point that if the field strength is high enough, the rheological fluid may turn into a solid fairly quickly.
• the flexible user interface device 600 may not have a predefined hinge 620. Instead, the area corresponding to the hinge 620 in Figure 6 may be filled with smart gel or rheological fluid. If the smart gel or rheological fluid is activated, as described above, and increased in stiffness, a temporary hinge may be created to divide the device 600 into two halves, such as the first portion 630 and the second portion 640, which can rotate around the newly created hinge. As soon as the actuation turns off, the hinge may soften and eventually disappear.
• a layer 710 filled with a smart gel or rheological fluid and flexible electrodes 712, 714 on each side may extend across the whole surface of the body 650 under the flexible display 660, as schematically illustrated in Figure 7.
• a temporary hinge By activating and thereby stiffening an arbitrary strip of the fluid, a temporary hinge can be created at an arbitrary location, with an arbitrary orientation (horizontal, lateral, diagonal, curved, etc.).
• FIG. 8 illustrates an embodiment of the system 100 in the form of a flexible user interface device 800 that includes a plurality of haptic output devices 810 embedded in a flexible body 820 and a hinge location 830 of the device 800. As illustrated, the haptic output devices 810 extend from a first portion 840 of the body 820, across the hinge location 830 to a second portion 850 of the body 820. Although five haptic output devices 810 are illustrated, more or less haptic output devices 810 may be used. The illustrated embodiment is not intended to be limiting in any way.
• the haptic output devices 810 may include shape memory alloys, such as in the form of shape memory alloy fibers, and one or more activation elements configured to heat the shape memory alloy fibers, which may cause the fibers to return to their original shape. For example, if the user interface device 800 is flexed to the condition illustrated in Figure 8, which may be sensed by a sensor embedded in the device, the processor 1 10 may generate a haptic control signal that activates the activation element, for example, passing current through the element, and cause the shape memory alloy fiber(s) to straighten, which would cause the user interface device 800 to move back to a substantially flat configuration, similar to the configuration illustrated in Figure 2.
• the shape memory alloy fibers may be configured to resist against elongation and thus generate a haptic effect that opposes the two halves of the device from closing.
• the shape memory alloys upon activation, may shorten, thereby leading to an active kinesthetic haptic effect in the form that may bring the two portions 840, 850 of the device 800 towards each other and fold the device 800 at the hinge location 830.
• the haptic output devices 810 may include macro fiber composite ("MFC”) piezoelectric fibers that are embedded around and within the hinge location 820 of the device 800.
• MFC macro fiber composite
• Figure 9 illustrates an embodiment of the system 100 in the form of a user interface device 900 that includes a rigid housing 910 that supports a flexible display 920. At least one haptic output device (not shown in Figure 9) may be used to assist the user to move a first portion 912 of the housing 910 towards a second portion 914 of the housing 910 that is on an opposite side of a hinge 930 provided by the flexible display 920 so that the user interface device 900 may be moved from an open state, as illustrated in Figure 9, to a closed state, as illustrated in Figure 10.
• a haptic output device in accordance with embodiments of the invention described herein may be actuated so that the hinge 930 locks the user interface device 900 in the closed position.
• the hinge 930 of the flexible display 920 may be haptically enabled using a combination of haptic output devices in the forms of an electric motor and a smart gel based actuator.
• the electric motor may be used to create active deformation and assist with the opening or closing of the foldable device, while the smart gel based actuator may lock the configuration in place, thereby preventing the foldable display from opening or closing.
• the rotating motion of the first and second portions of the display or device around the hinge 930 may involve frictional and/or sliding contact among the subcomponents in the hinge.
• the effective friction coefficient seen by the subcomponents may be modulated (e.g., reduced) if ultrasound vibration is applied on their surfaces, which may allow for a hinge-based programmable resistance to be created and displayed to the user as he/she is opening or closing the two halves of the flexible display.
• a fluidic actuator based on smart gels or rheological fluid, described above may be mounted to the back surface of a reliable display. Driving such an actuator may produce programmable resistive (passive) or active haptic effects on the rolling degree of freedom of the display.
• the haptic output device may include an electromechanical actuator to provide a mini resistive haptic effect along a large hinge.
• an ultrasonic motor may be located in an area with high friction and may generate ultrasonic vibrations when activated to reduce the friction.
• a shape memory alloy in the form of a wire may be used to oppose user movement.
• an actuator configured to deform and sustain the deformation when the user interacts with the device, such as a piezoelectric or MFC actuator, may be used.
• a smart gel or rheological fluid that is embedded in the back of the display may be configured to change the stiffness or damping of the surface of the display when activated.
• the haptic output device may be configured to generate haptic effects with faster dynamics.
• the haptic output device may be configured to generate a relatively fast "pop"-like haptic effect that simulates the sensation of "snapping" a foldable device open and/or closed, such as when a laptop computer is opened or closed.
• Haptic effects may be generated using one or a combination of the above-described technologies, in accordance with embodiments of the invention described herein. [0058]
• Embodiments of the invention described above may be used to generate both passive and active haptic effects, depending on a mode of operation.
• passive haptic effects on the flexible display may be generated by a change in mechanical stiffness/damping of the haptic output device embedded in the hinge or body of the device, and “active” haptic effects on the flexible display may be generated when the haptic output device that is embedded in the hinge or body of the device actively bends the display.
• Passive haptic effects may cause the perceived structural stiffness/damping of the display to change, which allows for delivering programmable structural resistance against deformation gestures (e.g., bending the display) applied by the user.
• the passive kinesthetic haptic effects that are created may be used to enable a variety of interaction parameters and/or schemes. For example, in an embodiment, a controlled and gradual increase of the perceived stiffness or firmness and damping factor of the display (versus its physical value) may be generated. In an embodiment, a controlled and gradual decrease of the perceived stiffness/damping from its physical value may be generated by applying bending force towards the bending direction and thus facilitating the gesture and interaction for the user.
• programmable resistance haptic effects may be delivered to the user as he/she bends or folds the device.
• This programmable resistance may be generated by driving the haptic output device located in the hinge in a programmable manner, for example by exposing the smart gel or rheological fluid to a controlled electric or magnetic field.
• a vast array of kinesthetic haptic effects and schemes may be enabled, which may increase the breadth and depth of gestures and interactions involving flexible displays. For example, in an embodiment, a controlled and gradual increase of the perceived damping factor of the display, as opposed to its physical value, may be generated.
• mechanical detents during the bending motion may be generated, as long as the response time of the haptic output device is faster than the bending gesture of the user.
• the locking or holding (i.e. solidifying) of the display in a certain position may be generated.
• the range of the bending and/or the extent of the bending may be limited to a certain threshold.
• an isolated, locally rigid section or patch or line on the display may be created.
• the deformation restoration rate i.e. how fast/slow a deformed part springs back to its neutral state, if restored back at all, may be adjusted.
• the device/display itself may actively apply force along the deformation degree of freedom (e.g., bending). This force may be opposite or in line with the external gesture force applied by the user (if any), and may or may not result in actual deformation (i.e. shape change) of the device and display.
• This force may be opposite or in line with the external gesture force applied by the user (if any), and may or may not result in actual deformation (i.e. shape change) of the device and display.
• the haptic output device may generate a bending or folding force on the display, which, as opposed to the passive mode, is not a pure resistance.
• the active mode haptic effects may be enabled, for example, with electromechanical actuators, shape memory alloys, MFC actuators, etc.
• Embodiments of the present invention may provide an advantage by providing an increase in flexibility of the haptic output device by using smart gels, rheological fluids, shape memory alloys, MFC, etc., and thus its compatibility with flexible surfaces and compact design.
• embodiments of the invention may satisfy the space constraints in mobile user interface devices by embedding the haptic output device in the hinge or surface of the device, which may provide a potential power savings by using a combination of actuation techniques.
• a DC motor may be used to rotate portions of the flexible user interface device, while a smart gel or an electro-rheological fluid may be used to lock the configuration in place.
• Embodiments of the invention that provide programmable kinesthetic haptic effects on flexible displays by using the actuation components described herein may expand the breadth and depth of the user interactions and enhance the user experience with flexible displays.
• the utility of the display may be facilitated. For example, typing on a touchscreen may be easier if the device is rigid and zooming an image output by the flexible display may be easier by bending the display, which requires a softer, less rigid display.
• the user may experience less fatigue.
• Embodiments of the present invention may enable several haptic experiences, including controlled and gradual increase of the perceived damping factor of the display, mechanical detents on bending motion, locking/holding (solidifying) the display in a certain position, limiting the range of bending range and extent to a certain threshold, creating isolated, locally rigid sections/patches/lines on the display, and adjusting the deformation restoration rate, i.e. how fast or slow the deformed parts spring back to their neutral state, if restored back at all.

Landscapes

• Engineering & Computer Science (AREA)
• Theoretical Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Human Computer Interaction (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Computer Hardware Design (AREA)
• User Interface Of Digital Computer (AREA)
• Devices For Indicating Variable Information By Combining Individual Elements (AREA)
• Telephone Function (AREA)

Priority Applications (5)

Applications Claiming Priority (2)

Publications (1)

Family

ID=50513838

Family Applications (2)

Family Applications Before (1)

Country Status (6)

Cited By (2)

Families Citing this family (280)

Citations (5)

Family Cites Families (139)

• 2014
  • 2014-04-25 EP EP18203858.8A patent/EP3462297A3/en not_active Withdrawn
  • 2014-04-25 CN CN201480023082.XA patent/CN105144035B/zh not_active Expired - Fee Related
  • 2014-04-25 JP JP2016510802A patent/JP6276385B2/ja not_active Expired - Fee Related
  • 2014-04-25 WO PCT/US2014/035508 patent/WO2014176532A1/en not_active Ceased
  • 2014-04-25 EP EP14166094.4A patent/EP2796983B1/en not_active Not-in-force
  • 2014-04-25 KR KR1020157033334A patent/KR20160003031A/ko not_active Abandoned
  • 2014-04-25 WO PCT/US2014/035500 patent/WO2014176528A1/en not_active Ceased
  • 2014-04-25 US US14/262,403 patent/US9405368B2/en not_active Expired - Fee Related
  • 2014-04-25 EP EP14787935.7A patent/EP2989525B1/en active Active
  • 2014-04-25 CN CN201910124413.3A patent/CN110069157A/zh active Pending
  • 2014-04-25 US US14/262,122 patent/US9335823B2/en active Active
  • 2014-04-25 EP EP14788165.0A patent/EP2989530B1/en active Active
  • 2014-04-25 JP JP2014090907A patent/JP6335613B2/ja not_active Expired - Fee Related
  • 2014-04-25 JP JP2016510805A patent/JP2016520915A/ja active Pending
  • 2014-04-25 EP EP19187964.2A patent/EP3575941A1/en not_active Withdrawn
  • 2014-04-25 KR KR1020157032818A patent/KR20160002941A/ko not_active Abandoned
  • 2014-04-25 CN CN201480023079.8A patent/CN105144052B/zh not_active Expired - Fee Related
  • 2014-04-25 CN CN201910126632.5A patent/CN109582150A/zh active Pending
  • 2014-04-25 US US14/262,482 patent/US9405369B2/en not_active Expired - Fee Related
  • 2014-04-28 KR KR1020140050655A patent/KR20140128275A/ko not_active Ceased
  • 2014-04-28 CN CN201810251553.2A patent/CN108563326A/zh active Pending
  • 2014-04-28 CN CN201410260402.5A patent/CN104122996B/zh not_active Expired - Fee Related
• 2016
  • 2016-04-06 US US15/092,088 patent/US9715281B2/en not_active Expired - Fee Related
  • 2016-06-28 US US15/195,705 patent/US9983676B2/en not_active Expired - Fee Related
  • 2016-06-29 US US15/196,981 patent/US9971409B2/en not_active Expired - Fee Related
• 2017
  • 2017-06-20 US US15/628,276 patent/US10248210B2/en active Active
• 2018
  • 2018-01-11 JP JP2018002297A patent/JP2018088264A/ja active Pending
  • 2018-04-05 US US15/945,862 patent/US10503262B2/en not_active Expired - Fee Related
  • 2018-04-24 US US15/961,675 patent/US20180246574A1/en not_active Abandoned
  • 2018-05-01 JP JP2018088219A patent/JP6670884B2/ja not_active Expired - Fee Related
  • 2018-10-26 JP JP2018201534A patent/JP2019050003A/ja active Pending
• 2019
  • 2019-02-25 US US16/284,499 patent/US20190204924A1/en not_active Abandoned
  • 2019-07-11 JP JP2019129286A patent/JP2019197576A/ja active Pending

Patent Citations (5)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events