US20170052591A1 - Tactile graphical display - Google Patents
Tactile graphical display Download PDFInfo
- Publication number
- US20170052591A1 US20170052591A1 US14/830,120 US201514830120A US2017052591A1 US 20170052591 A1 US20170052591 A1 US 20170052591A1 US 201514830120 A US201514830120 A US 201514830120A US 2017052591 A1 US2017052591 A1 US 2017052591A1
- Authority
- US
- United States
- Prior art keywords
- pressure
- graphical display
- tactile gradient
- tactile
- translation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 claims abstract description 46
- 238000004590 computer program Methods 0.000 claims abstract description 15
- 230000008859 change Effects 0.000 claims description 35
- 238000003860 storage Methods 0.000 claims description 32
- 238000013519 translation Methods 0.000 claims description 32
- 230000006870 function Effects 0.000 claims description 20
- 230000004044 response Effects 0.000 claims description 12
- 230000007704 transition Effects 0.000 claims description 10
- 238000012544 monitoring process Methods 0.000 claims description 6
- 230000009471 action Effects 0.000 claims description 2
- 230000000007 visual effect Effects 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 12
- 239000000463 material Substances 0.000 description 9
- 238000012545 processing Methods 0.000 description 8
- 230000008901 benefit Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000005452 bending Methods 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000003362 replicative effect Effects 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 238000012876 topography Methods 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 238000001746 injection moulding Methods 0.000 description 1
- 238000010329 laser etching Methods 0.000 description 1
- 238000007648 laser printing Methods 0.000 description 1
- 230000003278 mimic effect Effects 0.000 description 1
- 230000003204 osmotic effect Effects 0.000 description 1
- 238000000206 photolithography Methods 0.000 description 1
- 230000008929 regeneration Effects 0.000 description 1
- 238000011069 regeneration method Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000002174 soft lithography Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000013598 vector Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04102—Flexible digitiser, i.e. constructional details for allowing the whole digitising part of a device to be flexed or rolled like a sheet of paper
Definitions
- the present disclosure relates to graphical displays, and more specifically, to tactile graphical displays.
- Graphical displays convey information to a user via an electronic medium.
- One type of graphical display is an e-book reader. Some e-book readers imitate various physical aspects of books to enhance the user's experience.
- aspects of the present disclosure may include a method for visually and tactilely presenting at least a portion of a document having a plurality of pages on a graphical display.
- the method may include monitoring a flexural state of a graphical display presenting a current page of a document.
- the method may include sensing a change from a first flexural state to a second flexural state of the graphical display.
- the method may include determining the change from the first flexural state to the second flexural state is above a first threshold.
- the method may include defining a tactile gradient having a plurality of surfaces representing at least a portion of the plurality of pages of the document, where each surface comprises a discrete plane with respect to each other surface.
- the method may include applying the tactile gradient to the graphical display by distributing a selective volume within a portion of the graphical display.
- aspects of the present disclosure may include a system for presenting a tactile gradient on a graphical display having a plurality of flexural states.
- the tactile gradient may represent at least a portion of a document having a plurality of pages.
- the system may comprise a memory configured to store the document, a graphical display configured to present a current page of the document, a microfluidics panel configured to present the tactile gradient, at least one sensor configured to measure a change between a first flexural state of the graphical display and a second flexural state of the graphical display, and a processor.
- the processor may be configured to receive, from the sensor, the change between the first flexural state and the second flexural state.
- the processor may be further configured to determine the change between the first flexural state and the second flexural state is above a first threshold.
- the processor may be further configured to model the tactile gradient, where the tactile gradient comprises a plurality of discrete surfaces representing at least a portion of the plurality of pages of the document.
- the processor may be further configured to provide instructions to the microfluidics panel to apply the tactile gradient.
- aspects of the present disclosure may include a computer program product for creating a tactile representation of at least a portion of a document presented on a graphical display.
- the computer program product may comprise a computer readable storage medium containing program instructions which are executable by a processor.
- the program instructions may cause the processor to monitor a first curvature of a graphical display presenting a current page of a document having a plurality of pages.
- the program instructions may further cause the processor to quantify a change from the first curvature to a second curvature of the graphical display.
- the program instructions may further cause the processor to determine the change from the first curvature to the second curvature is above a first threshold.
- the program instructions may further cause the processor to model, in response to determining the change from the first curvature to the second curvature is above a first threshold, a tactile gradient comprising a plurality of discrete surfaces, where each surface contains a respective geometry, and where no two surfaces of the plurality of surfaces are coplanar.
- the program instructions may further cause the processor to provide instructions to the graphical display to apply the tactile gradient by distributing a selective volume contained within a portion of the graphical display.
- FIG. 1A is a top view and a front view of a graphical display in an unflexed state according to some embodiments of the present disclosure.
- FIG. 1B is a top view and a front view of the same graphical display in a flexed state according to some embodiments of the present disclosure.
- FIG. 2 depicts a portion of one example of a graphical display in a flexed state in accordance with embodiments of the present disclosure.
- FIG. 3A presents a top-view of an illustrative tactile gradient according to some embodiments of the present disclosure.
- FIG. 3B presents a side-view of the illustrative tactile gradient of FIG. 3A according to some embodiments of the present disclosure.
- FIG. 3C presents a front-view of the illustrative tactile gradient of FIG. 3A according to some embodiments of the present disclosure.
- FIG. 4 presents a block diagram of a graphical display according to some embodiments of the present disclosure.
- FIG. 5 presents a flowchart illustrating an example method of creating a tactile gradient according to some embodiments of the present disclosure.
- FIG. 6 presents a flowchart illustrating an example method of defining a tactile gradient according to some embodiments of the present disclosure.
- FIG. 7 presents a flowchart illustrating an example method of identifying and executing a user request according to some embodiments of the present disclosure.
- Graphical displays such as an e-book reader, convey information to a user via an electronic medium.
- Some embodiments of the present disclosure relate to improvements of an e-book reader. Additional embodiments relate to flexible graphical displays for presenting the user with information such as books, web pages, photographic albums, or other types of documents.
- a graphical display configured to produce a three-dimensional representation of the remaining number of pages in a given document.
- a document should be construed to mean any set of data capable of being paginated (e.g., a book, web sites, internet search results, photo albums).
- a user flexes an edge of the graphical display corresponding to an edge of the presented document which, sensing the flexion, generates a three-dimensional imitation of the remaining number of pages.
- a page of a document should be construed to mean any discrete portion of a data set capable of being presented individually.
- a page could contain a set of text, one or more photographs, one or more videos, one or more hyperlinks, etc.
- the present disclosure advantageously provides both a visual and a tactile representation of a set of pages, including, in some embodiments, tactile and visual representations of bookmarks and other section markings (e.g., chapter markings, user marked sections, social media markings, etc.). Aspects of the present disclosure further provide skeuomorphic advantages, that is, the tactile graphical display mimics aspects of an actual book for aesthetic purposes.
- aspects of the present disclosure can use microfluidic devices to generate a tactile representation of a set of pages.
- aspects of the present disclosure provide for a series of protrusions and depressions forming a set of discrete surfaces on an otherwise substantially smooth surface.
- the set of discrete surfaces is created via microfluidics.
- microfluidics leverages micro-level material characteristics to selectively distribute small volumes of fluid to achieve controlled outcomes.
- the controlled outcomes involve a change in the geometry of a portion of the graphical display.
- Non-limiting examples of these strategies include exploiting material characteristics (e.g., non-Newtonian behavior, laminar flow, etc.), designing channels, valves, mixers, and pumps operating by, for example, mechanical, biological, chemical, electrical, diffusive, osmotic, pneumatic, hydraulic, or a combination of the aforementioned methods, fabricating microfluidic devices via, for example, photolithography, soft lithography, injection molding, laser etching, printing, or other means.
- material characteristics e.g., non-Newtonian behavior, laminar flow, etc.
- designing channels, valves, mixers, and pumps operating by, for example, mechanical, biological, chemical, electrical, diffusive, osmotic, pneumatic, hydraulic, or a combination of the aforementioned methods
- fabricating microfluidic devices via, for example, photolithography, soft lithography, injection molding, laser etching, printing, or other means.
- microfluidics is a maturing scientific field and thus, modifications and improvements in the
- microfluidics is used for clarity, however, the application of microfluidic devices with respect to some aspects of the present disclosure should not be construed as limited to devices operating within a technically “micro” scale. Rather, the term microfluidics, as used for some embodiments in the present disclosure, should be construed to mean any mechanical, chemical, biological, electrical, hydraulic, or pneumatic method, or any combination of the aforementioned methods, able to successfully manipulate selective volumes on a sufficiently small scale to be embedded within, or otherwise operably coupled to, a graphical user interface presenting a tactile gradient in accordance with embodiments of the present disclosure.
- the present disclosure provides several advantages, both aesthetic (e.g., replicating the form of a flexed document) and practical (e.g., providing quick reference to the number of remaining pages), as a result of generating a tactile and visual representation of a set of pages on a graphical display.
- aesthetic e.g., replicating the form of a flexed document
- practical e.g., providing quick reference to the number of remaining pages
- FIG. 1A presents a graphical display in an unflexed state according to some embodiments of the present disclosure.
- FIG. 1A illustrates both a top view 100 A and a front view 120 A of the graphical display according to various embodiments.
- the graphical display can be referred to generally as graphical display 100 where the reference is irrespective of viewpoint or flexural state.
- the graphical display 100 is used to present data 130 (e.g., text, graphics, videos, etc.).
- the graphical display 100 is a tablet, an e-reader, a mobile phone, a monitor, or any other graphical display capable of presenting information to a user and capable of flexing in response to a user force.
- the graphical display 100 contains a microfluidics panel as will be further described hereinafter.
- FIG. 1B presents the same graphical display in a flexed state.
- FIG. 1B shows both a top view 100 B and a front view 120 B of the graphical display according to various embodiments.
- the graphical display in a flexed state 100 B is deformed by a rotational force 164 about an axis of rotation 160 .
- the same rotational force 164 and axis of rotation 160 demonstrate the creation of a curvature 150 of the graphical display.
- the microfluidics panel of the graphical display In response to the curvature 150 , the microfluidics panel of the graphical display generates a tactile gradient 140 replicating the visual and tactile appearance of a set of flexed pages.
- the curvature 150 is created by a rotational force 164 about an axis of rotation 160 .
- the flexion occurs around axes having alternative orientations with respect to the presented data 130 or the graphical display 100 and being located different distances from a given location on the graphical display 100 .
- the top right corner of the top view 100 B of the graphical display could be flexed.
- the axis of rotation can form an angle (e.g., approximately a 45 degree angle) with respect to the orientation of the data 130 or the graphical display 100 .
- the location of the axis of rotation can change.
- the location of the axis of rotation is related to the curvature 150 in some embodiments.
- a curvature can be defined as the reciprocal of the distance to the axis of rotation (i.e., the reciprocal of the radius).
- the distance of the axis of rotation to a point on the graphical display also provides information regarding the orientation of the flexion.
- the curvature 150 is defined as a maximum curvature, an average curvature, or a curvature value coupled to a distance value where the distance represents the length of a curvature line orthogonal to the axis of rotation (i.e., the length of the arc comprising the curvature).
- portions of the tactile gradient 140 are oriented substantially parallel to the axis of rotation. Specifically, edges of the tactile gradient representing pages or sets of pages are oriented substantially parallel to the axis of rotation. Thus, a planar cross-section of the tactile gradient 140 is substantially orthogonal to the axis of rotation.
- the curvature 150 can form a variety of geometries such as, but not limited to, cylindrical, spherical, ellipsoidal, conical, or combinations of the aforementioned geometries.
- shape of the curvature multiple axes, angles, distances, and curvatures can be calculated to sufficiently define the geometry of the curvature.
- the present disclosure discusses an orientation of the axis of rotation with respect to the data 130 (i.e., data presented on the graphical display 100 ) and one or more distances of the axis of rotation with respect to one or more points on the graphical display 100 , it should be appreciated that additional or alternative data can be collected regarding the flexion of the graphical display 100 in order to develop an appropriate tactile gradient 140 .
- the flexion is quantified using stress and strain data from aspects of the graphical display 100 .
- the flexion is quantified using varying distances between a plurality of sensors communicatively coupled to one another.
- the data is used, in whole or in part, to determine the characteristics of the tactile gradient 140 in some embodiments of the present disclosure.
- FIG. 2 shown is an illustrative cross-section of a tactile gradient in accordance with embodiments of the present disclosure.
- FIG. 2 is the same or substantially the same as the tactile gradient 140 of FIG. 1 .
- the tactile gradient contains a plurality of variable lengths 210 parallel to an x-axis 270 and a plurality of variable heights 220 parallel to the y-axis 260 .
- the x-axis 270 is parallel to the surface of the graphical display and a y-axis is perpendicular to the surface of the graphical display.
- a respective length 210 and height 220 adjacent to one another form a step.
- the tactile gradient is, therefore, composed of a plurality of steps.
- the lengths 210 and the heights 220 can vary in magnitude throughout the tactile gradient.
- the dimensions of individual steps can vary, and therefore, the relationships between steps can vary.
- a length-to-height ratio of the steps forming the tactile gradient decreases as the distance from the axis of rotation (e.g., axis of rotation 160 of FIG. 1 ) increases.
- outlying length-to-height ratios appear throughout the tactile gradient to generate a non-linear pattern. For example, replicating the page distribution of a book edge under flexion requires, in some cases, outlying length-to-height ratios for some steps to reproduce a book having, for example, inconsistent binding.
- each step is associated with a page or a set of pages, and furthermore, variations in the height 220 can represent different numbers of pages.
- the edge of various steps can contain a multitude of small steps 230 (e.g., a fractal representation of a set of steps connecting two surfaces), the edge can contain a slope 240 (e.g., a chamfer), or the edge can contain a radius 250 .
- steps 230 e.g., a fractal representation of a set of steps connecting two surfaces
- the edge can contain a slope 240 (e.g., a chamfer)
- the edge can contain a radius 250 .
- a length 210 represents a discrete surface of the tactile gradient.
- a discrete surface is separated from adjacent surfaces by at least a height 220 .
- the lengths 210 are shown to be substantially parallel with one another, the lengths 210 can be non-parallel.
- an angle in addition to a height 220 , can be used to describe the relationships between various discrete surfaces. Regardless of the orientation of each surface, no two surfaces in the tactile gradient are coplanar. That is to say, parallel surfaces are separated by at least a non-zero distance, and non-parallel surfaces are separated by at least a non-zero angle.
- FIG. 3 shown is a first-angle orthographic projection of a tactile gradient containing optional markings in accordance with embodiments of the present disclosure.
- FIG. 3A shows a top view of an illustrative tactile gradient.
- FIG. 3B shows a side view of the same illustrative tactile gradient.
- FIG. 3C shows a front view of the same illustrative tactile gradient.
- corner 350 A of FIG. 3A is the same corner as 350 C of FIG. 3C .
- corner 340 B of FIG. 3B is the same corner as 340 C of FIG. 3C .
- the tactile gradient contains markings (shown as optional via the dotted lines of FIG. 3 ) in the form of protrusions, depressions, or protrusions and depressions with respect to the surrounding surface.
- the two-dimensional or three-dimensional markings identify selective page numbers within the text according to some embodiments of the present disclosure. Numerous types of markings are contemplated in the present disclosure.
- some embodiments of the present disclosure generate triangular protrusions such as the one shown in 310 A, 310 B, and 310 C of FIGS. 3A, 3B, and 3C respectively.
- triangular depressions as shown by 330 A, 330 B, and 330 C of FIGS. 3A, 3B, and 3C , respectively, are also possible.
- triangular protrusions and depressions are possible, where, for instance, the protrusion and depression replicates added and detracted thicknesses of a folded page corner with respect to an unfolded portion of a page.
- the triangular protrusions and depressions can be any class of right triangle in accordance with various embodiments.
- the protrusion and the depression can share a common edge where the common edge forms a line of symmetry between the protrusion and the depression.
- the markings comprise substantially rectangular geometries as shown in 320 A, 320 B, and 320 C of FIGS. 3A, 3B, and 3C respectively.
- the rectangular geometries are alterable by, for example, changing lengths, widths, and corner radii.
- the exemplary page marking geometries are non-limiting, and the page marking geometries can be any class of polygonal, ovoidal, or a combination of both polygonal and ovoidal geometries in nature.
- the geometric markings contain text or graphics providing information regarding the identified page.
- the text or graphic can protrude or depress from the surface of the geometric marking according to various embodiments (e.g., the text or graphic can be embossed to provide further tactile characteristics to the marking in addition to the three-dimensional nature of the marking itself, in some embodiments).
- the markings' locations, data, and presentations can serve multiple purposes and can be user defined or automated (e.g., the markings can be bookmarks, chapter markings, topic markings, markings related to social media trends, etc.). In some embodiments, only markings appearing in the remainder of the document appear in the tactile gradient. In alternative embodiments, all markings appear in the tactile gradient irrespective of the location of the presented page within the document.
- the locations, geometries, and information contained within the markings can be stored within the document metadata (e.g., section titles) or within an alternative repository (e.g., a storage device operably coupled to the graphical display).
- the marking geometries are an aspect of the tactile gradient, and thus, the markings are generated by a microfluidics panel distributing a selective volume.
- the creation of a marking can be associated with a regeneration of the tactile gradient in accordance with some embodiments of the present disclosure.
- the graphical display 100 is the same or substantially the same as the graphical display 100 A and 100 B of FIGS. 1A and 1B respectively.
- the graphical display 100 includes a memory 425 , storage 430 , an interconnect (e.g., BUS) 420 , one or more processors (e.g., CPUs) 405 , an I/O device interface 410 , I/O devices 412 , and a network interface 415 .
- an interconnect e.g., BUS
- processors e.g., CPUs
- Each CPU 405 retrieves and executes programming instructions stored in the memory 425 or storage 430 .
- the interconnect 420 is used to move data, such as programming instructions, between the CPU 405 , I/O device interface 410 , storage 430 , network interface 415 , and memory 425 .
- the interconnect 420 can be implemented using one or more busses.
- the CPUs 405 can be a single CPU, multiple CPUs, or a single CPU having multiple processing cores in various embodiments.
- a processor 405 can be a digital signal processor (DSP).
- Memory 425 is generally included to be representative of a random access memory (e.g., static random access memory (SRAM), dynamic random access memory (DRAM), or Flash).
- SRAM static random access memory
- DRAM dynamic random access memory
- Flash Flash
- the storage 430 is generally included to be representative of a non-volatile memory, such as a hard disk drive, solid state device (SSD), removable memory cards, optical storage, or flash memory devices.
- the storage 430 can be replaced by storage area-network (SAN) devices, the cloud, or other devices connected to the graphical display 100 via the I/O devices 412 or a communication network via the network interface 415 .
- SAN storage area-network
- the memory 425 stores a compiler 426 and tactile gradient instructions 432 .
- the storage 430 stores the material 434 .
- the material 434 is the same or substantially the same as the data 130 of FIG. 1 (i.e., a paginated document).
- the compiler 426 , the tactile gradient instructions 432 , and the material 434 are stored partially in memory 425 and partially in storage 430 , or they are stored entirely in memory 425 or entirely in storage 430 , or they are accessed over a network via the network interface 415 .
- the I/O devices 412 include a user interface 440 , a flexion sensor 450 , a pressure sensor 452 , and a microfluidics panel 460 .
- the user interface 440 presents the user with the material 434 .
- the flexion sensor 450 monitors the flexion of the graphical display 100 .
- the flexion sensor 450 monitors the location of an axis of rotation of the flexion and the angle of the axis of rotation with respect to the presented material 434 or the graphical display 100 .
- the pressure sensor 452 monitors the pressure across the tactile gradient.
- the information collected by flexion sensor 450 and pressure sensor 452 is temporarily stored in the memory 425 or the storage 430 .
- the instructions 432 Upon reaching various flexion and pressure thresholds (as described hereinafter with respect to FIG. 5 , FIG. 6 , and FIG. 7 ), the instructions 432 calculate the topography of the tactile gradient according to the information supplied by the flexion sensor 450 and the pressure sensor 452 .
- the compiler 426 outputs a set of commands deployable by the CPU 405 according to the instructions 432 .
- the CPU 405 executes the instructions and causes the microfluidics panel 460 to distribute a selective volume to generate the tactile gradient.
- the user interface 440 and the microfluidics panel 460 are integrated with one another.
- the user interface 440 and the microfluidics panel 460 form two distinct layers of the graphical display 100 .
- the microfluidics panel 460 is smaller than the user interface 440 and is located in the portion of the graphical display 100 intended to display a tactile gradient. Regardless of the relationship between the user interface 440 and the microfluidics panel 460 , both panels are operably connected to present both visual and tangible aspects of the tactile gradient.
- the flexion sensor 450 and the pressure sensor 452 continuously, approximately continuously, or in predetermined time intervals collect information regarding the state of the user interface 440 .
- the CPU 405 calculates updated tactile gradient topographies based on the instructions 432 .
- the sufficiency of difference is a function comprising a maximum permissible change in curvature, maximum permissible change in location of the axis of rotation, and maximum permissible change in orientation of the axis of rotation.
- the sufficiency of difference is a function comprising a minimum pressure, a permissible location of the pressure, a maximum or minimum permissible translation of the pressure, and a permissible direction of the translation of the pressure.
- the compiler 426 based on the instructions 432 , outputs a set of commands deployable by a CPU 405 to alter the tactile gradient of the microfluidics panel 460 .
- FIG. 5 shown is a flowchart illustrating an example method of creating a tactile gradient according to some embodiments of the present disclosure.
- the method 500 is executed by one or more CPUs 405 according to a set of instructions 432 as illustrated and described with respect to FIG. 4 .
- Method 500 starts with monitoring the flexion (operation 510 ) of the graphical display using, for example, the flexion sensor 450 of FIG. 4 .
- operation 520 a change in the flexural state of the graphical display is sensed. Specifically, a change from a first flexural state to a second flexural state is sensed.
- operation 522 the magnitude of the change between the first flexural state and the second flexural state is compared to a first threshold.
- the first threshold is a function of the maximum permissible angle formed between axes of rotation of the first state and the second state, the maximum permissible distance between axes of rotation of the first state and the second state, and the maximum permissible difference in curvature of the first state and the second state.
- the term “maximum” refers to a predetermined limit on a characteristic (e.g., angle, distance, etc.) which need not be the maximum value which is physically possible.
- the maximum permissible characteristics comprising, for example, the first threshold, can be static or dynamic values.
- the first threshold can be a single number, a set of numbers, a percentage, or a set of percentages.
- the first threshold is a number, it is compared to the difference between the initial flexural state and the second flexural state. If the number is a percentage, it is compared to the percentage change from the initial flexural state to the second flexural state. If the threshold is a set of numbers or percentages, each number or percentage can be compared to the threshold, or compared to a set of thresholds corresponding to various distances, angles, curvatures, or combinations thereof as previously described. Thus, the first threshold can control, in whole or in part, the level of granularity which causes the tactile gradient to be generated or regenerated.
- the method 500 reverts to operation 510 and continues monitoring the flexion of the graphical display 100 . If the change is above the first threshold, the method proceeds to operation 530 to define a tactile gradient.
- the tactile gradient is defined to mimic characteristics of a book or other document. The characteristics defined by the tactile gradient can be, but are not limited to, the remaining pages in the document, all pages in the document, bookmarks, tags, and/or other markings.
- the tactile gradient defined in operation 530 can be determined by the instructions 432 of FIG. 4 in some embodiments.
- the updated tactile gradient is then applied to the graphical display (e.g., to the microfluidics panel 460 of FIG. 4 ) in operation 540 . In some embodiments operation 540 is executed by one or more CPUs 405 of FIG. 4 . Following application of the tactile gradient in operation 540 , the method returns to monitoring the curvature in operation 510 .
- the method 600 is, in whole or in part, a subroutine executed in operation 530 of the method 500 .
- the method 600 can start with operation 610 in which bending event information is received (e.g., the flexural state change detected in operation 520 and found to be above a first threshold in operation 522 of FIG. 5 ).
- the display is divided into at least two portions.
- the two portions can be the same or different sizes.
- the location and orientation of the division of the display is a function of the location of the bending event information received in operation 610 .
- the division of the display is affected by any one, or any combination of, the location of the axis of rotation, the orientation of the axis of rotation, and/or the magnitude of the curvature.
- the first portion of the divided display comprises, in whole or in part, the unflexed portion of the graphical display while the second portion of the divided graphical display comprises, in whole or in part, approximately the flexed portion of the graphical display.
- the content displayed on the graphical display will be consolidated to a first portion of the divided display.
- the content is minimized (e.g., text minimized from size 10 to size 5 ), a smaller portion of the content is displayed (e.g., 100 words of text is restricted to 50 words of text), or a combination of both minimized content and restricted content is displayed as compared to the presentation of the content in the unflexed graphical display.
- operation 640 the tactile gradient is modelled.
- the tactile gradient is modelled to replicate the flexed profile of a document having the dimensions and pages of the document being presented.
- operation 640 uses information such as the number of pages of the document, the location of the presented page, any markings (e.g., the markings shown and described with respect to FIG. 3 ), and bending event information such as the location of the axis of rotation, the orientation of the axis of rotation, and the magnitude of the curvature.
- the tactile gradient modelled in operation 640 is applied to the second portion of the display.
- the operation 650 involves distributing a selective volume contained within the graphical display to three-dimensionally produce the tactile gradient modelled in operation 640 .
- FIG. 7 shown is a flowchart illustrating an example method of identifying and executing a user request according to some embodiments of the present disclosure.
- the method 700 is executed by one or more CPUs 405 based on tactile gradient instructions 432 as shown and described in FIG. 4 .
- the method 700 begins with monitoring pressure on the tactile gradient in operation 710 .
- the operation 710 is conducted by pressure sensor 452 of FIG. 4 .
- a pressure associated with a movement is detected (e.g., dragging a finger on a portion of the graphical display).
- the magnitude of the pressure, the location of the initial pressure, the distance of the pressure movement, and the direction of the pressure movement are compiled.
- the magnitude of the pressure is compared to the second threshold.
- the second threshold is a user defined pressure magnitude in some embodiments. In cases where operation 720 indicates the pressure is below the second threshold, operation 732 can return the method 700 to operation 710 . Alternatively, in cases where the magnitude of the pressure sensed in operation 720 is above the second threshold, operation 732 can proceed to operation 734 .
- the distance of the pressure movement as calculated in operation 730 is compared to a third threshold.
- the third threshold is a user-defined distance magnitude in some embodiments. If the distance of the pressure movement is greater than the third threshold, the user interface will present the portion of the document associated with the location of the pressure in operation 736 .
- the location of the pressure as calculated in operation 730 is associated with a location in the document (e.g., the material 434 of FIG. 4 ). In some embodiments, the location of the pressure is associated with a marking. In alternative embodiments the location of the pressure is associated with a number of pages (e.g., in a document containing 100 remaining pages, a pressure located at the midpoint of the tactile gradient could be associated with 50 pages).
- a sufficiently large pressure (per the second threshold) coupled with a sufficiently long movement (per the third threshold) results in the presentation of a selective portion of the data as a function of the location of the initial pressure.
- operation 736 can include a transition from the current page of the document to the selective page of the document.
- the initial location of the pressure and the direction of the translation of the pressure can be used to generate an animation of the transition between the current page of the document and the selective page of the document associated with the location of the pressure.
- the transition can be two- or three-dimensional and can include an animated change in the tactile gradient representing the transition.
- a raised geometry can move across the graphical display representing a moving page or set of pages.
- the method 700 can continue to operation 738 .
- the distance of the pressure movement will be compared to a fourth threshold.
- the fourth threshold is an additional distance magnitude. In some embodiments the third threshold and the fourth threshold are the same distance magnitude, while in alternative embodiments the fourth threshold is less than the third threshold. If the distance is above the fourth threshold, the method 700 can return to operation 710 . If the distance is below the fourth threshold, the method 700 can continue to operation 740 .
- the direction of the pressure movement is considered according to a first range.
- the first range is a range of acceptable directions of pressure with respect to a portion of the graphical display (e.g., with respect to the orientation of the presented data, or with respect to an edge of the graphical display).
- operation 760 marks the presented page (e.g., marked as described with reference to FIG. 3 ) and stores the location of the marked page (e.g., in the storage 430 of FIG. 4 ). If the direction of pressure is not within the first range, then any data associated with the location of the pressure for the presented page will be un-marked and erased in operation 750 . In various embodiments the operation 750 erases previous iterations of operation 760 .
- operation 736 presents the user with selective portion of the data
- operation 760 marks a portion of the data
- operation 750 erases a previously marked portion of the data.
- the magnitude of the pressure, the location of the pressure, the distance of the pressure movement, and the direction of the pressure movement can be used to identify and execute the correct response.
- FIG. 7 presents a particular set of operations arranged in a particular order, numerous variations are contemplated.
- operation 710 can occur in parallel with all other processes shown in FIG. 7 (i.e., pressure on the tactile gradient can be approximately continuously, or according to predetermined intervals, monitored throughout the method 700 ).
- various blocks shown in FIG. 7 can occur in alternative orders. For example, one operation can sense a pressure which can be followed by a determination of whether the pressure is above the second threshold. Subsequently, a movement associated with the pressure can be detected, the distance calculated, and the calculated distance compared to the third threshold.
- various blocks of FIG. 7 can be split into multiple blocks and various blocks can be rearranged with respect to one another.
- embodiments of the present disclosure can use alternative measures.
- pressure, distance, and direction of pressure are stated, those variables can be represented in any number of ways, such as vectors, matrices, etc.
- different data can be collected such as, but not limited to, replacing pressure with displacement, replacing distance with velocity, etc.
- the present invention may be a system, a method, and/or a computer program product.
- the computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
- the computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device.
- the computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing.
- a non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing.
- RAM random access memory
- ROM read-only memory
- EPROM or Flash memory erasable programmable read-only memory
- SRAM static random access memory
- CD-ROM compact disc read-only memory
- DVD digital versatile disk
- memory stick a floppy disk
- a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon
- a computer readable storage medium is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
- Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network.
- the network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers.
- a network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
- Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages.
- the computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server.
- the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider).
- electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
- These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
- These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
- the computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
- each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s).
- the functions noted in the block may occur out of the order noted in the figures.
- two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
- The present disclosure relates to graphical displays, and more specifically, to tactile graphical displays.
- Graphical displays convey information to a user via an electronic medium. One type of graphical display is an e-book reader. Some e-book readers imitate various physical aspects of books to enhance the user's experience.
- Aspects of the present disclosure may include a method for visually and tactilely presenting at least a portion of a document having a plurality of pages on a graphical display. The method may include monitoring a flexural state of a graphical display presenting a current page of a document. The method may include sensing a change from a first flexural state to a second flexural state of the graphical display. The method may include determining the change from the first flexural state to the second flexural state is above a first threshold. The method may include defining a tactile gradient having a plurality of surfaces representing at least a portion of the plurality of pages of the document, where each surface comprises a discrete plane with respect to each other surface. The method may include applying the tactile gradient to the graphical display by distributing a selective volume within a portion of the graphical display.
- Aspects of the present disclosure may include a system for presenting a tactile gradient on a graphical display having a plurality of flexural states. The tactile gradient may represent at least a portion of a document having a plurality of pages. The system may comprise a memory configured to store the document, a graphical display configured to present a current page of the document, a microfluidics panel configured to present the tactile gradient, at least one sensor configured to measure a change between a first flexural state of the graphical display and a second flexural state of the graphical display, and a processor. The processor may be configured to receive, from the sensor, the change between the first flexural state and the second flexural state. The processor may be further configured to determine the change between the first flexural state and the second flexural state is above a first threshold. The processor may be further configured to model the tactile gradient, where the tactile gradient comprises a plurality of discrete surfaces representing at least a portion of the plurality of pages of the document. The processor may be further configured to provide instructions to the microfluidics panel to apply the tactile gradient.
- Aspects of the present disclosure may include a computer program product for creating a tactile representation of at least a portion of a document presented on a graphical display. The computer program product may comprise a computer readable storage medium containing program instructions which are executable by a processor. The program instructions may cause the processor to monitor a first curvature of a graphical display presenting a current page of a document having a plurality of pages. The program instructions may further cause the processor to quantify a change from the first curvature to a second curvature of the graphical display. The program instructions may further cause the processor to determine the change from the first curvature to the second curvature is above a first threshold. The program instructions may further cause the processor to model, in response to determining the change from the first curvature to the second curvature is above a first threshold, a tactile gradient comprising a plurality of discrete surfaces, where each surface contains a respective geometry, and where no two surfaces of the plurality of surfaces are coplanar. The program instructions may further cause the processor to provide instructions to the graphical display to apply the tactile gradient by distributing a selective volume contained within a portion of the graphical display.
- The drawings included in the present application are incorporated into, and form part of, the specification. They illustrate embodiments of the present disclosure and, along with the description, serve to explain the principles of the disclosure. The drawings are only illustrative of certain embodiments and do not limit the disclosure.
-
FIG. 1A is a top view and a front view of a graphical display in an unflexed state according to some embodiments of the present disclosure. -
FIG. 1B is a top view and a front view of the same graphical display in a flexed state according to some embodiments of the present disclosure. -
FIG. 2 depicts a portion of one example of a graphical display in a flexed state in accordance with embodiments of the present disclosure. -
FIG. 3A presents a top-view of an illustrative tactile gradient according to some embodiments of the present disclosure. -
FIG. 3B presents a side-view of the illustrative tactile gradient ofFIG. 3A according to some embodiments of the present disclosure. -
FIG. 3C presents a front-view of the illustrative tactile gradient ofFIG. 3A according to some embodiments of the present disclosure. -
FIG. 4 presents a block diagram of a graphical display according to some embodiments of the present disclosure. -
FIG. 5 presents a flowchart illustrating an example method of creating a tactile gradient according to some embodiments of the present disclosure. -
FIG. 6 presents a flowchart illustrating an example method of defining a tactile gradient according to some embodiments of the present disclosure. -
FIG. 7 presents a flowchart illustrating an example method of identifying and executing a user request according to some embodiments of the present disclosure. - While the invention is amenable to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not to limit the invention to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.
- Graphical displays, such as an e-book reader, convey information to a user via an electronic medium. Some embodiments of the present disclosure relate to improvements of an e-book reader. Additional embodiments relate to flexible graphical displays for presenting the user with information such as books, web pages, photographic albums, or other types of documents.
- Some embodiments of the present disclosure provide for a graphical display configured to produce a three-dimensional representation of the remaining number of pages in a given document. For the purposes of the present disclosure, a document should be construed to mean any set of data capable of being paginated (e.g., a book, web sites, internet search results, photo albums). In some embodiments, a user flexes an edge of the graphical display corresponding to an edge of the presented document which, sensing the flexion, generates a three-dimensional imitation of the remaining number of pages. For the purposes of this disclosure, a page of a document should be construed to mean any discrete portion of a data set capable of being presented individually. Thus, according to the variety of possible documents, a page could contain a set of text, one or more photographs, one or more videos, one or more hyperlinks, etc. The present disclosure advantageously provides both a visual and a tactile representation of a set of pages, including, in some embodiments, tactile and visual representations of bookmarks and other section markings (e.g., chapter markings, user marked sections, social media markings, etc.). Aspects of the present disclosure further provide skeuomorphic advantages, that is, the tactile graphical display mimics aspects of an actual book for aesthetic purposes.
- It is to be understood that the aforementioned advantages do not list every advantage, and furthermore, various embodiments of the present disclosure include some or none of the advantages described herein while remaining within the spirit and scope of the present disclosure.
- Aspects of the present disclosure can use microfluidic devices to generate a tactile representation of a set of pages. Specifically, aspects of the present disclosure provide for a series of protrusions and depressions forming a set of discrete surfaces on an otherwise substantially smooth surface. In various embodiments, the set of discrete surfaces is created via microfluidics. As is understood by one skilled in the art, microfluidics leverages micro-level material characteristics to selectively distribute small volumes of fluid to achieve controlled outcomes. In embodiments of the present disclosure, the controlled outcomes involve a change in the geometry of a portion of the graphical display. Some aspects of the present disclosure utilizing microfluidics employ any number of strategies known in the art to achieve the desired outcomes. Non-limiting examples of these strategies include exploiting material characteristics (e.g., non-Newtonian behavior, laminar flow, etc.), designing channels, valves, mixers, and pumps operating by, for example, mechanical, biological, chemical, electrical, diffusive, osmotic, pneumatic, hydraulic, or a combination of the aforementioned methods, fabricating microfluidic devices via, for example, photolithography, soft lithography, injection molding, laser etching, printing, or other means. As appreciated by one skilled in the art, microfluidics is a maturing scientific field and thus, modifications and improvements in the materials, design, fabrication, and application of microfluidic devices as employed in some embodiments of the present disclosure can be realized without departing from the spirit and scope of the present disclosure. Thus, microfluidics panel technology is sufficiently understood by one of skill in the art to not require more detailed discussion herein.
- Furthermore, it should be understood that the term “microfluidics” is used for clarity, however, the application of microfluidic devices with respect to some aspects of the present disclosure should not be construed as limited to devices operating within a technically “micro” scale. Rather, the term microfluidics, as used for some embodiments in the present disclosure, should be construed to mean any mechanical, chemical, biological, electrical, hydraulic, or pneumatic method, or any combination of the aforementioned methods, able to successfully manipulate selective volumes on a sufficiently small scale to be embedded within, or otherwise operably coupled to, a graphical user interface presenting a tactile gradient in accordance with embodiments of the present disclosure.
- As previously described, the present disclosure provides several advantages, both aesthetic (e.g., replicating the form of a flexed document) and practical (e.g., providing quick reference to the number of remaining pages), as a result of generating a tactile and visual representation of a set of pages on a graphical display. Thus, to further articulate some aspects of the present disclosure, it can be useful to describe various embodiments of the present disclosure with reference to a number of figures.
-
FIG. 1A presents a graphical display in an unflexed state according to some embodiments of the present disclosure.FIG. 1A illustrates both a top view 100A and afront view 120A of the graphical display according to various embodiments. Hereinafter, the graphical display can be referred to generally asgraphical display 100 where the reference is irrespective of viewpoint or flexural state. Thegraphical display 100 is used to present data 130 (e.g., text, graphics, videos, etc.). According to various embodiments, thegraphical display 100 is a tablet, an e-reader, a mobile phone, a monitor, or any other graphical display capable of presenting information to a user and capable of flexing in response to a user force. According to various embodiments, thegraphical display 100 contains a microfluidics panel as will be further described hereinafter. -
FIG. 1B presents the same graphical display in a flexed state.FIG. 1B shows both atop view 100B and afront view 120B of the graphical display according to various embodiments. The graphical display in a flexedstate 100B is deformed by arotational force 164 about an axis ofrotation 160. When the graphical display is presented in thefront view 120B, the samerotational force 164 and axis ofrotation 160 demonstrate the creation of acurvature 150 of the graphical display. In response to thecurvature 150, the microfluidics panel of the graphical display generates atactile gradient 140 replicating the visual and tactile appearance of a set of flexed pages. - As shown in
FIG. 1B , thecurvature 150 is created by arotational force 164 about an axis ofrotation 160. According to alternative embodiments, the flexion occurs around axes having alternative orientations with respect to the presenteddata 130 or thegraphical display 100 and being located different distances from a given location on thegraphical display 100. For example, the top right corner of thetop view 100B of the graphical display could be flexed. In such an instance, the axis of rotation can form an angle (e.g., approximately a 45 degree angle) with respect to the orientation of thedata 130 or thegraphical display 100. In the same example, the location of the axis of rotation can change. The location of the axis of rotation is related to thecurvature 150 in some embodiments. Specifically, a curvature can be defined as the reciprocal of the distance to the axis of rotation (i.e., the reciprocal of the radius). Thus, a shorter distance results in a larger degree of curvature whereas a longer distance results in a smaller degree of curvature. In addition to representing the curvature, the distance of the axis of rotation to a point on the graphical display also provides information regarding the orientation of the flexion. In various embodiments, thecurvature 150 is defined as a maximum curvature, an average curvature, or a curvature value coupled to a distance value where the distance represents the length of a curvature line orthogonal to the axis of rotation (i.e., the length of the arc comprising the curvature). - Regardless of the location of flexion, portions of the
tactile gradient 140 are oriented substantially parallel to the axis of rotation. Specifically, edges of the tactile gradient representing pages or sets of pages are oriented substantially parallel to the axis of rotation. Thus, a planar cross-section of thetactile gradient 140 is substantially orthogonal to the axis of rotation. - In various embodiments, the
curvature 150 can form a variety of geometries such as, but not limited to, cylindrical, spherical, ellipsoidal, conical, or combinations of the aforementioned geometries. Thus, according to the shape of the curvature, multiple axes, angles, distances, and curvatures can be calculated to sufficiently define the geometry of the curvature. - Although the present disclosure discusses an orientation of the axis of rotation with respect to the data 130 (i.e., data presented on the graphical display 100) and one or more distances of the axis of rotation with respect to one or more points on the
graphical display 100, it should be appreciated that additional or alternative data can be collected regarding the flexion of thegraphical display 100 in order to develop an appropriatetactile gradient 140. In some embodiments, the flexion is quantified using stress and strain data from aspects of thegraphical display 100. In alternative embodiments, the flexion is quantified using varying distances between a plurality of sensors communicatively coupled to one another. Thus, regardless of the type of data collected regarding the flexural state of thegraphical display 100, the data is used, in whole or in part, to determine the characteristics of thetactile gradient 140 in some embodiments of the present disclosure. - Referring now to
FIG. 2 , shown is an illustrative cross-section of a tactile gradient in accordance with embodiments of the present disclosure. In some embodiments,FIG. 2 is the same or substantially the same as thetactile gradient 140 ofFIG. 1 . The tactile gradient contains a plurality ofvariable lengths 210 parallel to anx-axis 270 and a plurality ofvariable heights 220 parallel to the y-axis 260. In this example, thex-axis 270 is parallel to the surface of the graphical display and a y-axis is perpendicular to the surface of the graphical display. Arespective length 210 andheight 220 adjacent to one another form a step. The tactile gradient is, therefore, composed of a plurality of steps. Thelengths 210 and theheights 220 can vary in magnitude throughout the tactile gradient. Thus, the dimensions of individual steps can vary, and therefore, the relationships between steps can vary. In some embodiments, a length-to-height ratio of the steps forming the tactile gradient decreases as the distance from the axis of rotation (e.g., axis ofrotation 160 ofFIG. 1 ) increases. However, in some embodiments, outlying length-to-height ratios appear throughout the tactile gradient to generate a non-linear pattern. For example, replicating the page distribution of a book edge under flexion requires, in some cases, outlying length-to-height ratios for some steps to reproduce a book having, for example, inconsistent binding. Thus, numerous patterns and trends are contemplated in determining the length-to-height ratio of the portions of the tactile gradient corresponding to various pages or sets of pages. In various embodiments each step is associated with a page or a set of pages, and furthermore, variations in theheight 220 can represent different numbers of pages. - In addition to the general variability of the
lengths 210 and theheights 220, some embodiments alter the edges of the various steps. For example, the edge of various steps can contain a multitude of small steps 230 (e.g., a fractal representation of a set of steps connecting two surfaces), the edge can contain a slope 240 (e.g., a chamfer), or the edge can contain aradius 250. It should be understood that these are exemplary embodiments, and a multitude of edge geometries and patterns, both constant and variable, and combinations of the aforementioned, are within the spirit and scope of the present disclosure. - Thus, a
length 210 represents a discrete surface of the tactile gradient. In some embodiments a discrete surface is separated from adjacent surfaces by at least aheight 220. Although thelengths 210 are shown to be substantially parallel with one another, thelengths 210 can be non-parallel. Thus, an angle, in addition to aheight 220, can be used to describe the relationships between various discrete surfaces. Regardless of the orientation of each surface, no two surfaces in the tactile gradient are coplanar. That is to say, parallel surfaces are separated by at least a non-zero distance, and non-parallel surfaces are separated by at least a non-zero angle. - Referring now to
FIG. 3 , shown is a first-angle orthographic projection of a tactile gradient containing optional markings in accordance with embodiments of the present disclosure.FIG. 3A shows a top view of an illustrative tactile gradient.FIG. 3B shows a side view of the same illustrative tactile gradient.FIG. 3C shows a front view of the same illustrative tactile gradient. Specifically,corner 350A ofFIG. 3A is the same corner as 350C ofFIG. 3C . Likewise,corner 340B ofFIG. 3B is the same corner as 340C ofFIG. 3C . - In some embodiments, the tactile gradient contains markings (shown as optional via the dotted lines of
FIG. 3 ) in the form of protrusions, depressions, or protrusions and depressions with respect to the surrounding surface. The two-dimensional or three-dimensional markings identify selective page numbers within the text according to some embodiments of the present disclosure. Numerous types of markings are contemplated in the present disclosure. As specific examples, some embodiments of the present disclosure generate triangular protrusions such as the one shown in 310A, 310B, and 310C ofFIGS. 3A, 3B, and 3C respectively. Alternatively, triangular depressions as shown by 330A, 330B, and 330C ofFIGS. 3A, 3B, and 3C , respectively, are also possible. Further, combinations of triangular protrusions and depressions are possible, where, for instance, the protrusion and depression replicates added and detracted thicknesses of a folded page corner with respect to an unfolded portion of a page. The triangular protrusions and depressions can be any class of right triangle in accordance with various embodiments. In cases using a combination of triangular protrusions and depressions, the protrusion and the depression can share a common edge where the common edge forms a line of symmetry between the protrusion and the depression. - In alternative embodiments, the markings comprise substantially rectangular geometries as shown in 320A, 320B, and 320C of
FIGS. 3A, 3B, and 3C respectively. The rectangular geometries are alterable by, for example, changing lengths, widths, and corner radii. It should be understood the exemplary page marking geometries are non-limiting, and the page marking geometries can be any class of polygonal, ovoidal, or a combination of both polygonal and ovoidal geometries in nature. - In some embodiments, the geometric markings contain text or graphics providing information regarding the identified page. The text or graphic can protrude or depress from the surface of the geometric marking according to various embodiments (e.g., the text or graphic can be embossed to provide further tactile characteristics to the marking in addition to the three-dimensional nature of the marking itself, in some embodiments). The markings' locations, data, and presentations can serve multiple purposes and can be user defined or automated (e.g., the markings can be bookmarks, chapter markings, topic markings, markings related to social media trends, etc.). In some embodiments, only markings appearing in the remainder of the document appear in the tactile gradient. In alternative embodiments, all markings appear in the tactile gradient irrespective of the location of the presented page within the document. Collectively, the locations, geometries, and information contained within the markings can be stored within the document metadata (e.g., section titles) or within an alternative repository (e.g., a storage device operably coupled to the graphical display).
- In some embodiments containing markings as described in
FIG. 3 , the marking geometries are an aspect of the tactile gradient, and thus, the markings are generated by a microfluidics panel distributing a selective volume. As a result, the creation of a marking can be associated with a regeneration of the tactile gradient in accordance with some embodiments of the present disclosure. - Referring now to
FIG. 4 , shown is a block diagram of a graphical display according to some embodiments of the present disclosure. In some embodiments thegraphical display 100 is the same or substantially the same as thegraphical display 100A and 100B ofFIGS. 1A and 1B respectively. In various embodiments, thegraphical display 100 includes amemory 425,storage 430, an interconnect (e.g., BUS) 420, one or more processors (e.g., CPUs) 405, an I/O device interface 410, I/O devices 412, and anetwork interface 415. - Each
CPU 405 retrieves and executes programming instructions stored in thememory 425 orstorage 430. Theinterconnect 420 is used to move data, such as programming instructions, between theCPU 405, I/O device interface 410,storage 430,network interface 415, andmemory 425. Theinterconnect 420 can be implemented using one or more busses. TheCPUs 405 can be a single CPU, multiple CPUs, or a single CPU having multiple processing cores in various embodiments. In some embodiments, aprocessor 405 can be a digital signal processor (DSP).Memory 425 is generally included to be representative of a random access memory (e.g., static random access memory (SRAM), dynamic random access memory (DRAM), or Flash). Thestorage 430 is generally included to be representative of a non-volatile memory, such as a hard disk drive, solid state device (SSD), removable memory cards, optical storage, or flash memory devices. In an alternative embodiment, thestorage 430 can be replaced by storage area-network (SAN) devices, the cloud, or other devices connected to thegraphical display 100 via the I/O devices 412 or a communication network via thenetwork interface 415. - In some embodiments, the
memory 425 stores acompiler 426 and tactile gradient instructions 432. Thestorage 430 stores thematerial 434. In some embodiments thematerial 434 is the same or substantially the same as thedata 130 ofFIG. 1 (i.e., a paginated document). In various embodiments thecompiler 426, the tactile gradient instructions 432, and thematerial 434 are stored partially inmemory 425 and partially instorage 430, or they are stored entirely inmemory 425 or entirely instorage 430, or they are accessed over a network via thenetwork interface 415. - According to various embodiments, the I/
O devices 412 include a user interface 440, aflexion sensor 450, apressure sensor 452, and amicrofluidics panel 460. The user interface 440 presents the user with thematerial 434. Theflexion sensor 450 monitors the flexion of thegraphical display 100. In some embodiments, theflexion sensor 450 monitors the location of an axis of rotation of the flexion and the angle of the axis of rotation with respect to the presentedmaterial 434 or thegraphical display 100. Thepressure sensor 452 monitors the pressure across the tactile gradient. In various embodiments the information collected byflexion sensor 450 andpressure sensor 452 is temporarily stored in thememory 425 or thestorage 430. Upon reaching various flexion and pressure thresholds (as described hereinafter with respect toFIG. 5 ,FIG. 6 , andFIG. 7 ), the instructions 432 calculate the topography of the tactile gradient according to the information supplied by theflexion sensor 450 and thepressure sensor 452. Thecompiler 426 outputs a set of commands deployable by theCPU 405 according to the instructions 432. TheCPU 405 executes the instructions and causes themicrofluidics panel 460 to distribute a selective volume to generate the tactile gradient. - In various embodiments the user interface 440 and the
microfluidics panel 460 are integrated with one another. In alternative embodiments, the user interface 440 and themicrofluidics panel 460 form two distinct layers of thegraphical display 100. In further embodiments still, themicrofluidics panel 460 is smaller than the user interface 440 and is located in the portion of thegraphical display 100 intended to display a tactile gradient. Regardless of the relationship between the user interface 440 and themicrofluidics panel 460, both panels are operably connected to present both visual and tangible aspects of the tactile gradient. - The
flexion sensor 450 and thepressure sensor 452 continuously, approximately continuously, or in predetermined time intervals collect information regarding the state of the user interface 440. Thus, as theflexion sensor 450 collects flexural information and thepressure sensor 452 collects pressure information, theCPU 405 calculates updated tactile gradient topographies based on the instructions 432. In cases where the new flexural state is sufficiently different from the previous flexural state, a new tactile gradient will be applied. In some embodiments, the sufficiency of difference is a function comprising a maximum permissible change in curvature, maximum permissible change in location of the axis of rotation, and maximum permissible change in orientation of the axis of rotation. In alternative embodiments, the sufficiency of difference is a function comprising a minimum pressure, a permissible location of the pressure, a maximum or minimum permissible translation of the pressure, and a permissible direction of the translation of the pressure. In cases where the second flexural state is sufficiently different from the first flexural state, thecompiler 426, based on the instructions 432, outputs a set of commands deployable by aCPU 405 to alter the tactile gradient of themicrofluidics panel 460. - Referring now to
FIG. 5 , shown is a flowchart illustrating an example method of creating a tactile gradient according to some embodiments of the present disclosure. In various embodiments themethod 500 is executed by one ormore CPUs 405 according to a set of instructions 432 as illustrated and described with respect toFIG. 4 . -
Method 500 starts with monitoring the flexion (operation 510) of the graphical display using, for example, theflexion sensor 450 ofFIG. 4 . Inoperation 520, a change in the flexural state of the graphical display is sensed. Specifically, a change from a first flexural state to a second flexural state is sensed. Inoperation 522, the magnitude of the change between the first flexural state and the second flexural state is compared to a first threshold. In various embodiments the first threshold is a function of the maximum permissible angle formed between axes of rotation of the first state and the second state, the maximum permissible distance between axes of rotation of the first state and the second state, and the maximum permissible difference in curvature of the first state and the second state. As used herein, the term “maximum” refers to a predetermined limit on a characteristic (e.g., angle, distance, etc.) which need not be the maximum value which is physically possible. Thus, in some embodiments, the maximum permissible characteristics comprising, for example, the first threshold, can be static or dynamic values. The first threshold can be a single number, a set of numbers, a percentage, or a set of percentages. If the first threshold is a number, it is compared to the difference between the initial flexural state and the second flexural state. If the number is a percentage, it is compared to the percentage change from the initial flexural state to the second flexural state. If the threshold is a set of numbers or percentages, each number or percentage can be compared to the threshold, or compared to a set of thresholds corresponding to various distances, angles, curvatures, or combinations thereof as previously described. Thus, the first threshold can control, in whole or in part, the level of granularity which causes the tactile gradient to be generated or regenerated. - If the change between the first flexural state and the second flexural state is below the first threshold, the
method 500 reverts tooperation 510 and continues monitoring the flexion of thegraphical display 100. If the change is above the first threshold, the method proceeds tooperation 530 to define a tactile gradient. Inoperation 530, the tactile gradient is defined to mimic characteristics of a book or other document. The characteristics defined by the tactile gradient can be, but are not limited to, the remaining pages in the document, all pages in the document, bookmarks, tags, and/or other markings. The tactile gradient defined inoperation 530 can be determined by the instructions 432 ofFIG. 4 in some embodiments. The updated tactile gradient is then applied to the graphical display (e.g., to themicrofluidics panel 460 ofFIG. 4 ) inoperation 540. In someembodiments operation 540 is executed by one ormore CPUs 405 ofFIG. 4 . Following application of the tactile gradient inoperation 540, the method returns to monitoring the curvature inoperation 510. - Referring now to
FIG. 6 , shown is a flowchart illustrating an example method of defining a tactile gradient according to some embodiments of the present disclosure. In some embodiments, themethod 600 is, in whole or in part, a subroutine executed inoperation 530 of themethod 500. Themethod 600 can start withoperation 610 in which bending event information is received (e.g., the flexural state change detected inoperation 520 and found to be above a first threshold inoperation 522 ofFIG. 5 ). - In
operation 620, the display is divided into at least two portions. The two portions can be the same or different sizes. In some embodiments, the location and orientation of the division of the display is a function of the location of the bending event information received inoperation 610. For example, in some embodiments, the division of the display is affected by any one, or any combination of, the location of the axis of rotation, the orientation of the axis of rotation, and/or the magnitude of the curvature. In various embodiments, the first portion of the divided display comprises, in whole or in part, the unflexed portion of the graphical display while the second portion of the divided graphical display comprises, in whole or in part, approximately the flexed portion of the graphical display. - In
operation 630, the content displayed on the graphical display will be consolidated to a first portion of the divided display. In various embodiments the content is minimized (e.g., text minimized from size 10 to size 5), a smaller portion of the content is displayed (e.g., 100 words of text is restricted to 50 words of text), or a combination of both minimized content and restricted content is displayed as compared to the presentation of the content in the unflexed graphical display. - In
operation 640 the tactile gradient is modelled. The tactile gradient is modelled to replicate the flexed profile of a document having the dimensions and pages of the document being presented. Thus, in various embodiments,operation 640 uses information such as the number of pages of the document, the location of the presented page, any markings (e.g., the markings shown and described with respect toFIG. 3 ), and bending event information such as the location of the axis of rotation, the orientation of the axis of rotation, and the magnitude of the curvature. - In
operation 650, the tactile gradient modelled inoperation 640 is applied to the second portion of the display. Thus, in various embodiments, theoperation 650 involves distributing a selective volume contained within the graphical display to three-dimensionally produce the tactile gradient modelled inoperation 640. - Referring now to
FIG. 7 , shown is a flowchart illustrating an example method of identifying and executing a user request according to some embodiments of the present disclosure. In various embodiments themethod 700 is executed by one ormore CPUs 405 based on tactile gradient instructions 432 as shown and described inFIG. 4 . - The
method 700 begins with monitoring pressure on the tactile gradient inoperation 710. In some embodiments theoperation 710 is conducted bypressure sensor 452 ofFIG. 4 . In operation 720 a pressure associated with a movement is detected (e.g., dragging a finger on a portion of the graphical display). Inoperation 730 the magnitude of the pressure, the location of the initial pressure, the distance of the pressure movement, and the direction of the pressure movement are compiled. - In
operation 732, the magnitude of the pressure is compared to the second threshold. The second threshold is a user defined pressure magnitude in some embodiments. In cases whereoperation 720 indicates the pressure is below the second threshold,operation 732 can return themethod 700 tooperation 710. Alternatively, in cases where the magnitude of the pressure sensed inoperation 720 is above the second threshold,operation 732 can proceed tooperation 734. - In
operation 734 the distance of the pressure movement as calculated inoperation 730 is compared to a third threshold. The third threshold is a user-defined distance magnitude in some embodiments. If the distance of the pressure movement is greater than the third threshold, the user interface will present the portion of the document associated with the location of the pressure inoperation 736. The location of the pressure as calculated inoperation 730 is associated with a location in the document (e.g., thematerial 434 ofFIG. 4 ). In some embodiments, the location of the pressure is associated with a marking. In alternative embodiments the location of the pressure is associated with a number of pages (e.g., in a document containing 100 remaining pages, a pressure located at the midpoint of the tactile gradient could be associated with 50 pages). Thus, a sufficiently large pressure (per the second threshold) coupled with a sufficiently long movement (per the third threshold) results in the presentation of a selective portion of the data as a function of the location of the initial pressure. - In some embodiments,
operation 736 can include a transition from the current page of the document to the selective page of the document. In such a case, the initial location of the pressure and the direction of the translation of the pressure can be used to generate an animation of the transition between the current page of the document and the selective page of the document associated with the location of the pressure. The transition can be two- or three-dimensional and can include an animated change in the tactile gradient representing the transition. In some embodiments, a raised geometry can move across the graphical display representing a moving page or set of pages. - Returning now to
operation 734 of themethod 700, in the event the distance of the pressure movement is below the third threshold, themethod 700 can continue tooperation 738. Inoperation 738 the distance of the pressure movement will be compared to a fourth threshold. The fourth threshold is an additional distance magnitude. In some embodiments the third threshold and the fourth threshold are the same distance magnitude, while in alternative embodiments the fourth threshold is less than the third threshold. If the distance is above the fourth threshold, themethod 700 can return tooperation 710. If the distance is below the fourth threshold, themethod 700 can continue tooperation 740. - In
operation 740 the direction of the pressure movement is considered according to a first range. In some embodiments the first range is a range of acceptable directions of pressure with respect to a portion of the graphical display (e.g., with respect to the orientation of the presented data, or with respect to an edge of the graphical display). In cases where the direction of pressure is within the first range,operation 760 marks the presented page (e.g., marked as described with reference toFIG. 3 ) and stores the location of the marked page (e.g., in thestorage 430 ofFIG. 4 ). If the direction of pressure is not within the first range, then any data associated with the location of the pressure for the presented page will be un-marked and erased inoperation 750. In various embodiments theoperation 750 erases previous iterations ofoperation 760. - Thus, the
method 700 provides numerous outcomes to various user actions. Specifically,operation 736 presents the user with selective portion of the data,operation 760 marks a portion of the data, andoperation 750 erases a previously marked portion of the data. In some cases, the magnitude of the pressure, the location of the pressure, the distance of the pressure movement, and the direction of the pressure movement can be used to identify and execute the correct response. - It should be understood that although
FIG. 7 presents a particular set of operations arranged in a particular order, numerous variations are contemplated. For example,operation 710 can occur in parallel with all other processes shown inFIG. 7 (i.e., pressure on the tactile gradient can be approximately continuously, or according to predetermined intervals, monitored throughout the method 700). In addition, various blocks shown inFIG. 7 can occur in alternative orders. For example, one operation can sense a pressure which can be followed by a determination of whether the pressure is above the second threshold. Subsequently, a movement associated with the pressure can be detected, the distance calculated, and the calculated distance compared to the third threshold. Thus, various blocks ofFIG. 7 can be split into multiple blocks and various blocks can be rearranged with respect to one another. Additionally, embodiments of the present disclosure can use alternative measures. For example, although pressure, distance, and direction of pressure are stated, those variables can be represented in any number of ways, such as vectors, matrices, etc. Likewise, different data can be collected such as, but not limited to, replacing pressure with displacement, replacing distance with velocity, etc. - The present invention may be a system, a method, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present invention.
- The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
- Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
- Computer readable program instructions for carrying out operations of the present invention may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present invention.
- Aspects of the present invention are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
- These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
- The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
- The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts or carry out combinations of special purpose hardware and computer instructions.
- The descriptions of the various embodiments of the present invention have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Claims (20)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/830,120 US10712821B2 (en) | 2015-08-19 | 2015-08-19 | Tactile graphical display |
US16/502,075 US10705618B2 (en) | 2015-08-19 | 2019-07-03 | Tactile graphical display |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/830,120 US10712821B2 (en) | 2015-08-19 | 2015-08-19 | Tactile graphical display |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/502,075 Continuation US10705618B2 (en) | 2015-08-19 | 2019-07-03 | Tactile graphical display |
Publications (2)
Publication Number | Publication Date |
---|---|
US20170052591A1 true US20170052591A1 (en) | 2017-02-23 |
US10712821B2 US10712821B2 (en) | 2020-07-14 |
Family
ID=58158217
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/830,120 Active 2038-04-02 US10712821B2 (en) | 2015-08-19 | 2015-08-19 | Tactile graphical display |
US16/502,075 Active US10705618B2 (en) | 2015-08-19 | 2019-07-03 | Tactile graphical display |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/502,075 Active US10705618B2 (en) | 2015-08-19 | 2019-07-03 | Tactile graphical display |
Country Status (1)
Country | Link |
---|---|
US (2) | US10712821B2 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180285153A1 (en) * | 2016-02-04 | 2018-10-04 | Hewlett-Packard Development Company, L.P. | Managing a microfluidic device |
CN109117223A (en) * | 2018-07-24 | 2019-01-01 | 北京酷我科技有限公司 | A kind of interactive algorithm for submitting solicited status prompt |
US10705618B2 (en) * | 2015-08-19 | 2020-07-07 | International Business Machines Corporation | Tactile graphical display |
CN111459281A (en) * | 2020-04-03 | 2020-07-28 | 维沃移动通信有限公司 | Haptic feedback method, electronic device, and storage medium |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130120302A1 (en) * | 2008-12-08 | 2013-05-16 | Samsung Electronics Co., Ltd. | Display device and data displaying method thereof |
US20130268847A1 (en) * | 2012-04-09 | 2013-10-10 | Samsung Electronics Co., Ltd. | System and method for displaying pages of e-book |
US20140192247A1 (en) * | 2013-01-07 | 2014-07-10 | Samsung Electronics Co., Ltd. | Method for controlling camera operation based on haptic function and terminal supporting the same |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010107800A (en) | 2008-10-31 | 2010-05-13 | David Rebolledo Mendez Jovan | Sensory device |
US8451238B2 (en) | 2009-09-02 | 2013-05-28 | Amazon Technologies, Inc. | Touch-screen user interface |
US8717151B2 (en) | 2011-05-13 | 2014-05-06 | Qualcomm Incorporated | Devices and methods for presenting information to a user on a tactile output surface of a mobile device |
US9007300B2 (en) | 2011-10-14 | 2015-04-14 | Blackberry Limited | Method and system to control a process with bend movements |
US20130222416A1 (en) | 2012-02-29 | 2013-08-29 | Pantech Co., Ltd. | Apparatus and method for providing a user interface using flexible display |
US20140173495A1 (en) | 2012-12-13 | 2014-06-19 | Peratech Limited | Bookmark Gesture Recognition |
US9547366B2 (en) | 2013-03-14 | 2017-01-17 | Immersion Corporation | Systems and methods for haptic and gesture-driven paper simulation |
US10712821B2 (en) * | 2015-08-19 | 2020-07-14 | International Business Machines Corporation | Tactile graphical display |
DK201670720A1 (en) | 2016-09-06 | 2018-03-26 | Apple Inc | Devices, Methods, and Graphical User Interfaces for Generating Tactile Outputs |
-
2015
- 2015-08-19 US US14/830,120 patent/US10712821B2/en active Active
-
2019
- 2019-07-03 US US16/502,075 patent/US10705618B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130120302A1 (en) * | 2008-12-08 | 2013-05-16 | Samsung Electronics Co., Ltd. | Display device and data displaying method thereof |
US20130268847A1 (en) * | 2012-04-09 | 2013-10-10 | Samsung Electronics Co., Ltd. | System and method for displaying pages of e-book |
US20140192247A1 (en) * | 2013-01-07 | 2014-07-10 | Samsung Electronics Co., Ltd. | Method for controlling camera operation based on haptic function and terminal supporting the same |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10705618B2 (en) * | 2015-08-19 | 2020-07-07 | International Business Machines Corporation | Tactile graphical display |
US20180285153A1 (en) * | 2016-02-04 | 2018-10-04 | Hewlett-Packard Development Company, L.P. | Managing a microfluidic device |
CN109117223A (en) * | 2018-07-24 | 2019-01-01 | 北京酷我科技有限公司 | A kind of interactive algorithm for submitting solicited status prompt |
CN111459281A (en) * | 2020-04-03 | 2020-07-28 | 维沃移动通信有限公司 | Haptic feedback method, electronic device, and storage medium |
Also Published As
Publication number | Publication date |
---|---|
US10705618B2 (en) | 2020-07-07 |
US20190324547A1 (en) | 2019-10-24 |
US10712821B2 (en) | 2020-07-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10705618B2 (en) | Tactile graphical display | |
McKee et al. | The MAC method | |
JP4761764B2 (en) | Virtual three-dimensional book image display device | |
Erickson et al. | Building spacetime meshes over arbitrary spatial domains | |
MXPA02002151A (en) | Feature modeling in a finite element model. | |
US10255711B2 (en) | System and method for providing contents by merging layers of page to which motion effect is set | |
Wei et al. | Immersed boundary-conformal isogeometric method for linear elliptic problems | |
Manteaux et al. | Adaptive physically based models in computer graphics | |
US10755446B2 (en) | System and method for providing contents using automatic margin creation | |
US20160148395A1 (en) | Paintbrush and Liquid Simulation | |
Ryan | Computer-aided graphics and design | |
Gassner et al. | A space–time adaptive discontinuous Galerkin scheme | |
Baeza et al. | Method for obtaining the wheel–rail contact location and its application to the normal problem calculation through ‘CONTACT’ | |
Vitasari et al. | A viscous froth model adapted to wet foams | |
JP4955758B2 (en) | Text editing in 3D graphics | |
Russomanno et al. | Modeling pneumatic actuators for a refreshable tactile display | |
WO2016182874A1 (en) | Annotation creation system and method | |
Jones et al. | Designing digital technologies and learning activities for different geometries | |
Li | An arbitrary Lagrangian Eulerian method for three-phase flows with triple junction points | |
Käfer et al. | Error bounds for the approximative solution of restricted planar location problems | |
Csajbók | On the roughly continuous real functions | |
Muth et al. | Contact simulation for many particles considering adhesion | |
Kimura et al. | Computer-created interactive 3D image with midair haptic feedback | |
Syvertsen | Tangible Scalar Fields | |
Li et al. | Computation of equilibrium bilayer monodisperse foam structures using the surface evolver |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HARDEE, CHRISTOPHER J.;RAKSHIT, SARBAJIT K.;SIGNING DATES FROM 20150805 TO 20150808;REEL/FRAME:036362/0499 Owner name: INTERNATIONAL BUSINESS MACHINES CORPORATION, NEW Y Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HARDEE, CHRISTOPHER J.;RAKSHIT, SARBAJIT K.;SIGNING DATES FROM 20150805 TO 20150808;REEL/FRAME:036362/0499 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |