CN110244845B - Haptic feedback method, haptic feedback device, electronic device and storage medium - Google Patents
Haptic feedback method, haptic feedback device, electronic device and storage medium Download PDFInfo
- Publication number
- CN110244845B CN110244845B CN201910502500.8A CN201910502500A CN110244845B CN 110244845 B CN110244845 B CN 110244845B CN 201910502500 A CN201910502500 A CN 201910502500A CN 110244845 B CN110244845 B CN 110244845B
- Authority
- CN
- China
- Prior art keywords
- icon
- application program
- application
- stimulation voltage
- hue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
- A61M21/00—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
- A61M2021/0005—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus
- A61M2021/0072—Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis by the use of a particular sense, or stimulus with application of electrical currents
Abstract
The embodiment of the application discloses a tactile feedback method and device, electronic equipment and a storage medium. The method comprises the following steps: determining an application program icon touched by a user in a screen, acquiring the tone of the application program icon, determining the initial stimulation voltage of the application program icon according to the tone of the application program icon and a preset mapping relation, and controlling an electrode to generate the initial stimulation voltage so that the user receives tactile feedback. In the embodiment of the application, the tone of all application icons in the electronic device is acquired, the preset mapping relation is established according to the tone of the application icon and the initial stimulation voltage, then the tone of the application icon clicked by a user is acquired, and the electrode is controlled to generate the initial stimulation voltage according to the initial stimulation voltage corresponding to the tone, so that the stimulation current is generated, and the user can feel a real tactile feedback effect.
Description
Technical Field
The application relates to the technical field of terminal control, in particular to a tactile feedback method and device, electronic equipment and a storage medium.
Background
In the research and practice process of the prior art, the inventor of the present application finds that, currently, most of the tactile feedback modes of electronic devices implement tactile feedback through a vibration motor, and the vibration motor vibrates the whole electronic device to achieve tactile feedback.
Disclosure of Invention
The embodiment of the application provides a method and a device for tactile feedback, electronic equipment and a storage medium. When a finger touches the screen, a real haptic feedback effect can be achieved.
In order to solve the above technical problems, the present application proposes the following technical solutions:
in a first aspect, an embodiment of the present application provides a haptic feedback method, where the method includes:
determining an application icon touched by a user in the screen;
acquiring the tone of the application program icon;
determining an initial stimulation voltage of the application program icon according to the tone of the application program icon and a first mapping relation;
controlling the electrodes to generate an initial stimulation voltage such that a user receives tactile feedback.
In a second aspect, embodiments of the present application provide a haptic feedback device, wherein the device includes:
the first determination module is used for determining the application program icon touched by the user in the screen;
the tone acquisition module is used for acquiring the tone of the application program icon;
the second determination module is used for determining the initial stimulation voltage of the application program icon according to the tone of the application program icon and the first mapping relation;
a first voltage generation module to control the electrodes to generate an initial stimulation voltage such that a user receives haptic feedback.
In a third aspect, embodiments of the present application provide an electronic device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the haptic feedback method when executing the program.
In a fourth aspect, embodiments of the present application provide a storage medium having a computer program stored thereon, where the computer program is executed by a processor to implement the steps of the haptic feedback method.
According to the method and the device, the tone of the application program icon is obtained by determining the application program icon touched by the user in the screen, the initial stimulation voltage of the application program icon is determined according to the tone of the application program icon and the preset mapping relation, and the electrode is controlled to generate the initial stimulation voltage so that the user receives the tactile feedback. In the embodiment of the application, the tone of all application icons in the electronic device is acquired, the preset mapping relation is established according to the tone of the application icon and the initial stimulation voltage, then the tone of the application icon clicked by a user is acquired, and the electrode is controlled to generate the initial stimulation voltage according to the initial stimulation voltage corresponding to the tone, so that the stimulation current is generated, and the user can feel a real tactile feedback effect.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a first flowchart of a haptic feedback method provided in an embodiment of the present application.
Fig. 2 is a second flowchart of a haptic feedback method provided in an embodiment of the present application.
Fig. 3 is a schematic circuit diagram for implementing haptic feedback according to an embodiment of the present application.
Fig. 4 is a schematic diagram of a first structure of a haptic feedback device provided in an embodiment of the present application.
Fig. 5 is a schematic diagram of a second structure of a haptic feedback device provided in an embodiment of the present application.
Fig. 6 is a circuit diagram of an electrode distribution provided in an embodiment of the present application.
Fig. 7 is a first structural schematic diagram of an electronic device according to an embodiment of the present application.
Fig. 8 is a second structural schematic diagram of an electronic device provided in the embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application are clearly and completely described with reference to the drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In the description that follows, specific embodiments of the present application will be described with reference to steps and symbols executed by one or more computers, unless otherwise indicated. Accordingly, these steps and operations will be referred to, several times, as being performed by a computer, the computer performing operations involving a processing unit of the computer in electronic signals representing data in a structured form. This operation transforms the data or maintains it at locations in the computer's memory system, which may be reconfigured or otherwise altered in a manner well known to those skilled in the art. The data maintains a data structure that is a physical location of the memory that has particular characteristics defined by the data format. However, while the principles of the application have been described in the foregoing text and are not meant to be limiting, those of ordinary skill in the art will appreciate that various of the steps and operations described below may be implemented in hardware.
The terms "first", "second", and "third", etc. in this application are used to distinguish between different objects and not to describe a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or modules is not limited to only those steps or modules listed, but rather, some embodiments may include other steps or modules not listed or inherent to such process, method, article, or apparatus.
The embodiment of the application provides a tactile feedback method and device, electronic equipment and a storage medium. The following are detailed below.
Referring to fig. 1, fig. 1 is a first flowchart of a haptic feedback method according to an embodiment of the present disclosure.
In step S101, an application icon touched by the user within the screen is determined.
When the user opens the application program, the user needs to click the icon of the application program in the screen and then enter the application program, and at the moment, the icon of the application program can be determined by detecting the position of the click screen of the finger.
In step S102, the tone of the application icon is acquired.
The design of the application icons is various, and each type of application icon has its own design style, wherein the application icons can contain various colors, characters, patterns and the like. The hue of the icon can be identified from the distribution of colors on the application icon by acquiring the colors on the application icon.
The obtaining of the hue of the application icon includes calculating areas occupied by different colors on the icon, for example, white occupies 10%, blue occupies 60%, and other colors occupy 30%, and since the area proportion occupied by blue is the largest, it can be determined that the hue of the application icon is blue.
In addition, the numerical value can be set for different colors, the numerical value range can be set for different hues, the area occupied by each color on the application icon is obtained, the numerical value of one color is multiplied by the color area to obtain the reference numerical value of the color, then the reference numerical values of each color are added in this way to obtain a total numerical value, the total numerical value is divided by the area of the icon to obtain the final hue numerical value, and if the hue numerical value falls into a certain hue numerical value range, the hue of the icon is considered as the hue corresponding to the numerical value range. For example, if the hue value is 5 and the hue value range of the red hue is 2 to 7, the hue of the icon is considered to be the red hue.
In step S103, an initial stimulation voltage of the application icon is determined according to the tone of the application icon and the preset mapping relation.
And after the tone of the touched and clicked application program icon is acquired, determining the initial stimulation voltage of the application program icon in the preset mapping relation according to the tone of the application program icon. The preset mapping relationship may set different initial stimulation voltages for different color tone correspondences of the application icon.
For example, the haptic drive parameters may be set according to the hue of the application icon, different haptic drive parameters being able to adjust the electronic surface, electrodes on the back shell to generate different initial stimulation voltages. And establishing a preset mapping relation between the tone of the application program icon and the initial stimulation voltage according to the tone of the application icon and the tactile driving parameters.
In step S104, the control electrode generates an initial stimulation voltage such that the user receives tactile feedback.
The electrodes generate an initial stimulation voltage to stimulate receptors/nerve fiber bundles under the skin, trigger nerve fiber action potential to be conducted to the sensory nerve center of the brain, and enable an operator to generate contact consciousness, so that tactile feedback is generated.
Referring specifically to fig. 3, fig. 3 is a schematic circuit diagram for implementing haptic feedback according to an embodiment of the present disclosure.
There are four types of tactile receptors on human skin, the Meissner's corpuscle, the Merkel's disk, the Pacinian corpuscle, and the Ruffini's ending, which are located below the epidermis, at the base of the epidermis, at the dermis and deep layers of the subcutaneous tissue, and at the dermis and joints, respectively.
Different tactile receptors can sense different tactile sensations, for example, the tactile sensation sensed by the meissner corpuscles is 'itching, vibrating, touching' and the like when the stimulation frequency is 10-200 Hz; when the stimulation frequency of the Merkel touch pad is 0.4-100Hz, the feeling type is 'edge, pressure' and the like; when the stimulation frequency of the small body of the annular layer is 40-800Hz, the feeling type is vibration, itch and the like; the sensory types of Lufenib are 'stretching, shearing force', etc. at the stimulation frequency of 740-1500 Hz.
The conductance Gm of the nerve membrane, the capacitance Cm and the conductance Ga of the medium inside the nerve.
When a current I passes through the skin surface, a potential distribution is generated on the skin surface, and the potential distribution Ψ generates a membrane current Im along the nerve axon, so as to further cause a voltage difference Vm on a membrane, namely, the stimulation of the nerve changes the voltage difference Vm of the nerve membrane by changing the external membrane potential Ψ. When the voltage difference Vm of the neural membrane reaches a certain threshold value, i.e., the current is large enough, the tactile receptors in the nerve endings are finally stimulated, and then the electric stimulation is transmitted to the central nervous system to generate the feeling of electric stimulation.
Therefore, when a user touches and clicks the icon of the application program, the stimulation voltage is generated by the control electrode, so that the finger or palm of the user feels real tactile feedback.
In summary, in the embodiment of the application, the application icon touched by the user in the screen is determined, the color tone of the application icon is obtained, the initial stimulation voltage of the application icon is determined according to the color tone of the application icon and the preset mapping relation, and the electrode is controlled to generate the initial stimulation voltage, so that the user receives the tactile feedback. In the embodiment of the application, the tone of all application icons in the electronic device is acquired, the preset mapping relation is established according to the tone of the application icon and the initial stimulation voltage, then the tone of the application icon clicked by a user is acquired, and the electrode is controlled to generate the initial stimulation voltage according to the initial stimulation voltage corresponding to the tone, so that the stimulation current is generated, and the user can feel a real tactile feedback effect.
Referring to fig. 2, fig. 2 is a second flowchart of a haptic feedback method according to an embodiment of the present application.
In step S201, all application icons in the electronic device are acquired.
It can be understood that many applications are installed inside the electronic device, the applications will generate an icon for opening the applications on the desktop, some applications will also generate shortcut icons on the desktop, and the system will generate application icons such as clock, weather, calendar and the like on the desktop, and of course, other icons are also included. An icon set is generated by acquiring all icons inside the electronic equipment.
In step S202, the color scale of the application icon is acquired.
The design of the application icons is various, and each type of application icon has its own design style, wherein the application icons can contain various colors, characters, patterns and the like. The hue of the icon can be identified from the distribution of colors on the application icon by acquiring the colors on the application icon.
The area occupied by the different colors on the icon, respectively, can be calculated, for example, 10% for white, 60% for blue, and 30% for the other colors.
For example, when the application icon contains red and orange, the lightness of red and orange can be respectively obtained, the saturation of red and orange can be respectively obtained, the lightness weight value of red is multiplied by the lightness of red to obtain a first parameter, the saturation weight value of red is multiplied by the saturation of red to obtain a second parameter, and then the first parameter and the second parameter are added to obtain the proportion occupied by red.
The above manner of obtaining the color ratio of the application icon is only exemplary and should not be considered as limiting the present application.
In step S203, the color with the highest proportion of the color proportion is determined as the hue of the application icon.
For example, the icon of the application program occupies 10% of white, 60% of blue, and 30% of other colors, and since the proportion of blue occupied is the largest, the color tone of the application icon may be determined to be a blue color tone.
In step S204, the preset mapping relationship between the hue of the application icon and the initial stimulation voltage is established.
The haptic drive parameters can be set according to the tone of the application icon, and different haptic drive parameters can adjust the electrodes on the electronic surface and the rear shell to generate different initial stimulation voltages. And establishing a preset mapping relation between the application program tone and the initial stimulation voltage according to the tone of the application icon and the tactile driving parameters.
For example, different initial stimulation voltages are set for the hues in the order of colors, which may be red, orange, yellow, green, cyan, blue, purple, etc., and the earlier color corresponds to the stronger initial stimulation voltage of the hue, for example, the stronger the initial stimulation voltage of the red hue corresponding to the red color is, and the weaker the initial stimulation voltage of the purple hue corresponding to the purple color is.
For example, the brightness of different hues is different, such as white and yellow are higher, blue and purple are lower, and black is lowest, so that the initial stimulation voltage can be set for the hues according to the brightness, and the higher the brightness is, the higher the initial stimulation voltage is set.
And establishing a corresponding mapping relation between the tone of the application icon and the application icon in the preset mapping relation.
The above manner of setting the preset mapping relationship between the application icon tone and the initial stimulation voltage is only exemplary and should not be construed as a limitation to the present application.
In step S205, the application icon touched by the user in the screen is determined, which is the same as step S101 and is not described herein.
In step S206, the tone of the application icon is acquired.
The tone corresponding to the application icon can be directly found according to the preset mapping relation.
When the icon of the application program is the newly added application program icon, the application program icon may also be calculated to obtain the color tone of the application program icon, for example, areas occupied by different colors on the icon are calculated, for example, white occupies 10%, blue occupies 60%, and other colors occupy 30%, and since the area proportion occupied by blue is the largest, the color tone of the application program icon may be determined to be blue.
In step S207, content on the application icon is acquired, where the content includes pictures and characters.
In step S208, a contour of the content is identified, and a target electrode corresponding to the contour is controlled to generate an initial stimulation voltage, so that the user receives tactile feedback.
It can be understood that the application icon includes a picture or a text, and an outline of the picture or the text or a texture of the picture or the text may be obtained.
And then controlling the electrodes of the corresponding targets in the outline of the application icon to generate an initial stimulation voltage. For example, a haptic sensation of texture of a pattern of an application icon or a haptic sensation of text of an application icon may be generated on a back cover of an electronic device, a haptic sensation of touching an arc-shaped surface, a haptic sensation of touching a cone vertex, etc. may also be generated on a screen of an electronic device.
Referring to fig. 6, fig. 6 is a circuit diagram of an electrode distribution of an electronic device according to an embodiment of the present disclosure.
The method comprises the steps that a plurality of electrodes are distributed on the surface of a screen or a rear shell and controlled through a plurality of switches, when the outline of the content on an application icon is obtained, an initial stimulation voltage is generated by controlling a target electrode corresponding to the outline, the target electrode corresponding to the outline can be the surface of the screen or the rear cover, the range of the outline can be enlarged or reduced by the target electrode corresponding to the outline, the initial stimulation voltage can be generated according to the original proportion, and therefore a user can feel the outline of the icon and real tactile feedback is generated.
Please refer to fig. 7, wherein fig. 7 is a schematic view illustrating a first structure of an electronic device according to an embodiment of the present application.
Fig. 7 specifically shows a screen of an electronic device, where 511 is a surface electrode, 510 is a first voltage driving module formed by combining a plurality of surface electrodes, 520 is an insulating medium, 530 is a flat electrode, 540 is a display screen, 550 is a second voltage driving module, and 560 is a piezoelectric vibration module.
The touch surface of the screen can be covered on the touch screen by using an ITO transparent material to form a touch electrode array, namely an electrode array formed by the surface electrodes 511 in the figure.
The touch driving parameters corresponding to the application icon tones are called through the preset mapping relation, the processor calls the voltage driving module by using the touch driving parameters, the initial stimulation voltage is generated on the surface electrode 511, and when a user contacts the surface electrode, the initial stimulation voltage can generate initial stimulation current.
The surface electrodes 511 will directly stimulate the receptors/nerve fiber bundles under the skin with current, and induce nerve fiber action potential, which is conducted to the sensory nerve center of the brain, to generate the consciousness of the operator being touched, thereby generating tactile feedback.
In step S209, the touch duration of the application icon is acquired.
It will be appreciated that the user may not release the application icon after touching it, and the length of time that the user touches the application icon may be obtained.
When the user touches the application icon, the pressure of the user finger pressing the screen can be detected.
In step S210, according to the touch duration, changing an initial stimulation voltage of the application icon to generate a dynamic stimulation voltage, so that the user receives dynamic tactile feedback.
For example, the duration of the user touching the application program icon is two seconds, the touch duration can be processed in a segmented manner, the electrode is controlled to generate the initial stimulation voltage within 0-1 second, and the electrode is controlled to increase or decrease the stimulation voltage on the basis of the initial stimulation voltage within 1-2 seconds to generate the dynamic stimulation voltage.
At this time, the pressure of the finger of the user on the screen or the rear cover can be detected, for example, within 1 to 1.5 seconds, if the pressure of the finger of the user on the screen is increasing, the electrode is controlled to increase the stimulation voltage on the basis of the initial stimulation voltage, and within 1.5 to 2 seconds, if the pressure of the finger of the user on the screen is decreasing, the electrode is controlled to decrease the stimulation voltage, and due to the change of the stimulation voltage, the tactile feedback to the user is also changed, so that dynamic tactile feedback is formed, and the user can feel real tactile feedback.
To sum up, in the embodiment of the present application, by obtaining icons of all application programs in an electronic device, determining a color with the highest ratio in the color ratios to the color ratios of the icons of the application programs, determining a color with the highest ratio in the color ratios as a hue of the icon of the application program, establishing a preset mapping relationship between the hue of the icon of the application program and an initial stimulation voltage, when a user touches the icon of the application program in a screen, obtaining the hue of the icon of the application program through the preset mapping relationship, then determining the initial stimulation voltage of the icon of the application program according to the hue of the icon of the application program and the preset mapping relationship, obtaining content on the icon of the application program, identifying an outline of the content, controlling a target electrode corresponding to the outline to generate the initial stimulation voltage, obtaining a touch duration of the icon of the application program after the initial stimulation voltage is generated, and according to the touch duration, the initial stimulation voltage of the application icon is changed to generate a dynamic stimulation voltage such that the user receives dynamic tactile feedback. Thereby enabling the user to obtain a true tactile feedback when clicking on an icon on the electronic device.
Referring to fig. 4, fig. 4 is a schematic diagram of a first structure of a haptic feedback device according to an embodiment of the present application. Wherein the apparatus comprises: a first determination module 410, a hue obtaining module 420, a second determination module 430, and a first voltage generation module 440.
A first determining module 410, configured to determine an application icon touched by the user in the screen.
When the user opens the application program, the user needs to click an icon of the application program in the screen and then enter the application program, and at this time, the icon of the application program can be determined by detecting the position where the finger clicks the screen through the first determining module 410.
A hue obtaining module 420, configured to obtain a hue of the application icon.
The hue obtaining module 420 determines the hue of the clicked application icon according to the relationship between the hue and the application icon according to the preset mapping relationship.
The areas occupied by the different colors on the icon may also be calculated, for example, white occupies 10%, blue occupies 60%, and other colors occupy 30%, and since the proportion of the area occupied by blue is the largest, the hue of the application icon may be determined to be blue.
In addition, the hue obtaining module 420 may further set values for different colors, set value ranges for different hues, obtain an area occupied by each color on the application icon, multiply the value of one color by the color area to obtain a reference value of the color, add the reference values of each color in this way to obtain a total value, divide the total value by the area of the icon to obtain a final hue value, and if the hue value falls within a certain hue value range, consider the hue of the icon as the hue corresponding to the value range. For example, if the hue value is 5 and the hue value range of the red hue is 2 to 7, the hue of the icon is considered to be the red hue.
And a second determining module 430, configured to determine an initial stimulation voltage of the application icon according to the tone of the application icon and a preset mapping relationship.
After acquiring the tone of the touched and clicked application icon, the second determining module 430 determines the initial stimulation voltage of the application icon in the preset mapping relationship according to the tone of the application icon. The preset mapping relationship may set different initial stimulation voltages for different color tone correspondences of the application icon.
For example, the haptic drive parameters may be set according to the hue of the application icon, different haptic drive parameters being able to adjust the electronic surface, electrodes on the back shell to generate different initial stimulation voltages. And establishing a preset mapping relation between the tone of the application program icon and the initial stimulation voltage according to the tone of the application icon and the tactile driving parameters.
A first voltage generation module 440 for controlling the electrodes to generate an initial stimulation voltage such that a user receives tactile feedback.
The first voltage generation module 440 controls the electrodes to generate an initial stimulation voltage to stimulate receptors/nerve fiber bundles under the skin, and to trigger nerve fiber action potentials to be conducted to the sensory nerve center of the brain, so that the operator can generate the contact awareness, and thus the tactile feedback is generated.
At this time, please refer to fig. 5, fig. 5 is a second structural diagram of the haptic feedback device according to the embodiment of the present application.
The first voltage generation module 440 includes a content acquisition sub-module 441 and an identification sub-module 442.
And the content obtaining sub-module 441 is configured to obtain content on the application icon, where the content includes pictures and characters.
A recognition sub-module 442 for recognizing the outline of the content and controlling the corresponding target electrode to generate the initial stimulation voltage.
It is understood that the application icon includes a picture or a text, and the recognition sub-module 442 can capture an outline of the picture or the text or a texture of the picture or the text.
And then controlling the target electrode corresponding to the outline of the application program icon to generate an initial stimulation voltage. For example, a haptic sensation of texture of a pattern of an application icon or a haptic sensation of text of an application icon may be generated on a back cover of an electronic device, a haptic sensation of touching an arc-shaped surface, a haptic sensation of touching a cone vertex, etc. may also be generated on a screen of an electronic device.
Referring to fig. 5, the haptic feedback device 400 according to an embodiment of the present application further includes: an icon acquiring module 450, a third determining module 460, a mapping relation establishing module 470, a duration acquiring module 480, and a second voltage generating module 490.
The icon obtaining module 450 is configured to obtain all application icons in the electronic device.
It can be understood that many applications are installed inside the electronic device, the applications will generate an icon for opening the applications on the desktop, some applications will also generate shortcut icons on the desktop, and the system will generate application icons such as clock, weather, calendar and the like on the desktop, and of course, other icons are also included. The icon capture module 450 generates a set of icons by capturing all icons within the electronic device.
And a third determining module 460, configured to determine a color tone corresponding to the application icon.
Wherein the third determining module 460 includes: a scale acquisition sub-module 461 and a determination sub-module 462.
A scale obtaining sub-module 461, configured to obtain a color scale of the application icon.
The design of the application icons is various, and each type of application icon has its own design style, wherein the application icons can contain various colors, characters, patterns and the like. The scale obtaining sub-module 461 can recognize the tone of the icon according to the color distribution on the application icon by obtaining the color on the application icon.
The proportion obtaining sub-module 461 can calculate the areas occupied by different colors on the icon respectively, for example, white occupies 10%, blue occupies 60%, and other colors occupy 30%.
The proportion obtaining sub-module 461 may further calculate the proportion occupied by each color in the application icon according to the lightness and saturation of each color, for example, when the application icon contains red and orange, the lightness of red and orange may be obtained respectively, the saturation of red and orange may be obtained respectively, according to the lightness weight value corresponding to red and orange respectively and the saturation weight value corresponding to red and orange respectively, the lightness weight value of red is multiplied by the lightness of red to obtain a first parameter, the saturation weight value of red is multiplied by the saturation of red to obtain a second parameter, and then the first parameter and the second parameter are added to obtain the proportion occupied by red.
The above manner of obtaining the color ratio of the application icon is only exemplary and should not be considered as limiting the present application.
The determining sub-module 462 is configured to determine a color with a highest proportion of the color proportion as the hue of the application icon.
For example, the icon of the application program occupies 10% of white, 60% of blue, and 30% of other colors, and since the proportion of blue occupied is the largest, the color tone of the application icon may be determined to be a blue color tone.
A mapping relation establishing module 470, configured to establish the preset mapping relation between the color tone of the application icon and the initial stimulation voltage.
The mapping relationship establishing module 470 can set the tactile driving parameters according to the tone of the application icon, and different tactile driving parameters can adjust the electrodes on the electronic surface and the rear shell to generate different initial stimulation voltages. And establishing a preset mapping relation between the application program tone and the initial stimulation voltage according to the tone of the application icon and the tactile driving parameters.
For example, different initial stimulation voltages are set for the hues in the order of colors, which may be red, orange, yellow, green, cyan, blue, purple, etc., and the earlier color corresponds to the stronger initial stimulation voltage of the hue, for example, the stronger the initial stimulation voltage of the red hue corresponding to the red color is, and the weaker the initial stimulation voltage of the purple hue corresponding to the purple color is.
For example, the brightness of different hues is different, such as white and yellow are higher, blue and purple are lower, and black is lowest, so that the initial stimulation voltage can be set for the hues according to the brightness, and the higher the brightness is, the higher the initial stimulation voltage is set.
The duration obtaining module 480 is configured to obtain a touch duration of the application icon.
It is understood that the user may not release the application icon after touching the application icon, and the duration acquiring module 480 may acquire the duration of the user touching the application icon.
When the user touches the application icon, the pressure of the user finger pressing the screen can be detected.
The second voltage generation module 490 is configured to change the initial stimulation voltage of the application icon according to the touch duration, and generate a dynamic stimulation voltage, so that the user receives dynamic tactile feedback.
For example, the duration of the user touching the application icon is two seconds, the touch duration may be processed in segments, within 0 to 1 second, the second voltage generation module 490 controls the electrode to generate the initial stimulation voltage, and within 1 to 2 seconds, on the basis of the initial stimulation voltage, the second voltage generation module 490 controls the electrode to enhance or weaken the stimulation voltage to generate the dynamic stimulation voltage.
At this time, the second voltage generating module 490 may detect the pressure of the user's finger on the screen or the rear cover, for example, within 1 to 1.5 seconds, if the pressure of the user's finger on the screen is increasing, the control electrode increases the stimulation voltage on the basis of the initial stimulation voltage, and within 1.5 to 2 seconds, if the pressure of the user's finger on the screen is decreasing, the control electrode decreases the stimulation voltage, and due to the change of the stimulation voltage, the tactile feedback to the user may also change, thereby forming a dynamic tactile feedback, and allowing the user to feel a real tactile feedback.
To sum up, in the embodiment of the present application, by obtaining icons of all application programs in an electronic device, determining a color with the highest ratio in the color ratios to the color ratios of the icons of the application programs, determining a color with the highest ratio in the color ratios as a hue of the icon of the application program, establishing a preset mapping relationship between the hue of the icon of the application program and an initial stimulation voltage, when a user touches the icon of the application program in a screen, obtaining the hue of the icon of the application program through the preset mapping relationship, then determining the initial stimulation voltage of the icon of the application program according to the hue of the icon of the application program and the preset mapping relationship, obtaining content on the icon of the application program, identifying an outline of the content, controlling a target electrode corresponding to the outline to generate the initial stimulation voltage, obtaining a touch duration of the icon of the application program after the initial stimulation voltage is generated, and according to the touch duration, the initial stimulation voltage of the application icon is changed to generate a dynamic stimulation voltage such that the user receives dynamic tactile feedback. Thereby enabling the user to obtain a true tactile feedback when clicking on an icon on the electronic device.
Referring to fig. 8, fig. 8 is a second structural schematic diagram of an electronic device according to an embodiment of the present application.
The electronic device 600 includes: a display unit 601, an input unit 602, a memory 603, a central processor 604, a power supply 605, a sensor 606, and the like. Those skilled in the art will appreciate that the electronic device configurations shown in the figures do not constitute limitations of the electronic device, and may include more or fewer components than shown, or some components in combination, or a different arrangement of components. Wherein:
the display unit 601 may be used to display information input by or provided to a user and various graphical user interfaces of the electronic device, which may be configured by graphics, text, icons, video, and any combination thereof. The Display unit 601 may include a Display panel, and optionally, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch-sensitive surface may overlay the display panel, and when a touch operation is detected on or near the touch-sensitive surface, the touch operation is transmitted to the central processor 604 to determine the type of touch event, and then the central processor 604 provides a corresponding visual output on the display panel according to the type of touch event. Although in FIG. 8 the touch sensitive surface and the display panel are two separate components to implement input and output functions, in some embodiments the touch sensitive surface may be integrated with the display panel to implement input and output functions.
The input unit 602 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control. In particular, in a particular embodiment, the input unit 602 may include a touch-sensitive surface as well as other input devices. The touch-sensitive surface, also referred to as a touch display screen or a touch pad, may collect touch operations by a user (e.g., operations by a user on or near the touch-sensitive surface using a finger, a stylus, or any other suitable object or attachment) thereon or nearby, and drive the corresponding connection device according to a predetermined program. Alternatively, the touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the central processing unit 604, and can receive and execute commands sent by the central processing unit 604. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The input unit 602 may include other input devices in addition to the touch-sensitive surface. In particular, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.
The memory 603 may be used to store software programs and modules, and the processor 504 executes various functional applications and data processing by operating the software programs and modules stored in the memory 603. The memory 604 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the electronic device, and the like. Further, the memory 603 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 603 may also include a memory controller to provide the processor 604 and the input unit 602 access to the memory 603.
The electronic device further includes a power supply 605 (e.g., a battery) for supplying power to the various components, which may preferably be logically connected to the central processor 604 via a power management system, so as to manage charging, discharging, and power consumption via the power management system. The power supply 605 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The electronic device may also include at least one sensor 606, such as light sensors, pressure sensors, motion sensors, and other sensors. In particular, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel according to the brightness of ambient light, and a proximity sensor that may turn off the display panel and/or the backlight when the electronic device is moved to the ear. As one of the motion sensors, the gravity acceleration sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when the mobile phone is stationary, and can be used for applications of recognizing the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be further configured to the electronic device, detailed descriptions thereof are omitted.
Although not shown in fig. 8, the electronic device may further include a camera, a bluetooth module, and the like, which are not described in detail herein. Specifically, in this embodiment, the central processing unit 604 in the electronic device loads the executable file corresponding to the process of one or more application programs into the memory 603 according to the following instructions, and the central processing unit 604 runs the application programs stored in the memory 603, so as to implement various functions:
determining an application icon touched by a user in the screen;
acquiring the tone of the application program icon;
determining the initial stimulation voltage of the application program icon according to the tone of the application program icon and a preset mapping relation;
controlling the electrodes to generate an initial stimulation voltage such that a user receives tactile feedback.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.
To this end, embodiments of the present application provide a storage medium having stored therein a plurality of instructions that can be loaded by a processor to perform the steps of any of the haptic feedback methods provided by embodiments of the present application. For example, the instructions may perform the steps of:
determining an application icon touched by a user in the screen;
acquiring the tone of the application program icon;
determining the initial stimulation voltage of the application program icon according to the tone of the application program icon and a preset mapping relation;
controlling the electrodes to generate an initial stimulation voltage such that a user receives tactile feedback.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the storage medium can execute the steps in any of the haptic feedback methods provided in the embodiments of the present application, the advantageous effects that can be achieved by any of the haptic feedback methods provided in the embodiments of the present application can be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
The foregoing detailed description has provided a haptic feedback method, apparatus, electronic device and storage medium according to embodiments of the present application, and specific examples have been applied to illustrate the principles and implementations of the present application, and the above descriptions of the embodiments are only used to help understand the method and the core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (7)
1. A tactile feedback method is applied to an electronic device, the electronic device comprises a screen and a back cover, the surface of the screen and the surface of the back cover are provided with electrodes, and the method comprises the following steps:
determining an application icon touched by a user in the screen;
obtaining the tone of the application icon, wherein the tone of the application icon is determined based on the following modes: setting values for different colors respectively, and setting tone value ranges for different tones respectively; acquiring the color area occupied by each color on the application program icon, multiplying the numerical value corresponding to each color with the corresponding color area to obtain a reference numerical value of each color, adding the reference numerical values corresponding to each color to obtain a total numerical value, dividing the total numerical value by the area of the application program icon to obtain a final hue numerical value, and determining the hue corresponding to the hue numerical value range as the hue of the application program icon if the final hue numerical value is within the hue numerical value range;
determining the initial stimulation voltage of the application program icon according to the tone of the application program icon and a preset mapping relation, wherein the preset mapping relation is that different initial stimulation voltages are correspondingly set for different tones of the application program icon;
acquiring the touch duration of the application program icon, and performing segmentation processing on the touch duration to obtain a first touch duration and a second touch duration;
controlling the electrodes to generate an initial stimulation voltage for the first touch duration such that a user receives haptic feedback;
and in the second touch duration, detecting the pressure of the finger of the user on the screen or the rear cover, if the pressure of the finger of the user on the screen is increased, controlling the electrode to increase the stimulation voltage on the basis of the initial stimulation voltage, and if the pressure of the finger of the user on the screen is decreased, controlling the electrode to decrease the stimulation voltage on the basis of the initial stimulation voltage to generate a dynamic stimulation voltage so that the user receives dynamic tactile feedback.
2. A haptic feedback method as recited in claim 1 wherein prior to determining an application icon touched by a user within said screen, said method further comprises:
acquiring all application icons in the electronic equipment;
determining a tone corresponding to the application icon;
and establishing the preset mapping relation between the tone of the application program icon and the initial stimulation voltage.
3. A haptic feedback method as recited in claim 1 wherein said controlling said electrodes to generate an initial stimulation voltage to cause a user to receive haptic feedback comprises:
acquiring content on the application program icon, wherein the content comprises pictures and characters;
and identifying the outline of the content, and controlling a target electrode corresponding to the outline to generate the initial stimulation voltage.
4. A tactile feedback device applied to an electronic device, wherein the electronic device comprises a screen and a back cover, and electrodes are arranged on the surfaces of the screen and the back cover, the tactile feedback device is characterized by comprising:
the first determination module is used for determining the application program icon touched by the user in the screen;
a hue obtaining module, configured to obtain a hue of the application icon, where the hue of the application icon is determined based on: setting numerical values for different colors respectively, and setting hue numerical value ranges for different hues respectively; acquiring the color area occupied by each color on the application program icon, multiplying the numerical value corresponding to each color with the corresponding color area to obtain a reference numerical value of each color, adding the reference numerical values corresponding to each color to obtain a total numerical value, dividing the total numerical value by the area of the application program icon to obtain a final hue numerical value, and determining the hue corresponding to the hue numerical value range as the hue of the application program icon if the final hue numerical value is within the hue numerical value range;
the second determination module is used for determining the initial stimulation voltage of the application program icon according to the tone of the application program icon and a preset mapping relation, wherein the preset mapping relation is that different initial stimulation voltages are correspondingly set for different tones of the application program icon;
the first voltage generation module is used for acquiring the touch duration of the application program icon and carrying out sectional processing on the touch duration to obtain a first touch duration and a second touch duration; controlling the electrodes to generate an initial stimulation voltage for the first touch duration such that a user receives haptic feedback; and in the second touch duration, detecting the pressure of the finger of the user on the screen or the rear cover, if the pressure of the finger of the user on the screen is increased, controlling the electrode to increase the stimulation voltage on the basis of the initial stimulation voltage, and if the pressure of the finger of the user on the screen is decreased, controlling the electrode to decrease the stimulation voltage on the basis of the initial stimulation voltage to generate a dynamic stimulation voltage so that the user receives dynamic tactile feedback.
5. A haptic feedback device as recited in claim 4 wherein said device further comprises:
the icon acquisition module is used for acquiring all application icons in the electronic equipment;
the third determining module is used for determining the tone corresponding to the application program icon;
and the mapping relation establishing module is used for establishing the preset mapping relation between the tone of the application program icon and the initial stimulation voltage.
6. An electronic device, comprising:
a memory storing executable program code, a processor coupled with the memory;
the processor calls the executable program code stored in the memory to perform the steps in the haptic feedback method of any one of claims 1 to 3.
7. A storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps of the haptic feedback method of any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910502500.8A CN110244845B (en) | 2019-06-11 | 2019-06-11 | Haptic feedback method, haptic feedback device, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910502500.8A CN110244845B (en) | 2019-06-11 | 2019-06-11 | Haptic feedback method, haptic feedback device, electronic device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110244845A CN110244845A (en) | 2019-09-17 |
| CN110244845B true CN110244845B (en) | 2022-08-05 |
Family
ID=67886612
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910502500.8A Active CN110244845B (en) | 2019-06-11 | 2019-06-11 | Haptic feedback method, haptic feedback device, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110244845B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111399645B (en) * | 2020-03-13 | 2023-07-25 | Oppo广东移动通信有限公司 | Wearable device, tactile feedback method, device and storage medium |
| CN115167747A (en) * | 2021-03-18 | 2022-10-11 | 华为技术有限公司 | Screen capturing method, electronic device and storage medium |
| WO2022266901A1 (en) * | 2021-06-23 | 2022-12-29 | 广州视源电子科技股份有限公司 | Touch control method, apparatus, and device, and storage medium and program product |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5526140A (en) * | 1995-03-03 | 1996-06-11 | Minnesota Mining And Manufacturing Company | Emulation of a halftone printed image on a continuous-tone device |
| US20040183817A1 (en) * | 2002-12-03 | 2004-09-23 | Bitstream Inc. | Methods, systems, and programming for scaled display of web pages |
| JP4365754B2 (en) * | 2004-08-31 | 2009-11-18 | 三菱重工業株式会社 | Pattern color tone control method and apparatus |
| US20090219252A1 (en) * | 2008-02-28 | 2009-09-03 | Nokia Corporation | Apparatus, method and computer program product for moving controls on a touchscreen |
| US20090303175A1 (en) * | 2008-06-05 | 2009-12-10 | Nokia Corporation | Haptic user interface |
| JP5533069B2 (en) * | 2009-03-18 | 2014-06-25 | 株式会社リコー | Image forming apparatus, image forming method, and program |
| US8441343B1 (en) * | 2009-11-20 | 2013-05-14 | Dean Fishman | Handheld mobile device viewing angle indicator |
| US20120327006A1 (en) * | 2010-05-21 | 2012-12-27 | Disney Enterprises, Inc. | Using tactile feedback to provide spatial awareness |
| JP5744437B2 (en) * | 2010-08-18 | 2015-07-08 | キヤノン株式会社 | TRACKING DEVICE, TRACKING METHOD, AND PROGRAM |
| JP6052277B2 (en) * | 2012-02-29 | 2016-12-27 | 日本電気株式会社 | Color arrangement determination device, color arrangement determination method, and color arrangement determination program |
| US9280206B2 (en) * | 2012-08-20 | 2016-03-08 | Samsung Electronics Co., Ltd. | System and method for perceiving images with multimodal feedback |
| CN103869940B (en) * | 2012-12-13 | 2018-02-16 | 富泰华工业（深圳）有限公司 | Tactile feedback system, electronic installation and its method that tactile feedback is provided |
| CN103869960B (en) * | 2012-12-18 | 2018-02-23 | 富泰华工业（深圳）有限公司 | Tactile feedback system and its method that tactile feedback is provided |
| WO2016038677A1 (en) * | 2014-09-09 | 2016-03-17 | 三菱電機株式会社 | Tactile sensation control system and tactile sensation control method |
-
2019
- 2019-06-11 CN CN201910502500.8A patent/CN110244845B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110244845A (en) | 2019-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110244845B (en) | Haptic feedback method, haptic feedback device, electronic device and storage medium | |
| US9939951B2 (en) | Electronic device operating according to pressure state of touch input and method thereof | |
| CN107066158B (en) | Touch-sensitive button with two gears | |
| US8330590B2 (en) | User interface feedback apparatus, user interface feedback method, and program | |
| CN104412201B (en) | Change the output of computing device based on tracking window | |
| US8686959B2 (en) | Touch screen multi-control emulator | |
| US20140168105A1 (en) | Electronic device and method for providing tactile stimulation | |
| US10261586B2 (en) | Systems and methods for providing electrostatic haptic effects via a wearable or handheld device | |
| KR20140093080A (en) | Mobile terminal for providing haptic effect with an input unit and method therefor | |
| CN110134238A (en) | Key feedback method, device, storage medium and electronic equipment | |
| EP4044004A1 (en) | Key structure, key control method, and electronic device | |
| CN110109549B (en) | Application notification processing method and device, storage medium and electronic equipment | |
| CN109062468B (en) | Split screen display method and device, storage medium and electronic equipment | |
| US20140253504A1 (en) | Mobile electronic device with sensors | |
| US20130285921A1 (en) | Systems and Methods for a Rollable Illumination Device | |
| US20170300109A1 (en) | Method of blowable user interaction and an electronic device capable of blowable user interaction | |
| KR20180066865A (en) | Systems and methods for compliance illusions with haptics | |
| US11928260B2 (en) | Control method and electronic device having touch positions with different pressure value | |
| CN112587925A (en) | Display method and device of guide information, storage medium and computer equipment | |
| US9075438B2 (en) | Systems and related methods involving stylus tactile feel | |
| US20170364190A1 (en) | Haptically enabled overlay for a pressure sensitive surface | |
| CN111399645A (en) | Wearable device, tactile feedback method and device, and storage medium | |
| EP3021202B1 (en) | Method of modeling haptic signal from haptic object, display apparatus, and driving method thereof | |
| CN110147176A (en) | A kind of control method of touch screen, device, storage medium and electronic equipment | |
| CN106886351B (en) | Display method and device of terminal time information and computer equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |