CN109782950B - Touch electrode control method and device, storage medium and electronic equipment - Google Patents
Touch electrode control method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN109782950B CN109782950B CN201910008864.0A CN201910008864A CN109782950B CN 109782950 B CN109782950 B CN 109782950B CN 201910008864 A CN201910008864 A CN 201910008864A CN 109782950 B CN109782950 B CN 109782950B
- Authority
- CN
- China
- Prior art keywords
- information
- touch electrode
- target
- dimensional
- dimensional image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application provides a touch electrode control method and device, a storage medium and electronic equipment, wherein a touch electrode is arranged on the outer surface of the electronic equipment and used for outputting an electrical stimulation signal, and the electrical stimulation signal is used for stimulating the skin of a user to enable the user to generate touch feeling; the method comprises the following steps: when a three-dimensional image output by electronic equipment is acquired, acquiring two-dimensional information and spatial information of the three-dimensional image; acquiring a corresponding target touch electrode according to the two-dimensional information; and controlling the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information. The electrical stimulation signal can stimulate the skin of the user to enable the user to generate touch feeling, so that the user can obtain vivid touch effect, and the authenticity of man-machine interaction is improved.
Description
Technical Field
The present disclosure relates to the field of electronic devices, and in particular, to a method and an apparatus for controlling a touch electrode, a storage medium, and an electronic device.
Background
With the development of electronic devices, human-computer interaction between the electronic devices and users becomes more and more important. In the related art, the human-computer interaction feedback includes: acousto-optic feedback and vibration feedback. The acousto-optic feedback is that when an effective key action is detected, the corresponding key displays a changed key image on the display screen, and a specific sound signal can be sent out to tell the user that the electronic equipment has received the key. The vibration feedback is that when a valid key action is detected, a user can feel the vibration of the electronic equipment by driving a vibration device in the electronic equipment, so that the information that the key is received by the equipment is obtained. The human-computer interaction effect of the acousto-optic feedback and the vibration feedback is poor.
Disclosure of Invention
The embodiment of the application provides a touch electrode control method and device, a storage medium and electronic equipment, which can provide a more realistic human-computer interaction effect.
The embodiment of the application provides a touch electrode control method, which is applied to electronic equipment, wherein a touch electrode is arranged on the outer surface of the electronic equipment and used for outputting an electrical stimulation signal, and the electrical stimulation signal is used for stimulating the skin of a user to enable the user to generate touch feeling; the method comprises the following steps:
when a three-dimensional image output by electronic equipment is acquired, acquiring two-dimensional information and spatial information of the three-dimensional image;
acquiring a corresponding target touch electrode according to the two-dimensional information;
and controlling the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information.
The embodiment of the application provides a touch electrode control device, which is applied to electronic equipment, wherein a touch electrode is arranged on the outer surface of the electronic equipment and used for outputting an electrical stimulation signal, and the electrical stimulation signal is used for stimulating the skin of a user to enable the user to generate touch feeling; the device comprises:
the information acquisition module is used for acquiring two-dimensional information and spatial information of the three-dimensional image when the three-dimensional image output by the electronic equipment is acquired;
the target touch electrode acquisition module is used for acquiring a corresponding target touch electrode according to the two-dimensional information;
and the processing module is used for controlling the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information.
The present application provides a storage medium on which a computer program is stored, which, when run on a computer, causes the computer to perform the method as described above.
An embodiment of the present application provides an electronic device, which includes:
the touch electrode is arranged on the outer surface of the electronic equipment and used for outputting an electrical stimulation signal, and the electrical stimulation signal is used for stimulating the skin of a user to enable the user to generate touch feeling;
the processor is used for acquiring two-dimensional information and spatial information of the three-dimensional image when the three-dimensional image output by the electronic equipment is acquired; acquiring a corresponding target touch electrode according to the two-dimensional information; and controlling the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information.
According to the touch electrode control method, the touch electrode control device, the storage medium and the electronic equipment, two-dimensional information and spatial information of a three-dimensional image can be acquired first, then a corresponding target touch electrode is acquired according to the two-dimensional information, and finally the target touch electrode is controlled to output a corresponding electric stimulation signal according to the spatial information. The electrical stimulation signal can stimulate the skin of the user to enable the user to generate touch feeling, so that the user can obtain vivid touch effect, and the authenticity of man-machine interaction is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings used in the description of the embodiments will be briefly introduced below. It is obvious that the drawings in the following description are only some embodiments of the application, and that for a person skilled in the art, other drawings can be derived from them without inventive effort.
Fig. 1 is a schematic flowchart of a first method for controlling a touch electrode according to an embodiment of the present disclosure.
Fig. 2 is a schematic diagram of an equivalent circuit of skin according to an embodiment of the present application.
Fig. 3 is a schematic flowchart of a second method for controlling a touch electrode according to an embodiment of the present disclosure.
Fig. 4 is a schematic flowchart of a third method for controlling a touch electrode according to an embodiment of the present disclosure.
Fig. 5 is a schematic structural diagram of a touch electrode control device according to an embodiment of the present application.
Fig. 6 is a schematic structural diagram of a first state of an electronic device according to an embodiment of the present application.
Fig. 7 is another schematic structural diagram of the first state of the electronic device according to the embodiment of the present application.
Fig. 8 is a schematic structural diagram of a second state of an electronic device according to an embodiment of the present application.
Fig. 9 is another schematic structural diagram of a second state of an electronic device according to an embodiment of the present application.
Fig. 10 is a block diagram schematically illustrating an electronic device according to an embodiment of the present application.
Detailed Description
Referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present application are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the application and should not be taken as limiting the application with respect to other embodiments that are not detailed herein.
The embodiment of the present application provides a touch electrode control method, where an execution main body of the touch electrode control method may be the touch electrode control device provided in the embodiment of the present application, or an electronic device integrated with the touch electrode control device, where the touch electrode control device may be implemented in a hardware or software manner. The electronic device may be a smart phone, a tablet computer, a palm computer, a notebook computer, or a desktop computer.
Referring to fig. 1, fig. 1 is a first flowchart illustrating a touch electrode control method according to an embodiment of the present disclosure. The specific process of the touch electrode control method provided by the embodiment of the application can be as follows:
and 101, when acquiring the three-dimensional image output by the electronic equipment, acquiring two-dimensional information and spatial information of the three-dimensional image.
The display screen of the electronic equipment is provided with a transparent touch electrode, the transparent touch electrode is used for outputting an electrical stimulation signal, and the electrical stimulation signal is used for stimulating the skin of a user to enable the user to generate touch feeling.
In particular, the sense of touch is a basic human sensation. Human skin senses the touch mainly obtained by four types of tactile receptors, which are respectively: meissner's corpuscle, Merkel's disk, Pacinian corpuscle, and Ruffini's ending, four tactile receptors are located below the epidermis layer, the base of the epidermis, the deep and subcutaneous tissues of the dermis layer, and the dermis layer and joints, respectively. The four receptors are distributed in the human skin unevenly, and sense the external temperature, humidity and vibration, and sense the deformation, extension, activity and other information of the skin. The four receptors have different sensing ranges and are affected by electrotactile.
The inventor finds out through a large number of experiments that the current is directly used for stimulating receptors/nerve fiber bundles under the skin, the action potential of nerve fiber is triggered and is conducted to the sensory nerve center of the brain, the operator is enabled to generate the contact consciousness, and therefore the touch reappearance is achieved. The equivalent circuit of the skin is shown in fig. 2, wherein the equivalent circuit of the skin comprises the conductance Gm of the nerve membrane, the capacitance Cm, and the conductance Ga of the medium inside the nerve, etc. When a current I passes through the skin surface, a potential distribution is generated on the skin surface, and the potential distribution Ψ generates a membrane current Im along the nerve axon, so as to further cause a voltage difference Vm on a membrane, namely, the stimulation of the nerve changes the voltage difference Vm of the nerve membrane by changing the external membrane potential Ψ. When the voltage difference Vm of the neural membrane reaches a certain threshold value, i.e., the current is large enough, the tactile receptors in the nerve endings are finally stimulated, and then the electric stimulation is transmitted to the central nervous system to generate the feeling of electric stimulation.
The display screen of the electronic equipment can be a naked eye three-dimensional display screen, three-dimensional images which can be displayed by the naked eye three-dimensional display screen directly have a three-dimensional effect, and a user can obtain the three-dimensional effect without other equipment. The display screen of the electronic equipment can be a common three-dimensional display screen, the common three-dimensional display screen outputs three-dimensional images, a user has a three-dimensional effect when viewing the three-dimensional images by means of three-dimensional glasses, and the three-dimensional effect cannot be obtained when viewing the three-dimensional images without means of equipment such as the three-dimensional glasses.
When a three-dimensional image output by the electronic equipment is acquired, two-dimensional information and spatial information of the three-dimensional image are acquired, the two-dimensional information can be understood as plane information of the three-dimensional image, and the spatial information can be understood as depth information of the three-dimensional image. The three-dimensional image can be understood by utilizing a coordinate system, the display surface of the display screen can be understood as an xy plane, the z axis is vertical to the xy plane, the two-dimensional information can be understood as the information of the xy plane corresponding to the three-dimensional image, and the spatial information can be understood as the information of the z axis corresponding to the three-dimensional image.
And 102, acquiring a corresponding target touch electrode according to the two-dimensional information.
After the two-dimensional information is acquired, the two-dimensional information can correspond to the display surface of the display screen, and the corresponding target touch electrode is acquired through the two-dimensional information. For example, the display screen displays a three-dimensional image of a human face, where the two-dimensional information is an outline, a color, and the like of the human face, the spatial information is depth information of each pixel of the human face, and the outline, the color, the depth information, and the like of the human face are synthesized to form a stereoscopic human face image. The two-dimensional information corresponds to a display surface of the display screen, and the touch electrodes are also arranged on the display screen, so that the corresponding target touch electrodes can be obtained according to the two-dimensional information.
And 103, controlling the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information.
After the spatial information is obtained, the target touch electrode can be controlled to output the corresponding electrical stimulation signal, abundant touch experience is provided, and the method is more real and visual. For example, the display screen displays a three-dimensional image of a human face, and because the image is a three-dimensional image, each part of the human face image has different spatial information, and it can also be understood that each part of the human face image has different depth information. Taking a nose in a face image as an example, firstly, two-dimensional information about the nose is acquired through technologies such as picture recognition and the like, then, according to the two-dimensional information, a corresponding target touch electrode is obtained, namely, the current target touch electrode corresponds to the nose, then, spatial information about the nose can be acquired, since the nose protrudes out of the face, the spatial information of each part of the nose is different, and according to the different spatial information, the corresponding target touch electrode is controlled to output a corresponding electrical stimulation signal, so that a user can feel the height difference of the nose. For example, an electrical stimulation signal with large spatial information is large, and an electrical stimulation signal with small spatial information is small. The spatial information corresponding to the nose tip is the largest, and the corresponding electrical stimulation signal is also the largest.
In some embodiments, the corresponding output waveform is selected based on one of the two-dimensional information and the spatial information, and the corresponding output intensity is selected based on the other of the two-dimensional information and the spatial information; and synthesizing the output waveform and the output intensity to obtain an electric stimulation signal output by the target touch electrode.
Wherein the two-dimensional information may be texture information of the two-dimensional image, etc. The texture information may be a visual feature reflecting homogeneity in the image, the texture information representing a slowly or periodically varying surface structure organization arrangement property of the object surface. Texture information has three major flags: a local sequence of continuously repeating, non-random arrays, a substantially uniform continuum within a textured area. Texture is different from image features such as gray scale, color and the like, and is represented by gray scale distribution of pixels and surrounding spatial neighborhoods, namely: local texture information. Local texture information is more or less repetitive, i.e. global texture information. The texture information may be used for image classification and scene recognition, and may reflect characteristics of the object surface, thereby providing a realistic haptic experience for the user.
The texture information may be obtained by a statistical-based method, a model-based method, a structure-based method, and a signal processing-based method. The statistical-based method comprises a gray level co-occurrence matrix, a gray level travel statistic, a gray level difference statistic, a local gray level statistic, a semi-variance graph, an autocorrelation function and the like. Model-based methods include synchronous autoregressive models, Markov models, Gibbs models, moving average models, complex network models, and the like. Structure-based methods include syntactic texture analysis, mathematical morphology, Laws texture measurement, feature filters, and the like. Methods based on signal processing include Radon transform, discrete cosine transform, local fourier transform, Gabor transform, binary wavelet transform, tree wavelet decomposition, and the like.
Referring to fig. 3, fig. 3 is a second flowchart illustrating a touch electrode control method according to an embodiment of the present disclosure. The specific process of the touch electrode control method provided by the embodiment of the application can be as follows:
when a three-dimensional image output by the electronic device is acquired, two-dimensional information and spatial information of the three-dimensional image are acquired 201.
The display screen of the electronic equipment is provided with a transparent touch electrode, the transparent touch electrode is used for outputting an electrical stimulation signal, and the electrical stimulation signal is used for stimulating the skin of a user to enable the user to generate touch feeling.
When a three-dimensional image output by the electronic equipment is acquired, two-dimensional information and spatial information of the three-dimensional image are acquired, the two-dimensional information can be understood as plane information of the three-dimensional image, and the spatial information can be understood as depth information of the three-dimensional image. The three-dimensional image can be understood by utilizing a coordinate system, the display surface of the display screen can be understood as an xy plane, the z axis is vertical to the xy plane, the two-dimensional information can be understood as the information of the xy plane corresponding to the three-dimensional image, and the spatial information can be understood as the information of the z axis corresponding to the three-dimensional image.
202, when the three-dimensional image includes a map image, the spatial information corresponds to altitude information of the map image.
The three-dimensional image may be a map image. The map image may be a contour map, a three-dimensional map, or the like, the two-dimensional information corresponding to a shape of the map image, and the spatial information corresponding to altitude information of the map image, so that a user can feel a difference in altitude of each part in the map image when touching the map image. Such as making the user have a rugged touch according to the altitude information of the map image.
And 203, when the two-dimensional information comprises road information, acquiring a corresponding target touch electrode according to the road information.
The two-dimensional information may include road information, and the corresponding target touch electrode is acquired according to the road information. For example, in some games, the game interface passes through a three-dimensional image program, the game interface includes road information, and characters in the game can walk along the road, such as a gunshot game, a racing game, and the like.
And 204, controlling the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information.
After the spatial information is obtained, the target touch electrode can be controlled to output the corresponding electrical stimulation signal, abundant touch experience is provided, and the method is more real and visual. For example, a display screen displays a map image of a three-dimensional scenic spot, the map image of the scenic spot comprises a plurality of mountaineering roads, two-dimensional information in the map image of the scenic spot corresponds to images of the display screen for displaying the mountaineering roads and the like, target touch electrodes corresponding to the plurality of mountaineering roads are obtained, and the target touch electrodes output corresponding electrical stimulation signals according to spatial information of each position in the plurality of mountaineering roads, so that a touch feeling of walking at different altitudes is provided for a user.
It should be noted that the corresponding electronic device may be one terminal, or may be one terminal and a plurality of accessories. The plurality of accessories can be arranged at a plurality of positions such as soles, palms and the like of the users, the plurality of accessories are connected with the terminal, the accessories are provided with a plurality of touch electrodes, and the terminal outputs different electrical stimulation signals to different positions of the users according to the three-dimensional images. For example, the three-dimensional image is a character mountain climbing, and the terminal may output an electrical stimulation signal to a touch electrode provided on an accessory on the sole of the foot of the user to provide the user with a tactile sensation simulating mountain climbing. And different touch senses can be provided according to different walking roads of the user in the three-dimensional image. For example, the character walks on various floors such as a beach, a gravel road, a grass, a mud, a cement, a wood floor, a carpet, etc., and the terminal may output an electrical stimulation signal to a touch electrode provided on an accessory of the sole of the foot of the user, thereby providing the user with a sense of touch when walking on various floors.
For another example, the display screen displays a three-dimensional image of a game application, the game application comprises a game scene, and the game scene can be understood as a map image, for example, in a racing game, the game scene comprises a track and a track surrounding environment, and the track and the surrounding environment are a map image. The game scene can be a three-dimensional image, when the racing car walks on the track, the racing car can be subjected to various conditions such as vibration and impact, the touch electrodes can simulate the conditions such as vibration and impact of the racing car and feed back to a user, and therefore on the basis of audio-video interaction, the touch electrodes are combined with touch interaction, and more real and visual interaction experience is provided for the user.
205, the two-dimensional information further includes road periphery information, and a preset touch electrode corresponding to the road periphery information is obtained.
The road periphery information may be walls, retaining walls, trees, isolation belts, barriers, etc. on both sides of the road.
And 206, controlling the preset touch electrode to output a corresponding electrical stimulation signal for prompting the no-pass.
When the role in the three-dimensional image moves to the periphery of the road, the preset touch electrode corresponding to the road periphery information outputs a corresponding electric stimulation signal for prompting the no-pass. For example, in a racing game, when a racing car hits a tree beside a race track, a preset touch electrode corresponding to the tree is controlled to output a corresponding electrical stimulation signal for prompting no passing.
Referring to fig. 4, fig. 4 is a third flowchart illustrating a touch electrode control method according to an embodiment of the present disclosure. The specific process of the touch electrode control method provided by the embodiment of the application can be as follows:
301, when acquiring a three-dimensional image output by an electronic device, acquiring two-dimensional information and spatial information of the three-dimensional image.
The display screen of the electronic equipment is provided with a transparent touch electrode, the transparent touch electrode is used for outputting an electrical stimulation signal, and the electrical stimulation signal is used for stimulating the skin of a user to enable the user to generate touch feeling.
When a three-dimensional image output by the electronic equipment is acquired, two-dimensional information and spatial information of the three-dimensional image are acquired, the two-dimensional information can be understood as plane information of the three-dimensional image, and the spatial information can be understood as depth information of the three-dimensional image. The three-dimensional image can be understood by utilizing a coordinate system, the display surface of the display screen can be understood as an xy plane, the z axis is vertical to the xy plane, the two-dimensional information can be understood as the information of the xy plane corresponding to the three-dimensional image, and the spatial information can be understood as the information of the z axis corresponding to the three-dimensional image.
302, when the number of the personal information in the three-dimensional image is at least two, a selection menu is displayed, and the selection menu comprises at least two options of the personal information.
At least two pieces of personal information may be included in the three-dimensional image. For example, when a user views a video or live broadcast of a game application, the game application is a two-party battle game, the two parties have 5 people each, and the character selected by each person is different, so that the electronic device can display a selection menu, and options of all characters displayed on the selection menu, or options of all characters of one party.
303, determining the target personal information from at least two pieces of personal information according to the selection instruction of the user.
After the selection menu is displayed, the user can select one role, and then the role selected by the user is determined as the target task information.
In some embodiments, the three-dimensional image of the game application includes a plurality of characters, each of which may be understood as a piece of character information. In the game application, a user can select one character to play the game, and the character selected by the user can be the target character information.
In some embodiments, the three-dimensional image may be a movie, a short video, or the like, and one of the at least two pieces of personal information may be determined as the target personal information based on the user information.
For example, one of at least two pieces of personal information is determined as target personal information based on gender information, face information, personal taste, and the like of the user.
When the two-dimensional information includes the target personal information, the spatial information corresponding to the target personal information and the target touch electrode corresponding to the target personal information are acquired 304.
After the two-dimensional information is acquired, the two-dimensional information can correspond to the display surface of the display screen, and the corresponding target touch electrode is acquired through the two-dimensional information. For example, the display screen displays a three-dimensional image of a human face, where the two-dimensional information is an outline, a color, and the like of the human face, the spatial information is depth information of each pixel of the human face, and the outline, the color, the depth information, and the like of the human face are synthesized to form a stereoscopic human face image. The two-dimensional information corresponds to a display surface of the display screen, and the touch electrodes are also arranged on the display screen, so that the corresponding target touch electrodes can be obtained according to the two-dimensional information.
Object information associated with the object person information in the three-dimensional image is identified 305.
The target information related to the target personal information may include a texture signal of the target personal information, a movement trajectory of the target personal information in the three-dimensional image, target information received by the target personal information in the three-dimensional image, and the like.
For example, the three-dimensional image may be a three-dimensional image of a match-up game in which two characters match up, and the target information received by the target character information in the three-dimensional image may be an attack signal received by one of the characters.
And 306, controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
For example, the three-dimensional image is a three-dimensional image of a military battle game, the three-dimensional image includes a plurality of character signals, target information received by the target character information in the three-dimensional image can be an attack signal received by the target character information, the position of the target character information is moved after the target character information is attacked, the spatial information is changed, and the spatial information and the attack signal received by the target character information are all converted into corresponding electric stimulation signals.
In some embodiments, the electrical stimulation signal includes an output waveform and an output intensity, the corresponding output waveform is selected according to one of the target information and the spatial information, and the corresponding output intensity is selected according to the other of the two-dimensional information and the spatial information;
and synthesizing the output waveform and the output intensity to obtain an electric stimulation signal output by the target touch electrode. The output intensity may correspond to a voltage amplitude, a frequency, etc. of the electrical stimulation signal. The output waveform can enable the electric stimulation signal to simulate different touch senses, such as concave-convex touch sense, multi-thorn touch sense, granular touch sense, rough touch sense and the like.
In some embodiments, the method further comprises: when the notification information is acquired, the user is notified through the touch electrode.
The notification information may be short message notification information, instant notification information, incoming call information, application push information, and the like. When the notification information is acquired, the user can be notified through the touch electrode. Specifically, when the notification information is acquired, the current notification setting is acquired, such as whether to ring the notification or not, whether to be in a conference mode, and the like. When the current state is a non-ringing notification or in a conference mode, the contact position of the electronic equipment and a user is obtained, the touch electrode needing to be triggered is determined according to the contact position, and finally the touch electrode in contact with the user is controlled to output a corresponding electrical stimulation signal for notifying the user.
As can be seen from the above, in the touch electrode control method in the embodiment of the application, the two-dimensional information and the spatial information of the three-dimensional image may be obtained first, then the corresponding target touch electrode is obtained according to the two-dimensional information, and finally the target touch electrode is controlled to output the corresponding electrical stimulation signal according to the spatial information. The electrical stimulation signal can stimulate the skin of the user to enable the user to generate touch feeling, so that the user can obtain vivid touch effect, and the authenticity of man-machine interaction is improved.
Referring to fig. 5, fig. 5 is a schematic structural diagram of a touch electrode control device according to an embodiment of the present disclosure. The touch electrode control device 400 is applied to an electronic device, and a touch electrode is disposed on an outer surface of the electronic device, and is configured to output an electrical stimulation signal, where the electrical stimulation signal is used to stimulate the skin of a user to generate a touch sensation; the apparatus includes an information acquisition module 410, a target touch electrode acquisition module 420, and a processing module 430.
The information obtaining module 410 is configured to obtain two-dimensional information and spatial information of a three-dimensional image when the three-dimensional image output by the electronic device is obtained;
the target touch electrode obtaining module 420 is configured to obtain a corresponding target touch electrode according to the two-dimensional information;
the processing module 430 is configured to control the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information.
In some embodiments, the target touch electrode acquiring module 420 is further configured to acquire a corresponding target touch electrode according to the road information when the two-dimensional information includes the road information.
In some embodiments, the processing module 430 is further configured to obtain the two-dimensional information further includes road periphery information, and obtain a preset touch electrode corresponding to the road periphery information; and controlling the preset touch electrode to output a corresponding electrical stimulation signal for prompting the no-pass.
In some embodiments, the target touch electrode acquiring module 420 is further configured to acquire spatial information corresponding to the target person information and a target touch electrode corresponding to the target person information when the target person information is included in the two-dimensional information.
The processing module 430 is further configured to control the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information corresponding to the target person information.
In some embodiments, the processing module 430 is further configured to identify target information received by the target person information in the three-dimensional image; and controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
In some embodiments, the target touch electrode obtaining module 420 is further configured to, when the number of the person information in the three-dimensional image is at least two, present a selection menu, where the selection menu includes at least two options of the person information; and determining the target personal information from the at least two pieces of personal information according to a selection instruction of the user.
In some embodiments, the processing module 430 is further configured to identify target information received by the target person information in the three-dimensional image; and controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
In some embodiments, the target touch electrode obtaining module 420 is further configured to, when the number of the person information in the three-dimensional image is at least two, present a selection menu, where the selection menu includes at least two options of the person information; and determining the target personal information from the at least two pieces of personal information according to a selection instruction of the user.
In some embodiments, the processing module 430 is further configured to select a corresponding output waveform based on one of the two-dimensional information and the spatial information, and select a corresponding output intensity based on the other of the two-dimensional information and the spatial information; and synthesizing the output waveform and the output intensity to obtain an electrical stimulation signal output by the target touch electrode.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a first state of an electronic device according to an embodiment of the present application. The electronic device 100 includes a touch electrode 11 and a processor 19. The touch electrode 11 is disposed on an outer surface of the electronic device 19, and the touch electrode 11 is configured to output an electrical stimulation signal, where the electrical stimulation signal is configured to stimulate the skin of the user to generate a touch feeling for the user. The processor 19 is used for acquiring two-dimensional information and spatial information of the three-dimensional image when acquiring the three-dimensional image output by the electronic equipment 100; acquiring a corresponding target touch electrode 11 according to the two-dimensional information; and controlling the target touch electrode 11 to output a corresponding electrical stimulation signal according to the spatial information.
With reference to fig. 7, fig. 7 is another schematic structural diagram of the electronic device in the first state according to the embodiment of the present application. The electronic device comprises a display screen 12 and a shell 15, wherein the shell 15 comprises a frame 151 and a rear cover 152, the display screen 12 and the rear cover 152 are located on two opposite sides of the electronic device 100, the frame 151 is arranged around the display screen 12, the touch electrode 11 is a transparent electrode, and the touch electrode 11 is arranged on the outer surface of the display screen 12.
In some embodiments, the touch electrode 11 may be disposed on an outer surface of the back cover 152, the touch electrode 11 may also be disposed on an outer surface of the bezel 151, and the touch electrode 11 may also be disposed on outer surfaces of the back cover 152 and the bezel 151.
In some embodiments, this application embodiment still provides an electronic equipment, and electronic equipment includes main part and accessory, and main part and accessory physical connection or wireless connection, physical connection can be through the wire connection, transmission control signal and power signal, and wireless connection can be connected through modes such as bluetooth, WIFI to transmission control signal. The accessory is provided with a touch electrode, and the main body can control the touch electrode on the accessory to output a corresponding electric stimulation signal according to the three-dimensional image output by the main body. The accessory may be provided at one or more of the user's body parts, such as the palm, sole, head, back, front of the body, arms, legs, etc. Different tactile sensations are provided to different parts of the user based on the three-dimensional image.
It should be noted that the number of the touch electrodes 11 is plural, the touch electrodes 11 are arranged in an array manner, the touch electrodes 11 form a touch electrode array, each touch electrode 11 of the touch electrode array is used as a separate point, and then different stimulation patterns are realized by applying driving voltages to the points. The applied drive voltage can also be scanned across the touch electrodes to achieve some dynamic effect.
In some embodiments, the touch electrode may have a ring shape, such as a circular ring, a square ring, an elliptical ring, or an irregular ring structure. The number of the touch electrodes is multiple, and the multiple touch electrodes can be arranged in concentric rings. Providing a haptic effect to the user may be achieved with fewer touch electrodes.
In some embodiments, when the two-dimensional information includes road information, the processor is further configured to obtain a corresponding target touch electrode according to the road information.
In some embodiments, the processor is further configured to obtain the two-dimensional information further includes road periphery information, and obtain a preset touch electrode corresponding to the road periphery information; and controlling the preset touch electrode to output a corresponding electrical stimulation signal for prompting the no-pass.
In some embodiments, when the two-dimensional information includes the target person information, the processor is further configured to obtain spatial information corresponding to the target person information and a target touch electrode corresponding to the target person information, and control the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information corresponding to the target person information.
In some embodiments, the processor is further configured to identify target information received by the target person information in the three-dimensional image; and controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
In some embodiments, the processor is further configured to present a selection menu when the number of the person information in the three-dimensional image is at least two, the selection menu including at least two options of the person information; and determining the target personal information from the at least two pieces of personal information according to a selection instruction of the user.
In some embodiments, the processor is further configured to identify target information received by the target person information in the three-dimensional image; and controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
In some embodiments, the processor is further configured to present a selection menu when the number of the person information in the three-dimensional image is at least two, the selection menu including at least two options of the person information; and determining the target personal information from the at least two pieces of personal information according to a selection instruction of the user.
In some embodiments, the processor is further configured to select a corresponding output waveform based on one of the two-dimensional information and the spatial information, and to select a corresponding output intensity based on the other of the two-dimensional information and the spatial information; and synthesizing the output waveform and the output intensity to obtain an electrical stimulation signal output by the target touch electrode.
As can be seen from the above, the electronic device according to the embodiment of the application may first acquire the two-dimensional information and the spatial information of the three-dimensional image, then acquire the corresponding target touch electrode according to the two-dimensional information, and finally control the target touch electrode to output the corresponding electrical stimulation signal according to the spatial information. The electrical stimulation signal can stimulate the skin of the user to enable the user to generate touch feeling, so that the user can obtain vivid touch effect, and the authenticity of man-machine interaction is improved.
With reference to fig. 8 and 9, fig. 8 is a schematic structural diagram of a second state of the electronic device according to the embodiment of the present disclosure, and fig. 9 is another schematic structural diagram of the second state of the electronic device according to the embodiment of the present disclosure. The first state may be a state in which the electronic device 100 does not turn on the camera function, such as a standby state and a state in which the camera is not turned on when the screen is bright. The second state is a state when the electronic device 100 turns on the image capturing function.
In some embodiments, the electronic device 100 may include a display 12, electronics board, battery, housing 15, front camera 161, and rear camera 162. Note that the electronic apparatus 100 is not limited to the above.
In some embodiments, electronic device 100 may further include a sliding mechanism 18, sliding mechanism 18 being coupled to housing 15, sliding mechanism 18 being slidable relative to the housing. The front camera 161 and the rear camera 162 are provided on the slide mechanism 18, and are located on opposite sides, respectively.
When the electronic device 100 is in the first state, the sliding mechanism 18 is in the initial state, i.e., the sliding mechanism 18 is located in the housing.
When the electronic device 100 is in the second state, i.e. when the camera function is turned on, the sliding mechanism 18 slides out of the housing 15, and the front camera 161 and the rear camera 162 are disposed on the sliding mechanism 18. When the sliding mechanism 18 does not slide out of the casing 15, the front camera 161 and the rear camera 162 are hidden in the casing, and when the electronic device 100 is in the second state, the sliding mechanism 18 slides out of the casing 15, so that photographing, shooting and the like can be performed by using the front camera 161 and the rear camera 162.
Wherein the display screen 12 is mounted in the housing 15. The display 12 is electrically connected to the electronic circuit board to form a display surface of the electronic device 100. The display 12 may be in a regular shape, such as a rectangular parallelepiped structure, and the display 12 may cover the entire display surface of the electronic device 100, that is, a full screen display of the electronic device 100 is realized.
In some embodiments, the Display 12 may be a Liquid Crystal Display (LCD) or an Organic Light-Emitting Diode (OLED) Display.
The electronic circuit board is mounted in the housing 15, and may be a main board of the electronic device 100, and one, two or more functional components of a motor, a microphone, a speaker, an earphone interface, a universal serial bus interface, a front camera 161, a rear camera 162, a receiver 171, a distance sensor, an ambient light sensor, a processor, and the like may be integrated on the electronic circuit board. It is noted that, in the description of the present application, "a plurality" means two or more unless specifically defined otherwise.
In some embodiments, the electronic circuit board may be screwed into the housing 15 by screws, or may be snap-fit into the housing 15. It should be noted that the way of specifically fixing the electronic circuit board in the housing 15 according to the embodiment of the present application is not limited to this, and other ways, such as a way of jointly fixing by a snap and a screw, may also be used.
The electronic device 100 may further include a cover plate mounted to the display 12 to cover the display 12. The cover may be a clear glass cover so that the display 12 is transparent to the cover for display. In some embodiments, the cover plate may be a glass cover plate made of a material such as sapphire.
Wherein the housing 15 may form an outer contour of the electronic device 100. In some embodiments, the housing 15 may be a metal housing component, such as a metal such as magnesium alloy, stainless steel, and the like. It should be noted that the material of the housing 15 in the embodiment of the present application is not limited to this, for example: the housing 15 may be a plastic housing, a ceramic housing, a glass housing, or the like.
The electronic apparatus of the present application may have only the first state, that is, the electronic apparatus does not have the slide mechanism 18, and the electronic apparatus may have a non-display area, and the front camera 161, the receiver 171, the distance sensor, the ambient light sensor, and the like may be provided in the non-display area.
Referring to fig. 10, fig. 10 is a block diagram illustrating an electronic device according to an embodiment of the disclosure. The electronic device 100 may include control circuitry, which may include storage and processing circuitry 61. The storage and processing circuitry 61 may include memory, volatile memory, etc., and the processing circuitry in the storage and processing circuitry 61 may be used to control the operation of the electronic device 100. The storage and processing circuitry 61 may be used to run software in the electronic device 100.
The electronic device 100 may also include input-output circuitry 62. The input-output circuit 62 may be used to enable the electronic device 100 to input and output data, i.e., to allow the electronic device 100 to receive data from external devices and also to allow the electronic device 100 to output data from the electronic device 100 to external devices. The input-output circuitry 62 may further include a sensor 63, and one or more displays (e.g., display 64).
The electronic device 100 may further include other input-output units 67. The input-output unit 67 may include buttons, joysticks, click wheels, scroll wheels, touch pads, keypads, keyboards, cameras, light emitting diodes and other status indicators, etc.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
An embodiment of the present application further provides a storage medium, where the storage medium stores a computer program, and when the computer program runs on a computer, the computer is caused to execute the gender determination method in any of the embodiments, for example: when a three-dimensional image output by electronic equipment is acquired, acquiring two-dimensional information and spatial information of the three-dimensional image; acquiring a corresponding target touch electrode according to the two-dimensional information; and controlling the target touch electrode to output a corresponding electrical stimulation signal according to the spatial information.
In the embodiment of the present application, the storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It should be noted that, for the touch electrode control method of the embodiment of the present application, it can be understood by a person skilled in the art that all or part of the process of implementing the touch electrode control method of the embodiment of the present application can be completed by controlling related hardware through a computer program, where the computer program can be stored in a computer-readable storage medium, such as a memory of an electronic device, and executed by at least one processor in the electronic device, and during the execution process, the process of the embodiment of the touch electrode control method can be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory, a random access memory, etc.
The touch electrode control method, the touch electrode control device, the storage medium and the electronic device provided by the embodiments of the present application are described in detail above, and a specific example is applied in the present application to explain the principle and the implementation of the present application, and the description of the above embodiments is only used to help understanding the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (12)
1. A touch electrode control method is applied to electronic equipment and is characterized in that touch electrodes are arranged on the outer surface of the electronic equipment and used for outputting electrical stimulation signals, and the electrical stimulation signals are used for stimulating the skin of a user to enable the user to generate touch feeling; the method comprises the following steps:
when a three-dimensional image output by the electronic equipment is acquired, acquiring two-dimensional information and spatial information of the three-dimensional image;
when the number of the character information in the three-dimensional image is at least two, displaying a selection menu, wherein the selection menu comprises at least two options of the character information;
determining target person information from at least two pieces of person information according to a selection instruction of a user;
when the two-dimensional information comprises the target person information, acquiring space information corresponding to the target person information and a target touch electrode corresponding to the target person information;
identifying target information related to the target person information in the three-dimensional image;
and controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
2. The touch electrode control method according to claim 1, wherein when the three-dimensional image includes a map image, the spatial information corresponds to altitude information of the map image.
3. The touch electrode control method according to claim 2, wherein the obtaining of the corresponding target touch electrode according to the two-dimensional information comprises:
and when the two-dimensional information comprises road information, acquiring a corresponding target touch electrode according to the road information.
4. The touch electrode control method according to claim 3, characterized by further comprising:
the two-dimensional information also comprises road peripheral information, and a preset touch electrode corresponding to the road peripheral information is obtained;
and controlling the preset touch electrode to output a corresponding electrical stimulation signal for prompting the no-pass.
5. The touch electrode control method according to claim 1, wherein the controlling the target touch electrode to output the corresponding electrical stimulation signal according to the spatial information corresponding to the target person information comprises:
identifying target information related to the target person information in the three-dimensional image;
and controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
6. The touch electrode control method according to claim 1, wherein the controlling the target touch electrode to output the corresponding electrical stimulation signal according to the spatial information comprises:
selecting a corresponding output waveform according to one of the two-dimensional information and the spatial information, and selecting a corresponding output intensity according to the other of the two-dimensional information and the spatial information;
and synthesizing the output waveform and the output intensity to obtain an electrical stimulation signal output by the target touch electrode.
7. The touch electrode control method according to claim 1, characterized by further comprising:
when the notification information is acquired, the user is notified through the touch electrode.
8. A touch electrode control device is applied to electronic equipment and is characterized in that touch electrodes are arranged on the outer surface of the electronic equipment and used for outputting electrical stimulation signals, and the electrical stimulation signals are used for stimulating the skin of a user to enable the user to generate touch feeling; the device comprises:
the information acquisition module is used for acquiring two-dimensional information and spatial information of the three-dimensional image when the three-dimensional image output by the electronic equipment is acquired;
the target touch electrode acquisition module is used for displaying a selection menu when the number of the character information in the three-dimensional image is at least two, wherein the selection menu comprises at least two options of the character information; determining target person information from at least two pieces of person information according to a selection instruction of a user; when the two-dimensional information comprises the target person information, acquiring space information corresponding to the target person information and a target touch electrode corresponding to the target person information;
the processing module is used for identifying target information related to the target person information in the three-dimensional image; and controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
9. A storage medium having stored thereon a computer program, characterized in that, when the computer program is run on a computer, it causes the computer to execute the method according to any one of claims 1 to 7.
10. An electronic device, comprising:
the touch electrode is arranged on the outer surface of the electronic equipment and used for outputting an electrical stimulation signal, and the electrical stimulation signal is used for stimulating the skin of a user to enable the user to generate touch feeling;
the processor is used for acquiring two-dimensional information and spatial information of the three-dimensional image when the three-dimensional image output by the electronic equipment is acquired; when the number of the character information in the three-dimensional image is at least two, displaying a selection menu, wherein the selection menu comprises at least two options of the character information; determining target person information from at least two pieces of person information according to a selection instruction of a user; when the two-dimensional information comprises the target person information, acquiring space information corresponding to the target person information and a target touch electrode corresponding to the target person information; identifying target information related to the target person information in the three-dimensional image; and controlling the target touch electrode to output a corresponding electric stimulation signal according to the space information corresponding to the target person information and the target information.
11. The electronic device of claim 10, wherein the electronic device comprises a display screen, and the touch electrode is a transparent electrode disposed on an outer surface of the display screen.
12. The electronic device according to claim 10, wherein the touch electrode is ring-shaped, the number of the touch electrodes is plural, and the plural touch electrodes are arranged in concentric rings.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910008864.0A CN109782950B (en) | 2019-01-04 | 2019-01-04 | Touch electrode control method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910008864.0A CN109782950B (en) | 2019-01-04 | 2019-01-04 | Touch electrode control method and device, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109782950A CN109782950A (en) | 2019-05-21 |
| CN109782950B true CN109782950B (en) | 2022-05-17 |
Family
ID=66499925
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910008864.0A Active CN109782950B (en) | 2019-01-04 | 2019-01-04 | Touch electrode control method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109782950B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101801480A (en) * | 2007-09-20 | 2010-08-11 | 皇家飞利浦电子股份有限公司 | The feedback device that is used to play |
| CN101819462A (en) * | 2010-03-12 | 2010-09-01 | 东南大学 | Image texture tactile representation system based on force/haptic interaction equipment |
| CN104423709A (en) * | 2013-09-09 | 2015-03-18 | 意美森公司 | Electrical Stimulation Haptic Feedback Interface |
| CN104766317A (en) * | 2015-03-31 | 2015-07-08 | 浙江理工大学 | Rigid texture image force touch sense generating method based on five elements |
| CN106061456A (en) * | 2013-12-31 | 2016-10-26 | 伊夫徳发明未来科技有限公司 | Wearable devices, systems, methods and architectures for sensory stimulation and manipulation, and physiological data acquisition |
| CN106657060A (en) * | 2016-12-21 | 2017-05-10 | 惠州Tcl移动通信有限公司 | VR communication method and system based on reality scene |
| CN108021229A (en) * | 2016-10-31 | 2018-05-11 | 迪斯尼企业公司 | High fidelity numeral immersion is recorded by computed offline to experience |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102331838B (en) * | 2011-11-18 | 2014-04-16 | 东南大学 | Method for expressing vibration tactility of image based on depth contour |
| JP6012068B2 (en) * | 2012-08-28 | 2016-10-25 | 日本電気株式会社 | Electronic device, control method thereof, and program |
| CN102805900B (en) * | 2012-08-30 | 2015-08-19 | 上海交通大学 | For generation of the electric stimulation of artificial electric touch |
| CN103869940B (en) * | 2012-12-13 | 2018-02-16 | 富泰华工业（深圳）有限公司 | Tactile feedback system, electronic installation and its method that tactile feedback is provided |
| KR102201733B1 (en) * | 2013-09-30 | 2021-01-12 | 엘지전자 주식회사 | Apparatus and Method for Display Device |
| CN104331155B (en) * | 2014-10-27 | 2017-02-15 | 北京理工大学 | Device using electric stimulation to realize touch reappearing |
| KR20180112847A (en) * | 2016-04-07 | 2018-10-12 | 재팬 사이언스 앤드 테크놀로지 에이전시 | A tactile information conversion device, a tactile information conversion method, and a tactile information conversion program |
| CN108874150A (en) * | 2018-07-27 | 2018-11-23 | 华南理工大学 | A kind of virtual reality touch feedback interactive system |
-
2019
- 2019-01-04 CN CN201910008864.0A patent/CN109782950B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101801480A (en) * | 2007-09-20 | 2010-08-11 | 皇家飞利浦电子股份有限公司 | The feedback device that is used to play |
| CN101819462A (en) * | 2010-03-12 | 2010-09-01 | 东南大学 | Image texture tactile representation system based on force/haptic interaction equipment |
| CN104423709A (en) * | 2013-09-09 | 2015-03-18 | 意美森公司 | Electrical Stimulation Haptic Feedback Interface |
| CN106061456A (en) * | 2013-12-31 | 2016-10-26 | 伊夫徳发明未来科技有限公司 | Wearable devices, systems, methods and architectures for sensory stimulation and manipulation, and physiological data acquisition |
| CN104766317A (en) * | 2015-03-31 | 2015-07-08 | 浙江理工大学 | Rigid texture image force touch sense generating method based on five elements |
| CN108021229A (en) * | 2016-10-31 | 2018-05-11 | 迪斯尼企业公司 | High fidelity numeral immersion is recorded by computed offline to experience |
| CN106657060A (en) * | 2016-12-21 | 2017-05-10 | 惠州Tcl移动通信有限公司 | VR communication method and system based on reality scene |
Non-Patent Citations (1)
| Title |
|---|
| "基于手指的触觉替代视觉系统的设计与实现";张竹茂，刘捷，赵瑛;《中国医学物理学杂志》;20090731;第26卷(第4期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109782950A (en) | 2019-05-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111035918B (en) | Reconnaissance interface display method and device based on virtual environment and readable storage medium | |
| CN110354489B (en) | Virtual object control method, device, terminal and storage medium | |
| CN111013142B (en) | Interactive effect display method and device, computer equipment and storage medium | |
| US7774075B2 (en) | Audio-visual three-dimensional input/output | |
| CN109343716B (en) | Image display method and device and computer readable storage medium | |
| CN111324253B (en) | Virtual article interaction method and device, computer equipment and storage medium | |
| CN111729307B (en) | Virtual scene display method, device, equipment and storage medium | |
| CN110675412B (en) | Image segmentation method, training method, device and equipment of image segmentation model | |
| CN109426343B (en) | Collaborative training method and system based on virtual reality | |
| WO2019184782A1 (en) | Method for controlling object in virtual scene, device, and computer apparatus | |
| CN112569607B (en) | Display method, device, equipment and medium for pre-purchased prop | |
| CN113538696A (en) | Special effect generation method and device, storage medium and electronic equipment | |
| CN111068323B (en) | Intelligent speed detection method, intelligent speed detection device, computer equipment and storage medium | |
| CN113457173B (en) | Remote teaching method, remote teaching device, computer equipment and storage medium | |
| CN112367533B (en) | Interactive service processing method, device, equipment and computer readable storage medium | |
| CN109782950B (en) | Touch electrode control method and device, storage medium and electronic equipment | |
| CN112316423A (en) | Method, device, equipment and medium for displaying state change of virtual object | |
| Rodriguez et al. | An Arduino-based device for visually impaired people to play videogames | |
| CN116955983A (en) | Training method, device, equipment and storage medium of electroencephalogram analysis model | |
| CN113194329B (en) | Live interaction method, device, terminal and storage medium | |
| CN114042315B (en) | Virtual scene-based graphic display method, device, equipment and medium | |
| CN112604274B (en) | Virtual object display method, device, terminal and storage medium | |
| CN110134239B (en) | Information transmission method, storage medium, and electronic device | |
| CN110928913A (en) | User display method, device, computer equipment and computer readable storage medium | |
| CN211319177U (en) | Display system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |