WO2023000958A1 - 显示系统、操作反馈方法、电子设备和存储介质 - Google Patents

显示系统、操作反馈方法、电子设备和存储介质 Download PDF

Info

Publication number
WO2023000958A1
WO2023000958A1 PCT/CN2022/103394 CN2022103394W WO2023000958A1 WO 2023000958 A1 WO2023000958 A1 WO 2023000958A1 CN 2022103394 W CN2022103394 W CN 2022103394W WO 2023000958 A1 WO2023000958 A1 WO 2023000958A1
Authority
WO
WIPO (PCT)
Prior art keywords
feedback
type
gui control
line segment
user
Prior art date
Application number
PCT/CN2022/103394
Other languages
English (en)
French (fr)
Inventor
张恒飞
Original Assignee
京东方科技集团股份有限公司
北京京东方技术开发有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司, 北京京东方技术开发有限公司 filed Critical 京东方科技集团股份有限公司
Priority to EP22845123.3A priority Critical patent/EP4339752A4/en
Priority to US18/569,004 priority patent/US20240281068A1/en
Publication of WO2023000958A1 publication Critical patent/WO2023000958A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/014—Force feedback applied to GUI

Definitions

  • the present disclosure relates to the field of display technology, and in particular, to a display system, a tactile feedback method, an electronic device, and a non-volatile computer-readable storage medium.
  • GUI Graphical User Interface
  • GUI controls can be displayed on the screens of display devices in different application scenarios such as mobile phones, vehicle-mounted display devices, smart TVs, and central control display devices. Users can realize corresponding types by touching the GUI controls.
  • GUI controls can generate feedback. For example, when the user clicks an application icon on the screen, vibration feedback is generated immediately at least at the clicked position to indicate that the click is valid.
  • the present disclosure provides a display system, a tactile feedback method, an electronic device, and a non-volatile computer-readable storage medium.
  • a display system including a display screen configured to display a GUI control and a processor; the processor is configured to: determine that the user touches the GUI control displayed on the display screen
  • the operation attribute information of the control operation includes at least one of the following: the type of the GUI control, the operation position of the touch operation in the area where the GUI control is located, and the operation type of the touch operation; Haptic feedback is generated according to the operational attribute information.
  • the processor is further configured to: determine a tactile feedback intensity corresponding to the operation attribute information; generate a tactile signal corresponding to the tactile feedback intensity.
  • the feedback intensity of the haptic signal is characterized by at least one of the following: amplitude of signal waveform, type of signal waveform, and high or low signal frequency.
  • the type of the signal waveform includes at least one of the following: pulse wave, square wave, triangle wave, rectangular wave, sawtooth wave.
  • the type of the GUI control includes at least one of the following: a button, a knob, and a progress bar.
  • the type of the GUI control includes a button
  • the GUI control includes an edge area and a center area
  • the feedback intensity corresponding to the edge area is greater than the feedback intensity corresponding to the center area
  • the type of the GUI control includes a knob
  • the GUI control includes line segments extending in multiple directions
  • the plurality of line segments include at least one line segment of the first type and at least one line segment of the second type
  • the feedback intensity corresponding to the first type of line segment is greater than the feedback intensity corresponding to the second type of line segment.
  • the included angles between adjacent line segments are the same, and there is a first-type line segment every preset number of second-type line segments.
  • the width of the first type of line segment is greater than the width of the second type of line segment.
  • the type of the GUI control includes a progress bar
  • the GUI control includes a plurality of intersection lines intersecting with the length direction of the GUI control
  • the feedback strengths corresponding to the plurality of intersection lines are along the Gradient in the length direction of the GUI control.
  • the processor is further configured to generate at least one of the following feedbacks according to the operational attribute information: auditory feedback, olfactory feedback, and gustatory feedback.
  • an operation feedback method including: determining the operation attribute information of the user's touch operation on the displayed GUI control on the display screen, the operation attribute information including at least one of the following: The type of the GUI control, the operation position of the touch operation in the area where the GUI control is located, and the operation type of the touch operation; generate tactile feedback according to the operation attribute information.
  • the generating tactile feedback according to the operation property information includes: determining a tactile feedback intensity corresponding to the operation property information; and generating a tactile signal corresponding to the tactile feedback intensity.
  • the type of the GUI control includes at least one of the following: a button, a knob, and a progress bar.
  • the type of the GUI control includes a button
  • the GUI control includes an edge area and a center area
  • the feedback intensity corresponding to the edge area is greater than the feedback intensity corresponding to the center area
  • the type of the GUI control includes a knob
  • the GUI control includes line segments extending in multiple directions
  • the plurality of line segments include at least one line segment of the first type and at least one line segment of the second type
  • the feedback intensity corresponding to the first type of line segment is greater than the feedback intensity corresponding to the second type of line segment.
  • the included angles between adjacent line segments are the same, and there is a first-type line segment every preset number of second-type line segments.
  • the width of the first type of line segment is greater than the width of the second type of line segment.
  • the type of the GUI control includes a progress bar
  • the GUI control includes a plurality of intersection lines intersecting with the length direction of the GUI control
  • the feedback strengths corresponding to the plurality of intersection lines are along the Gradient in the length direction of the GUI control.
  • an electronic device including a processor and a memory for storing instructions executable by the processor; wherein the processor is configured to implement the above method.
  • a non-volatile computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps in any one of the methods described above are implemented.
  • a user when a user performs a touch operation on a GUI control, he or she can feel different tactile sensations when touching different types of GUI controls, touching different positions of the GUI controls, and performing different types of operations on the GUI controls.
  • Feedback enriches the user's tactile experience of operating GUI controls, and can also effectively guide users in touch operations on GUI controls based on different tactile feedback.
  • Fig. 1 is a schematic diagram of a GUI control according to an embodiment of the present disclosure.
  • Fig. 2 is a schematic diagram of another GUI control according to an embodiment of the present disclosure.
  • Fig. 3 is a schematic diagram of another GUI control according to an embodiment of the present disclosure.
  • Fig. 4 is a schematic flowchart of an operation feedback method according to an embodiment of the present disclosure.
  • Fig. 5 is a schematic flowchart of another operation feedback method according to an embodiment of the present disclosure.
  • Fig. 6 is a schematic block diagram of an apparatus for tactile feedback according to an embodiment of the present disclosure.
  • Embodiments of the present disclosure propose a display system, the operating system includes a display screen configured to display GUI controls and a processor.
  • the display system shown in this embodiment can be applied to a display panel, the display panel has a touch function, can receive a user's touch operation, and generate tactile feedback for the touch operation, for example, the display panel can display a GUI control, and the user can When touch operations are performed on the GUI controls, such as operations such as clicking and sliding, the display panel can generate tactile feedback for the user's touch operations on the GUI controls.
  • the display panel can be applied to electronic devices with a display function, and the types of electronic devices are not limited to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, central control devices, and the like.
  • the application scenarios are not limited to smart transportation, smart furniture, smart wear, smart finance, etc.
  • the processor is configured to: determine the operation attribute information of the user's touch operation on the GUI control displayed on the display screen, the operation attribute information includes at least one of the following: the GUI control The type of the touch operation, the operation position of the touch operation in the area where the GUI control is located, and the operation type of the touch operation; generating tactile feedback according to the operation attribute information.
  • the operation attribute information of the touch operation can be determined, such as the type of the GUI control operated, the operating position of the touch operation in the area where the GUI control is located, The operation type of the touch operation.
  • the type of GUI control includes at least one of the following: button, knob, and progress bar; the operation type includes at least one of the following: click, double-click, long press (which can be further divided into light press and heavy press), slide, and zoom.
  • the operation attribute information includes the type and operation position of the GUI control
  • different GUI control types may correspond to different tactile feedback sets
  • the tactile feedback set may include a plurality of tactile feedback corresponding to the operation position, so that when determining After the type of GUI space is operated, the operation position can be further determined, and the corresponding tactile feedback can be determined in the tactile feedback set according to the operation position.
  • the corresponding tactile feedback set includes two elements: one element is a sharp vibration feedback, and the corresponding position is the edge area of the corresponding area of the GUI control; the other element is a thick vibration feedback, and the corresponding position is It is the central area of the corresponding area of the GUI control.
  • the operation position of the touch operation can be determined, for example, the operation position is located in the edge area of the corresponding area of the GUI control , can generate sharp vibration feedback, for example, if the operating position is located in the center of the corresponding area of the GUI control, thick vibration feedback can be generated.
  • the operation attribute information includes an operation position and an operation type
  • different operation positions may correspond to different tactile feedback sets
  • the tactile feedback set may include a plurality of tactile feedbacks corresponding to the operation type, so that the touch operation After the operation position, the operation type can be further determined, and the corresponding tactile feedback can be determined in the tactile feedback set according to the operation type.
  • the operation position is the central area of the GUI control
  • the corresponding tactile feedback itself includes two elements: one element is low-frequency vibration feedback, and the corresponding operation type is tap; the other element is high-frequency vibration feedback, and the corresponding operation Type is heavy press.
  • the operation type of the touch operation can be determined.
  • the operation type is a tap, which can generate low frequency Vibration feedback, for example, if the operation type is heavy pressing, it can generate high-frequency vibration feedback.
  • combination of operation attribute information is not limited to the cases shown in the above two embodiments, and the combination of operation attribute information can be set as required, for example, it can include the type of GUI control, operation position and operation type.
  • the following embodiments mainly illustrate the technical solution of the present disclosure under the condition that the operation attribute information includes the operation position.
  • the shape feature of the GUI control can be set as required, for example, it can be held, circled, or bar-shaped.
  • the same type of GUI controls may have different or the same shape features, and different types of GUI controls may have different or the same shape features.
  • the following embodiments mainly illustrate the technical solution of the present disclosure under the condition that the shape feature of the button-type GUI control is a rectangle, the shape feature of the knob-type GUI control is a circle, and the shape feature of the progress bar GUI control is a bar.
  • the corresponding relationship between the type of the GUI control and the shape feature can also be adjusted as required.
  • the area where the GUI control is located may be divided, and corresponding tactile feedback is generated according to the area where the operation position is located.
  • the manners of dividing regions for GUI controls of different shapes may be different or the same.
  • the shape feature of the GUI control includes at least one of the following: rectangle, circle, and bar.
  • the GUI control can be divided into two parts: the edge area and the center area.
  • the edge area is the four sides of the GUI control, 2/5 of the width and side length.
  • the part is the center area, that is, the edge area is a rectangular frame, and the center area is a square inside the edge area.
  • the way of generating vibration of the display panel includes but not limited to frictional electrostatic vibration, driving of a vibration device, vibration of a piezoelectric sheet, and the like.
  • a user when a user performs a touch operation on a GUI control, he or she can feel different tactile sensations when touching different types of GUI controls, touching different positions of the GUI controls, and performing different types of operations on the GUI controls.
  • Feedback enriches the user's tactile experience of operating GUI controls, and can also effectively guide users in touch operations on GUI controls based on different tactile feedback.
  • the display panel is applied to a vehicle-mounted device. Since the screen of the vehicle-mounted device is generally larger than that of a terminal such as a mobile phone, the size of the GUI controls displayed therein is also relatively large to facilitate operations by the user. However, when the user is driving, he needs to keep his eyes on the front of the vehicle. When operating the GUI control, it is inconvenient to see the specific position of the finger in the GUI control. Generally, he can only guess the degree of operation of the GUI control based on memory, for example When the user drags the slider in the GUI control to adjust the volume of the player, the degree of dragging the slider cannot be accurately determined, which leads to the inability to accurately adjust the volume. This may cause invalid operations or even Incorrect operation affects user experience.
  • a user when a user performs a touch operation on a GUI control, different tactile feedbacks can be generated for the user according to different operating positions, so that the user can determine the correct position according to the tactile feedback when performing a touch operation on the GUI control.
  • the degree of manipulation of the GUI controls for accurate manipulation.
  • the GUI control requires the user to press and hold to perform the corresponding operation in the central area.
  • the GUI control requires the user to press and hold to perform the corresponding operation in the central area.
  • the user when the user touches the edge of the GUI control, the user can determine the finger according to the sharp vibration. After touching the edge of the GUI control, you can move your finger to the central area. After touching the central area, you can determine that the finger is located in the central area according to the thick vibration, and then you can perform a long press operation. It can be seen that setting the GUI control to generate corresponding tactile feedback according to the user's operation position can effectively guide the user to operate, so that the user can accurately complete the touch operation by relying on the tactile feedback even without viewing the GUI control.
  • tactile feedback uses vibration feedback as an example.
  • tactile feedback can also be generated in other ways as needed.
  • the tactile feedback can be temperature feedback, so for different operations Attribute information can make users feel different temperature feedback.
  • the processor is further configured to: determine a tactile feedback intensity corresponding to the operation attribute information; generate a tactile signal corresponding to the tactile feedback intensity.
  • different feedback intensities can be preset for different operation attribute information, and then after determining the operation attribute information of the user's touch operation, the feedback intensity can be quickly determined according to the operation attribute information, and according to the determined feedback intensity Generate haptic signals.
  • the feedback intensity of the haptic signal is characterized by at least one of the following: amplitude of signal waveform, type of signal waveform, and high or low signal frequency.
  • the feedback intensity of the haptic signal can be adjusted by setting at least one of the amplitude, type, and signal frequency of the signal waveform of the haptic signal. For example, the higher the signal frequency, the greater the feedback intensity, and the lower the signal frequency. , the smaller the feedback intensity; the larger the amplitude, the greater the feedback intensity, and the smaller the amplitude, the smaller the feedback intensity.
  • the type of the signal waveform includes at least one of the following: pulse wave, square wave, triangle wave, rectangular wave, sawtooth wave. Among them, when the amplitude and frequency are equal, the feedback intensity of square wave and rectangular wave is relatively small, and the feedback intensity of pulse wave, triangle wave and sawtooth wave is relatively large.
  • the tactile signal For example, if you need to design a tactile signal with relatively large feedback intensity, you can set the tactile signal as a high-frequency pulse wave. For example, if you need to design a tactile signal with relatively small feedback intensity, you can set the tactile signal as a low-frequency square wave.
  • the feedback strength of the haptic signal By setting the feedback strength of the haptic signal from the three dimensions of the amplitude, type and signal frequency of the signal waveform, it is beneficial to ensure that the feedback strength of the haptic feedback is set more delicately.
  • the waveforms of the signals corresponding to the haptic feedback are not limited to the above-mentioned waveforms, but can be a combination of the above-mentioned basic waveforms, or a conversion of the above-mentioned waveforms, such as generating
  • the tactile feedback is simulated to generate the corresponding waveform.
  • GUI controls are exemplified below through several embodiments, but the methods in the embodiments shown in the present disclosure are not limited to the following types of GUI controls, and the shape features of the GUI controls are not limited to the following implementations case shown in the example.
  • the type of the GUI control includes at least one of the following: a button, a knob, and a progress bar.
  • Fig. 1 is a schematic diagram of a GUI control according to an embodiment of the present disclosure.
  • the GUI control is a button control with a rectangular shape
  • the GUI control includes an edge area and a center area
  • the feedback intensity corresponding to the edge area is greater than that corresponding to the center area. the strength of the feedback.
  • the feedback intensity of the edge area and the central area can be set to be different, for example, the feedback intensity corresponding to the edge area is relatively large, and the feedback intensity corresponding to the central area is relatively small.
  • a relatively sharp pulse signal is generated as tactile feedback; when it is determined that the operating position is located in the central area, a relatively thick square wave signal is generated as tactile feedback.
  • the user touches the edge area of the GUI control he can feel a relatively sharp vibration, and then can move his finger to the inner area as required, so as to accurately perform the desired touch operation, such as long pressing the inner area.
  • boundary line between the areas shown in Figure 1 is only to distinguish the two areas.
  • the tactile feedback in different areas is still different, which is beneficial to ensure beautiful visual effects.
  • Fig. 2 is a schematic diagram of another GUI control according to an embodiment of the present disclosure.
  • the GUI control is a knob control with a circular shape
  • the GUI control includes line segments extending in multiple directions, for example, in a circular area, it may be equivalent to the radius
  • the multiple line segments include at least one line segment of the first type and at least one line segment of the second type, and the feedback intensity corresponding to the line segment of the first type is greater than the feedback intensity corresponding to the line segment of the second type.
  • the circular GUI control shown in Figure 2 can be used as a knob control. Users can use their fingers to perform touch operations in the GUI control in a clockwise direction, or in a counterclockwise direction. During the process, multiple line segments can be passed through. Therefore, in this embodiment, by setting different types of line segments and setting different feedback intensities for different types of line segments, the user can relatively accurately determine the rotation process according to the tactile feedback during the touch operation. Angle.
  • a Cartesian coordinate system in order to determine the touch position of the touch operation, can be established with the center of the circle as the origin in the GUI control shown in FIG.
  • the direction is the positive direction of the y-axis, and the symbols of the x and y coordinates in different quadrants are determined according to the function arctan2(y,x), and the angle range is (- ⁇ , ⁇ ].
  • a line segment can be set every 10°, wherein a first-type line segment is set every 30°, and two second-type line segments are set between every two first-type line segments.
  • the finger will continuously pass through the first type of line segment and the second type of line segment.
  • the feedback intensity corresponding to the first type of line segment to be greater than the feedback intensity corresponding to the second type of line segment, the user's finger can feel different intensities of tactile feedback when passing the first type of line segment and the second type of line segment.
  • the first type of line segment corresponds to the high gear
  • the second type of line segment corresponds to the low gear.
  • the finger passes through the first type of line segment, it can produce vibration with a relatively strong sense of frustration
  • the finger passes through the second type of line segment, it can produce vibration with a relatively moderate sense of frustration.
  • the user can intuitively feel the change of the gear position during the operation process when operating the GUI control, which is convenient for controlling the operation range.
  • the user knows that the first type of line segment and the second type of line segment are distributed as shown in Figure 2.
  • the included angles between adjacent line segments are the same, and there is a first-type line segment every preset number of second-type line segments.
  • the line segments therein are symmetrically distributed in the center, and the first type line segment and the line segment are set according to a fixed rule.
  • the second type of line segment enables the user to feel the same tactile feedback when performing an operation of the same magnitude (for example, through the same angle) at any position in the GUI control, so that the rule of determining the operation range according to the tactile feedback at any position is the same. are the same, and the user does not need to distinguish the operating position.
  • the width of the first type of line segment is greater than the width of the second type of line segment.
  • the line segments may be densely distributed in the GUI control, the user usually passes through multiple line segments during one operation, and the vibration feedback of the GUI control at the corresponding positions of the first type line segment and the second type line segment is different, but it can generate The vibration of is still very limited, which may make it difficult for the user to accurately distinguish between the first type of line segment and the second type of line segment when the user's finger passes through multiple line segments.
  • the width of the first type of line segment is greater than the width of the second type of line segment, such as shown in Figure 2, when the user's finger passes through the first type of line segment and the second type of line segment at a fixed speed, the process of passing through the first type of line segment A relatively strong vibration can be felt within a relatively long period of time, which is beneficial to ensure that the user can accurately distinguish the first type of line segment from the second type of line segment according to the tactile feedback.
  • the line segments shown in Figure 2 are only to express the relationship between different types of line segments.
  • the tactile feedback of the position is still varied, which is good for good looking visuals.
  • the distribution and types of line segments are not limited to the situation shown in Figure 2, and can be set according to needs, for example, three or more types of line segments can be set, and the tactile feedback corresponding to each type of line segment is different, for example, every Three second-type line segments are provided with one second-type line segment, for example, the included angle between every two line segments may also be different.
  • Fig. 3 is a schematic diagram of another GUI control according to an embodiment of the present disclosure.
  • the GUI control is a progress bar control
  • the shape feature is a bar shape.
  • the GUI control includes a plurality of intersection lines intersecting with the length direction of the GUI control. The feedback strengths corresponding to the intersection lines change gradually along the length direction of the GUI control.
  • the bar-shaped GUI control shown in FIG. 3 can be used to adjust functions, such as adjusting volume, adjusting brightness, adjusting temperature, etc., and the user can drag the slider to implement the operation.
  • functions such as adjusting volume, adjusting brightness, adjusting temperature, etc.
  • the user can drag the slider to implement the operation.
  • the feedback strengths corresponding to the multiple intersection lines can gradually change along the length direction of the GUI control (for example, step by step)
  • the user can feel the gradual change of the tactile feedback during the operation of dragging the slider, which is convenient for the user to use according to the tactile
  • the feedback strength of the feedback accurately determines the magnitude of the operation.
  • the slider moves from left to right to increase the volume, and from right to left to decrease the volume, then you can set the feedback intensity corresponding to the intersection line to gradually increase from left to right, then the user drags the slider from left to right During the adjustment process, the user can feel the gradually increasing feedback intensity when passing the intersection line; on the contrary, when the user drags the slider from right to left to adjust, the user can feel the gradually weakening feedback intensity when passing the intersection line. Accordingly, the user can accurately determine the magnitude of dragging the slider according to the change of the feedback intensity, which is conducive to accurately grasping the operation precision.
  • intersection line shown in Figure 3 is only to express the positional relationship of the intersection line inside the GUI control.
  • the GUI control is visually a line, and the slider is a dot on the line; the number of intersecting lines in the GUI control is not limited to that shown in FIG. In the case shown in 3, the number of intersection lines can be increased or decreased as required.
  • the processor is further configured to generate at least one of the following feedbacks according to the operational attribute information: auditory feedback, olfactory feedback, and gustatory feedback.
  • other sensory feedback such as auditory feedback, olfactory feedback, and gustatory feedback, may also be generated on the basis of the tactile feedback generated according to the user's touch operation on the GUI control.
  • auditory feedback can also be generated, for example A "click, click" sound can be generated, and the frequency of the sound is related to the speed of the user's operation, for example, the faster the user turns counterclockwise, the higher the frequency of the sound.
  • the user's operation experience can be enriched from the sense of touch, but also the user's operation experience can be enriched from other senses, which is beneficial to improve the effect of guiding the user's operation.
  • the present disclosure also proposes embodiments of an operation feedback method.
  • Fig. 4 is a schematic flowchart of an operation feedback method according to an embodiment of the present disclosure.
  • the operation feedback method shown in this embodiment can be applied to a display panel, the display panel has a touch function, can receive a user's touch operation, and generate tactile feedback for the touch operation, for example, the display panel can display GUI controls, and the user can Touch operations, such as clicking and sliding, can be performed on the GUI controls, and the display panel can generate tactile feedback for the touch operations performed by the user on the GUI controls.
  • the display panel can be applied to electronic devices with a display function, and the types of electronic devices are not limited to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, central control devices, and the like.
  • the application scenarios are not limited to smart transportation, smart furniture, smart wear, smart finance, etc.
  • the operation feedback method includes the following steps:
  • step S401 determine the operation attribute information of the user's touch operation on the GUI control displayed on the display screen, the operation attribute information includes at least one of the following: the type of the GUI control, the touch operation in the The operation position of the area where the GUI control is located, the operation type of the touch operation;
  • step S402 generate tactile feedback according to the operation attribute information.
  • the operation attribute information of the touch operation can be determined, such as the type of the GUI control operated, the operating position of the touch operation in the area where the GUI control is located, The operation type of the touch operation.
  • the type of GUI control includes at least one of the following: button, knob, and progress bar;
  • the operation type includes at least one of the following: click, double-click, long press (can be further divided into light press and heavy press), slide, zoom.
  • the operation attribute information includes the type and operation position of the GUI control
  • different GUI control types may correspond to different tactile feedback sets
  • the tactile feedback set may include a plurality of tactile feedback corresponding to the operation position, so that when determining After the type of GUI space is operated, the operation position can be further determined, and the corresponding tactile feedback can be determined in the tactile feedback set according to the operation position.
  • the corresponding tactile feedback set includes two elements: one element is a sharp vibration feedback, and the corresponding position is the edge area of the corresponding area of the GUI control; the other element is a thick vibration feedback, and the corresponding position is It is the central area of the corresponding area of the GUI control.
  • the operation position of the touch operation can be determined, for example, the operation position is located in the edge area of the corresponding area of the GUI control , can generate sharp vibration feedback, for example, if the operating position is located in the center of the corresponding area of the GUI control, thick vibration feedback can be generated.
  • the operation attribute information includes an operation position and an operation type
  • different operation positions may correspond to different tactile feedback sets
  • the tactile feedback set may include a plurality of tactile feedbacks corresponding to the operation type, so that the touch operation After the operation position, the operation type can be further determined, and the corresponding tactile feedback can be determined in the tactile feedback set according to the operation type.
  • the operation position is the central area of the GUI control
  • the corresponding tactile feedback itself includes two elements: one element is low-frequency vibration feedback, and the corresponding operation type is tap; the other element is high-frequency vibration feedback, and the corresponding operation Type is heavy press.
  • the operation type of the touch operation can be determined.
  • the operation type is a tap, which can generate low frequency Vibration feedback, for example, if the operation type is heavy pressing, it can generate high-frequency vibration feedback.
  • combination of operation attribute information is not limited to the cases shown in the above two embodiments, and the combination of operation attribute information can be set as required, for example, it can include the type of GUI control, operation position and operation type.
  • the following embodiments mainly illustrate the technical solution of the present disclosure under the condition that the operation attribute information includes the operation position.
  • the shape feature of the GUI control can be set as required, for example, it can be held, circled, or bar-shaped.
  • the same type of GUI controls may have different or the same shape features, and different types of GUI controls may have different or the same shape features.
  • the following embodiments mainly illustrate the technical solution of the present disclosure under the condition that the shape feature of the button-type GUI control is a rectangle, the shape feature of the knob-type GUI control is a circle, and the shape feature of the progress bar GUI control is a bar.
  • the corresponding relationship between the type of the GUI control and the shape feature can also be adjusted as required.
  • the area where the GUI control is located may be divided, and corresponding tactile feedback is generated according to the area where the operation position is located.
  • the manners of dividing regions for GUI controls of different shapes may be different or the same.
  • the shape feature of the GUI control includes at least one of the following: rectangle, circle, and bar.
  • the GUI control can be divided into two parts: the edge area and the center area.
  • the edge area is the four sides of the GUI control, 2/5 of the width and side length.
  • the part of the GUI control except the edge area is The central area, that is, the edge area is a rectangular frame, and the central area is a square inside the edge area.
  • the way of generating vibration of the display panel includes but not limited to frictional electrostatic vibration, driving of a vibration device, vibration of a piezoelectric sheet, and the like.
  • GUI controls when the user performs a touch operation on the GUI control, he touches different types of GUI controls, touches different positions of the GUI control, and performs different types of operations on the GUI control, which enriches the user's control over the GUI control.
  • the operating tactile experience can also effectively guide the user's touch operation for GUI controls based on different tactile feedback.
  • the display panel is applied to a vehicle-mounted device. Since the screen of the vehicle-mounted device is generally larger than that of a terminal such as a mobile phone, the size of the GUI controls displayed therein is also relatively large to facilitate operations by the user. However, when the user is driving, he needs to keep his eyes on the front of the vehicle. When operating the GUI control, it is inconvenient to see the specific position of the finger in the GUI control. Generally, he can only guess the degree of operation of the GUI control based on memory, for example When the user drags the slider in the GUI control to adjust the volume of the player, the degree of dragging the slider cannot be accurately determined, which leads to the inability to accurately adjust the volume. This may cause invalid operations or even Incorrect operation affects user experience.
  • a user when a user performs a touch operation on a GUI control, different tactile feedbacks can be generated for the user according to different operating positions, so that the user can determine the correct position according to the tactile feedback when performing a touch operation on the GUI control.
  • the degree of manipulation of the GUI controls for accurate manipulation.
  • the GUI control requires the user to press and hold to perform the corresponding operation in the central area.
  • the GUI control requires the user to press and hold to perform the corresponding operation in the central area.
  • the user when the user touches the edge of the GUI control, the user can determine the finger according to the sharp vibration. After touching the edge of the GUI control, you can move your finger to the central area. After touching the central area, you can determine that the finger is located in the central area according to the thick vibration, and then you can perform a long press operation. It can be seen that setting the GUI control to generate corresponding tactile feedback according to the user's operation position can effectively guide the user to operate, so that the user can accurately complete the touch operation by relying on the tactile feedback even without viewing the GUI control.
  • tactile feedback uses vibration feedback as an example.
  • tactile feedback can also be generated in other ways as needed.
  • the tactile feedback can be temperature feedback, so for different operations Attribute information can make users feel different temperature feedback.
  • Fig. 5 is a schematic flowchart of another operation feedback method according to an embodiment of the present disclosure. As shown in FIG. 5, the generating tactile feedback according to the operation attribute information includes:
  • step S501 determine the tactile feedback intensity corresponding to the operation attribute information
  • step S502 a tactile signal corresponding to the intensity of the tactile feedback is generated.
  • different feedback intensities can be preset for different operation attribute information, and then after determining the operation attribute information of the user's touch operation, the feedback intensity can be quickly determined according to the operation attribute information, and according to the determined feedback intensity Generate haptic signals.
  • the feedback intensity of the haptic signal is characterized by at least one of the following: amplitude of signal waveform, type of signal waveform, and high or low signal frequency.
  • the feedback intensity of the haptic signal can be adjusted by setting at least one of the amplitude, type, and signal frequency of the signal waveform of the haptic signal. For example, the higher the signal frequency, the greater the feedback intensity, and the lower the signal frequency. , the smaller the feedback intensity; the larger the amplitude, the greater the feedback intensity, and the smaller the amplitude, the smaller the feedback intensity.
  • the type of the signal waveform includes at least one of the following: pulse wave, square wave, triangle wave, rectangular wave, sawtooth wave. Among them, when the amplitude and frequency are equal, the feedback intensity of square wave and rectangular wave is relatively small, and the feedback intensity of pulse wave, triangle wave and sawtooth wave is relatively large.
  • the tactile signal For example, if you need to design a tactile signal with relatively large feedback intensity, you can set the tactile signal as a high-frequency pulse wave. For example, if you need to design a tactile signal with relatively small feedback intensity, you can set the tactile signal as a low-frequency square wave.
  • the feedback strength of the haptic signal By setting the feedback strength of the haptic signal from the three dimensions of the amplitude, type and signal frequency of the signal waveform, it is beneficial to ensure that the feedback strength of the haptic feedback is set more delicately.
  • the waveforms of the signals corresponding to the haptic feedback are not limited to the above-mentioned waveforms, but can be a combination of the above-mentioned basic waveforms, or a conversion of the above-mentioned waveforms, such as generating
  • the tactile feedback is simulated to generate the corresponding waveform.
  • GUI controls are exemplified below through several embodiments, but the methods in the embodiments shown in the present disclosure are not limited to the following types of GUI controls, and the shape features of the GUI controls are not limited to the following implementations case shown in the example.
  • the type of the GUI control includes at least one of the following: a button, a knob, and a progress bar.
  • Fig. 1 is a schematic diagram of a GUI control according to an embodiment of the present disclosure.
  • the GUI control is a button control with a rectangular shape
  • the GUI control includes an edge area and a center area
  • the feedback intensity corresponding to the edge area is greater than that corresponding to the center area. the strength of the feedback.
  • the feedback intensity of the edge area and the central area can be set to be different, for example, the feedback intensity corresponding to the edge area is relatively large, and the feedback intensity corresponding to the central area is relatively small.
  • a relatively sharp pulse signal is generated as tactile feedback; when it is determined that the operating position is located in the central area, a relatively thick square wave signal is generated as tactile feedback.
  • the user touches the edge area of the GUI control he can feel a relatively sharp vibration, and then can move his finger to the inner area as required, so as to accurately perform the desired touch operation, such as long pressing the inner area.
  • boundary line between the areas shown in Figure 1 is only to distinguish the two areas.
  • the tactile feedback in different areas is still different, which is beneficial to ensure beautiful visual effects.
  • Fig. 2 is a schematic diagram of another GUI control according to an embodiment of the present disclosure.
  • the knob control of the GUI control has a circular shape, and the GUI control includes line segments extending in multiple directions, for example, in a circular area, it may be equal to the radius
  • the multiple line segments include at least one line segment of the first type and at least one line segment of the second type, and the feedback intensity corresponding to the line segment of the first type is greater than the feedback intensity corresponding to the line segment of the second type.
  • the circular GUI control shown in Figure 2 can be used as a knob control. Users can use their fingers to perform touch operations in the GUI control in a clockwise direction, or in a counterclockwise direction. During the process, multiple line segments can be passed through. Therefore, in this embodiment, by setting different types of line segments and setting different feedback intensities for different types of line segments, the user can relatively accurately determine the rotation process according to the tactile feedback during the touch operation. Angle.
  • a Cartesian coordinate system in order to determine the touch position of the touch operation, can be established with the center of the circle as the origin in the GUI control shown in FIG.
  • the direction is the positive direction of the y-axis, and the symbols of the x and y coordinates in different quadrants are determined according to the function arctan2(y,x), and the angle range is (- ⁇ , ⁇ ].
  • a line segment can be set every 10°, wherein a first-type line segment is set every 30°, and two second-type line segments are set between every two first-type line segments.
  • the finger will continuously pass through the first type of line segment and the second type of line segment.
  • the feedback intensity corresponding to the first type of line segment to be greater than the feedback intensity corresponding to the second type of line segment, the user's finger can feel different intensities of tactile feedback when passing the first type of line segment and the second type of line segment.
  • the first type of line segment corresponds to the high gear
  • the second type of line segment corresponds to the low gear.
  • the finger passes through the first type of line segment, it can produce vibration with a relatively strong sense of frustration
  • the finger passes through the second type of line segment, it can produce vibration with a relatively moderate sense of frustration.
  • the user can intuitively feel the change of the gear position during the operation process when operating the GUI control, which is convenient for controlling the operation range.
  • the user knows that the first type of line segment and the second type of line segment are distributed as shown in Figure 2.
  • the included angles between adjacent line segments are the same, and there is a first-type line segment every preset number of second-type line segments.
  • the line segments therein are symmetrically distributed in the center, and the first type line segment and the line segment are set according to a fixed rule.
  • the second type of line segment enables the user to feel the same tactile feedback when performing an operation of the same magnitude (for example, through the same angle) at any position in the GUI control, so that the rule of determining the operation range according to the tactile feedback at any position is the same. are the same, and the user does not need to distinguish the operating position.
  • the width of the first type of line segment is greater than the width of the second type of line segment.
  • the line segments may be densely distributed in the GUI control, the user usually passes through multiple line segments during one operation, and the vibration feedback of the GUI control at the corresponding positions of the first type line segment and the second type line segment is different, but it can generate The vibration of is still very limited, which may make it difficult for the user to accurately distinguish between the first type of line segment and the second type of line segment when the user's finger passes through multiple line segments.
  • the width of the first type of line segment is greater than the width of the second type of line segment, such as shown in Figure 2, when the user's finger passes through the first type of line segment and the second type of line segment at a fixed speed, the process of passing through the first type of line segment A relatively strong vibration can be felt within a relatively long period of time, which is beneficial to ensure that the user can accurately distinguish the first type of line segment from the second type of line segment according to the tactile feedback.
  • the line segments shown in Figure 2 are only to express the relationship between different types of line segments.
  • the tactile feedback of the position is still varied, which is good for good looking visuals.
  • the distribution and types of line segments are not limited to the situation shown in Figure 2, and can be set according to needs, for example, three or more types of line segments can be set, and the tactile feedback corresponding to each type of line segment is different, for example, every Three second-type line segments are provided with one second-type line segment, for example, the included angle between every two line segments may also be different.
  • Fig. 3 is a schematic diagram of another GUI control according to an embodiment of the present disclosure.
  • the GUI control is a progress bar control
  • the shape feature is a bar shape.
  • the GUI control includes a plurality of intersection lines intersecting with the length direction of the GUI control. The feedback strengths corresponding to the intersection lines change gradually along the length direction of the GUI control.
  • the bar-shaped GUI control shown in FIG. 3 can be used to adjust functions, such as adjusting volume, adjusting brightness, adjusting temperature, etc., and the user can drag the slider to implement the operation.
  • functions such as adjusting volume, adjusting brightness, adjusting temperature, etc.
  • the user can drag the slider to implement the operation.
  • the feedback strengths corresponding to the multiple intersection lines can gradually change along the length direction of the GUI control (for example, step by step)
  • the user can feel the gradual change of the tactile feedback during the operation of dragging the slider, which is convenient for the user to use according to the tactile
  • the feedback strength of the feedback accurately determines the magnitude of the operation.
  • the slider moves from left to right to increase the volume, and from right to left to decrease the volume, then you can set the feedback intensity corresponding to the intersection line to gradually increase from left to right, then the user drags the slider from left to right During the adjustment process, you can feel the gradually increasing feedback intensity when passing the intersection line; on the contrary, when the user drags the slider from right to left to adjust, you can feel the gradually weakening feedback intensity when passing the intersection line. Accordingly, the user can accurately determine the magnitude of dragging the slider according to the change of the feedback intensity, which is conducive to accurately grasping the operation precision.
  • intersection line shown in Figure 3 is only to express the positional relationship of the intersection line inside the GUI control.
  • the GUI control is visually a line, and the slider is a dot on the line; the number of intersecting lines in the GUI control is not limited to that shown in FIG. In the case shown in 3, the number of intersection lines can be increased or decreased as required.
  • Embodiments of the present disclosure also provide an electronic device, including a processor and a memory for storing instructions executable by the processor.
  • the processor is configured to implement the operation feedback method described in any one of the above embodiments.
  • Embodiments of the present disclosure also provide a non-volatile computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the steps in the operation feedback method described in any of the above-mentioned embodiments are implemented.
  • Fig. 6 is a schematic block diagram of an apparatus 600 for operation feedback according to an embodiment of the present disclosure.
  • the apparatus 600 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
  • device 600 may include one or more of the following components: processing component 602, memory 604, power supply component 606, multimedia component 608, audio component 610, input/output (I/O) interface 612, sensor component 614, and communication component 616 .
  • the processing component 602 generally controls the overall operations of the device 600, such as those associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the above method.
  • processing component 602 may include one or more modules that facilitate interaction between processing component 602 and other components.
  • processing component 602 may include a multimedia module to facilitate interaction between multimedia component 608 and processing component 602 .
  • the memory 604 is configured to store various types of data to support operations at the device 600 . Examples of such data include instructions for any application or method operating on device 600, contact data, phonebook data, messages, pictures, videos, and the like.
  • the memory 604 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic or Optical Disk Magnetic Disk
  • the power supply component 606 provides power to various components of the device 600 .
  • Power components 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for device 600 .
  • the multimedia component 608 includes a screen that provides an output interface between the device 600 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user.
  • the touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense a boundary of a touch or swipe action, but also detect duration and pressure associated with the touch or swipe action.
  • the multimedia component 608 includes a front camera and/or a rear camera. When the device 600 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capability.
  • the audio component 610 is configured to output and/or input audio signals.
  • the audio component 610 includes a microphone (MIC) configured to receive external audio signals when the device 600 is in operation modes, such as call mode, recording mode and voice recognition mode. Received audio signals may be further stored in memory 604 or sent via communication component 616 .
  • the audio component 610 also includes a speaker for outputting audio signals.
  • the I/O interface 612 provides an interface between the processing component 602 and a peripheral interface module.
  • the peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: a home button, volume buttons, start button, and lock button.
  • Sensor assembly 614 includes one or more sensors for providing status assessments of various aspects of device 600 .
  • the sensor component 614 can detect the open/closed state of the device 600, the relative positioning of components, such as the display and keypad of the device 600, and the sensor component 614 can also detect a change in the position of the device 600 or a component of the device 600 , the presence or absence of user contact with the device 600 , the device 600 orientation or acceleration/deceleration and the temperature change of the device 600 .
  • the sensor assembly 614 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact.
  • Sensor assembly 614 may also include optical sensors, such as CMOS or CCD image sensors, for use in imaging applications.
  • the sensor component 614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor or a temperature sensor.
  • the communication component 616 is configured to facilitate wired or wireless communication between the apparatus 600 and other devices.
  • the device 600 can access wireless networks based on communication standards, such as WiFi, 2G or 3G, 4G LTE, 5G NR or a combination thereof.
  • the communication component 616 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wide Band
  • Bluetooth Bluetooth
  • apparatus 600 may be programmed by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation for performing the methods described above.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor or other electronic component implementation for performing the methods described above.
  • non-transitory computer-readable storage medium including instructions, such as the memory 604 including instructions, which can be executed by the processor 620 of the device 600 to implement the above method.
  • the non-transitory computer readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.
  • first and second are used for descriptive purposes only, and should not be understood as indicating or implying relative importance.
  • plurality means two or more, unless otherwise clearly defined.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开涉及显示系统、操作反馈方法、电子设备和存储介质。根据本公开的一个示例，所述显示系统包括配置为显示GUI控件的显示屏和处理器。其中，所述处理器配置为：确定用户在显示屏上对显示有所述GUI控件的触控操作的操作属性信息；根据所述操作属性信息生成触觉反馈。这样，当用户对GUI控件进行触控操作时，在接触到不同类型的GUI控件、接触到GUI控件的不同位置、对GUI控件执行不同类型的操作，可以感受到不同的触觉反馈，丰富了用户对GUI控件进行操作触觉体验，还可以基于不同的触觉反馈对用户在针对GUI控件的触控操作进行有效引导。

Description

显示系统、操作反馈方法、电子设备和存储介质
本申请基于一个中国专利申请提出，对应的申请号为202110825871.7，申请日为2021年07月21日。并要求上述中国专利申请的优先权，上述中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本公开涉及显示技术领域，尤其涉及显示系统、触觉反馈方法、电子设备和非易失性计算机可读存储介质。
背景技术
在显示设备中可以设置GUI(Graphical User Interface，图形用户界面)控件，以供用户触控。例如目前在手机、车载显示设备、智能电视、中控显示设备等不同应用场景的显示设备屏幕上都可以显示GUI控件，用户通过对GUI控件进行触控操作，来实现相应的类型。
用户对GUI控件进行触控操作时，有些GUI控件可以产生反馈，例如用户点击屏幕中的应用图标时，至少在点击位置即时产生振动反馈，以表示点击有效。
发明内容
本公开提供显示系统、触觉反馈方法、电子设备和非易失性计算机可读存储介质。
根据本公开实施例第一方面，提出一种显示系统，包括配置为显示GUI控件的显示屏和处理器；所述处理器配置为：确定用户在显示屏上对显示有所述GUI控件的触控操作的操作属性信息，所述操作属性信息包括以下至少之一：所述GUI控件的类型、所述触控操作在所述GUI控件所在区域的操作位置、所述触控操作的操作类型；根据所述操作属性信息生成触觉反馈。
在一个实施例中，所述处理器还配置为：确定所述操作属性信息对应的触觉反馈强度；生成与所述触觉反馈强度对应的触觉信号。
在一个实施例中，所述触觉信号的反馈强度通过以下至少一项表征：信号波形的振幅、信号波形的类型、信号频率的高低。
在一个实施例中，所述信号波形的类型包括以下至少之一：脉冲波、方波、三角波、矩形波、锯齿波。
在一个实施例中，所述GUI控件的类型包括以下至少之一：按钮、旋钮、进度条。
在一个实施例中，所述GUI控件的类型包括按钮，所述GUI控件包括边缘区域和中心区域，所述边缘区域对应的反馈强度大于所述中心区域对应的反馈强度。
在一个实施例中，所述GUI控件的类型包括旋钮，所述GUI控件包括朝着多个方向延伸的线段，多个所述线段中包括至少一个第一类型线段和至少一个第二类型线段，所述第一类型线段对应的反馈强度大于所述第二类型线段对应的反馈强度。
在一个实施例中，相邻线段之间的夹角相同，且每隔预设数量的第二类型线段存在一个第一类型线段。
在一个实施例中，所述第一类型线段的宽度大于所述第二类型线段的宽度。
在一个实施例中，所述GUI控件的类型包括进度条，所述GUI控件包括多个与所述GUI控件长度方向相交的交线，多个所述交线分别对应的反馈强度沿着所述GUI控件长度方向渐变。
在一个实施例中，所述处理器还配置为根据所述操作属性信息生成以下至少一种反馈：听觉反馈、嗅觉反馈、味觉反馈。
根据本公开实施例第二方面，提出一种操作反馈方法，包括：确定用户在显示屏上对显示有GUI控件的触控操作的操作属性信息，所述操作属性信息包括以下至少之一：所述GUI控件的类型、所述触控操作在所述GUI控件所在区域的操作位置、所述触控操作的操作类型；根据所述操作属性信息生成触觉反馈。
在一个实施例中，所述根据所述操作属性信息生成触觉反馈包括：确定所述操作属性信息对应的触觉反馈强度；生成与所述触觉反馈强度对应的触觉信号。
在一个实施例中，所述GUI控件的类型包括以下至少之一：按钮、旋钮、进度条。
在一个实施例中，所述GUI控件的类型包括按钮，所述GUI控件包括边缘区域和中心区域，所述边缘区域对应的反馈强度大于所述中心区域对应的反馈强度。
在一个实施例中，所述GUI控件的类型包括旋钮，所述GUI控件包括朝着多 个方向延伸的线段，多个所述线段中包括至少一个第一类型线段和至少一个第二类型线段，所述第一类型线段对应的反馈强度大于所述第二类型线段对应的反馈强度。
在一个实施例中，相邻线段之间的夹角相同，且每隔预设数量的第二类型线段存在一个第一类型线段。
在一个实施例中，所述第一类型线段的宽度大于所述第二类型线段的宽度。
在一个实施例中，所述GUI控件的类型包括进度条，所述GUI控件包括多个与所述GUI控件长度方向相交的交线，多个所述交线分别对应的反馈强度沿着所述GUI控件长度方向渐变。
根据本公开实施例第三方面，提出一种电子设备，包括处理器和用于存储处理器可执行指令的存储器；其中，所述处理器被配置为实现上述方法。
根据本公开实施例第四方面，提出一种非易失性计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述任一项所述的方法中的步骤。
根据本公开的实施例，当用户对GUI控件进行触控操作时，在接触到不同类型的GUI控件、接触到GUI控件的不同位置、对GUI控件执行不同类型的操作，可以感受到不同的触觉反馈，丰富了用户对GUI控件进行操作触觉体验，还可以基于不同的触觉反馈对用户在针对GUI控件的触控操作进行有效引导。
应当理解的是，以上的一般描述和后文的细节描述仅是用于说明本发明核心发明构思的有限的示例和解释，并不能限制本公开。
附图说明
图1是根据本公开的实施例示出的一种GUI控件的示意图。
图2是根据本公开的实施例示出的另一种GUI控件的示意图。
图3是根据本公开的实施例示出的又一种GUI控件的示意图。
图4是根据本公开实施例示出的一种操作反馈方法的示意流程图。
图5是根据本公开实施例示出的另一种操作反馈方法的示意流程图。
图6是根据本公开的实施例示出的一种用于触觉反馈的装置的示意框图。
具体实施方式
这里将详细地对示例性实施例进行说明，其示例表示在附图中。下面的描述涉及附图时，除非另有表示，不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本公开相一致的所有实施方式。相反，它们仅是与如所附权利要求书中所详述的、本公开的一些方面相一致的装置和方法的例子。
本公开的实施例提出了一种显示系统，所述操作系统包括配置为显示GUI控件的显示屏和处理器。本实施例所示的显示系统可以应用于显示面板，所述显示面板具有触控功能，可以接收用户的触控操作，并针对触控操作生成触觉反馈，例如显示面板可以显示GUI控件，用户可以对GUI控件进行触控操作，例如点击、滑动等操作，显示面板可以针对用户对GUI控件进行的触控操作生成触觉反馈。
所述显示面板可以应用于具有显示功能的电子设备，电子设备的类型可不限于手机、平板电脑、穿戴设备、车载设备、中控设备等。应用场景不限于，智能交通、智能家具、智能穿戴、智慧金融等。
在一个实施例中，所述处理器配置为：确定用户在显示屏上对显示有所述GUI控件的触控操作的操作属性信息，所述操作属性信息包括以下至少之一：所述GUI控件的类型、所述触控操作在所述GUI控件所在区域的操作位置、所述触控操作的操作类型；根据所述操作属性信息生成触觉反馈。
在一个实施例中，在感应到用户对GUI控件的触控操作时，可以确定触控操作的操作属性信息，例如所操作的GUI控件的类型、触控操作在GUI控件所在区域的操作位置、触控操作的操作类型。其中，GUI控件的类型包括以下至少之一：按钮、旋钮、进度条；操作类型包括以下至少之一：点击、双击、长按(还可以进一步划分为轻按和重按)、滑动、缩放。
在一个实施例中，例如操作属性信息包括GUI控件的类型和操作位置，不同的GUI控件类型可以对应不同的触觉反馈集合，触觉反馈集合可以包括多个与操作位置对应的触觉反馈，从而在确定所操作的GUI空间的类型后，可以进一步确定操作位置，并根据操作位置在触觉反馈集合中确定对应的触觉反馈。
例如GUI控件的类型为按钮，对应的触觉反馈集合包括两个元素：一个元素为锐利的振动反馈，对应的位置为GUI控件对应区域的边缘区域；另一个元素为厚重的振动反馈，对应的位置为GUI控件对应区域的中心区域。
在确定用户触控操作所操作的GUI控件类型为按钮时，可以确定对应的触觉反馈集合包括上述两个元素，进而可以确定触控操作的操作位置，例如操作位置位于GUI控件对应区域的边缘区域，可以生成锐利的振动反馈，例如操作位置位于GUI控件对应区域的中心区域，可以生成厚重的振动反馈。
在一个实施例中，例如操作属性信息包括操作位置和操作类型，不同的操作位置可以对应不同的触觉反馈集合，触觉反馈集合可以包括多个与操作类型对应的触觉反馈，从而在触控操作的操作位置后，可以进一步确定操作类型，并根据操作类型在触觉反馈集合中确定对应的触觉反馈。
例如操作位置为GUI控件的中心区域，对应的触觉反馈自己和包括两个元素：一个元素为低频的振动反馈，对应的操作类型为轻按；另一个元素为高频的振动反馈，对应的操作类型为重按。
在确定用户触控操作的操作位置位于GUI控件的中心区域时，可以确定对应的触觉反馈集合包括上述两个元素，进而可以确定触控操作的操作类型，例如操作类型为轻按，可以生成低频的振动反馈，例如操作类型为重按，可以生成高频的振动反馈。
需要说明的是，操作属性信息的组合并不限于上述两个实施例中所示的情况下，可以根据需要设置操作属性信息的组合，例如可以包括GUI控件的类型、操作位置和操作类型。
以下实施例主要在操作属性信息包括操作位置的情况下，对本公开的技术方案进行示例性说明。
在一个实施例中，GUI控件的形状特征可以根据需要设置，例如可以为举行、圆形、条形。同一种类型的GUI控件可以具有不同的形状特征，也可以具有相同的形状特征，不同类型的GUI控件可以具有不同的形状特征，也可以具有相同的形状特征。
以下实施例主要在按钮型GUI控件的形状特征为矩形、旋钮型GUI控件的形状特征为圆形、进度条GUI控件的形状特征为条形的情况下，对本公开的技术方案进行示例性说明，当然，也可根据需要调整GUI控件的类型和形状特征之间的对应关系。
在一个实施例中，可以对GUI控件所在的区域进行划分，根据操作位置所位于的区域，生成相应的触觉反馈。其中，针对不同形状的GUI控件划分区域的方式可以不同，也可以相同。在一个实施例中，所述GUI控件的形状特征包括以下至少之一：矩形、圆形、条形。
以正方形的按钮GUI控件为例，可以将GUI控件划分为两部分区域：边缘区域和中心区域，例如边缘区域为GUI控件的四条边，宽度边长的2/5，GUI控件中除了边缘区域的部分为中心区域，也即边缘区域为矩形框，中心区域为边缘区域内部的正方形。
可以设置在确定操作位置位于边缘区域时，生成锐利感相对较强的脉冲信号作为触觉反馈，在确定操作位置位于中心区域时，生成厚重感相对平稳的方波信号作为触觉反馈。需要说明的是，生成的信号可以使得显示面板在触觉上发生变化，例如引起显示面板在操作位置产生振动，当用户接触到边缘区域时，可以感受到锐利的相对较强的振动，当用户接触到中心区域时，可以感受到厚重的振动。其中，显示面板产生振动的方式包括但不限于摩擦静电振动、振动装置驱动、压电片振动等。
当然，也可以不对GUI控件划分区域，直接确定操作位置的坐标，进而根据操作位置所位于的坐标，生成相应的触觉反馈。
根据本公开的实施例，当用户对GUI控件进行触控操作时，在接触到不同类型的GUI控件、接触到GUI控件的不同位置、对GUI控件执行不同类型的操作，可以感受到不同的触觉反馈，丰富了用户对GUI控件进行操作触觉体验，还可以基于不同的触觉反馈对用户在针对GUI控件的触控操作进行有效引导。
例如所述显示面板应用于车载设备，由于车载设备的屏幕相对于手机等终端一般较大，其中显示的GUI控件的尺寸也相对较大，以便用户进行操作。但是在用户开车行驶过程中，目光需要保持关注车辆前方，在对GUI控件进行操作时，不方便去看手指在GUI控件中的具体位置，一般只能凭记忆推测对GUI控件的操作程度，例如用户在GUI控件中拖拽滑块调节播放器音量时，不能准确确定拖拽滑块的程度，进而导致不能准确调节音量，这会导致用户对GUI控件进行触控操作时，可能出现无效操作甚至误操作，影响用户体验。
根据本公开的实施例，用户在对GUI控件进行触控操作时，根据操作位置的不同，可以为用户生成不同的触觉反馈，便于用户在对GUI控件进行触控操作使，根据触觉反馈确定对GUI控件的操作程度，以便进行准确的操作。
例如用户需要对上述正方形GUI控件进行操作，GUI控件需要用户长按才会中心区域执行相应操作，根据本公开的实施例，用户在接触到GUI控件的边缘时，根据锐利的振动就可以确定手指接触到了GUI控件的边缘，然后可以将手指向中心区域移 动，接触到中心区域后，根据厚重的振动可以确定手指位于中心区域，进而可以进行长按操作。可见，设置GUI控件根据用户的操作位置生成相应的触觉反馈，可以有效地引导用户进行操作，使得用户即使在不观看GUI控件的情况下，也可以依靠触觉反馈准确地完成触控操作。
需要说明的是，以上触觉反馈是以振动反馈作为一种示例，除了振动这种反馈方式，也可以根据需要通过其他方式来生成触觉反馈，例如可以触觉反馈可以是温度反馈，那么针对不同的操作属性信息，可以使用户感受到不同的温度反馈。
在一个实施例中，所述处理器还配置为：确定所述操作属性信息对应的触觉反馈强度；生成与所述触觉反馈强度对应的触觉信号。
在一个实施例中，对于不同的操作属性信息可以预先设置不同的反馈强度，进而在确定用户触控操作的操作属性信息后，可以根据操作属性信息快速地确定反馈强度，并根据确定的反馈强度生成触觉信号。
在一个实施例中，所述触觉信号的反馈强度通过以下至少一项表征：信号波形的振幅、信号波形的类型、信号频率的高低。
在一个实施例中，可以通过设置触觉信号的信号波形的振幅、类型、信号频率的高低中至少之一来调整触觉信号的反馈强度，例如信号频率越高，反馈强度越大，信号频率越低，反馈强度越小；振幅越大，反馈强度越大，振幅越小，反馈强度越小。
在一个实施例中，所述信号波形的类型包括以下至少之一：脉冲波、方波、三角波、矩形波、锯齿波。其中，在幅度和频率相等的情况下，方波、矩形波的反馈强度相对较小，脉冲波、三角波、锯齿波的反馈强度相对较大。
例如需要设计反馈强度相对较大的触觉信号，可以设置触觉信号为高频的脉冲波，例如需要设计反馈强度相对较小的触觉信号，可以设置触觉信号为低频的方波。
通过从信号波形的幅度、类型和信号频率三个维度来设置触觉信号的反馈强度，有利于确保对触觉反馈的反馈强度设置的更加细腻。
需要说明的是，在实际使用过程中，触觉反馈对应信号的波形并不限于上述几种波形，可以是上述几种基础波形的结合，可以是对上述几种波形的转换，例如根据所需生成的触觉反馈来模拟生成相应的波形。
以下通过几个实施例对几种类型的GUI控件进行示例性说明，但是本公开所示 实施例中的方法，并不限于以下几种类型的GUI控件，GUI控件的形状特征也不限于以下实施例所示的情况。
在一个实施例中，所述GUI控件的类型包括以下至少之一：按钮、旋钮、进度条。
图1是根据本公开的实施例示出的一种GUI控件的示意图。
在一个实施例中，如图1所示，所述GUI控件为按钮控件，形状特征为矩形，所述GUI控件包括边缘区域和中心区域，所述边缘区域对应的反馈强度大于所述中心区域对应的反馈强度。
可以设置边缘区域和中心区域的反馈强度不同，例如边缘区域对应的反馈强度相对较大，中心区域对应的反馈强度相对较小。在确定操作位置位于边缘区域时，生成锐利感相对较强的脉冲信号作为触觉反馈，在确定操作位置位于中心区域时，生成厚重感相对平稳的方波信号作为触觉反馈。
从而使得用户在接触到GUI控件的边缘区域时，能够感受到相对锐利的振动，进而可以根据需要将手指移向内部区域，从而准确地进行所需的触控操作，例如长按内部区域。
需要说明的是，图1所示的区域之间的交界线只是为了区分两个区域，实际设计GUI控件时，GUI控件内部可以没有显示区域之间的交界线，视觉上是一片连通的区域，但是在不同区域的触觉反馈仍然有所不同，有利于保证美观的视觉效果。
图2是根据本公开的实施例示出的另一种GUI控件的示意图。
在一个实施例中，如图2所示，所述GUI控件为旋钮控件，形状特征为圆形，所述GUI控件包括朝着多个方向延伸的线段，例如在圆形区域中可以等同于半径，多个所述线段中包括至少一个第一类型线段和至少一个第二类型线段，所述第一类型线段对应的反馈强度大于所述第二类型线段对应的反馈强度。
图2所示的圆形GUI控件可以作为旋钮控件，用户可以通过手指在GUI控件内部沿着顺时针方向进行触控操作，也可以沿着逆时针方向进行触控操作，在进行触控操作的过程中，可以经过多个线段，因此本实施例通过设置不同类型的线段，并针对不同类型的线段设置不同的反馈强度，使得用户可以在触控操作过程中根据触觉反馈相对准确地确定旋转过的角度。
在一个实施例中，为了确定触控操作的触控位置，可在图2所示的GUI控件中以圆心为原点建立直角坐标系，水平向右的方向为x轴正方向，竖直向上的方向为y轴正方向，根据函数arctan2(y,x)确定不同象限内x和y坐标的符号，角度范围为(-π,π]。
例如图2所示，在360°范围内，可以每隔10°设置一个线段，其中每隔30°设置一个第一类型线段，每两个第一类型线段之间设置两个第二类型线段。
用户在GUI控件中无论沿着逆时针方向进行触控操作，还是沿着顺时针方向进行触控操作，手指都会连续经过第一类型线段和第二类型线段。本实施例通过设置第一类型线段对应的反馈强度大于所述第二类型线段对应的反馈强度，使得用户手指在经过第一类型线段和第二类型线段时，可以感受到不同强度的触觉反馈。
例如第一类型线段对应高档位、第二类型线段对应低档位，手指经过第一类型线段时，可以产生顿挫感相对强烈的振动，手指经过第二类型线段时，可以产生顿挫感相对缓和的振动，使得用户可以在对GUI控件进行操作时，直观地感受到操作过程中档位的变化，便于对操作幅度进行控制。例如用户已知第一类型线段和第二类型线段按照如图2所述的方式分布，在操作过程中，当感受到两次顿挫感较弱的振动，一次顿挫感较强的振动时，可以确定手指在GUI控件中转过了30°左右，即使用户不直接观看操作过程，也能够相对准确地掌握操作幅度。
在一个实施例中，相邻线段之间的夹角相同，且每隔预设数量的第二类型线段存在一个第一类型线段。
例如图2所示，每隔2个第二类型的线段存在1个第一类型的线段，由于GUI控件是圆形的，其中的线段是中心对称分布的，按照固定规律设置第一类型线段和第二类型线段，使得用户在GUI控件中的任意位置进行相同幅度(例如经过相同的角度)的操作时，感受到的触觉反馈可以是相同，从而在任意位置根据触觉反馈确定操作幅度的规律都是相同的，无需用户区分操作位置。
在一个实施例中，所述第一类型线段的宽度大于所述第二类型线段的宽度。
由于线段在GUI控件中分布可能较为密集，用户在一次操作过程中，手指一般经过多个线段，而且GUI控件在第一类型线段和第二类型线段对应位置的振动反馈虽然不同，但是所能产生的振动仍然非常有限，这可能导致用户手指经过多个线段时，难以准确地区分经过的第一类型线段和第二类型线段。
通过设置第一类型线段的宽度大于第二类型线段的宽度，例如图2所示，使得 用户手指在以固定速度经过第一类型线段时和第二类型线段时，在经过第一类型线段的过程中可以在相对较长的时间内感受到相对强烈的振动，有利于确保用户能够根据触觉反馈准确地区分第一类型线段和第二类型线段。
需要说明的是，图2所示的线段只是为了表达不同类型线段之间的关系，实际设计GUI控件时，GUI控件内部可以没有显示线段，视觉上是一片连通的区域，但是在不同类型的线段位置的触觉反馈仍然有所不同，有利于保证美观的视觉效果。并且线段的分布和类型也不限于图2所示的情况，可以根据需要进行设置，例如可以设置3种或3种以上类型的线段，每种类型的线段对应的触觉反馈不同，例如可以每隔3个第二类型线段设置1个第二类型线段，例如每两个线段之间的夹角也可以不同。
图3是根据本公开的实施例示出的又一种GUI控件的示意图。
在一个实施例中，如图3所示，所述GUI控件为进度条控件，形状特征为条形，所述GUI控件包括多个与所述GUI控件长度方向相交的交线，多个所述交线分别对应的反馈强度沿着所述GUI控件长度方向渐变。
在一个实施例中，图3所示的条形GUI控件可以用于调节功能，例如调节音量、调节亮度、调节温度等，用户可以拖动滑块实现操作。通过设置多个交线分别对应的反馈强度沿着所述GUI控件长度方向渐变(例如逐级变化)，使得用户在拖动滑块操作过程中，能够感受到触觉反馈的渐变，便于用户根据触觉反馈的反馈强度准确地确定操作幅度。
例如滑块在GUI控件中从左到右为提高音量，从右到左为降低音量，那么可以设置交线对应的反馈强度从左到右逐渐加强，那么用户在拖动滑块从左到右调节的过程中，经过交线时就可以感受到逐渐加强的反馈强度；反之，用户在拖动滑块从右到左调节的过程中，经过交线时就可以感受到逐渐减弱的反馈强。据此，用户可以根据反馈强度的变化准确地确定拖动滑块的幅度，有利于准确掌握操作精度。
需要说明的是，图3所示的交线只是为了表达交线在GUI控件内部的位置关系，实际设计GUI控件时，GUI控件内部可以没有显示交线，视觉上是一片连通的区域，但是在不同交线位置的触觉反馈仍然有所不同，有利于保证美观的视觉效果。并且GUI控件在宽度上可以远小于图3所示的情况，例如极限情况下GUI控件在视觉上为一条线，滑块为线上的一个圆点；GUI控件中交线的数量也不限于图3所示的情况，可以根据需要增加或减少交线的数量。
在一个实施例中，所述处理器还配置为根据所述操作属性信息生成以下至少一种反馈：听觉反馈、嗅觉反馈、味觉反馈。
在一个实施例中，根据用户对GUI控件的触控操作，在生成触觉反馈的基础上，还可以生成其他感官方面的反馈，例如听觉反馈、嗅觉反馈、味觉反馈。
以还生成听觉反馈为例，例如用户在操作旋钮GUI控件时，在感应到用户进行逆时针或者顺时针的触控操作时，除了可以按照上述实施例生成触觉反馈，还可以生成听觉反馈，例如可以生成“咔哒、咔哒”的声音，并且声音的频率与用户操作的速度相关，例如用户逆时针转动的越快，声音的频率越高。
据此，不仅可以从触觉上丰富用户操作的感受，还可以从其他感官上丰富用户操作的感受，有利于提高引导用户操作的效果。
与上述显示系统的实施例相对应地，本公开还提出了操作反馈方法的实施例。
图4是根据本公开实施例示出的一种操作反馈方法的示意流程图。本实施例所示的操作反馈方法可以应用于显示面板，所述显示面板具有触控功能，可以接收用户的触控操作，并针对触控操作生成触觉反馈，例如显示面板可以显示GUI控件，用户可以对GUI控件进行触控操作，例如点击、滑动等操作，显示面板可以针对用户对GUI控件进行的触控操作生成触觉反馈。
所述显示面板可以应用于具有显示功能的电子设备，电子设备的类型可不限于手机、平板电脑、穿戴设备、车载设备、中控设备等。应用场景不限于，智能交通、智能家具、智能穿戴、智慧金融等。
如图4所示，所述操作反馈方法包括以下步骤：
在步骤S401中，确定用户在显示屏上对显示有GUI控件的触控操作的操作属性信息，所述操作属性信息包括以下至少之一：所述GUI控件的类型、所述触控操作在所述GUI控件所在区域的操作位置、所述触控操作的操作类型；
在步骤S402中，根据所述操作属性信息生成触觉反馈。
在一个实施例中，在感应到用户对GUI控件的触控操作时，可以确定触控操作的操作属性信息，例如所操作的GUI控件的类型、触控操作在GUI控件所在区域的操作位置、触控操作的操作类型。
其中，GUI控件的类型包括以下至少之一：按钮、旋钮、进度条；操作类型包 括以下至少之一：点击、双击、长按(还可以进一步划分为轻按和重按)、滑动、缩放。
在一个实施例中，例如操作属性信息包括GUI控件的类型和操作位置，不同的GUI控件类型可以对应不同的触觉反馈集合，触觉反馈集合可以包括多个与操作位置对应的触觉反馈，从而在确定所操作的GUI空间的类型后，可以进一步确定操作位置，并根据操作位置在触觉反馈集合中确定对应的触觉反馈。
例如GUI控件的类型为按钮，对应的触觉反馈集合包括两个元素：一个元素为锐利的振动反馈，对应的位置为GUI控件对应区域的边缘区域；另一个元素为厚重的振动反馈，对应的位置为GUI控件对应区域的中心区域。
在确定用户触控操作所操作的GUI控件类型为按钮时，可以确定对应的触觉反馈集合包括上述两个元素，进而可以确定触控操作的操作位置，例如操作位置位于GUI控件对应区域的边缘区域，可以生成锐利的振动反馈，例如操作位置位于GUI控件对应区域的中心区域，可以生成厚重的振动反馈。
在一个实施例中，例如操作属性信息包括操作位置和操作类型，不同的操作位置可以对应不同的触觉反馈集合，触觉反馈集合可以包括多个与操作类型对应的触觉反馈，从而在触控操作的操作位置后，可以进一步确定操作类型，并根据操作类型在触觉反馈集合中确定对应的触觉反馈。
例如操作位置为GUI控件的中心区域，对应的触觉反馈自己和包括两个元素：一个元素为低频的振动反馈，对应的操作类型为轻按；另一个元素为高频的振动反馈，对应的操作类型为重按。
在确定用户触控操作的操作位置位于GUI控件的中心区域时，可以确定对应的触觉反馈集合包括上述两个元素，进而可以确定触控操作的操作类型，例如操作类型为轻按，可以生成低频的振动反馈，例如操作类型为重按，可以生成高频的振动反馈。
需要说明的是，操作属性信息的组合并不限于上述两个实施例中所示的情况下，可以根据需要设置操作属性信息的组合，例如可以包括GUI控件的类型、操作位置和操作类型。
以下实施例主要在操作属性信息包括操作位置的情况下，对本公开的技术方案进行示例性说明。
在一个实施例中，GUI控件的形状特征可以根据需要设置，例如可以为举行、 圆形、条形。同一种类型的GUI控件可以具有不同的形状特征，也可以具有相同的形状特征，不同类型的GUI控件可以具有不同的形状特征，也可以具有相同的形状特征。
以下实施例主要在按钮型GUI控件的形状特征为矩形、旋钮型GUI控件的形状特征为圆形、进度条GUI控件的形状特征为条形的情况下，对本公开的技术方案进行示例性说明，当然，也可以根据需要调整GUI控件的类型和形状特征之间的对应关系。
在一个实施例中，可以对GUI控件所在的区域进行划分，根据操作位置所位于的区域，生成相应的触觉反馈。其中，针对不同形状的GUI控件划分区域的方式可以不同，也可以相同。在一个实施例中，所述GUI控件的形状特征包括以下至少之一：矩形、圆形、条形。
以正方形GUI控件为例，可以将GUI控件划分为两部分区域：边缘区域和中心区域，例如边缘区域为GUI控件的四条边，宽度边长的2/5，GUI控件中除了边缘区域的部分为中心区域，也即边缘区域为矩形框，中心区域为边缘区域内部的正方形。
可以设置在确定操作位置位于边缘区域时，生成锐利感相对较强的脉冲信号作为触觉反馈，在确定操作位置位于中心区域时，生成厚重感相对平稳的方波信号作为触觉反馈。需要说明的是，生成的信号可以使得显示面板在触觉上发生变化，例如引起显示面板在操作位置产生振动，当用户接触到边缘区域时，可以感受到锐利的相对较强的振动，当用户接触到中心区域时，可以感受到厚重的振动。其中，显示面板产生振动的方式包括但不限于摩擦静电振动、振动装置驱动、压电片振动等。
当然，也可以不对GUI控件划分区域，直接确定操作位置的坐标，进而根据操作位置所位于的坐标，生成相应的触觉反馈。
根据本公开的实施例，当用户对GUI控件进行触控操作时，在接触到不同类型的GUI控件、接触到GUI控件的不同位置、对GUI控件执行不同类型的操作，丰富了用户对GUI控件进行操作触觉体验，还可以基于不同的触觉反馈对用户在针对GUI控件的触控操作进行有效引导。
例如所述显示面板应用于车载设备，由于车载设备的屏幕相对于手机等终端一般较大，其中显示的GUI控件的尺寸也相对较大，以便用户进行操作。但是在用户开车行驶过程中，目光需要保持关注车辆前方，在对GUI控件进行操作时，不方便去看手指在GUI控件中的具体位置，一般只能凭记忆推测对GUI控件的操作程度，例如用 户在GUI控件中拖拽滑块调节播放器音量时，不能准确确定拖拽滑块的程度，进而导致不能准确调节音量，这会导致用户对GUI控件进行触控操作时，可能出现无效操作甚至误操作，影响用户体验。
根据本公开的实施例，用户在对GUI控件进行触控操作时，根据操作位置的不同，可以为用户生成不同的触觉反馈，便于用户在对GUI控件进行触控操作使，根据触觉反馈确定对GUI控件的操作程度，以便进行准确的操作。
例如用户需要对上述正方形GUI控件进行操作，GUI控件需要用户长按才会中心区域执行相应操作，根据本公开的实施例，用户在接触到GUI控件的边缘时，根据锐利的振动就可以确定手指接触到了GUI控件的边缘，然后可以将手指向中心区域移动，接触到中心区域后，根据厚重的振动可以确定手指位于中心区域，进而可以进行长按操作。可见，设置GUI控件根据用户的操作位置生成相应的触觉反馈，可以有效地引导用户进行操作，使得用户即使在不观看GUI控件的情况下，也可以依靠触觉反馈准确地完成触控操作。
需要说明的是，以上触觉反馈是以振动反馈作为一种示例，除了振动这种反馈方式，也可以根据需要通过其他方式来生成触觉反馈，例如可以触觉反馈可以是温度反馈，那么针对不同的操作属性信息，可以使用户感受到不同的温度反馈。
图5是根据本公开实施例示出的另一种操作反馈方法的示意流程图。如图5所示，所述根据所述操作属性信息生成触觉反馈包括：
在步骤S501中，确定所述操作属性信息对应的触觉反馈强度；
在步骤S502中，生成与所述触觉反馈强度对应的触觉信号。
在一个实施例中，对于不同的操作属性信息可以预先设置不同的反馈强度，进而在确定用户触控操作的操作属性信息后，可以根据操作属性信息快速地确定反馈强度，并根据确定的反馈强度生成触觉信号。
在一个实施例中，所述触觉信号的反馈强度通过以下至少一项表征：信号波形的振幅、信号波形的类型、信号频率的高低。
在一个实施例中，可以通过设置触觉信号的信号波形的振幅、类型、信号频率的高低中至少之一来调整触觉信号的反馈强度，例如信号频率越高，反馈强度越大，信号频率越低，反馈强度越小；振幅越大，反馈强度越大，振幅越小，反馈强度越小。
在一个实施例中，所述信号波形的类型包括以下至少之一：脉冲波、方波、三角波、矩形波、锯齿波。其中，在幅度和频率相等的情况下，方波、矩形波的反馈强度相对较小，脉冲波、三角波、锯齿波的反馈强度相对较大。
例如需要设计反馈强度相对较大的触觉信号，可以设置触觉信号为高频的脉冲波，例如需要设计反馈强度相对较小的触觉信号，可以设置触觉信号为低频的方波。
通过从信号波形的幅度、类型和信号频率三个维度来设置触觉信号的反馈强度，有利于确保对触觉反馈的反馈强度设置的更加细腻。
需要说明的是，在实际使用过程中，触觉反馈对应信号的波形并不限于上述几种波形，可以是上述几种基础波形的结合，可以是对上述几种波形的转换，例如根据所需生成的触觉反馈来模拟生成相应的波形。
以下通过几个实施例对几种类型的GUI控件进行示例性说明，但是本公开所示实施例中的方法，并不限于以下几种类型的GUI控件，GUI控件的形状特征也不限于以下实施例所示的情况。
在一个实施例中，所述GUI控件的类型包括以下至少之一：按钮、旋钮、进度条。
图1是根据本公开的实施例示出的一种GUI控件的示意图。
在一个实施例中，如图1所示，所述GUI控件为按钮控件，形状特征为矩形，所述GUI控件包括边缘区域和中心区域，所述边缘区域对应的反馈强度大于所述中心区域对应的反馈强度。
可以设置边缘区域和中心区域的反馈强度不同，例如边缘区域对应的反馈强度相对较大，中心区域对应的反馈强度相对较小。在确定操作位置位于边缘区域时，生成锐利感相对较强的脉冲信号作为触觉反馈，在确定操作位置位于中心区域时，生成厚重感相对平稳的方波信号作为触觉反馈。
从而使得用户在接触到GUI控件的边缘区域时，能够感受到相对锐利的振动，进而可以根据需要将手指移向内部区域，从而准确地进行所需的触控操作，例如长按内部区域。
需要说明的是，图1所示的区域之间的交界线只是为了区分两个区域，实际设计GUI控件时，GUI控件内部可以没有显示区域之间的交界线，视觉上是一片连通的 区域，但是在不同区域的触觉反馈仍然有所不同，有利于保证美观的视觉效果。
图2是根据本公开的实施例示出的另一种GUI控件的示意图。
在一个实施例中，如图2所示，所述GUI控件的旋钮控件，形状特征为圆形，所述GUI控件包括朝着多个方向延伸的线段，例如在圆形区域中可以等同于半径，多个所述线段中包括至少一个第一类型线段和至少一个第二类型线段，所述第一类型线段对应的反馈强度大于所述第二类型线段对应的反馈强度。
图2所示的圆形GUI控件可以作为旋钮控件，用户可以通过手指在GUI控件内部沿着顺时针方向进行触控操作，也可以沿着逆时针方向进行触控操作，在进行触控操作的过程中，可以经过多个线段，因此本实施例通过设置不同类型的线段，并针对不同类型的线段设置不同的反馈强度，使得用户可以在触控操作过程中根据触觉反馈相对准确地确定旋转过的角度。
在一个实施例中，为了确定触控操作的触控位置，可在图2所示的GUI控件中以圆心为原点建立直角坐标系，水平向右的方向为x轴正方向，竖直向上的方向为y轴正方向，根据函数arctan2(y,x)确定不同象限内x和y坐标的符号，角度范围为(-π,π]。
例如图2所示，在360°范围内，可以每隔10°设置一个线段，其中每隔30°设置一个第一类型线段，每两个第一类型线段之间设置两个第二类型线段。
用户在GUI控件中无论沿着逆时针方向进行触控操作，还是沿着顺时针方向进行触控操作，手指都会连续经过第一类型线段和第二类型线段。本实施例通过设置第一类型线段对应的反馈强度大于所述第二类型线段对应的反馈强度，使得用户手指在经过第一类型线段和第二类型线段时，可以感受到不同强度的触觉反馈。
例如第一类型线段对应高档位、第二类型线段对应低档位，手指经过第一类型线段时，可以产生顿挫感相对强烈的振动，手指经过第二类型线段时，可以产生顿挫感相对缓和的振动，使得用户可以在对GUI控件进行操作时，直观地感受到操作过程中档位的变化，便于对操作幅度进行控制。例如用户已知第一类型线段和第二类型线段按照如图2所述的方式分布，在操作过程中，当感受到两次顿挫感较弱的振动，一次顿挫感较强的振动时，可以确定手指在GUI控件中转过了30°左右，即使用户不直接观看操作过程，也能够相对准确地掌握操作幅度。
在一个实施例中，相邻线段之间的夹角相同，且每隔预设数量的第二类型线段存在一个第一类型线段。
例如图2所示，每隔2个第二类型的线段存在1个第一类型的线段，由于GUI控件是圆形的，其中的线段是中心对称分布的，按照固定规律设置第一类型线段和第二类型线段，使得用户在GUI控件中的任意位置进行相同幅度(例如经过相同的角度)的操作时，感受到的触觉反馈可以是相同，从而在任意位置根据触觉反馈确定操作幅度的规律都是相同的，无需用户区分操作位置。
在一个实施例中，所述第一类型线段的宽度大于所述第二类型线段的宽度。
由于线段在GUI控件中分布可能较为密集，用户在一次操作过程中，手指一般经过多个线段，而且GUI控件在第一类型线段和第二类型线段对应位置的振动反馈虽然不同，但是所能产生的振动仍然非常有限，这可能导致用户手指经过多个线段时，难以准确地区分经过的第一类型线段和第二类型线段。
通过设置第一类型线段的宽度大于第二类型线段的宽度，例如图2所示，使得用户手指在以固定速度经过第一类型线段时和第二类型线段时，在经过第一类型线段的过程中可以在相对较长的时间内感受到相对强烈的振动，有利于确保用户能够根据触觉反馈准确地区分第一类型线段和第二类型线段。
需要说明的是，图2所示的线段只是为了表达不同类型线段之间的关系，实际设计GUI控件时，GUI控件内部可以没有显示线段，视觉上是一片连通的区域，但是在不同类型的线段位置的触觉反馈仍然有所不同，有利于保证美观的视觉效果。并且线段的分布和类型也不限于图2所示的情况，可以根据需要进行设置，例如可以设置3种或3种以上类型的线段，每种类型的线段对应的触觉反馈不同，例如可以每隔3个第二类型线段设置1个第二类型线段，例如每两个线段之间的夹角也可以不同。
图3是根据本公开的实施例示出的又一种GUI控件的示意图。
在一个实施例中，如图3所示，所述GUI控件为进度条控件，形状特征为条形，所述GUI控件包括多个与所述GUI控件长度方向相交的交线，多个所述交线分别对应的反馈强度沿着所述GUI控件长度方向渐变。
在一个实施例中，图3所示的条形GUI控件可以用于调节功能，例如调节音量、调节亮度、调节温度等，用户可以拖动滑块实现操作。通过设置多个交线分别对应的反馈强度沿着所述GUI控件长度方向渐变(例如逐级变化)，使得用户在拖动滑块操作过程中，能够感受到触觉反馈的渐变，便于用户根据触觉反馈的反馈强度准确地确定操作幅度。
例如滑块在GUI控件中从左到右为提高音量，从右到左为降低音量，那么可以设置交线对应的反馈强度从左到右逐渐加强，那么用户在拖动滑块从左到右调节的过程中，经过交线时就可以感受到逐渐加强的反馈强度；反之，用户在拖动滑块从右到左调节的过程中，经过交线时就可以感受到逐渐减弱的反馈强。据此，用户可以根据反馈强度的变化准确地确定拖动滑块的幅度，有利于准确掌握操作精度。
需要说明的是，图3所示的交线只是为了表达交线在GUI控件内部的位置关系，实际设计GUI控件时，GUI控件内部可以没有显示交线，视觉上是一片连通的区域，但是在不同交线位置的触觉反馈仍然有所不同，有利于保证美观的视觉效果。并且GUI控件在宽度上可以远小于图3所示的情况，例如极限情况下GUI控件在视觉上为一条线，滑块为线上的一个圆点；GUI控件中交线的数量也不限于图3所示的情况，可以根据需要增加或减少交线的数量。
本公开的实施例还提出一种电子设备，包括处理器和用于存储处理器可执行指令的存储器。其中，所述处理器被配置为实现上述任一实施例所述的操作反馈方法。
本公开的实施例还提出一种非易失性计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述任一实施例所述操作反馈方法中的步骤。
图6是根据本公开的实施例示出的一种用于操作反馈的装置600的示意框图。例如，装置600可以是移动电话，计算机，数字广播终端，消息收发设备，游戏控制台，平板设备，医疗设备，健身设备，个人数字助理等。
参照图6，装置600可以包括以下一个或多个组件：处理组件602，存储器604，电源组件606，多媒体组件608，音频组件610，输入/输出(I/O)的接口612，传感器组件614，以及通信组件616。
处理组件602通常控制装置600的整体操作，诸如与显示，电话呼叫，数据通信，相机操作和记录操作相关联的操作。处理组件602可以包括一个或多个处理器620来执行指令，以完成上述的方法的全部或部分步骤。此外，处理组件602可以包括一个或多个模块，便于处理组件602和其他组件之间的交互。例如，处理组件602可以包括多媒体模块，以方便多媒体组件608和处理组件602之间的交互。
存储器604被配置为存储各种类型的数据以支持在装置600的操作。这些数据的示例包括用于在装置600上操作的任何应用程序或方法的指令，联系人数据，电话簿数据，消息，图片，视频等。存储器604可以由任何类型的易失性或非易失性存储 设备或者它们的组合实现，如静态随机存取存储器(SRAM)，电可擦除可编程只读存储器(EEPROM)，可擦除可编程只读存储器(EPROM)，可编程只读存储器(PROM)，只读存储器(ROM)，磁存储器，快闪存储器，磁盘或光盘。
电源组件606为装置600的各种组件提供电力。电源组件606可以包括电源管理系统，一个或多个电源，及其他与为装置600生成、管理和分配电力相关联的组件。
多媒体组件608包括在所述装置600和用户之间的提供一个输出接口的屏幕。在一些实施例中，屏幕可以包括液晶显示器(LCD)和触摸面板(TP)。如果屏幕包括触摸面板，屏幕可以被实现为触摸屏，以接收来自用户的输入信号。触摸面板包括一个或多个触摸传感器以感测触摸、滑动和触摸面板上的手势。所述触摸传感器可以不仅感测触摸或滑动动作的边界，而且还检测与所述触摸或滑动操作相关的持续时间和压力。在一些实施例中，多媒体组件608包括一个前置摄像头和/或后置摄像头。当装置600处于操作模式，如拍摄模式或视频模式时，前置摄像头和/或后置摄像头可以接收外部的多媒体数据。每个前置摄像头和后置摄像头可以是一个固定的光学透镜系统或具有焦距和光学变焦能力。
音频组件610被配置为输出和/或输入音频信号。例如，音频组件610包括一个麦克风(MIC)，当装置600处于操作模式，如呼叫模式、记录模式和语音识别模式时，麦克风被配置为接收外部音频信号。所接收的音频信号可以被进一步存储在存储器604或经由通信组件616发送。在一些实施例中，音频组件610还包括一个扬声器，用于输出音频信号。
I/O接口612为处理组件602和外围接口模块之间提供接口，上述外围接口模块可以是键盘，点击轮，按钮等。这些按钮可包括但不限于：主页按钮、音量按钮、启动按钮和锁定按钮。
传感器组件614包括一个或多个传感器，用于为装置600提供各个方面的状态评估。例如，传感器组件614可以检测到装置600的打开/关闭状态，组件的相对定位，例如所述组件为装置600的显示器和小键盘，传感器组件614还可以检测装置600或装置600一个组件的位置改变，用户与装置600接触的存在或不存在，装置600方位或加速/减速和装置600的温度变化。传感器组件614可以包括接近传感器，被配置用来在没有任何的物理接触时检测附近物体的存在。传感器组件614还可以包括光传感器，如CMOS或CCD图像传感器，用于在成像应用中使用。在一些实施例中，该传感器组件614还可以包括加速度传感器，陀螺仪传感器，磁传感器，压力传感器或温 度传感器。
通信组件616被配置为便于装置600和其他设备之间有线或无线方式的通信。装置600可以接入基于通信标准的无线网络，如WiFi，2G或3G，4G LTE、5G NR或它们的组合。在一个示例性实施例中，通信组件616经由广播信道接收来自外部广播管理系统的广播信号或广播相关信息。在一个示例性实施例中，所述通信组件616还包括近场通信(NFC)模块，以促进短程通信。例如，在NFC模块可基于射频识别(RFID)技术，红外数据协会(IrDA)技术，超宽带(UWB)技术，蓝牙(BT)技术和其他技术来实现。
在示例性实施例中，装置600可以被一个或多个应用专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理设备(DSPD)、可编程逻辑器件(PLD)、现场可编程门阵列(FPGA)、控制器、微控制器、微处理器或其他电子元件实现，用于执行上述方法。
在示例性实施例中，还提供了一种包括指令的非临时性计算机可读存储介质，例如包括指令的存储器604，上述指令可由装置600的处理器620执行以完成上述方法。例如，所述非临时性计算机可读存储介质可以是ROM、随机存取存储器(RAM)、CD-ROM、磁带、软盘和光数据存储设备等。
在本公开中，术语“第一”、“第二”仅用于描述目的，而不能理解为指示或暗示相对重要性。术语“多个”指两个或两个以上，除非另有明确的限定。
本领域技术人员在考虑说明书及实践这里公开的公开后，将容易想到本公开的其它实施方案。本公开旨在涵盖本公开的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本公开的真正范围和精神由下面的权利要求指出。
应当理解的是，本公开并不局限于上面已经描述并在附图中示出的精确结构，并且可以在不脱离其范围进行各种修改和改变。本公开的范围仅由所附的权利要求来限制。

Claims (21)

  1. 一种显示系统，其特征在于，包括配置为显示GUI控件的显示屏和处理器；
    所述处理器配置为执行如下方法：
    确定用户在显示屏上对显示有所述GUI控件的触控操作的操作属性信息，所述操作属性信息包括以下至少之一：所述GUI控件的类型、所述触控操作在所述GUI控件所在区域的操作位置、所述触控操作的操作类型；
    根据所述操作属性信息生成触觉反馈。
  2. 根据权利要求1所述的显示系统，其特征在于，所述处理器还配置为：
    确定所述操作属性信息对应的触觉反馈强度；
    生成与所述触觉反馈强度对应的触觉信号。
  3. 根据权利要求2所述的显示系统，其特征在于，所述触觉信号的反馈强度通过以下至少一项表征：信号波形的振幅、信号波形的类型、信号频率的高低。
  4. 根据权利要求3所述的显示系统，其特征在于，所述信号波形的类型包括以下至少之一：脉冲波、方波、三角波、矩形波、锯齿波。
  5. 根据权利要求2所述的显示系统，其特征在于，所述GUI控件的类型包括以下至少之一：按钮、旋钮、进度条。
  6. 根据权利要求5所述的显示系统，其特征在于，所述按钮包括边缘区域和中心区域，所述边缘区域对应的反馈强度大于所述中心区域对应的反馈强度。
  7. 根据权利要求5所述的显示系统，其特征在于，所述旋钮包括朝着多个方向延伸的线段，多个所述线段中包括至少一个第一类型线段和至少一个第二类型线段，所述第一类型线段对应的反馈强度大于所述第二类型线段对应的反馈强度。
  8. 根据权利要求7所述的显示系统，其特征在于，相邻的所述线段之间的夹角相同，且每隔预设数量的第二类型线段存在一个第一类型线段。
  9. 根据权利要求7所述的显示系统，其特征在于，所述第一类型线段的宽度大于所述第二类型线段的宽度。
  10. 根据权利要求5所述的显示系统，其特征在于，所述进度条包括多个与所述进度条长度方向相交的交线，多个所述交线分别对应的反馈强度沿着所述进度条长度方向渐变。
  11. 根据权利要求1至10中任一项所述的显示系统，其特征在于，所述处理器还配置为，根据所述操作属性信息生成以下至少一种反馈：听觉反馈、嗅觉反馈、味觉反馈。
  12. 一种操作反馈方法，其特征在于，包括：
    确定用户在显示屏上对显示有GUI控件的触控操作的操作属性信息，所述操作属性信息包括以下至少之一：所述GUI控件的类型、所述触控操作在所述GUI控件所在区域的操作位置、所述触控操作的操作类型；
    根据所述操作属性信息生成触觉反馈。
  13. 根据权利要求12所述的操作反馈方法，其特征在于，所述根据所述操作属性信息生成触觉反馈包括：
    确定所述操作属性信息对应的触觉反馈强度；
    生成与所述触觉反馈强度对应的触觉信号。
  14. 根据权利要求13所述的操作反馈方法，其特征在于，所述GUI控件的类型包括以下至少之一：按钮、旋钮、进度条。
  15. 根据权利要求14所述的操作反馈方法，其特征在于，所述按钮包括边缘区域和中心区域，所述边缘区域对应的反馈强度大于所述中心区域对应的反馈强度。
  16. 根据权利要求14所述的操作反馈方法，其特征在于，所述旋钮包括朝着多个方向延伸的线段，多个所述线段中包括至少一个第一类型线段和至少一个第二类型线段，所述第一类型线段对应的反馈强度大于所述第二类型线段对应的反馈强度。
  17. 根据权利要求16所述的操作反馈方法，其特征在于，相邻的所述线段之间的夹角相同，且每隔预设数量的第二类型线段存在一个第一类型线段。
  18. 根据权利要求16所述的操作反馈方法，其特征在于，所述第一类型线段的宽度大于所述第二类型线段的宽度。
  19. 根据权利要求14所述的操作反馈方法，其特征在于，所述进度条包括多个与所述进度条长度方向相交的交线，多个所述交线分别对应的反馈强度沿着所述进度条长度方向渐变。
  20. 一种电子设备，其特征在于，包括处理器和用于存储处理器可执行指令的存储器；其中，所述处理器被配置为实现权利要求12至19中任一项所述的方法。
  21. 一种非易失性计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现权利要求12至19中任一项所述的方法中的步骤。
PCT/CN2022/103394 2021-07-21 2022-07-01 显示系统、操作反馈方法、电子设备和存储介质 WO2023000958A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP22845123.3A EP4339752A4 (en) 2021-07-21 2022-07-01 DISPLAY SYSTEM, OPERATIONAL FEEDBACK METHOD, ELECTRONIC DEVICE AND STORAGE MEDIUM
US18/569,004 US20240281068A1 (en) 2021-07-21 2022-07-01 Display systems, operation feedback methods, electronic devices and storage media

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110825871.7A CN115686331A (zh) 2021-07-21 2021-07-21 显示系统、操作反馈方法、电子设备和存储介质
CN202110825871.7 2021-07-21

Publications (1)

Publication Number Publication Date
WO2023000958A1 true WO2023000958A1 (zh) 2023-01-26

Family

ID=84978918

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/103394 WO2023000958A1 (zh) 2021-07-21 2022-07-01 显示系统、操作反馈方法、电子设备和存储介质

Country Status (4)

Country Link
US (1) US20240281068A1 (zh)
EP (1) EP4339752A4 (zh)
CN (1) CN115686331A (zh)
WO (1) WO2023000958A1 (zh)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080158149A1 (en) * 2006-12-27 2008-07-03 Immersion Corporation Virtual Detents Through Vibrotactile Feedback
US20090292990A1 (en) * 2008-05-23 2009-11-26 Lg Electronics Inc. Terminal and method of control
US20100156809A1 (en) * 2008-12-19 2010-06-24 Honeywell International Inc. Method and apparatus for avionic touchscreen operation providing sensible feedback
CN101910978A (zh) * 2007-12-31 2010-12-08 苹果公司 电子设备中的触觉反馈
US20200257364A1 (en) * 2019-02-11 2020-08-13 Volvo Car Corporation Facilitating interaction with a vehicle touchscreen using haptic feedback
CN111552420A (zh) * 2020-03-25 2020-08-18 瑞声科技(新加坡)有限公司 一种触摸交互方法、装置、终端设备及存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8686952B2 (en) * 2008-12-23 2014-04-01 Apple Inc. Multi touch with multi haptics
US20150169059A1 (en) * 2012-04-18 2015-06-18 Nokia Corporation Display apparatus with haptic feedback
US9330544B2 (en) * 2012-11-20 2016-05-03 Immersion Corporation System and method for simulated physical interactions with haptic effects
KR102673702B1 (ko) * 2016-10-20 2024-06-12 삼성전자주식회사 피드백 제공 방법 및 이를 지원하는 전자 장치
US10310605B2 (en) * 2016-11-15 2019-06-04 Steering Solutions Ip Holding Corporation Haptic feedback for steering system controls

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080158149A1 (en) * 2006-12-27 2008-07-03 Immersion Corporation Virtual Detents Through Vibrotactile Feedback
CN101910978A (zh) * 2007-12-31 2010-12-08 苹果公司 电子设备中的触觉反馈
US20090292990A1 (en) * 2008-05-23 2009-11-26 Lg Electronics Inc. Terminal and method of control
US20100156809A1 (en) * 2008-12-19 2010-06-24 Honeywell International Inc. Method and apparatus for avionic touchscreen operation providing sensible feedback
US20200257364A1 (en) * 2019-02-11 2020-08-13 Volvo Car Corporation Facilitating interaction with a vehicle touchscreen using haptic feedback
CN111552420A (zh) * 2020-03-25 2020-08-18 瑞声科技(新加坡)有限公司 一种触摸交互方法、装置、终端设备及存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4339752A4 *

Also Published As

Publication number Publication date
CN115686331A (zh) 2023-02-03
US20240281068A1 (en) 2024-08-22
EP4339752A1 (en) 2024-03-20
EP4339752A4 (en) 2024-10-09

Similar Documents

Publication Publication Date Title
US11641517B2 (en) User interface for camera effects
US10627902B2 (en) Devices, methods, and graphical user interfaces for a wearable electronic ring computing device
US10692333B2 (en) Devices, methods, and graphical user interfaces for providing haptic feedback
US9111076B2 (en) Mobile terminal and control method thereof
EP3179358A1 (en) Method and apparatus for inputting contents based on virtual keyboard, and touch device
CN113031830A (zh) 用于与强度敏感输入区域进行交互的设备、方法和图形用户界面
JP6157885B2 (ja) 携帯端末装置の表示制御方法
US9041677B2 (en) Mobile terminal and method of controlling the same
US20230109787A1 (en) Wide angle video conference
KR20150073378A (ko) 동작인식을 기반으로 하는 가상 입력장치의 사용자 인터페이스(ui)를 표시하는 장치 및 방법
CN104461232A (zh) 在屏幕显示过程中确定缩小比例的方法及装置
CN107798309A (zh) 指纹录入方法、装置及计算机可读存储介质
CN103927101A (zh) 操作控件的方法和装置
US20210382736A1 (en) User interfaces for calibrations and/or synchronizations
WO2023000958A1 (zh) 显示系统、操作反馈方法、电子设备和存储介质
US20140115510A1 (en) Information Processing Method And Electronic Device
WO2023245373A1 (zh) 电子显示设备及其显示控制方法、装置，存储介质
WO2023236052A1 (zh) 输入信息确定方法、装置、设备及存储介质
CN113518149B (zh) 屏幕显示的方法及装置、存储介质
JP2014021893A (ja) 情報処理装置、操作信号生成方法、およびプログラム
RU2020130515A (ru) Система ультразвуковой визуализации для работы с преобладающим использованием большого пальца

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22845123

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18569004

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2022845123

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022845123

Country of ref document: EP

Effective date: 20231215

NENP Non-entry into the national phase

Ref country code: DE