WO2023206544A1

WO2023206544A1 - Input method and apparatus, terminal device and readable storage medium

Info

Publication number: WO2023206544A1
Application number: PCT/CN2022/090687
Authority: WO
Inventors: 王月; 王玲
Original assignee: 北京小米移动软件有限公司
Priority date: 2022-04-29
Filing date: 2022-04-29
Publication date: 2023-11-02
Also published as: CN117321553A

Abstract

The present disclosure provides an input method and apparatus, a terminal device and a readable storage medium. The input method comprises: detecting a touch trajectory generated by a crease area acting on a display screen (S101); under the condition that a touch parameter corresponding to the touch trajectory meets a preset condition, determining a trajectory compensation parameter according to the touch parameter (S102); and adjusting the touch trajectory on the basis of the trajectory compensation parameter (S103).

Description

Input methods and devices, terminal equipment, readable storage media

Technical field

The present disclosure relates to the technical field of folding display but is not limited to it, and in particular, to an input method and device, a terminal device, and a readable storage medium.

Background technique

With the development of science and technology, terminal equipment with display screens with folding functions has become a development trend of terminal equipment. When the display screen with the folding function is in the expanded state, the expanded display size can be larger than or equal to the display size of the tablet computer, and graffiti marks or notes can be completed by inputting on the expanded display screen. However, a display with a folding function will have creases during the folding process, which will affect input on the display.

Contents of the invention

Embodiments of the present disclosure provide an input method and device, a terminal device, and a readable storage medium.

A first aspect of an embodiment of the present disclosure provides an input method, wherein the method includes:

Detect the touch traces produced by the crease area of the display screen;

When the touch parameters corresponding to the touch trajectories meet preset conditions, determine the trajectory compensation parameters according to the touch parameters;

The touch trajectory is adjusted based on the trajectory compensation parameter.

A second aspect of the embodiment of the present disclosure provides an input device, wherein the device includes:

The first detection module is configured to detect the touch trajectory generated by the crease area of the display screen;

a compensation determination module configured to determine the trajectory compensation parameters according to the touch parameters when the touch parameters corresponding to the touch trajectories meet preset conditions;

A first adjustment module configured to adjust the touch trajectory based on the trajectory compensation parameter.

A third aspect of the embodiment of the present disclosure provides a terminal device, which at least includes: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the input method as provided in the first aspect. .

A fourth aspect of an embodiment of the present disclosure provides a readable storage medium, including: when instructions in the storage medium are executed by a processor of a terminal device, the terminal device is able to perform the input method as provided in the first aspect.

The technical solution provided by the embodiment of the present disclosure takes into account that the creases in the crease area will have an impact on the touch trajectory formed by the input. When the touch parameters meet the preset conditions, the touch trajectory in the crease area will be calculated based on the trajectory compensation parameters. Adjustment. In this way, the impact of the crease in the crease area on the touch trajectory can be reduced and the touch input experience can be improved.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and do not limit the embodiments of the present disclosure.

Description of the drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the embodiments of the invention.

Figure 1 is a schematic flowchart 1 of an input method proposed according to an exemplary embodiment.

Figure 2 is a flowchart 2 of an input method proposed according to an exemplary embodiment.

Figure 3 is a schematic diagram of an input device according to an exemplary embodiment.

Figure 4 is a block diagram of a terminal device according to an exemplary embodiment.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with embodiments of the invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of embodiments of the invention.

The terminology used in the embodiments of the present disclosure is for the purpose of describing specific embodiments only and is not intended to limit the embodiments of the present disclosure. As used in this disclosure, the singular forms "a," "the" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It will also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used to describe various information in the embodiments of the present disclosure, the information should not be limited to these terms. These terms are only used to distinguish information of the same type from each other. For example, without departing from the scope of the embodiments of the present disclosure, the first information may also be called second information, and similarly, the second information may also be called first information. Depending on the context, the word "if" as used herein may be interpreted as "when" or "when" or "in response to determining."

As shown in Figure 1, an embodiment of the present disclosure proposes an input method, wherein the input method can be applied to a terminal device with a display screen. The terminal device performing the input method includes the following steps:

S101. Detect the touch trajectory generated by the crease area of the display screen;

S102. When the touch parameters corresponding to the touch trajectories meet the preset conditions, determine the trajectory compensation parameters according to the touch parameters;

S103. Adjust the touch trajectory based on the trajectory compensation parameter.

In the embodiment of the present disclosure, the above input method can be applied to the scenario of inputting on a display screen with a crease area for graffiti marking or note taking. For example, when marking graffiti in the crease area of the display screen, the touch track in the crease area can be detected through the input method. When the touch parameters corresponding to the touch track are detected to meet the preset conditions, the touch track can be detected. The trajectory is compensated to adjust the touch display of the touch trajectory in the crease area, which can reduce the impact of the crease in the crease area on the touch trajectory.

The display screen of the above-mentioned terminal device can be folded or deformed. For example, the display screen may be a foldable or deformable screen, including but not limited to a display screen formed of organic light-emitting diodes (OLED). For example, the display screen may include a pull-out screen (such as a scroll screen), a folding screen (such as an inner folding screen, an outer folding screen, an up-and-down folding screen, a double folding screen, etc.).

In step S101, the display screen is likely to form uneven creases in the folded position or deformed position, and the area where the folded position or deformed position of the display screen is located may be a crease area. For example, when the display screen is a folding screen, the area where the folding position of the folding screen is located may be a crease area.

In the embodiment of the present disclosure, the display screen has a crease area and a flat area located outside the crease area. Since the touch surface in the crease area has uneven creases compared to the touch surface in the flat area, the touch track generated in the crease area will change due to the uneven creases compared to the flat area, and then the touch track will change. The touch parameters of each touch point on the control trajectory will also change.

The above-mentioned touch parameters are detection parameters that can be obtained by the touch screen when the touch object acts on the display screen, or intermediate parameters that can be obtained based on the detection parameters. For example, the touch parameters may include: touch pressure, touch inclination angle, and input speed of the touch position, which can be directly obtained. They may also include: the pressure change amount corresponding to the touch pressure or the inclination angle corresponding to the touch inclination angle. The variation amount of these intermediate parameters obtained based on the detection parameters is not limited by the embodiment of the present disclosure.

Among them, the touch pressure is the force exerted by the touch object on the display screen in the process of forming the touch trajectory; the touch inclination angle is the angle between the touch object and the display screen in the process of forming the touch trajectory, where, the The touch object may include an active pen or a stylus, which is not limited in the embodiment of the present disclosure.

It should be noted that the detection module of the terminal device can detect touch parameters at preset intervals. The preset duration can be set according to actual conditions. For example, it can be set to 1 minute or 3 minutes, which is not limited by the embodiment of the present disclosure.

For example, different detection modules can be used to detect different touch parameters. For example, when the touch parameters include the speed of the touch position, the corresponding detection module may include a speed detection sensor; when the touch parameters include touch pressure, the corresponding detection module may include a pressure detection sensor; when the touch parameters include When the touch tilt angle is included, the corresponding detection module may include an angle detection sensor. For example, the touch parameters can be obtained based on the touch chip of the terminal device.

In the embodiment of the present disclosure, when using the graffiti marking function or note-taking function of the terminal device, the display lines of the display screen in the crease area are different from the display lines of the display screen in the flat area. For example, the display line thickness changes evenly in the flat area, but the display line thickness changes unevenly in the crease area. For another example, the display lines in the flat area of the display screen are straight lines, and the display lines in the crease area are curves. Therefore, based on the display difference between the crease area and the flat area, the embodiment of the present disclosure does not detect the touch trajectories in all areas of the display screen, but only detects the touch trajectories in the crease area, and performs the touch trajectory on the crease area. Compensate to reduce the display difference of the crease area relative to the flat area.

It should be noted that, in the process of detecting the touch traces acting on the crease area of the display screen, the touch traces acting on the crease area of the display screen can be detected by detecting the touch coordinates of the touch operation acting on the display screen. Touch track. For example, if the touch coordinates of the touch operation are all located in the crease area, then the trajectory formed by the touch operation on the display screen is the touch trajectory in the crease area.

In step S102, when the display screen is displayed in the crease area, not all touch parameters corresponding to the touch trajectories acting on the crease area need to be compensated. For example, when the touch track is located between the convex and concave creases in the crease area, the touch track may be displayed without line deformation, and there is no need to compensate for the touch track. For another example, when the touch parameter corresponding to the touch trajectory used in the crease area of the display screen does not change or the change amount of the touch parameter corresponding to the touch parameter is less than or equal to the preset change threshold, the touch trajectory The display may not have line deformation, and there is no need to compensate for the touch trajectory.

Therefore, before determining the trajectory compensation parameters, the terminal device will determine whether the touch parameters corresponding to the touch trajectory meet the preset conditions. Only when the touch parameters meet the preset conditions, the terminal device will determine the trajectory compensation parameters based on the touch parameters. , and then adjust the touch trajectory in time based on the trajectory compensation parameters to reduce the impact of creases in the crease area on the touch trajectory.

It should be noted that when the touch parameters do not meet the preset conditions, there is no need to compensate the touch trajectory in the crease area, and the touch trajectory can be directly displayed.

In the embodiment of the present disclosure, the touch parameters are different and the corresponding preset conditions are different. For example, when the touch parameter is the touch pressure of each touch point on the touch trajectory, the corresponding satisfying preset condition may include being greater than the pressure threshold; when the touch parameter is the touch pressure corresponding to each touch point on the touch trajectory. When the touch pressure change amount is determined by the touch pressure, satisfying the preset condition may include that the touch pressure change amount is greater than the preset pressure change threshold.

Here, when the touch parameters include at least two different touch parameters, the trajectory compensation parameter can be determined when at least two different touch parameters meet the corresponding preset conditions, and the trajectory compensation parameter can also be determined when at least two different touch parameters meet the corresponding preset conditions. The trajectory compensation parameters are determined when any one of the touch parameters among the parameters meets the corresponding preset condition, which is not limited by the embodiments of the present disclosure.

In step S103, after obtaining the trajectory compensation parameters, the touch trajectory can be adjusted based on the trajectory compensation parameters.

In the embodiment of the present disclosure, if the touch parameters are different, the corresponding trajectory compensation parameters are different. For example, when the touch parameters include the touch pressure of each touch point in the touch trajectory, the trajectory compensation parameter may include a pressure compensation parameter to compensate for the touch pressure; when the touch parameters include each touch point in the touch trajectory, When the touch inclination of the control point is determined, the trajectory compensation parameter may include an inclination compensation parameter that compensates for the touch inclination.

It should be noted that adjusting the trajectory based on the trajectory compensation parameters can adjust the position of each touch point in the trajectory based on the trajectory compensation parameters, thereby reducing trajectory deformation; it can also adjust the pressure of the touch trajectory based on the trajectory compensation parameters. value, thereby adjusting the size of the touch track in the first direction, which is perpendicular to the extension direction of the touch track, thereby making the size of the touch track change evenly.

In the embodiment of the present disclosure, the terminal device detects the touch trajectory generated by acting on the crease area of the display screen; when the touch parameters corresponding to the touch trajectory meet the preset conditions, the touch parameters are determined based on the touch parameters. Trajectory compensation parameters; based on the trajectory compensation parameters, adjust the touch trajectory. That is to say, the embodiments of the present disclosure take into account that the creases in the crease area will have an impact on the touch trajectory formed by the input, for example, affecting the linearity of the touch trajectory or affecting the extension direction of the touch trajectory perpendicular to the touch trajectory. size, and then propose that when the touch parameters meet the preset conditions, the touch trajectory in the crease area will be adjusted based on the trajectory compensation parameters. In this way, the impact of the creases in the crease area on the touch trajectory can be reduced, and the linearity and size change uniformity of the touch trajectory can be improved.

In some embodiments, the touch parameters include: a touch parameter change amount; and when the touch parameters corresponding to the touch trajectories meet preset conditions, the trajectory is determined based on the touch parameters. Compensation parameters, including:

In the case where the change amount of the touch parameter is greater than the preset change threshold, the trajectory compensation parameter is determined based on the change amount of the touch parameter.

In the embodiment of the present disclosure, when acting on the crease area, the touch parameters corresponding to the touch trajectory will change. For example, when acting on a concave crease or a convex crease in the crease area, the speed, touch pressure and touch inclination of the touch position at the concave crease or convex crease will all change. . The touch parameter variation is used to reflect the changes in the touch parameters corresponding to the touch trajectory at different types of creases in the crease area. For example, the change amount of the touch parameter may be the change amount of the touch parameter of each touch point in the touch trajectory.

In the embodiment of the present disclosure, considering that compared with the touch parameter, the change amount of the touch parameter can better characterize the change of the touch parameter corresponding to the touch trajectory in the folding area, therefore, the trajectory compensation parameter determined based on the change amount of the touch parameter To compensate for the changed touch trajectory in the crease area, it can improve the compensation accuracy.

In some embodiments, the touch parameter variation includes at least one of the following: pressure variation of touch pressure, inclination variation of touch inclination, speed variation of touch position; for example, touch pressure variation The pressure change amount can be the change amount of the touch pressure of each touch point (ie, the touch position) in the touch track, and the change amount of the touch inclination angle can be the change amount of the touch inclination angle of each touch point (ie, the touch position) in the touch track. The change amount of the touch inclination angle and the change amount of the speed of the touch position can be the change amount of the speed of each touch point (ie, the touch position) in the touch trajectory.

For example, when the touch object is a stylus or an active pen, the touch chip of the terminal device interacts with the touch object, determines the touch point, and obtains the touch inclination angle of the touch object acting on the touch point. For example, when the touch object is a stylus or an active pen, the touch chip of the terminal device interacts with the touch object to obtain the touch pressure of the touch object acting on the touch point, or it can be set through the terminal device. The pressure detection device under the display screen obtains the touch pressure of the corresponding touch point. For example, when the touch object is a stylus or an active pen, the speed of the touch input can be detected through a sensor set on the touch object. The touch chip of the terminal device interacts with the touch object to obtain the speed of the touch object. The speed of each touch point, or the terminal device can determine the speed of the touch object at each touch point based on each touch point and the corresponding input time.

Determining the trajectory compensation parameter based on the change amount of the touch parameter when the change amount of the touch parameter is greater than a preset parameter threshold includes:

When the change amount of the touch parameter satisfies the change condition, determine the trajectory compensation parameter based on the change amount of the touch parameter;

Wherein, the change amount of the touch parameter satisfies the change condition, including at least one of the following:

The pressure change amount of the touch pressure is greater than the preset pressure change threshold;

The inclination angle change amount of the touch inclination angle is greater than the preset inclination angle change threshold;

The speed change amount of the touch position is greater than the preset speed change threshold.

In the embodiment of the present disclosure, the terminal device can determine the pressure change amount of the touch pressure based on the touch pressure corresponding to each touch point in the touch trajectory; determine the touch inclination angle corresponding to each touch point in the touch trajectory. The inclination angle change amount of the control inclination angle; based on the speed of each touch point in the touch trajectory at different touch positions, the speed change amount of the touch position is determined.

The change conditions for the above-mentioned touch parameter changes to satisfy include at least one of the following: the pressure change of the touch pressure is greater than the preset pressure change threshold; the inclination change of the touch inclination is greater than the preset inclination change threshold; the speed change of the touch position Greater than the preset speed change threshold. That is to say, in the process of determining whether to determine the trajectory compensation parameters, as long as any one of the three touch parameter changes: the pressure change of the touch pressure, the inclination change of the touch inclination, and the speed change of the touch position is touched. The change amount of the control parameter is greater than the corresponding threshold.

In this way, on the one hand, since the change amount of the touch parameter can better characterize the change of the touch parameter corresponding to the touch trajectory in the folding area, the trajectory compensation parameter is determined based on the change amount of the touch parameter to compensate for the touch change in the fold area. Compensation based on the trajectory can improve the compensation accuracy; on the other hand, by determining the change amount of touch parameters to meet the change conditions through the satisfaction of multiple different conditions, the compensation timing can be determined more flexibly and the occurrence of false compensation can be reduced.

In some embodiments, determining the trajectory compensation parameter based on the touch parameter change includes:

Determine the crease type and crease depth of the crease area based on the pressure change amount of the touch pressure, the inclination angle change amount of the touch inclination angle, and/or the speed change amount of the touch position;

Based on the crease type and the crease depth, an inclination compensation value and a pressure compensation value are determined.

In the embodiments of the present disclosure, the pressure change amount of the touch pressure, the inclination angle change amount of the touch inclination angle, and the speed change amount of the touch position are all different at the folds of different fold types. Therefore, the crease type of the crease area may be determined based on the pressure change amount of the touch pressure and/or the inclination angle change amount of the touch inclination angle and/or the speed change amount of the touch position.

Here, when the pressure change amount of the touch pressure meets the first pressure condition, it can be determined that the crease type of the crease area is a concave crease; when the pressure change amount of the touch pressure meets the second pressure condition, it can be determined that the crease type is a concave crease. The crease type in the scar area is convex crease;

It should be noted that the first pressure condition may be that the pressure change is first greater than the first value, then less than the first value, and finally equal to the first value. The second pressure condition may be that the pressure change is first less than the first value, then greater than the first value, and finally equal to the first value. The first value can be set according to the actual situation. For example, the first value can be set in the range of 0 to 1.

When the inclination change amount of the touch inclination meets the first inclination angle condition, the crease type of the crease area can be determined to be a concave crease; when the inclination angle change amount of the touch inclination meets the second inclination angle condition, the crease area can be determined The type of crease is convex crease;

It should be noted that the first inclination angle condition may be that the inclination angle change is first greater than the second value, then less than the second value, and finally equal to the second value. The second inclination angle condition may be that the inclination angle change is first less than the second value, then greater than the second value, and finally equal to the second value. The second value can be set according to the actual situation. For example, the second value can be set in the range of 0 to 1.

When the speed change of the touch position satisfies the first speed condition, the crease type of the crease area can be determined to be a concave crease; when the speed change of the touch position satisfies the second speed condition, the crease area can be determined The type of crease is convex crease.

It should be noted that the first speed condition may be that the speed change is first greater than the third value, then less than the third value, and finally equal to the third value. The second speed condition may be that the speed change is first less than the third value, then greater than the third value, and finally equal to the third value. The third value can be set according to the actual situation. For example, the third value can be set in the range of 0 to 1.

In the embodiment of the present disclosure, the fold can be determined based on one of the three touch parameter changes: pressure change of the touch pressure, inclination change of the touch inclination, and speed change of the touch position. The crease type can also be jointly determined based on two or three touch parameter changes among the three touch parameter changes.

In the process of jointly determining the crease type based on two or three touch parameter changes among the three touch parameter changes, the jointly determined crease types can be all concave creases or all convex creases. The compensation value is determined under the condition of , in this way, the accuracy of determining the compensation value based on the crease type can be improved.

In the embodiment of the present disclosure, the first correspondence relationship between the pressure change amount of the touch pressure and the crease depth, the second correspondence relationship between the inclination angle change amount of the touch inclination and the crease depth, and the touch inclination angle are stored in the terminal device. The third correspondence between the velocity change of the touch position and the crease depth. Therefore, the crease depth can be determined based on the first correspondence and the pressure change of the touch pressure; the crease depth can be determined based on the second correspondence and the touch inclination. The amount of change can determine the depth of the crease; the amount of change in speed based on the third correspondence and the touch position can determine the depth of the crease.

It should be noted that when multiple crease depths are determined based on the pressure change amount of the touch pressure, the inclination angle change amount of the touch inclination angle, and/or the speed change amount of the touch position, the multiple crease depths can be determined. Calculate the average value, and then determine the trajectory compensation parameters based on the average result and the crease type; you can also select one of the crease depths from multiple crease depths to participate in the crease type to determine the trajectory compensation parameters together, which is not limited by the embodiment of the present disclosure. .

Here, after the crease type and crease depth are determined, the trajectory compensation parameters may be determined based on the crease type and crease depth. Here, the trajectory compensation parameters can be determined based on the compensation table stored in the terminal device, that is, based on the crease type and the crease depth, the corresponding trajectory compensation parameters can be found from the compensation table.

In the embodiment of the present disclosure, the terminal device takes into account the impact of the crease type and crease depth of the display screen on the touch trajectory, and then determines the trajectory compensation parameters based on the crease type and crease depth, which can better compensate for the touch trajectory. The changes that occur at the crease can improve the accuracy of trajectory compensation.

In some embodiments, adjusting the touch trajectory based on the trajectory compensation parameter includes:

Based on the tilt angle compensation value, adjust the position of each touch point in the touch trajectory;

Based on the pressure compensation value, the pressure value of the touch track is adjusted.

In the embodiment of the present disclosure, when inputting in the crease area of the display screen, the problem of deformation of the touch track and uneven size change of the touch track in the first direction will occur, just like writing with an ordinary pen on uneven paper. . Based on this, the embodiments of the present disclosure not only adjust the position of each touch point in the touch trajectory based on the tilt angle compensation value, so as to reduce the sudden change in the position of each touch point in the touch trajectory in the crease area, resulting in the deformation of the touch trajectory. Improve the linearity of the touch track in the crease area; also adjust the pressure of the touch track based on the pressure compensation value to reduce the sudden change in the pressure of each touch point in the touch track in the crease area, causing the touch track to move in the first direction The uneven size change in the upward direction can make the size change of the touch track in the crease area more uniform.

In some embodiments, the method further includes:

Detecting sample trajectories generated by touch operations on the display screen;

When the sample touch parameter corresponding to the sample trajectory changes, the area where the touch operation's action position is located is used as the crease area.

In the embodiment of the present disclosure, before the terminal device detects the crease area and generates a touch trajectory, the terminal device needs to determine the crease area on the folding screen, so that it can detect the touch trajectory generated by the crease area of the display screen.

It should be noted that the terminal device can determine the crease area through the sample trajectory generated by the touch object of the display screen acting on the display screen. The touch object may include a stylus or an active pen, which is not limited in the embodiment of the present disclosure.

The sample touch parameters of the touch trajectory may include sample touch pressure, sample touch inclination and/or speed of the sample touch position, which are not limited in the embodiment of the present disclosure.

Changes in the above sample touch parameters may include: the change trend of the sample touch parameters changes according to a preset curve. For example, the changing trend of the sample touch parameters is a convex curve or a concave curve, which is not limited by the embodiment of the present disclosure.

In the embodiment of the present disclosure, since the sample touch parameters acting on the crease area will change, it can be determined that the action position has a crease as long as the sample touch parameters change. In this way, the terminal device can better determine the crease area through the sample touch parameters.

In some embodiments, the sample trajectory includes: a first trajectory and a second trajectory; when the sample touch parameter corresponding to the sample trajectory changes, the area where the action position of the touch operation is located is As the crease area includes:

Compare the coordinates of each touch point in the first trajectory with the coordinates of each touch point in the second trajectory;

In the case where the difference between the coordinate value of the first touch point in the first trajectory and the coordinate value of the second touch point in the second trajectory is within the preset range, from the first Determine a first trajectory segment including the first touch point in the trajectory, and determine a second trajectory segment including the second touch point from the second trajectory;

In the case where the sample touch parameters corresponding to the first track segment and the sample touch parameters corresponding to the second track segment have the same change, the area where the first track segment is located and the area where the second track segment is located are The area where the two track segments are located serves as the crease area.

In the embodiment of the present disclosure, the above-mentioned coordinate value may be an abscissa value or an ordinate value, which is not limited in the embodiment of the present disclosure. Here, the terminal device can drive the display screen to fold through the rotation of the rotating shaft. Therefore, the display screen will have the same type of creases at the rotating shaft. When it is detected that the first trajectory and the second trajectory have the same change, the second trajectory can be folded. The area where the first track is located and the area where the second track is located are used as the crease area.

That is to say, in the embodiment of the present disclosure, on the basis of determining the crease area based on the sample touch parameters corresponding to the sample trajectory, the crease area can be further determined by having the same changes in the first trajectory and the second trajectory, so that the crease area can be The determination is more accurate and can better detect the touch trajectory in the crease area.

For example, in some embodiments, if the display screen is a folding screen, the crease area may be determined based on the folding center of the folding screen. For example, a preset area based on the folding center of the folding screen is determined as the crease area; the preset area can be an area determined based on experimental data, or based on the folding center of the folding screen and the folding area of the folding screen. Areas whose morphology is determined through simulation.

For example, in some embodiments, if the display screen is a folding screen, the area where the touch operation's action position is determined based on the sample trajectory can be combined with the preset area based on the folding center of the folding screen to determine Crease area; for example, the larger area of the two areas can be used as the folding area, or the two areas can be calculated and determined according to the preset operation method, such as mean operation, weighted operation, etc.

In some embodiments, the method further includes:

The display compensation parameters are determined according to the touch parameters and the viewing angle of the holding object relative to the display screen; wherein the holding object is an object holding a terminal device with the display screen;

Based on the display compensation parameters, the display parameters of the touch track in the crease area are adjusted.

In the embodiment of the present disclosure, the display parameters of the touch trajectory can be adjusted when the touch parameters meet the preset conditions. The display parameters may include display color, display size or display brightness, which are not limited in the embodiment of the present disclosure.

For example, when the display parameters include display brightness, the touch trajectory can be adjusted through the determined display compensation parameters of the display brightness; when the display parameters include display size, the touch trajectory can be adjusted through the determined display compensation parameters of the display size. trajectory. Among them, adjusting the touch track based on the display compensation parameter of the display brightness may include: increasing or reducing the display brightness of the touch track in the crease area; adjusting the touch track based on the display compensation parameter of the display size may include: reducing or Increase the display font of touch tracks in the crease area.

In the embodiment of the present disclosure, the camera of the terminal device (such as always on camera) can be used to determine the viewing angle range of the held object relative to the display screen. Determining the viewing angle of the held object relative to the display screen may include: collecting an image of the held object through a camera of the terminal device; and determining the viewing angle of the held object relative to the folding screen based on the posture of the held object in the image.

It should be noted that the collection direction of the above-mentioned camera is the same as the display direction of the display screen. That is to say, the terminal device collects images of the held object through a camera with a self-timer function, that is, a front-facing camera.

In the embodiment of the present disclosure, in the process of determining the display compensation parameters, the corresponding first mapping relationship table can be searched through the touch parameters and the viewing angle to obtain the corresponding display compensation parameters. Of course, the embodiment of the present disclosure can also directly search the second mapping relationship table through the touch parameters to obtain the corresponding display compensation parameters, which is not limited by the embodiment of the present disclosure.

The first mapping table includes mapping relationships between touch parameters, viewing angles and display compensation parameters, and the second mapping table includes mapping relationships between touch parameters and display compensation parameters.

The above-mentioned adjustment of the display parameters of the touch track in the crease area based on the display compensation parameters may include: determining the target display parameters of the display screen based on the display compensation parameters; adjusting the display parameters corresponding to the display part within the viewing angle range in the crease area. Display parameters for the target. That is to say, in the actual process of adjusting the display parameters, only the display parameters corresponding to the display portion within the viewing angle range in the crease area can be adjusted. In this way, targeted adjustments can be made based on the viewing angle, which not only reduces the visual presence of creases, but also reduces the adjustment workload and improves adjustment efficiency.

For example, in the process of adjusting the display parameters of the crease area, you can reduce the display brightness corresponding to the display part in the crease area that is within the viewing angle range; or, change the display color corresponding to the display part in the crease area that is within the viewing angle range. Adjust to light color.

In the embodiment of the present disclosure, when it is determined that the touch parameters meet the preset conditions, the display parameters of the touch track in the crease area can be adjusted. That is to say, in addition to adjusting the touch trajectory, the embodiment of the present disclosure can also adjust the display parameters of the touch trajectory based on the display compensation parameters determined by the touch parameters, that is, it can optically compensate the crease area and improve the performance of the display screen in the crease. area visual experience.

In order to better understand one or more of the above embodiments, the embodiments of the present disclosure provide the following examples:

As shown in Figure 2, the terminal device performing the input method may also include the following steps:

S201. Detect the touch trajectory generated by the crease area of the display screen;

S202. Determine the pressure change amount of the touch pressure corresponding to the touch trajectory;

S203. Determine the inclination change amount of the touch inclination corresponding to the touch trajectory;

S204. Respond to and display the touch trajectory;

S205. Determine whether the pressure change is greater than the preset pressure change threshold; if so, go to step S206; if not, go to step S204;

S206. Determine whether the inclination angle change is greater than the preset inclination angle change threshold; if so, go to step S207; if not, go to step S204;

S207. Determine the crease type and crease depth in the crease area based on the pressure change and the inclination angle change;

S208. Based on the crease type and the crease depth, determine the inclination compensation value and the pressure compensation value;

S209. Based on the inclination compensation value, adjust the position of each touch point in the touch trajectory;

S210. Based on the pressure compensation value, adjust the pressure value of the touch trajectory.

In the embodiments of the present disclosure, it is considered that the creases in the crease area will have an impact on the touch trajectory formed by the input, for example, affecting the linearity of the touch trajectory or affecting the size of the touch trajectory in the direction perpendicular to the extension of the touch trajectory. , and further proposed that when the touch parameters meet the preset conditions, the touch trajectory in the crease area will be adjusted based on the trajectory compensation parameters. In this way, the impact of the creases in the crease area on the touch trajectory can be reduced, and the linearity and size change uniformity of the touch trajectory can be improved.

As shown in Figure 3, an embodiment of the present disclosure provides an input device, wherein the input device 1000 includes a first detection module 1001, a compensation determination module 1002 and an adjustment module 1003, wherein,

The first detection module 1001 is configured to detect the touch trajectory generated by the crease area of the display screen;

The compensation determination module 1002 is configured to determine the trajectory compensation parameters according to the touch parameters when the touch parameters corresponding to the touch trajectories meet preset conditions;

The first adjustment module 1003 is configured to adjust the touch trajectory based on the trajectory compensation parameter.

In some embodiments, the compensation determination module is configured to determine the trajectory compensation parameter based on the change amount of the touch parameter when the change amount of the touch parameter is greater than a preset change threshold.

In some embodiments, the compensation determination module is configured to determine the trajectory compensation parameter based on the touch parameter change when the touch parameter change meets the change condition;

Wherein, the touch change parameter satisfies the change condition, including at least one of the following:

The touch pressure change amount is greater than the preset pressure change threshold;

The change amount of the touch inclination angle is greater than the preset inclination angle change threshold;

In some embodiments, the compensation determination module is further configured to determine the crease area based on the change in touch pressure, the change in touch inclination, and/or the change in speed of the touch position. The crease type and the crease depth; based on the crease type and the crease depth, the inclination compensation value and the pressure compensation value are determined.

In some embodiments, the first adjustment module is configured to adjust the position of each touch point in the touch trajectory based on the tilt angle compensation value; adjust the position of each touch point in the touch trajectory based on the pressure compensation value. Pressure value.

In some embodiments, the device further includes:

A display determination module configured to determine the display compensation parameter according to the touch parameters and the viewing angle of the holding object relative to the display screen; wherein the holding object is a terminal device having the display screen. Object;

The second adjustment module is configured to adjust the display parameters of the touch track in the crease area based on the display compensation parameter.

In some embodiments, the device further includes:

a second detection module configured to detect sample trajectories generated by touch operations acting on the display screen;

The crease determination module is configured to use the area where the touch operation's action position is located as the crease area when the sample touch parameter corresponding to the sample trajectory changes.

In some embodiments, the fold determination module is configured to compare the coordinates of each touch point in the first trajectory with the coordinates of each touch point in the second trajectory; in the first When the difference between the coordinate value of the first touch point in the trajectory and the coordinate value of the second touch point in the second trajectory is within a preset range, it is determined from the first trajectory that the coordinate value includes the The first track segment of the first touch point, and determine the second track segment including the second touch point from the second track; the sample touch parameters corresponding to the first track segment When the sample touch parameters corresponding to the second track segment have the same change, the area where the first track segment is located and the area where the second track segment is located are used as the crease area.

Regarding the devices in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

Embodiments of the present disclosure provide a terminal device, which at least includes:

processor;

Memory used to store instructions executable by the processor;

Wherein, the processor is configured to execute the input method as provided in one or more of the above embodiments.

The processor may include various types of storage media, which are non-transitory computer-readable storage media that can continue to store information stored thereon after the terminal device is powered off.

The processor can be connected to the memory through a bus or the like, and is used to read the executable program stored in the memory.

Figure 4 is a block diagram of a terminal device according to an exemplary embodiment. For example, the terminal device may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

Referring to FIG. 4 , the terminal device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power supply component 806 , a multimedia component 808 , an audio component 810 , an input/output (I/O) interface 812 , and a sensor component 814 , and communication component 816.

The processing component 802 generally controls the overall operations of the terminal device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to generate all or part of the steps of the methods described above. Additionally, processing component 802 may include one or more modules that facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

The memory 804 is configured to store various types of data to support operations at the terminal device 800 . Examples of such data include instructions for any application or method operating on the terminal device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

Power supply component 806 provides power to various components of terminal device 800 . Power supply components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to end device 800 .

Multimedia component 808 includes a screen providing an output interface between the terminal device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action. In some embodiments, multimedia component 808 includes a front-facing camera and/or a rear-facing camera. When the terminal device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

Audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC) configured to receive external audio signals when the terminal device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may be further stored in memory 804 or sent via communication component 816 . In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module, which may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.

Sensor component 814 includes one or more sensors for providing various aspects of status assessment for terminal device 800 . For example, the sensor component 814 can detect the open/closed state of the device 800 and the relative positioning of components, such as the display and keypad of the terminal device 800. The sensor component 814 can also detect the terminal device 800 or a component of the terminal device 800. position changes, presence or absence of user contact with the terminal device 800 , orientation or acceleration/deceleration of the terminal device 800 and temperature changes of the terminal device 800 . Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the terminal device 800 and other devices. The terminal device 800 can access a wireless network based on communication standards, such as WiFi, 2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communications component 816 also includes a near field communications (NFC) module to facilitate short-range communications. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, the terminal device 800 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable A programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic component implementation is used to perform the above method.

In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as a memory 804 including instructions, which are executable by the processor 820 of the terminal device 800 to generate the above method is also provided. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a terminal device, enable the terminal device to perform an input method, the method includes: detecting a fold acting on a display screen The touch trajectory generated in the trace area; when the touch parameters corresponding to the touch trajectory meet the preset conditions, the trajectory compensation parameters are determined according to the touch parameters; based on the trajectory compensation parameters, the touch The trajectory is adjusted.

Other embodiments of the invention will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common common sense or customary technical means in the technical field that are not disclosed in the present disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.

It is to be understood that the present invention is not limited to the precise construction described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.

Claims

An input method, including:

Detect the touch traces produced by the crease area of the display screen;

When the touch parameters corresponding to the touch trajectories meet preset conditions, determine the trajectory compensation parameters according to the touch parameters;

The touch trajectory is adjusted based on the trajectory compensation parameter.
The method according to claim 1, wherein the touch parameter includes: a change amount of the touch parameter;

When the touch parameters corresponding to the touch trajectories meet preset conditions, determining the trajectory compensation parameters according to the touch parameters includes:

In the case where the change amount of the touch parameter is greater than the preset change threshold, the trajectory compensation parameter is determined based on the change amount of the touch parameter.
The method according to claim 2, wherein the touch parameter change includes at least one of the following: pressure change of touch pressure, inclination change of touch inclination, speed change of touch position;

Determining the trajectory compensation parameter based on the change amount of the touch parameter when the change amount of the touch parameter is greater than a preset parameter threshold includes:

When the change amount of the touch parameter satisfies the change condition, determine the trajectory compensation parameter based on the change amount of the touch parameter;

Wherein, the change amount of the touch parameter satisfies the change condition, including at least one of the following:

The pressure change amount of the touch pressure is greater than the preset pressure change threshold;

The inclination angle change amount of the touch inclination angle is greater than the preset inclination angle change threshold;

The speed change amount of the touch position is greater than the preset speed change threshold.
The method according to claim 3, wherein the determining the trajectory compensation parameter based on the change amount of the touch parameter includes:

Determine the crease type and crease depth of the crease area based on the pressure change amount of the touch pressure, the inclination angle change amount of the touch inclination angle, and/or the speed change amount of the touch position;

Based on the crease type and the crease depth, an inclination compensation value and a pressure compensation value are determined.
The method of claim 4, wherein adjusting the touch trajectory based on the trajectory compensation parameter includes:

Based on the tilt angle compensation value, adjust the position of each touch point in the touch trajectory;

Based on the pressure compensation value, the pressure value of the touch track is adjusted.
The method according to any one of claims 1 to 5, wherein the method further includes:

The display compensation parameters are determined according to the touch parameters and the viewing angle of the holding object relative to the display screen; wherein the holding object is an object holding a terminal device with the display screen;

Based on the display compensation parameters, the display parameters of the touch track in the crease area are adjusted.
The method according to any one of claims 1 to 5, wherein the method further includes:

Detecting sample trajectories generated by touch operations on the display screen;

When the sample touch parameter corresponding to the sample trajectory changes, the area where the touch operation's action position is located is used as the crease area.
The method according to claim 7, wherein the sample trajectory includes: a first trajectory and a second trajectory; when the sample touch parameter corresponding to the sample trajectory changes, the touch operation The area where the action location is located is used as the crease area, including:

Compare the coordinates of each touch point in the first trajectory with the coordinates of each touch point in the second trajectory;

In the case where the difference between the coordinate value of the first touch point in the first trajectory and the coordinate value of the second touch point in the second trajectory is within the preset range, from the first Determine a first trajectory segment including the first touch point in the trajectory, and determine a second trajectory segment including the second touch point from the second trajectory;

In the case where the sample touch parameters corresponding to the first track segment and the sample touch parameters corresponding to the second track segment have the same change, the area where the first track segment is located and the area where the second track segment is located are The area where the two track segments are located serves as the crease area.
An input device, including:

The first detection module is configured to detect the touch trajectory generated by the crease area of the display screen;

a compensation determination module configured to determine the trajectory compensation parameters according to the touch parameters when the touch parameters corresponding to the touch trajectories meet preset conditions;

A first adjustment module configured to adjust the touch trajectory based on the trajectory compensation parameter.
The device according to claim 9, wherein the compensation determination module is configured to determine the trajectory compensation parameter based on the change amount of the touch parameter when the change amount of the touch parameter is greater than a preset change threshold. .
The device according to claim 10, wherein the compensation determination module is configured to determine the trajectory compensation parameter based on the touch parameter change amount when the touch parameter change amount satisfies a change condition;

Wherein, the touch change parameter satisfies the change condition, including at least one of the following:

The touch pressure change amount is greater than the preset pressure change threshold;

The change amount of the touch inclination angle is greater than the preset inclination angle change threshold;

The speed change amount of the touch position is greater than the preset speed change threshold.
The device according to claim 11, wherein the compensation determination module is further configured to determine based on the touch pressure change amount, the touch tilt angle change amount and/or the speed change amount of the touch position. The crease type and crease depth of the crease area; based on the crease type and the crease depth, the inclination compensation value and the pressure compensation value are determined.
The device according to claim 12, wherein the first adjustment module is configured to adjust the position of each touch point in the touch trajectory based on the inclination compensation value; and adjust the position of each touch point in the touch trajectory based on the pressure compensation value. The pressure value of the touch track.
The device according to any one of claims 9 to 13, wherein the device further includes:

A display determination module configured to determine the display compensation parameter according to the touch parameters and the viewing angle of the holding object relative to the display screen; wherein the holding object is a terminal device having the display screen. Object;

The second adjustment module is configured to adjust the display parameters of the touch track in the crease area based on the display compensation parameter.
The device according to any one of claims 9 to 13, wherein the device further includes:

a second detection module configured to detect sample trajectories generated by touch operations acting on the display screen;

The crease determination module is configured to use the area where the touch operation's action position is located as the crease area when the sample touch parameter corresponding to the sample trajectory changes.
The device according to claim 15, wherein the fold determination module is configured to compare the coordinates of each touch point in the first trajectory with the coordinates of each touch point in the second trajectory; In the case where the difference between the coordinate value of the first touch point in the first trajectory and the coordinate value of the second touch point in the second trajectory is within the preset range, from the first Determine a first trajectory segment including the first touch point in the trajectory, and determine a second trajectory segment including the second touch point from the second trajectory; When the sample touch parameters and the sample touch parameters corresponding to the second track segment have the same change, the area where the first track segment is located and the area where the second track segment is located are used as the crease. district.
A terminal device includes: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the input method provided in any one of claims 1 to 8.
A non-transitory computer-readable storage medium that, when instructions in the storage medium are executed by a processor of a terminal device, enables the terminal device to perform the input method provided in any one of claims 1 to 8.