CN115023683A

CN115023683A - Stylus pen, terminal, control method thereof, and computer-readable storage medium

Info

Publication number: CN115023683A
Application number: CN202080085344.0A
Authority: CN
Inventors: 肖明; 李凌志; 陆伟峰; 朱荣昌; 沈剑锋; 洪帆; 夏程杰; 朱菊
Original assignee: Shanghai Chuanying Information Technology Co Ltd
Current assignee: Shanghai Chuanying Information Technology Co Ltd
Priority date: 2019-12-11
Filing date: 2020-07-31
Publication date: 2022-09-06
Also published as: WO2021114690A1

Abstract

The application discloses a control method of a touch control pen, which comprises the following steps: acquiring operation information between the touch pen and a writing interface; determining a target operation object and operation information according to the operation information; and controlling the target operation object to operate according to the operation information. The application also provides a touch pen, a terminal and a control method, a control method of the mobile terminal, a terminal control method of the built-in touch pen, a touch reminding method based on the touch pen and a computer readable storage medium.

Description

Stylus pen, terminal, control method thereof, and computer-readable storage medium

The application requires that Chinese patent applications with application number 201911279109.2, named as "touch pen, terminal and control method thereof, and computer readable storage medium" are submitted in 2019, 12, month 11; chinese patent office filed on 11/12/2019, application No. 201911268427.9, chinese patent application entitled "control method for mobile terminal, and storage medium"; chinese patent application No. 201911386064.9 entitled "terminal control method, device, storage medium, and terminal with built-in stylus" filed by chinese patent office on 26.12.2019; chinese patent application No. 201911342018.9 entitled "touch prompting method based on stylus pen, terminal, and computer readable storage medium", filed by the chinese patent office on 12/20/2019, the entire contents of which are incorporated herein by reference.

Technical Field

The present application relates to the field of terminal touch technologies, and in particular, to a stylus, a terminal, a control method thereof, and a computer-readable storage medium.

Background

Portable terminals have become essential living goods for people. The terminal can be provided with a touch pen, and a user can operate the terminal through the touch pen.

In some implementations, interaction (such as control or reminding) between the stylus and the terminal has a problem of tedious or unintelligent flow, thereby affecting user experience.

In an exemplary technology, when a user needs to operate an application program or a document of a terminal, the user needs to perform multiple operations through a stylus pen to display different states of the application or the document, or to enable the application or the document to execute control instructions corresponding to the multiple operations, so that a touch operation flow of the terminal is complicated.

The foregoing description is provided for general background information and is not admitted to be prior art.

Content of application

The present application mainly aims to provide a stylus, a terminal, a control method thereof, and a computer-readable storage medium, and aims to solve the problem that a touch operation process of the terminal is complicated.

In order to achieve the above object, the present application provides a method for controlling a stylus, including:

acquiring operation information between the touch pen and a writing interface;

determining a target operation object and operation information according to the operation information;

and controlling the target operation object to operate according to the operation information.

In order to achieve the above object, the present application further provides a terminal control method, where the terminal includes a stylus and a touch screen, and the terminal control method includes the following steps:

acquiring the distance between the touch pen and the touch screen and the position of a contact point of the touch pen on the touch screen;

determining a target operation object of the touch pen on the touch screen according to the position;

determining running information of the target operation object according to the distance;

In order to achieve the above object, the present application further provides a terminal control method, where the terminal control method includes the following steps:

acquiring operation information between a touch device and a terminal;

determining a target operation object according to the operation information;

determining execution information corresponding to the target operation object according to a preset rule;

and controlling the target operation object to operate according to the execution information.

In order to achieve the above object, the present application further provides a method for controlling a mobile terminal, where the method for controlling a mobile terminal includes the following steps:

acquiring operation information between a touch device and a mobile terminal, and acquiring a target application interface according to the operation information, wherein the operation information comprises that a touch pen floats on a display screen of the mobile terminal;

and displaying the target application interface in a target area of the display screen.

In order to achieve the above object, the present application further provides a terminal control method of a built-in stylus, where the terminal includes a stylus provided with a pressing key, and the stylus is fixed at a fixed position, and the terminal control method of the built-in stylus includes the following steps:

after operation information between the touch pen and the terminal is detected, the terminal carries out preset operation, and the operation information comprises pressing operation of a pressing key of the touch pen.

In order to achieve the above object, the present application further provides a touch reminding method based on a stylus, where the stylus is applied to a touch screen of a terminal, a pressure sensor is disposed on the touch screen, and the pressure sensor is used for detecting a pressure generated by the stylus on the touch screen, and the touch reminding method includes the following steps:

after operation information of the touch control screen by the touch control pen is detected, acquiring a pressure value detected by the pressure sensor, wherein the operation information comprises writing operation of the touch control pen on the touch control screen;

and outputting touch reminding information according to the pressure value.

In order to achieve the above object, the present application further provides a stylus pen, which includes a memory, a processor, and a control program stored in the memory and executable on the processor, wherein the control program, when executed by the processor, implements the control method of the stylus pen as described above.

To achieve the above object, the present application also provides a terminal including a memory, a processor, and a control program stored in the memory and executable on the processor, the control program implementing the control method of the terminal as described above when executed by the processor.

To achieve the above object, the present application also provides a computer-readable storage medium storing a control program which, when executed by a processor, implements the control method of the stylus pen as described above or the control method of the terminal as described above.

According to the stylus, the terminal, the control method of the stylus and the computer readable storage medium, the stylus acquires operation information between the stylus and the writing interface, so that a target operation object and operation information are determined according to the operation information, and the target operation object is controlled to operate according to the operation information. The touch control pen can control the terminal to perform corresponding operation according to the operation information between the touch control pen and the writing interface, so that the touch control operation process of the terminal is simple and convenient without performing multiple operations on the writing interface through the touch control pen to operate the terminal.

Drawings

The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the principles of the application and not to limit the application. In the drawings:

fig. 1 is a schematic diagram of a hardware structure of a terminal/stylus according to an embodiment of the present disclosure;

fig. 2 is a flowchart illustrating a control method of the terminal according to an embodiment of the present disclosure;

FIG. 3 is a detailed flowchart of step S30 in FIG. 2;

FIG. 4 is a schematic diagram illustrating operation of the terminal of the present application;

FIG. 5 is another operational diagram of the terminal of the present application;

FIG. 6 is a schematic view of another detailed flow chart of step S30 in FIG. 2;

FIG. 7 is a schematic view of another operation of the terminal of the present application;

fig. 8 is a flowchart illustrating another embodiment of a control method of the terminal according to the present application;

fig. 9 is a flowchart illustrating a control method of a terminal according to another embodiment of the present application;

FIG. 10 is a detailed flowchart of step S70 in FIG. 9;

fig. 11 is a flowchart illustrating a control method of the terminal according to still another embodiment of the present application;

FIG. 12 is a flowchart illustrating a stylus control method according to an embodiment of the present disclosure;

FIG. 13 is a flowchart illustrating a stylus control method according to another embodiment of the present disclosure;

fig. 14 is a detailed flowchart of step S130 in fig. 12.

Fig. 15 is a flowchart illustrating a control method of a mobile terminal according to an embodiment of the present application;

FIG. 16 is a diagram illustrating an example of a target area on a display screen according to an embodiment of a control method of a mobile terminal of the present application;

fig. 17 is a diagram illustrating an example of a target application interface in a target area according to an embodiment of a control method of a mobile terminal of the present application;

fig. 18 is a diagram illustrating an exemplary touch point position of a stylus according to an embodiment of a control method of a mobile terminal of the present application;

fig. 19 is a diagram illustrating an example of adjusting a display scale of a target application interface according to an embodiment of a control method of a mobile terminal of the present application;

FIG. 20 is a flowchart illustrating an embodiment of a terminal control method with a built-in stylus according to the present application;

fig. 21 is a schematic structural diagram of a device with a built-in stylus according to an embodiment of the present application.

FIG. 22 is a flowchart illustrating an embodiment of a touch reminding method based on a stylus according to the present invention;

fig. 23 is a schematic diagram illustrating touch reminding information output according to a pressure value when a report point is detected;

FIG. 24 is a diagram illustrating that a stylus pen detects a floating point and then detects a touch point when operating a mobile terminal according to the present application;

FIG. 25 is a diagram illustrating detection of a floating point but no hit detection when a stylus is operating a mobile terminal according to the present invention.

The implementation, functional features and advantages of the object of the present application will be further explained with reference to the embodiments, and with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the statement that an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the processes, methods, articles, or apparatuses that comprise the element, and that elements, features, or elements having the same designation in different embodiments of the application may or may not have the same meaning as that of the other elements in the embodiment illustrated and/or described in further detail in connection with the context of that embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, items, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, in different orders, and may be performed alternately or at least partially with respect to other steps or sub-steps of other steps.

It should be noted that step numbers such as S10 and S20 are used herein for the purpose of more clearly and briefly describing the corresponding content, and do not constitute a substantial limitation on the sequence, and those skilled in the art may perform S20 first and then S10 in specific implementation, which should be within the scope of the present application.

The application provides a solution for acquiring operation information between a stylus and a writing interface; determining a target operation object and operation information according to the operation information; and controlling the target operation object to operate according to the operation information.

The touch control pen can control the terminal to perform corresponding operation according to the operation information between the touch control pen and the writing interface, the touch control pen does not need to perform multiple operations on the writing interface to operate the terminal, and the touch control operation process of the terminal is simple and convenient.

As shown in fig. 1, fig. 1 is a schematic diagram of a hardware structure of a terminal/stylus according to an embodiment of the present disclosure.

Referring to fig. 1, an embodiment of the present application relates to a terminal and a stylus pen, where the stylus pen or the terminal may include: a processor 1001, such as a CPU, a memory 1002, a communication bus 1003, network interfaces 1004,. Wherein the communication bus 1003 is configured to implement connection communication between the constituent components of the apparatus. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1002 may be a high-speed RAM memory or a non-volatile memory such as a disk memory. The memory 1002 may alternatively be a storage device separate from the processor 1001. As shown in fig. 1, the memory 1002, which is a kind of computer storage medium, may include therein an operating system, a network communication module, and a control program.

Those skilled in the art will appreciate that the configuration of the device shown in fig. 1 is not intended to be limiting of the device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

In the hardware involved in the apparatus shown in fig. 1, the processor 1001 may be arranged to call up a control program stored in the memory 1002 and perform the following operations:

acquiring operation information between the touch pen and a writing interface;

In one embodiment, the processor 1001 may be configured to call a control program stored in the memory 1002, and further perform the following operations:

acquiring operation information between a touch device and a terminal;

determining a target operation object according to the operation information;

and outputting touch reminding information according to the pressure value.

Based on the hardware construction of the terminal, the embodiment of the control method of the terminal is provided.

Referring to fig. 2, fig. 2 is an embodiment of a control method of a terminal according to the present application, where the control method of the terminal includes:

step S10, obtaining a distance between the touch pen and the touch screen and a position of a touch point of the touch pen on the touch screen;

in this embodiment, the terminal includes a stylus and a touch screen. A chip for receiving signals is arranged on the touch screen, and a chip for transmitting signals is arranged on the touch pen. After the chip on the touch screen receives the signal transmitted by the touch pen through the chip, the terminal determines the strength of the signal, so that the distance between the touch pen and the touch screen is determined according to the strength of the signal. In addition, the receiving angle of the chip for receiving signals in the touch screen covers the upper part of the touch screen, so that the touch screen can receive signals transmitted by the chip in the touch pen only when the touch pen floats above the touch screen.

The stylus is also provided with a chip for receiving signals, the chip is generally positioned on a pen point of the stylus, and the pen point is a contact of the stylus. And a chip for transmitting signals is also arranged on the touch screen. The chip on the touch screen transmits a signal, so that the chip on the touch pen receives the signal, and the touch screen senses the position of the touch point on the touch screen, wherein the position refers to the projection position of the touch pen on the touch screen. It should be noted that the touch screen determines the distance between the touch screen and the touch point by receiving a signal transmitted by a chip on the touch pen, and the touch point of the touch pen is arranged at the pen point, and an application icon or a document corresponding to the projection position of the pen point on the touch screen is an object that a user wants to operate. Therefore, the chip for transmitting signals on the touch control pen can be arranged close to the pen point, namely the distance between the pen point and the transmitting chip is smaller than the preset distance, so that the distance between the touch control screen and the touch control pen can represent the distance between a contact point of the touch control pen and a target operation object, and the situation that the distance calculated by the touch control screen is large and the pen point is in contact with the touch control screen is prevented.

Step S20, determining a target operation object of the touch pen on the touch screen according to the position;

each icon on the touch screen corresponds to a function of the terminal, a document, or an application drawer including a plurality of application programs or application functions. The terminal can determine the target operation object according to the position of the touch point on the touch screen.

Specifically, after determining the position of the contact, the terminal determines whether the position is located on an icon, and if the position is located on the icon, an application program or a document corresponding to the icon can be determined as an object operated by the stylus pen, that is, a target operation object; if the position is in the gap between the icons, the icons adjacent to the gap are determined, then the distance between the position and each icon is calculated, and the application program or the document corresponding to each icon with the distance smaller than the preset distance can be used as the target operation object, or the application program or the document corresponding to the icon with the minimum distance can be used as the target operation object.

Step S30, determining the running information of the target operation object according to the distance;

the terminal stores a mapping relation between the distance and the operation information of the operation object, wherein the operation information comprises at least one of a target sub-menu in the target operation object, the size of a display interface of the target operation object, the privacy information of the target operation object, a control instruction of the target operation object, the display content of the target operation object, the display format of the target operation object and the function to be operated of the target operation object. For example, when the target operation object is a music player, if the distance is small, the control instruction is to play music, and if the distance is large, the control instruction is to pause playing; for another example, if the distance is large, the control instruction turns the page up, and if the distance is small, the control instruction turns the page down.

The target operation object includes a document, a folder, an application function, or an application drawer. When the target operation object is a document, the display content comprises at least one of document content, a display size of an image corresponding to the document and a display interface of the document. The document content refers to specific content in the document, such as characters, pictures and the like, different distances correspond to different document contents, if the distance is larger, the document content is a title of the document, and if the distance is smaller, the document content is a part of content in the document; the image corresponding to the document can be a thumbnail of the document, and different distances correspond to thumbnails with different display sizes, namely the size of a display interface of the document; the display interface of the document is the interface when the document is opened, the interfaces have different formats, different distances and different formats, namely the running information comprises the display format of the target operation object.

When the target operation object is an application function, the display content includes sub-functions of the application function, that is, the application function is an icon corresponding to a plurality of functions, that is, the running information includes a function to be run of the target operation object. For example, the icon set in the terminal corresponds to an application function, the setting includes security setting, WIFI setting, bluetooth setting, and the display content is sub-functions such as security setting, WIFI setting, bluetooth setting. At different distances, the displayed sub-functions are different. For example, when the distance is large, the displayed sub-function is the bluetooth setting, and when the distance is small, the displayed sub-function is the WIFI setting. And when the target operation object has a plurality of control menus, the run information may be a target sub-menu of the target operation object.

When the target operation object is a folder, the display content includes at least one of an image corresponding to the document, document content, a display size of the image corresponding to the document, and a display interface of the document. Since a plurality of documents are included in the folder, different documents within the document are displayed at different distances. And when only one document is included in the folder, the display content may be at least one of the document content, the display size of the image corresponding to the document, and the display interface of the document.

When the target operation object is an application drawer, the display content comprises an application icon, an application function and an operation method of an application program corresponding to the application icon. When the application drawer has a plurality of application icons, the display content is the application icons, namely different application icons are displayed at different distances. The application drawer is provided with a plurality of application functions, and the display content is icons corresponding to the application functions. In addition, the application program corresponding to the application icon has multiple operation methods, and the operation methods can be understood as the opening mode, the setting mode and the like of the application program; for example, the application program may be opened through an application icon on a desktop, may be opened through an applet corresponding to the WeChat, and may also be opened at regular time through a preset time, with different distances corresponding to different opening methods of the application program.

In addition, when the target operation object is a private folder, corresponding private information can be displayed according to the distance, that is, the running information includes the private information of the target operation object. And displaying the privacy information with different privacy grades if the distances are different.

It can be understood that the terminal stores the mapping relationship between the operation information and the distance of each operation object on the terminal in advance, and after the terminal obtains the distance between the stylus and the touch screen and determines the target operation object, the operation information of the target operation object can be determined according to the distance, the target operation object and the mapping relationship. The mapping relation between the running information and the distance of the operation object can be set on the terminal by a user, namely the terminal provides a running information setting interface corresponding to icons such as application icons and documents, so that the selected running information and the distance are obtained on the setting interface, and the selected running information, the distance and the operation object corresponding to the setting interface are stored in an associated mode.

And step S40, controlling the target operation object to operate according to the operation information.

And after the terminal determines the running information of the target operation object, controlling the target operation object to run according to the running information. For example, if the operation information is a control instruction, the control target operation object executes the control instruction. And when the operation information is the display content, controlling the touch screen to display the display content. It should be noted that the display content may be displayed on the touch screen in a preview form, that is, the terminal needs to determine a display area of the display content on the touch screen, so as to display the display content in the display area. The display area may be adjacent to the icon corresponding to the target operation object, or the display area may include the icon corresponding to the target operation object.

In the technical scheme provided by this embodiment, the terminal obtains the distance between the touch pen and the touch screen and the position of the touch pen on the touch screen, determines a target operation object of the touch pen on the touch screen according to the position, and determines operation information such as a control instruction and display content of the target operation object according to the distance, so as to control the target operation object to execute the control instruction and control the touch screen to display the display content of the target operation object. The terminal can display different display contents of the operation object according to the distance between the touch pen and the touch screen, and the operation object can execute the control instruction corresponding to the distance, so that the touch screen does not need to be operated for multiple times through the touch pen to search corresponding functions or display contents, and the touch operation process of the terminal is simple and convenient.

Referring to fig. 3, fig. 3 is a detailed flowchart of step S30 in fig. 2, where the step S30 includes:

step S31, determining the distance section where the distance is;

and step S32, determining the running information of the target operation object according to the distance.

In this embodiment, the terminal divides the distance between the stylus and the touch screen into a plurality of distance intervals, and different distance intervals are associated with different operation information of the operation object. For example, the distance intervals may be divided into three distance intervals, a far distance interval, a middle distance interval, and a near distance interval. After the terminal obtains the distance between the touch pen and the touch screen, the distance interval where the distance is located is determined, and therefore operation information is determined according to the distance interval and the target operation object.

Referring to fig. 4, fig. 4 is an operation schematic diagram of the terminal, where a target operation object is a document, and when a distance belongs to a long-distance interval, the touch screen displays a thumbnail of the document; when the distance belongs to the middle distance interval, the touch screen displays a global graph of the document; and when the distance belongs to the short-distance interval, receiving a control instruction for opening the document so as to open the document.

Further, referring to fig. 5, fig. 5 is another operation schematic diagram of the terminal, where a target operation object is an application function, and when a distance belongs to a long-distance interval, a first sub-function is displayed on the touch screen; when the distance belongs to the middle distance interval, displaying a second sub-function on the touch screen; and when the distance belongs to the short-distance interval, displaying a third sub-function on the touch screen.

In the technical scheme provided by this embodiment, after the terminal acquires the distance between the touch screen and the touch pen, the distance interval where the distance is located is determined, so that the running information of the target operation object is determined according to the distance interval, and the following change of the control instruction and the display content caused by the slight change of the distance is avoided.

Referring to fig. 6, fig. 6 is another detailed schematic flow chart of step S30 in fig. 2, where the step S30 includes:

step S33, determining an operation parameter corresponding to the target operation object according to the distance, wherein the operation parameter comprises at least one of an operation time point and an operation frequency of the target operation object;

and step S34, determining the running information of the target operation object according to the operation parameters.

In this embodiment, a mapping relationship between an operation parameter and a distance may be set for the operation object, the operation parameter including at least one of an operation time point and an operation number of the operation object. The terminal can determine the running information of the target operation object according to the operation parameters.

For example, when the target operation object is an application drawer, the application drawer includes a plurality of application programs therein. The terminal obtains the operation times of each application program, and the operation times can be running times. And the terminal sorts the application programs according to the sequence of the operation times from small to large. Referring to fig. 7, fig. 7 is another operation diagram of the terminal, when the distance belongs to the long-distance interval, controlling the touch screen to display a first application sorted first; when the distance belongs to the middle distance interval, controlling the touch screen to display a second application of the second sequence; and when the distance belongs to the close range, controlling the touch screen to display a third application of the third sequence.

In addition, the terminal can determine the use time period corresponding to each application program in the application drawer. The usage period is counted according to an operation time point of the application program. Specifically, the terminal determines the application programs that may be run by the user in the current time period according to the operation time points of the application programs, and then sorts the operation times of the application programs corresponding to the current time period, where the sorting manner is described above and is not described herein again. When the distance belongs to a long-distance interval, controlling the touch screen to display an application icon of a first application program sequenced in the current time period; when the distance belongs to the middle distance interval, controlling the touch screen to display an application icon of a second application program sequenced in the current time period; and when the distance belongs to the close range, controlling the touch screen to display the application icons of the application programs ranked in the third time period.

In addition, the terminal determines the target application program according to the operation time point of each application program, the operation time point of the target application program is located in the current time period, the distance intervals to which the distance between the touch pen and the touch screen belongs are different, and the target application programs displayed on the touch screen are different.

In the technical scheme provided by this embodiment, the terminal determines operation parameters such as an operation time point and operation times of the target operation object according to the distance between the touch pen and the touch screen, and then determines the operation information of the operation object according to the operation information, so that the operation information of the target operation object is matched with habits of a user.

Referring to fig. 8, fig. 8 is another embodiment of the control method of the terminal of the present application, and based on the embodiment shown in fig. 2, after step S40, the method further includes:

step S50, when a selection operation of the display content displayed on the touch screen is detected, locking the display content, where the locked display content is unchanged when a distance between the touch pen and the touch screen is changed.

In the present embodiment, the operation information refers to the display content of the target operation object. The distance between the touch pen and the touch screen is not fixed and may vary with the operation of the user, and it can be understood that the display content displayed on the touch screen may vary with the distance between the touch pen and the touch screen. When a user has a selection intention for a certain display content, the display content on the touch screen needs to be clicked through the touch point of the touch pen, but the touch point of the touch pen clicks the touch screen, so that the distance is changed, and the display content is changed. Therefore, the terminal provides a selection function, a user can select the function in real time through the touch pen to lock the display content currently displayed by the touch screen, the display content in the locked state cannot change along with the change of the distance between the touch pen and the touch screen, the user can select the locked display content to open or start the target operation object, and the running interface of the target operation object after the target operation object is opened or started is determined by the display content. Of course, the display content may also be locked for the user to peruse.

When the touch screen displays the display content, the selected button can be displayed; if the staying time of the touch point of the touch pen on the touch screen reaches a preset time, for example, staying for 2s, the display content can be locked. Correspondingly, when the touch screen displays the display content, the touch screen may display an unlock button, and if the dwell time of the touch point of the touch pen on the unlock button reaches a preset time, for example, 2s, the lock of the display content is released.

When the display content is in a locked state, if the terminal detects the touch operation of the touch screen by the stylus, determining an operation interface of the target operation object according to the locked display content, for example, the display content is part of or all of the content in the operation interface, or configuring the operation interface according to the display content. And after the target operation object is opened or started, the touch screen displays the determined running interface. For example, the locked display content is document content, the document content is all contents of the third chapter, and the operation interface is all contents of the third chapter after the target operation object is opened.

In the technical scheme provided in this embodiment, after the display content of the target operation object is displayed on the touch screen, if the selected operation on the touch screen for the display content is detected, the display content is locked, and the display content is prevented from changing according to the change of the distance, so that the user can view the display content conveniently or perform subsequent operations on the display content conveniently.

In one embodiment, the icon sets a corresponding area on the touch screen, and the area contains the icon. After the position of the touch point on the touch screen is determined, the area where the position is located is determined, the icon corresponding to the area is the target operation object, namely, the document, the folder, the application function or the application drawer corresponding to the area where the position is located is determined as the target operation object. The terminal sets the area for the icon, so that the position of the touch point of the touch pen on the screen does not need to be located on the icon, the operation object corresponding to the icon can be controlled to operate according to the operation information corresponding to the distance, and the operation fault tolerance rate of the touch pen is increased.

In one embodiment, the user does not necessarily operate the application on the terminal when using the stylus pen, but may simply view the stylus pen. If the user operates the touch pen but does not operate the application on the touch screen, the duration of the touch pen hovering over the touch screen is shorter. For this, the terminal stores a preset time length, and the preset time length does not exceed 5 s. When the duration of the hovering of the stylus on the touch screen reaches a preset duration, it may be determined that the user tends to operate the application program with the stylus, and at this time, the terminal performs steps S10-S40.

In this embodiment, the terminal obtains the suspension duration of the touch pen on the touch screen, so as to determine whether the user has an operation tendency on the application program on the terminal according to the suspension duration, thereby reducing the probability of the terminal responding to the misoperation of the user.

The application also provides a control method of the terminal.

Referring to fig. 9, fig. 9 is a further embodiment of a control method of a terminal according to the present application, where the control method of the terminal includes the following steps:

step S60, acquiring operation information between the touch device and the terminal;

in this embodiment, the execution subject is a terminal. The touch device can be an object sensed by the terminal, and the object refers to a non-circuit connection relation and a communication connection relation with the terminal. For example, the object may be a finger of the user, or any object held by the user. The terminal can be provided with a camera for image acquisition so as to sense an object. The touch device can also be a component on the terminal, for example, a rear shell on the terminal, the terminal can be provided with a touch area on the rear shell for a user to perform touch operation on the rear shell by using a finger, the terminal can perform corresponding control according to the touch operation of the user behind and the mirror effect of the rear shell operation, and the mirror effect refers to the mirror effect of the touch operation; or directly equating the touch operation on the rear shell to the touch operation on the touch screen on the terminal. The touch device may also be an external device connected to the terminal, for example, the touch device may be a stylus.

The operation information comprises the position of a contact of the touch device on the terminal, the distance between the touch device and the terminal or the stay time of the touch device on the terminal.

Step S70, determining a target operation object according to the operation information;

the terminal may determine the target operation object according to the position in the operation information, and refer to the above embodiment for the process of determining the target operation object according to the position, which is not described in detail herein.

The terminal can also determine a target operation object according to the distance. Specifically, the distance has a mapping relationship with each application or file on the terminal. The terminal can determine a target operation object corresponding to the distance in the application and the file displayed on the currently displayed interface.

In addition, the terminal can determine the target operation object according to the stay time of the touch device on the terminal, wherein the stay time refers to the duration of immobility of the touch device after the touch device is sensed by the terminal. The duration may represent a current selection state of the user, and when the duration is longer, it indicates what application the user is hesitant to use or read what document, and at this time, the application or document that the user likes is taken as a target operation object. When the duration is short, the user is indicated to purposefully use a certain application, and at the moment, the user can determine the application according to the position of the side contact of the touch device on the terminal; or displaying the application or the document recently used by the user according to the distance for further selection by the user, thereby determining the target operation object.

Step S80, determining the execution information corresponding to the target operation object according to a preset rule;

the preset rule comprises the current time, the current location of the terminal, the operation habit of the user on an operation object or the operation mode of the terminal. The terminal can determine the execution information corresponding to the target operation object according to a preset rule. The execution information is the running information, and the execution information includes a target sub-menu in the target operation object, a size of a display interface of the target operation object, private information of the target operation object, a control instruction of the target operation object, display content of the target operation object, a display format of the target operation object, and/or a function to be run of the target operation object. For the application and example of the execution information, reference is made to the above description, which is not repeated herein.

The following describes in detail the execution information corresponding to the terminal selection operation information according to the preset rule.

A. The preset rule is the current time

The operation information may correspond to a plurality of applications or documents. For example, the operation information corresponds to WeChat, Payment Bao, Taobao, and the like. If the current time is the off-duty time, the execution information is a riding code for opening WeChat; if the current time is the dining time, the execution information is the payment interface of the payment treasure opened; if the current time is near the double eleven, the execution information is to open a commodity interface concerned in panning and the like. The off-duty time, the dining time and the like are determined according to the actual off-duty time and the actual dining time of the user, namely the off-duty time and the dining time are the habit off-duty time and the habit dining time of the user.

B. Presetting a rule as the current location of the terminal

The execution information may be determined according to the current location of the terminal. Specifically, when the terminal detects that the place is a subway entrance, the execution information is to open a riding code in the WeChat; and when the current position is detected to be the tourist attraction at the terminal, executing the information to open a shooting interface of the camera.

C. The preset rule is the operation habit of the user to the operation object

The terminal can collect the operation records of the user on the application or the document, so that the operation habits of the user on the operation object are analyzed and obtained. For example, the target operation object is a music player, and the user often listens to a cheerful song, that is, the operation habit is to find the cheerful song, and at this time, the execution information is to automatically find the cheerful song. For another example, if the target operation object is a video player and the operation habit of the user is to watch a cartoon, the execution information is to automatically display the currently updated cartoon for the user.

D. Presetting rule as operation mode of terminal

The terminal may determine the execution information according to its own operation mode. For example, the terminal starts a split screen mode, the target operation object is WeChat, and at the moment, the execution information is that the voice chat of the chat interface of the WeChat is displayed, so that the WeChat interface is prevented from being occupied by typing. For another example, the terminal turns on the mute mode, the target operation object is a game, and the execution information is to modulate the volume of the target operation object to the lowest.

It is understood that the terminal may determine the execution information of the target operation object according to any preset rule. The user may set a preset rule on the terminal, and of course, the preset rule is also determined by the user on the historical operation information of the terminal. And when the preset rule set by the user conflicts with the preset rule determined by the terminal according to the historical operation information, determining the execution information of the target operation object by taking the preset rule set by the user as the reference. For example, the preset rule set by the user is to play soft music at a certain place, the preset rule determined by the terminal is to play songs stimulated by hot blood at the place, and if the terminal is at the place, the soft music is played.

And step S90, controlling the target operation object to operate according to the execution information.

After the execution information is determined, the terminal, i.e., the control target operation object, operates according to the execution information.

In the technical scheme provided by this embodiment, the terminal acquires operation information between the touch device and the terminal, so as to determine, according to an operation information target operation object, execution information corresponding to the target operation object according to a preset rule, and enable the terminal to operate according to the execution information. The terminal can automatically determine the target operation object and the execution information of the target operation object according to the operation information between the touch device and the terminal, and does not need to send a plurality of control instructions to the terminal, so that the touch operation of the terminal is simple and convenient.

Referring to fig. 10, fig. 10 is a schematic view of a detailed flow of step S70 in fig. 9, where step S70 includes:

step S71, determining the type of the touch device;

and step S72, determining the target operation object according to the type and the operation information.

In this embodiment, the touch device is an object sensed by the terminal, a component on the terminal, or an external device connected to the terminal. Different touch devices are different in the operation object. For example, the object sensed by the terminal is a finger of a person, and the operation objects corresponding to the finger are a game, a video player, a music player, and the like, so that the terminal determines the game, the video player, and the music player first, and then determines the target operation object from the three according to the operation information. For another example, the touch device is a back shell of the terminal, and the operation objects corresponding to the back shell are a memo, a calendar, a calculator and the like, that is, the terminal determines the memo, the calendar and the calculator according to the back shell, and then determines the target operation object from the memo, the calendar and the calculator according to the operation information. It can be understood that the terminal determines a plurality of operation objects preliminarily according to the type of the touch device, and then determines a target operation object in the preliminarily determined operation objects according to the operation information. The terminal determines the target operation object according to the operation information, and the above description is referred to, which is not repeated herein.

In the technical solution provided in this embodiment, the terminal determines the type of the touch device, and then determines the target operation object accurately according to the type and the operation information.

Referring to fig. 11, fig. 11 is a further embodiment of the control method of the terminal of the present application, and based on the embodiment shown in fig. 9, before step S60, the method further includes:

step S100, when the operation aiming at the terminal is detected, determining an operation object corresponding to the operation;

step S110, when the operation object is a touch device, executing the step of acquiring operation information between the touch device and the terminal.

In this embodiment, in the operation process of the terminal, only the operation information of the touch device is responded, and the operation of the non-touch device is not responded, so that the power consumption loss of the terminal is avoided. For example, when the terminal is placed in a pocket, cloth of the pocket is sensed by the terminal, and if the terminal responds according to operation information between the sensed cloth and the terminal, the terminal may be operated by mistake. In this regard, the terminal responds only to the operation information of the touch device.

When the terminal detects the operation aiming at the terminal, the operation object corresponding to the operation is determined, and the camera can be adopted to carry out image acquisition on the operation object. And if the operation object is the touch device, acquiring operation information between the touch device and the terminal, and responding according to the operation information.

In the technical scheme provided by this embodiment, when the terminal detects an operation, the terminal determines an operation object corresponding to the operation, and when the operation object is a touch device, acquires operation information between the touch device and the terminal to perform a corresponding response, thereby avoiding the terminal performing an incorrect operation.

The application also provides a control method of the touch control pen.

Referring to fig. 12, fig. 12 is a diagram illustrating an embodiment of a method for controlling a stylus according to the present application, where the method for controlling the stylus includes the following steps:

step S120, acquiring operation information between the touch pen and a writing interface;

in this embodiment, the execution main body is a touch pen, and the touch pen is in communication connection with the terminal. The stylus includes but is not limited to a pen type, and the stylus may have a sensed touch point or not, any type of object sensed by the terminal may be regarded as the stylus, and the sensed type of the terminal includes but is not limited to camera sensing, signal sensing, and the like.

The touch pen is a control terminal, the terminal is a terminal to be controlled, and the terminal can be a mobile phone and the like. The writing interface can be a touch interface of the terminal; the touch interface can be a touch interface of the stylus, or a touch interface connected with the stylus, for example, the stylus can control the mobile phone based on a touch screen of the air conditioner; or the writing interface may also be an air projection interface.

The operation information includes a position of a contact of the stylus on the writing interface, a distance between the stylus and the stylus, or a dwell time of the stylus on the writing interface.

Step S130, determining a target operation object and operation information according to the operation information;

the terminal can determine a target operation object and operation information of the target operation object according to the operation information, wherein the operation information includes a target sub-menu in the target operation object, a size of a display interface of the target operation object, private information of the target operation object, a control instruction of the target operation object, display content of the target operation object, a display format of the target operation object and/or a function to be operated of the target operation object. The operation information determines a target operation object and operation information, and a distance description of the operation information, which please refer to the above description specifically, and is not repeated herein.

And step S140, controlling the target operation object to operate according to the operation information.

And after the target operation object is determined, controlling the operation of the target operation object case operation information. That is, the stylus pen determines a control instruction according to the operation information, and sends the control instruction to the terminal, so that the terminal operates according to the control instruction. Of course, the stylus pen can directly send the operation information to the terminal, so that the terminal operates according to the operation information.

In the technical scheme provided by this embodiment, the stylus acquires operation information between the stylus and the writing interface, so as to determine a target operation object and operation information according to the operation information, thereby controlling the target operation object to operate according to the operation information. The touch control pen can control the terminal to perform corresponding operation according to the operation information between the touch control pen and the writing interface, so that the touch control operation process of the terminal is simple and convenient without performing multiple operations on the writing interface through the touch control pen to operate the terminal.

Referring to fig. 13, fig. 13 is another embodiment of the method for controlling a stylus according to the present application, and based on the embodiment shown in fig. 12, the step S130 includes:

step 131, acquiring a preset rule, and determining a target operation object and operation information according to the preset rule and the operation information.

In this embodiment, the terminal may determine the target operation object according to the operation information, and then determine the operation information of the target operation object according to a preset rule. The preset rule can be determined according to reference characteristics, wherein the reference characteristics comprise the current time, the position of the touch pen, the operation habit of a user on an operation object or the operation mode of the touch pen-controlled terminal. That is, the preset rules correspond to the reference features one to one.

The operation information of the target operation object determined according to the preset rule may refer to the above description, and is not described herein again.

In the technical scheme provided by this embodiment, the stylus acquires the preset rule, and determines the operation information of the target operation object accurately according to the preset rule and the operation information.

Referring to fig. 14, fig. 14 is a detailed flowchart of step S130 in fig. 12, where the step S130 includes:

step S132, determining a user identifier corresponding to the touch pen;

step S133, determining a target operation object and operation information according to the user identifier and the operation information.

In this embodiment, the stylus pen may be an office pen, that is, each member of the office may control the terminal through the stylus pen. And the control requirements and control habits of different members on the terminal are not exactly the same. In this regard, the stylus determines a corresponding user identification, which characterizes the user. The touch control pen can be provided with a fingerprint acquisition device, and the user identification is determined through the fingerprint acquisition device. Or a camera is arranged on the touch pen, and the face is collected to determine the user identification. Still alternatively, a voice acquisition module may be disposed on the stylus pen to determine the user identifier through the voice of the user.

After the stylus pen determines the user identifier, the target operation object and the operation information of the target operation object can be determined according to the user identifier and the operation information.

In the technical scheme provided by this embodiment, the stylus determines the user identifier, so that the target operation object and the operation information of the target operation object are determined according to the user identifier and the operation information, the stylus accurately determines the operation information according with the intention of the user, so that the terminal operates according to the operation information, and the degree of intelligence of the stylus is high.

The application also provides a control method of the mobile terminal.

Referring to fig. 15, in an embodiment, the method for controlling a mobile terminal includes:

step S150, operation information between the touch device and the mobile terminal is obtained, and a target application interface is obtained according to the operation information, wherein the operation information comprises that a touch pen is suspended on a display screen of the mobile terminal.

In this embodiment, the mobile terminal may be a smart phone, a tablet computer, or the like.

Optionally, signal receivers are respectively disposed at four corners of a display screen of the mobile terminal, when the stylus is suspended above the display screen, multiple positions of the stylus are selected as calibration points corresponding to the four positions of the signal receivers, and a distance between each calibration point and the corresponding receiver is required to be relatively closer than a distance between the calibration point and another receiver, distances from the stylus to the four receivers are calculated according to a time difference of the signals received by each receiver and coordinate position information of the receiver, and spatial coordinates of the stylus in a display plane coordinate system using the display plane as a reference plane are calculated, and then projected onto the display plane to obtain coordinates of projection points, where the coordinates of the projection points can be used as positions of the stylus on the display screen. That is, the terminal can detect whether the stylus is currently hovering over the display screen through the four signal receivers.

It should be noted that the stylus (signal generator) is allowed to transmit signal pulses (each pulse may be of multiple wavelengths) at a fixed frequency as a stylus signal, such as ultrasonic pulses.

Optionally, the display screen of the mobile terminal may also detect an infrared signal, and the stylus may send the infrared signal to the display screen, and when the terminal detects the infrared signal sent by the stylus through the display screen, it may be determined that the stylus is suspended on the display screen of the mobile terminal. The touch position of the infrared signal on the display screen can be used as the touch point position of the touch pen on the display screen.

Optionally, the terminal obtains operation information between the touch device and the mobile terminal, and obtains the target application interface according to the operation information, where the touch device is a stylus, the operation information is that the stylus is suspended on a display screen of the mobile terminal, and at this time, the target application interface is obtained.

Optionally, the terminal may obtain at least one preset application interface as the target application interface. The preset application interface may be preset by a user or set by a designer of the mobile terminal (i.e., default setting of the system), and the preset application interface may be an application interface on a certain application currently installed on the mobile terminal, such as a main interface of the wechat application, a home interface of the microblog application, and the like. It should be noted that the preset application interface may be all main interfaces of a certain application; when a plurality of preset application interfaces are provided, the application interfaces can also be application interfaces of a plurality of different applications.

For example, because the user needs to frequently use the home interface of the wechat application and the home interface of the microblog application, the user can set both the home interface of the wechat application and the home interface of the microblog application as preset application interfaces.

Alternatively, the terminal may acquire the target application after detecting that the stylus pen hovers on the display screen of the mobile terminal, and then further acquire an application interface of the target application as the target application interface. The target application may be a preset application, and the preset application interface may be preset by a user, or may be set by a designer of the mobile terminal (i.e., default setting of the system), such as a wechat application, a microblog application, and the like. Optionally, the terminal may acquire a preset application as a target application, and use at least one application interface in the target application as a target application interface. For example, when the preset application is a WeChat application, the target application interface may include a chat interface, an address book interface, a friend circle interface, a discovery interface, a setting interface, and the like.

And step S160, displaying the target application interface in a target area of the display screen.

Alternatively, referring to fig. 16, in the display area of the display screen 20 of the mobile terminal 10, a target area 30 is provided. The target area 30 may be displayed on the display screen 20 in the form of a floating frame after the stylus is suspended on the display screen of the mobile terminal; the target area 30 may also be in the form of a transparent area on the display 20 after the stylus is suspended on the display of the mobile terminal.

Optionally, the target area may be used to display a plurality of target application interfaces.

Alternatively, referring to fig. 17, the terminal may display the acquired target application interface 31 in the target area 30.

Optionally, after detecting that the stylus is suspended on the display screen of the mobile terminal, the terminal may start to record and acquire a suspension duration of the stylus on the display screen, and when detecting that the acquired suspension duration is greater than a second preset duration, the terminal performs the step of acquiring the target application interface. Therefore, misjudgment of the terminal on the display of the target application interface can be reduced, frequent display of the target application interface in the target area is avoided, and the user can use the touch pen at will. It should be noted that the second preset time period may be set according to actual requirements, for example, 3 seconds to 5 seconds.

In one embodiment, after detecting that a touch pen floats on a display screen of a mobile terminal, acquiring a target application interface; and displaying the target application interface in a target area of the display screen. Therefore, based on the suspension detection of the touch pen, when the touch pen is suspended on the display screen, the target application interface which needs to be checked by the user is acquired and displayed in the target area of the display screen, and the user can conveniently and quickly check the application interface.

In an embodiment, the terminal may acquire the target application after detecting that the stylus is hovering on a display screen of the mobile terminal, and then further acquire an application interface of the target application as the target application interface.

Optionally, the terminal may obtain a position of a touch point of the stylus on the display screen when the stylus is detected to be hovering on the display screen of the mobile terminal, and then obtain the target application according to a relationship between the position of the touch point and a display position of the application on the display screen.

Alternatively, referring to fig. 18, the terminal may acquire an application in which the touch point position 40 is in the display position of the application 21 on the display screen 20, and take the acquired application as a target application.

For example, when the touch point position of the touch pen is at the icon display position of the WeChat application, the WeChat application is acquired as the target application; and when the touch point position of the touch pen is at the icon display position of the microblog application, acquiring the microblog application as a target application.

Optionally, after the terminal acquires the target application, at least one application interface in the target application is used as the target application interface.

In this way, a user can change the position of the touch point (i.e., the position of the touch point of the touch pen) by moving the touch pen suspended on the display screen, and switch the target application by controlling the position of the touch point to be located in the display position of different applications, i.e., switch the target application interface displayed in the target area. For example, when the touch point position is currently located in the display position of the wechat application, the application interface of the wechat application is displayed in the target area, and when the touch point position is located in the microblog application by a user, the terminal switches the target application interface displayed in the target area to the application interface of the microblog application.

Therefore, the user can be helped to quickly preview the application interfaces of different applications, and the user can conveniently and quickly view the application interfaces.

In an embodiment, after detecting that a stylus floats on a display screen of a mobile terminal, a terminal acquires a position of the stylus on the display screen when the stylus floats.

Optionally, after the terminal obtains the touch point position, it may detect whether the touch point position is within the range of the target area, and when it is detected that the touch point position is not within the range of the target area, adjust the display position of the target area, so that the touch point position is within the range of the target area.

Therefore, the user can control the movement of the target area by controlling the position of the touch point, and then the display position of the target area on the display screen is adjusted.

Optionally, when the user hovers the stylus on the display screen, the display scale of the target application interface in the target area can be changed by controlling the movement of the stylus. Optionally, when the display scale of the target application interface is related to the display scale of the target area, the user may adjust the display scale of the target application interface in the target area by changing the display scale of the target area.

Optionally, when the stylus pen hovering over the display screen moves, a plurality of touch point positions are generated, and the terminal may form a moving track of the touch point positions by capturing the plurality of touch point positions.

Optionally, the terminal may adjust the display scale of the target area according to the moving track of the touch point position, so as to adjust the display scale of the target application interface in the target area.

Optionally, the terminal is preset with preset tracks corresponding to different display scale adjustment instructions, where the display scale adjustment instruction may be a display scale scaling instruction and a display scale enlarging instruction.

Optionally, after acquiring the moving track of the touch point position, the terminal detects whether a preset track matched with the moving track exists, and after detecting the preset track identical to the moving track, acquires a display scale adjustment instruction corresponding to the preset track, and adjusts the display scale of the target application interface in the target area by executing the display scale adjustment instruction. When the terminal executes the display scale amplification instruction, the display scale of the target application interface can be increased by increasing the area range of the target area; when the terminal executes the display scale scaling instruction, the display scale of the target application interface can be reduced by reducing the area range of the target area.

For example, referring to fig. 19, the terminal may preset a preset track corresponding to the display scale enlargement instruction as the touch point position 40 moves to the area outside the target area 30 at the corner position of the target area 30, and then when the user controls the touch point position 40 to be located at the corner position of the target area 30 and further drags the touch point position 40 to the area outside the target area 30, the terminal determines that the movement track of the current touch point position is the same as the preset track corresponding to the display scale enlargement instruction, and then the terminal executes the display scale enlargement instruction to increase the display scale of the target application interface 31 in the target area 30.

Optionally, the terminal may preset a preset track corresponding to the display scaling instruction as the touch point moves from the corner position of the target area to the center position of the target area, and then when the user controls the touch point to be located at the corner position of the target area and further drags the touch point to the center position of the target area, the terminal determines that the moving track of the current touch point is the same as the preset track corresponding to the display scaling instruction, and then the terminal executes the display scaling instruction to reduce the display scale of the target application interface in the target area.

It should be understood that the preset trajectory is not limited to the above, and for example, the preset trajectory corresponding to the display scale-up instruction may also be a segment of a circular trajectory.

Therefore, the display proportion of the target application interface can be conveniently adjusted by the user at will, and the user can check the application interface in the target area more conveniently.

Optionally, the terminal may open the shortcut application according to a moving track of the touch point position.

Optionally, the terminal is preset with preset tracks corresponding to different quick opening modes, where applications associated with the different quick opening modes may be preset by a user, and the applications may be any application on the mobile terminal, such as a WeChat friend circle, a video shooting application, and the like.

Optionally, after acquiring the moving track of the touch point position, the terminal detects whether a preset track coincident with the moving track exists, and after detecting the preset track identical to the moving track, acquires a quick opening mode associated with the preset track, and then opens an application corresponding to the quick opening mode.

Optionally, the terminal may preset tracks corresponding to different quick opening modes as tracks for the touch point to move from the middle area of the target area to different boundary lines of the target area. For example, the target area may include four boundary lines, namely, an upper boundary line, a lower boundary line, a left boundary line, a right boundary line, and a third boundary line, and when the terminal detects that the movement track of the current touch point position moves toward the upper boundary line of the target area, the quick opening mode associated with the preset track corresponding to the upper boundary line is the WeChat friend circle, the quick opening mode is the WeChat friend circle.

Therefore, the user can conveniently and quickly open the application corresponding to the quick opening mode.

In one embodiment, after displaying the target application interface in the target area, the user may enter the target application interface by selecting the target application interface in the target area. When the terminal detects the selection operation of the target application interface in the target area, the target application interface targeted by the selection operation is displayed in the main interface of the display screen, and meanwhile, the display of other target application interfaces is cancelled.

Alternatively, the user may click on the target application interface in the target area by using a stylus to issue a selected operation of the target application interface.

Further, when the terminal detects a selection operation sent by the stylus through clicking the target application interface, the terminal starts to record the contact time of the stylus and the target application interface as the selection duration corresponding to the selection operation, and the selection duration is compared with the first preset duration.

Optionally, when the terminal detects that the selected duration is less than or equal to a first preset duration, the target application interface is displayed through a main interface of the display screen.

Optionally, when the terminal detects that the selected duration is longer than a first preset duration, the interface content of the target application interface is obtained, and the obtained interface content is copied to a clipboard of the mobile terminal, so that a user can copy the interface content in the target application interface conveniently.

Optionally, the stylus is provided with a signal sending key, and the user can send the first signal and the second signal to the terminal by pressing the signal sending key, wherein the terminal takes the signal sent by the stylus first as the first signal and takes the signal sent by the stylus subsequently as the second signal. Further, when the terminal detects that the selected duration is longer than a first preset duration, the terminal starts to receive a first signal and a second signal sent by the stylus, records a first contact point between the stylus and the target display interface when receiving the first signal, and records a second contact point between the stylus and the target display interface when receiving the second signal. And then, the terminal acquires the content information between the first contact point and the second contact point, and copies the content information to a clipboard of the mobile terminal as the interface content in the target application interface so as to facilitate the user to copy the interface content in the target application interface. For example, through the method, a user can conveniently capture a piece of text information on the target application interface.

Optionally, when the terminal detects that the selected duration is longer than a first preset duration, and in the process that the terminal acquires the interface content of the target application interface, the key information in the target application interface is identified, and then the identified key information is copied to a clipboard of the mobile terminal as the interface content.

Note that the key information includes at least one of document information (an identification card, a driver's license, a passport, and the like), a telephone number, and address information.

Alternatively, the certificate information may be information having the same number of characters as the certificate number. For example, character information composed of 18-bit digits is recognized as an identification number (it should be understood that character information in which 17 is a combination of a digit and a 1-bit letter is also possible).

Alternatively, the telephone number may be character information consisting of 13 digits, or character information consisting of an area code plus 8 digits. Character information consisting of 13 digits is recognized as a telephone number, or character information consisting of an area code plus 8 digits is recognized as a telephone number.

Alternatively, the address information may be a character information combination having a regional administrative area identification character of "province", "city", "district", "town", or the like. The character information of the identification characters of the administrative regions of the areas such as province, city, district and town is identified as the address information, for example, the 18 th number of the south lake Daiao in the east China, Handong city, Handong, is the address information.

Optionally, the text information and the picture information in the target display interface are recognized through a machine learning technology, and the recognized document information (identity card, driving license, passport, etc.), telephone number, and address information are all used as key information.

Therefore, the user can select the key information in the target display interface conveniently.

Optionally, when the terminal detects that the selected duration is longer than the first preset duration, the terminal may perform screen capture processing on the content currently displayed on the target display interface to capture the interface content of the target application interface, so as to generate and store a screenshot of the target application interface.

Therefore, the user can conveniently perform screenshot operation on the target display interface.

Optionally, the user may control the stylus to float on the target application interface in the target area, and when the terminal detects that the floating duration of the stylus on the target application interface is longer than a second preset duration, it is determined that the selected operation of the target application interface is received, the target application interface with the stylus floating at present is obtained, and the obtained target application interface is displayed in the main interface of the display screen. It should be noted that the second preset time period may be set according to actual requirements, for example, 3 seconds to 5 seconds.

Alternatively, the user may directly click the target application interface in the target area by hand to issue a selection operation of the target application interface.

In an embodiment, when the selected operation of the target application interface is detected, the target application interface is displayed through a main interface of the display screen. Therefore, the user can conveniently and quickly enter the target application interface.

In an embodiment, the terminal determines that the stylus is away from the top of the display screen, where the stylus is in contact with the display screen (i.e., the stylus clicks the display screen), or the distance between the stylus and the display screen is greater than a predetermined distance (e.g., the user takes the stylus away).

Optionally, when the terminal detects that the stylus pen leaves the upper part of the display screen, the display of the target area can be cancelled, so that the display of the target application interface in the target area is cancelled.

Alternatively, when the terminal detects that the stylus pen leaves the upper part of the display screen and the target area is displayed in the form of a transparent area, the terminal can directly cancel the display of the target application interface in the target area.

Therefore, the user can be helped to cancel the display of the target application interface quickly when the user does not need to view the target application interface.

The application also provides a terminal control method of the built-in touch pen

Referring to fig. 20, in an embodiment of the present application, a method for controlling a terminal with a built-in stylus includes:

step S170, detecting operation information between the touch pen and the terminal, wherein the operation information comprises pressing operation of a pressing key of the touch pen;

the terminal control method of the built-in touch pen is mainly used for interaction between the terminal and the touch pen which is not pulled out. The terminal related to the terminal control method with the built-in touch pen provided by the application comprises but is not limited to a mobile phone, a tablet computer, a computer and the like, and a related application system is pre-loaded on the terminal.

In this embodiment, the terminal includes a touch pad provided with a pressing key and a touch pen fixing position, where a touch pen is fixed on the touch pen fixing position, and the touch pen is provided with the pressing key. The push button can be sprung or pushed back. The pressing operation comprises a bouncing operation and a pressing back operation, the bouncing operation corresponds to bouncing of the pressing key, and the pressing back operation corresponds to pressing back of the pressing key. It can be understood that, a sending unit is further disposed in the stylus pen, and is used for sending a corresponding pressing operation to the terminal when the stylus pen is bounced or pressed back. The existing touch pen can simulate the left-click operation of a mouse in a click mode, so that simple interaction with controlled devices such as a tablet personal computer is realized, and characters (including letters, numbers, characters and symbols) or drawings and the like can be input on handwriting input software loaded on the controlled devices such as the tablet personal computer in a handwriting mode. In order to prevent the loss of the stylus and to quickly find the control pen, mobile terminals with built-in stylus are available on the market. Because the mobile terminal with the built-in touch pen can not realize the functions when the touch pen is not pulled out, the existing terminal with the touch pen can not interact with the terminal when the touch pen is not pulled out, a pressing key capable of bouncing up or pressing back is arranged at the pen point of the touch pen, even if the touch pen is in the touch pen fixing position of the terminal, the touch pen can also interact with the terminal through the pressing key on the touch pen, and the interaction is set by a user in a self-defined mode or is set in a default mode. When a user has a requirement for interacting with the terminal, pressing a pressing key on the touch control pen, feeding back information corresponding to the pressing operation to the terminal by the touch control pen, and detecting the information corresponding to the pressing operation fed back by the touch control pen in real time by the terminal. It is understood that the operation information between the stylus pen and the terminal includes a pressing operation of a pressed key of the stylus pen.

And step S180, after the operation information between the touch pen and the terminal is detected, the terminal carries out preset operation.

In this embodiment, the terminal performs a preset operation after detecting the pressing operation. Wherein the preset operation comprises at least one of:

the terminal clearing inactive applications, including running but unused applications;

the terminal deletes a target file of which the file type is a preset type in all files of the inactive application;

and the terminal starts a preset application.

It is to be understood that the preset operation is not limited to the above-listed operations. The preset operation can also be other interactive operations such as turning up or turning down the ring of the terminal and/or displaying unread mails.

For a better understanding of the present embodiment, the following examples are set forth. For example, a user sets in advance in a preset operation setting interface, and sets the preset operation as clearing the inactive application of the terminal. When the stylus is not pulled out and the user presses the pressing key of the stylus, for example, the user pops up the pressing key and presses back the pressing key within a preset time, the stylus feeds back information of the pressing operation to the terminal, and the terminal detects the pressing operation information fed back by the stylus and then clears the inactive application of the terminal. It can be understood that, the present embodiment is not limited to the number of the preset operations, and the user may preset a plurality of interactive operations, and execute the preset plurality of interactive operations after the terminal detects the pressing operation information fed back by the stylus.

In the technical scheme disclosed in this embodiment, a pressing operation of a pressing key of a stylus pen is detected first, and then, after the pressing operation is detected, the terminal performs a preset operation. According to the method and the device, the terminal can be arranged in the terminal when the touch pen of the terminal is not pulled out, the terminal is interacted through the pressing key of the touch pen, and the terminal is subjected to preset operation, so that the problem that the terminal with the touch pen cannot be interacted with the terminal when the touch pen is not pulled out is solved.

In one embodiment, the states of the stylus include a pulled-out state and a non-pulled-out state. Since the preset operation set in the state where the stylus is pulled out is different from the control parameter set in the state where the stylus is not pulled out, the state of the stylus is detected by the detection device on the fixed position after the pressing operation is detected in order to distinguish the next operation. And when the stylus is not pulled out, acquiring a preset operation corresponding to the state of not pulling out, and performing the preset operation.

And when the touch control pen is detected to be pulled out, adjusting display parameters when the touch control pen contacts the screen of the terminal.

Specifically, the adjusting the display parameter when the stylus touches the screen of the terminal includes at least one of: changing the color of a line displayed when the touch pen is in contact with the screen of the terminal; and changing the thickness of the line displayed when the touch pen contacts the screen of the terminal. And when the pressing operation is detected and the touch control pen is pulled out, changing the color of the line displayed when the touch control pen contacts the screen of the terminal. Or changing the thickness of a line displayed when the touch pen contacts the screen of the terminal. Or when the pressing operation is detected and the touch control pen is pulled out, changing the color and thickness of lines displayed when the touch control pen contacts the screen of the terminal. The line color and the line thickness are preset in the setting interface by the user, and can also be default settings.

In the technical scheme disclosed in this embodiment, the fixed state of the stylus is detected after the pressing operation is detected, and then the corresponding preset operation is performed according to the fixed state of the stylus.

In an embodiment, when a preset operation is executed, the permission of the preset operation needs to be verified first, and the terminal invokes a self-verification mechanism to verify the permission of the preset operation. It can be understood that each application is an application, each application system is assigned an authority combination, the authority combination is an authority list owned by the application, the authority verification is to verify the authority required to be specified when doing a certain task, then judge whether the intelligent management application is in the applied authority combination according to the required authority, if the intelligent management application is in the applied authority combination, the authority verification is passed, and if the intelligent management application is not in the applied authority combination, the authority verification is not passed. And when the authority passes the verification, the terminal performs preset operation. And when the authority verification is not passed, the preset operation is not executed.

In the technical scheme disclosed in this embodiment, after the pressing operation is detected, the authority verification is performed first, and when the authority verification passes, the terminal performs the preset operation, so that an effect of avoiding the execution of the preset operation from affecting the use of the terminal system is achieved.

In an embodiment, since the interaction requirements of the user are diversified, the default preset operation may not meet the requirements of the user, and thus a preset operation customization mode needs to be provided for the user. The pressing key of the stylus pen in this embodiment may also be rotated, and when the terminal detects that the pressing key is rotated by a preset angle and the stylus pen is not pulled out, the terminal obtains information of a preset operation setting interface, and displays the preset operation setting interface after generating the preset operation setting interface according to the information. And acquiring the setting operation of the user through the preset operation setting interface.

Specifically, a user can customize a preset operation on the preset operation setting interface, and when the terminal detects a setting operation triggered based on the preset operation setting interface, the user-defined preset operation is determined according to the setting operation.

Further, after the preset operation defined by the user is determined according to the setting operation, the currently determined preset operation is updated to the preset operation corresponding to the pressing operation and capable of being triggered by the pressing operation.

It can be understood that the preset operation is updated every time the user sets one preset operation. Or after the plurality of operations of the user are set, updating the plurality of operations which are not preset.

The embodiment can generate the preset operation setting interface for the user to perform the preset operation, thereby avoiding the operation performed by the interaction between the terminal and the touch pen from being the operation not desired by the user.

In order to achieve the above object, the present application further provides a device with a built-in stylus, the device with the built-in stylus, and a fixing position for fixing the touch pad.

As shown in fig. 21, the stylus built-in apparatus 100 further includes a detection unit 101 for detecting an operation of the stylus. An execution unit 102, wherein the execution unit 102 is configured to control the apparatus to execute a preset operation according to an operation of the stylus.

Optionally, the operation of the stylus includes a pressing operation of a pressing key of the stylus and/or a rotating operation of the pressing key of the stylus.

As an embodiment, the device with a built-in stylus 100 further includes a state detection unit 103, where the state detection unit 103 is configured to detect a fixed state of the stylus, where the fixed state includes an unplugged state and/or an unplugged state. Wherein, when the operation of the stylus is a pressing operation of the pressing key and the fixed state is the unplugged state, the preset operation includes at least one of:

the apparatus purging inactive applications, including running but unused applications;

the device deletes a target file of which the file type is a preset type in all files of the inactive application;

and the terminal starts a preset application.

Further, when the operation of the stylus is a pressing operation of pressing a key, and the fixed state is an unplugged state, the preset operation is adjusting a display parameter when the stylus contacts a screen of the device, where the display parameter includes at least one of:

adjusting the color of a line displayed when the touch pen contacts the screen of the device;

and adjusting the thickness of the lines displayed when the touch pen contacts the screen of the device.

Displaying a preset operation setting interface when the operation of the touch control pen is the rotation operation of pressing a key and the fixed state is the unplugged state; and the preset operation setting interface updates the preset operation according to the setting operation of the user.

In the technical scheme disclosed in this embodiment, the device with the built-in stylus includes a stylus provided with a pressing key, a fixed position of the stylus, a detection unit and an execution unit, and the terminal performs a preset operation by detecting a pressing operation of the pressing key of the stylus and then detecting the pressing operation. According to the method and the device, the terminal can be arranged in the terminal when the touch pen of the terminal is not pulled out, the terminal is interacted through the pressing key of the touch pen, and the terminal is subjected to preset operation, so that the problem that the terminal with the touch pen cannot be interacted with the terminal when the touch pen is not pulled out is solved.

The application also provides a touch reminding method based on the touch pen.

Referring to fig. 22, a first embodiment of the present application provides a method for touch reminding based on a stylus, where the method includes:

step S190, after operation information of the touch control screen by the touch control pen is detected, obtaining a pressure value detected by the pressure sensor, wherein the operation information comprises writing operation of the touch control screen by the touch control pen;

in this embodiment, the execution subject is a terminal. The terminal can be a smart phone, a Pad, a notebook computer, a learning machine, an electronic book and other devices with touch screens. The touch screen is loaded with a pressure sensor for detecting a pressure value acting on the touch screen. The pressure sensor converts the pressure signal into an electric signal after receiving the pressure signal, and transmits the electric signal to the controller. Among them, the pressure sensor is preferably a strain sensor. The strain sensor means that a test piece deforms under stress, and a sensitive grid of the strain gauge also obtains the same deformation, so that the resistance of the strain gauge changes along with the deformation and is converted into a corresponding electric signal, such as current or voltage change.

The touch pen is made of a conductive material and has a conductive characteristic, and is used for touch control of the touch screen to complete man-machine conversation operation. The touch pen is detachably installed on the terminal, is used by being combined with a touch screen of the terminal, and is applied to software with special functions, such as drawing, handwriting, animation design and the like.

When the touch control screen is pressed by the touch control pen, the pressure sensor loaded on the touch control screen can detect the pressure value generated on the touch control screen. It is understood that the operation information of the touch screen by the touch pen includes writing operation of the touch screen by the touch pen

And S200, outputting touch reminding information according to the pressure value.

After the terminal acquires the pressure value detected by the pressure sensor, touch prompting information is output according to the size relation between the pressure value and the preset pressure value.

The touch prompting information is represented in the form of one or more of characters, pictures, animations, videos, voice, light and vibration, and can be displayed in a prompt box in a mode of a prompt box.

The step of outputting touch prompting information according to the pressure value comprises the following steps:

and outputting corresponding touch prompting information according to the pressure value and the current reference parameter.

The current reference parameter includes at least one of current environment information, current time information and current user information, and the environment information may include at least one of environment brightness, location information, environment temperature and weather information; the time information may include at least one of a time period in which the current time point is located and a use duration of the terminal; the user information may be a user characteristic, which may be identified by fingerprint recognition or image recognition.

In this embodiment, outputting corresponding touch prompting information according to the pressure value and the current reference parameter includes: acquiring a mapping relation between a reference parameter corresponding to the pressure value and the touch reminding information; and acquiring touch reminding information corresponding to the current reference parameter according to the mapping relation.

Different mapping relations between the reference parameters and the touch reminding information can be set when the pressure value is larger than a preset threshold value and the pressure value is smaller than the preset threshold value, different reminding can be realized according to the different mapping relations, and the reminding accuracy is improved; or setting a mapping relation between different pressure values and the touch reminding information according to different reference parameters.

For example, the terminal performs reminding in different reminding modes according to different time periods, can perform reminding in a mode of combining voice and animation, can perform reminding in a mode of combining voice, animation and vibration modes, and can perform reminding by using voice alone or animation alone. For example, in working hours of a working day, corresponding reminding information of too large touch pressure or too small touch pressure is carried out in the form of animation and vibration or independently in the form of animation; reminding in a mode of combining voice, animation bullet frames and vibration modes from six o 'clock to ten o' clock at night; reminding in a mode of popping a frame by an animation from ten points at night to eight points in the morning of the next day; and reminding in a mode of combining voice, animation and vibration modes in the daytime of weekends. In practical application, the user can set one or more reminding modes preferred by the user.

In this embodiment, by obtaining the pressure value, touch prompting information is output according to the pressure value, and voice and animation prompting is performed on poor touch strength of the user, so that the user can accurately grasp information of touch strength errors to perform timely adjustment, and touch efficiency is improved.

In an embodiment, when the pressure value is greater than a second preset pressure value, a prompt message indicating that the touch pressure is too large is output, wherein the first preset pressure value is less than the second preset pressure value. And when the pressure value is greater than the second preset pressure value, reminding is not carried out, or reminding information of the reduced force is output.

It is understood that, in other modified embodiments of the present embodiment, step S200 includes: when the pressure value is larger than a second preset pressure value, outputting reminding information of overlarge touch pressure, and when the pressure value is smaller than a first preset pressure value, outputting reminding information of undersize touch pressure, wherein the first preset pressure value is smaller than the second preset pressure value. And when the pressure value is smaller than the second preset pressure value, reminding is not carried out, or reminding information for increasing the strength is output.

The first preset pressure value is a minimum pressure value at which a user can touch with a stylus. When the pressure value is smaller than the first preset pressure value, the touch control force is too light to be displayed on the touch control screen when the user uses the touch control pen, and the user needs to be reminded of increasing the scribing force.

The second preset pressure value is a maximum pressure value which does not damage the pen point of the touch pen when the user uses the touch pen, wherein the first preset pressure value is smaller than the second preset pressure value. When the pressure value is greater than the second preset pressure value, it is described that when the user uses the stylus, the touch strength is too heavy, and although the touch can still be continued, the pen point of the stylus is damaged, and the user needs to be reminded to reduce the touch strength.

When the pressure value is between the first preset pressure value and the second preset pressure value, the fact that the user can normally touch is indicated, normal touch reminding information can be output, reminding is not needed, and the touch condition of the user is continuously detected in a background.

In this embodiment, the terminal judges whether the touch force of the user is normal according to the magnitude relation between the pressure value detected by the pressure sensor and the preset pressure value, and reminds the user so that the user can timely master the touch force information, and when the touch force is abnormal, correct adjustment is made.

In an embodiment, before step S190, the method further includes:

detecting a report point of the touch screen;

judging whether a report point is detected;

and outputting first preset reminding information when the report point is not detected.

When the touch pen touches the touch screen, the touch pen and the touch screen form a coupling capacitor, and when the touch pen draws a small part of current, the current or the capacitance on the touch screen can be changed. When the change of the current or the capacitance exceeds a first preset threshold value, the touch screen can detect the position coordinates of the touch point and generate a report point.

The principle of calculating the position coordinates of the touch point on the touch screen through the current or the capacitance on the touch screen comprises the following steps:

when a touch pen or a finger touches a touch screen, the touch pen or the finger and a working surface form a coupling capacitor, wherein the working surface is connected with high-frequency current, when the touch pen or the finger sucks away a small part of current, the part of current respectively flows out from electrodes on four corners of the screen, in theory, the current passing through four motors is proportional to the distance from the touch pen or the finger to the four corners, and the terminal precisely calculates the four current proportions to obtain a position coordinate;

secondly, the touch screen can also determine the position coordinates of the touch points by the capacitance change caused by the touch of a stylus or a finger on the touch screen. The touch screen is provided with a driving line and a sensing line, wherein the driving line transmits signals, and the sensing line detects the change of the capacitance value. When a touch pen or a finger touches the touch screen, the touch pen or the finger forms a coupling capacitor with the surface of the touch screen. For high frequency current, the capacitor is a direct conductor, and when a stylus or finger draws a small portion of the current, it affects the coupling between the two electrodes near the touch point, and changes the capacitance between the two electrodes. When the interactive capacitance is detected, the electrodes in the driving line direction sequentially send out excitation signals, meanwhile, the electrodes in the sensing line direction receive the signals, the capacitance value change of all the intersection points of the longitudinal electrodes and the transverse electrodes is obtained, namely the capacitance of the whole touch screen is obtained, and the coordinate of each touch point is calculated according to the variable quantity data of the capacitance of the touch screen.

After the hit is detected, step S190 is executed to obtain the pressure value detected by the pressure sensor.

When the current or capacitance change generated when the touch pen touches the touch screen reaches a set threshold value, the terminal calculates the position coordinates of the touch point according to the current or capacitance change so as to generate a report point. The report point can be displayed on the touch screen by the intersection point of two vertical crossed straight lines or not. After the touch screen is detected to report points, the fact that the pen holding posture of the user is correct is indicated, the terminal further obtains a pressure value detected by the pressure sensor, and poor writing strength of the user is reminded according to the pressure value.

When the current or capacitance variation generated by the touch pen contacting the touch screen does not reach the set threshold value, the terminal cannot calculate the position coordinates of the touch point, so that the report point of the touch pen cannot be detected. The terminal does not detect the report point of the touch screen, which indicates that the inclination angle between the touch pen and the touch screen is too small, the pen point does not contact the screen, but the pen body contacts the screen, so that the illusion that the user can write is given, the user needs to be reminded of the error pen holding posture, and the pen point needs to be improved. The first preset reminding information can be used for reminding a user of bad pen holding posture, and the expression form of the first preset reminding information is one or more of characters, pictures, animation, video, voice, light and vibration.

As shown in fig. 23, when the pen tip of the stylus touches the screen, the current or the touch amount variation generated by the touch screen reaches a set threshold, the terminal calculates the position coordinates of the touch point according to the current or the touch amount variation, and generates an alarm point, that is, when the alarm point is detected, it indicates that the stylus touches the screen.

In this embodiment, the terminal detects the pen holding posture and the touch force of the user in real time according to whether the report is generated, and reminds the user of the bad pen holding posture and the touch force, so that the pen point of the touch pen is protected, the service life of the touch pen is prolonged, and the touch efficiency is improved.

In one embodiment, when the stylus is within a certain distance, for example, 10mm, the stylus can cause a small change in capacitance or current on the touch screen, that is, the change in current or capacitance exceeds a second predetermined threshold, which is smaller than the first predetermined threshold, and the distance and position coordinates of the stylus, which can be expressed as (distance, x, y), can be determined according to the small change in capacitance or current, so as to generate a floating point. The floating point integrates the characteristics of distance and coordinates and can be marked on the touch screen. According to the color of the mark of the floating point on the touch screen, whether the touch pen is in a writable state can be judged, for example, the touch pen can write when the blue mark is carried out; when the red mark is carried out, the touch pen is in a state of low electric quantity, and needs to be charged; unmarked indicates unusable.

When the touch pen is pulled out of the terminal or the touch pen is within a preset distance from the touch screen, the terminal can detect a floating point on the touch screen.

And when the pressure value is greater than a third preset pressure value, detecting a report point of the touch screen.

The third preset pressure value is a minimum pressure value of the touch screen generating the report point, and can be smaller than or equal to the first preset pressure value.

When the terminal detects the floating point and detects that the touch control pen presses the touch control screen, the terminal obtains a pressure value through the pressure sensor. And if the pressure value is greater than a third preset pressure value, the terminal detects the report point of the touch screen. And if the pressure value is smaller than the third preset pressure value, the terminal continues to detect in the background.

When the touch pen is in contact with the touch screen or within a certain distance from the touch pen, the floating point of the touch screen cannot be detected, the electric quantity of the touch pen is exhausted, the touch pen is damaged, and a user needs to be reminded that the touch pen fails. The preset reminding information in this embodiment may be a reminding information of a failure of the stylus pen, or a reminding information of an unused state of the stylus pen, and the presentation form of the preset reminding information is one or a combination of a plurality of characters, pictures, animations, videos, voice, light, and vibrations.

Referring to fig. 24, a schematic diagram of detecting a floating point and then detecting a report point when a stylus operates a mobile terminal is shown, where the floating point can be detected only when the stylus is located above a touch screen, and the report point can be generated only when a pen tip of the stylus contacts the touch screen, the floating point can be detected first, the report point is detected after the floating point is detected, and touch prompting information is output according to a detected pressure value after the report point is detected; referring to fig. 25, a schematic diagram of detecting a floating point but not detecting a touch point is shown, where the detection of the touch point after the floating point is detected indicates that a pen point of the stylus has not contacted the touch screen, and at this time, indicates that the user operates the stylus abnormally, and at this time, the first preset prompt message may be output.

In this embodiment, the terminal detects and reminds the state of the stylus and the touch behavior of the user by combining the floating point and the pressure value, so that the user can conveniently and timely grasp information of damage or power exhaustion of the stylus and bad touch gestures, and timely adjust the touch gestures, thereby improving the touch efficiency.

In one embodiment, the touch screen is illuminated upon detecting a stylus pull.

The terminal is provided with a fixed position for fixing the touch pen, and the fixed position is provided with a detection device for detecting the state of the touch pen. The detection device on the fixed position of the terminal can detect the state of the touch pen. When the terminal detects that the touch pen is pulled out from the fixed position or is within a certain distance from the touch screen, the terminal can detect that the touch screen generates a floating point and automatically lights the touch screen. Meanwhile, when the touch pen contacts the touch screen and a report point is generated on the touch screen, the terminal can automatically light the touch screen.

And in a preset time, the pressure value is not detected, and the touch screen is extinguished.

And in the preset time, the terminal detects the floating point but does not detect the pressure value, and the touch screen is extinguished. The preset time may be 5 seconds, 30 seconds, 2 minutes, etc. for various periods of time. It can be understood that the stylus is above the touch screen, but does not touch the touch screen, and the terminal extinguishes the touch screen to reduce the overall power consumption.

In this embodiment, the terminal automatically lights the touch screen by detecting the touch point or the floating point on the touch screen, and if the pressure value is not detected within the preset time, the touch screen is turned off. The terminal automatically lights the touch screen, so that the operation of a user can be reduced, the keys are reduced, the touch screen is automatically turned off according to the preset conditions, the extra power consumption of the touch pen when the touch pen is not touched can be effectively reduced, the power consumption is reduced, and the standby time of the terminal is prolonged.

The present application further provides a stylus pen, which includes a memory, a processor, and a control program stored in the memory and capable of running on the processor, and when the control program is executed by the processor, the steps of the control method of the stylus pen according to the above embodiments are implemented.

The present application also provides a terminal, which includes a memory, a processor, and a control program stored in the memory and executable on the processor, and when the control program is executed by the processor, the control program implements the steps of the control method of the terminal according to the above embodiments.

The present application also provides a computer-readable storage medium storing a control program, which when executed by a processor implements the control method of the terminal or the steps of the control method of the stylus pen according to the above embodiments.

The present application further provides an apparatus, comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, carries out the steps of the method as described above.

Embodiments of the present application also provide a computer program product, which includes computer program code, when the computer program code runs on a computer, the computer is caused to execute the method as described in the above various possible embodiments.

An embodiment of the present application further provides a chip, which includes a memory and a processor, where the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device installed with the chip executes the method described in the foregoing various possible embodiments.

The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application or portions thereof contributing to the exemplary technology may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above and includes several instructions for enabling a terminal device (which may be a television, a mobile phone, a computer, an apparatus, an air conditioner, or a network device) to execute the method described in the embodiments of the present application.

The above description is only an example of the present application and is not intended to limit the scope of the present application, and all modifications, equivalents, and flow charts using the contents of the specification and drawings of the present application or those directly or indirectly applied to other related arts are included in the scope of the present application.

Claims

A control method of a stylus, wherein the control method of the stylus comprises the following steps:

acquiring operation information between the touch pen and a writing interface;

determining a target operation object and operation information according to the operation information;

and controlling the target operation object to operate according to the operation information.
The stylus pen control method according to claim 1, wherein the writing interface comprises a touch interface of a terminal, a touch interface connected with a stylus pen, or an air projection interface.
The control method of the stylus pen according to claim 1, wherein the determining of the target operation object and the operation information according to the operation information comprises:

and acquiring a preset rule, and determining a target operation object and operation information according to the preset rule and the operation information.
The stylus control method according to claim 3, wherein the acquiring of the preset rule comprises:

and acquiring a reference characteristic and acquiring a preset rule corresponding to the reference characteristic.
The control method of the stylus pen according to claim 1, wherein the determining of the target operation object and the operation information according to the operation information comprises:

determining a user identifier corresponding to the touch pen;

and determining a target operation object and operation information according to the user identification and the operation information.
A control method of a terminal, wherein the terminal comprises a touch pen and a touch screen, and the control method of the terminal comprises the following steps:

acquiring the distance between the touch pen and the touch screen and the position of a contact point of the touch pen on the touch screen;

determining a target operation object of the touch pen on the touch screen according to the position;

determining running information of the target operation object according to the distance;

and controlling the target operation object to operate according to the operation information.
The method for controlling a terminal according to claim 6, wherein the determining the operation information of the target operation object according to the distance comprises:

determining a distance interval in which the distance is located;

and determining the running information of the target operation object according to the distance.
The terminal control method according to claim 7, wherein the determining the operation information of the target operation object according to the distance includes:

determining an operation parameter corresponding to the target operation object according to the distance, wherein the operation parameter comprises at least one of an operation time point and an operation frequency of the target operation object;

and determining the running information of the target operation object according to the operation parameters.
The method for controlling a terminal according to claim 7, wherein the operation information includes display contents, and after the step of determining the operation information of the target operation object based on the distance, the method further comprises:

and when the selected operation of the display content displayed on the touch screen is detected, locking the display content, wherein when the distance between the touch pen and the touch screen is changed, the locked display content is unchanged.
The method for controlling a terminal according to claim 9, wherein the step of locking the display contents is followed by further comprising:

and when the touch operation of the touch pen on the touch screen is detected, opening or starting the target operation object, wherein the running interface of the opened or started target operation object is determined according to the display content.
The control method according to claim 6, wherein the step of determining the target operation object of the stylus on the touch screen according to the position comprises:

determining an area of the location on the touch screen;

and determining the document, the folder, the application function or the application drawer corresponding to the area as a target operation object.
The method for controlling a terminal according to claim 6, wherein the method for controlling a terminal further comprises:

acquiring the suspension duration of the touch pen on the touch screen;

and when the suspension duration reaches a preset duration, executing the step of acquiring the distance between the touch pen and the touch screen.
A control method of a terminal, wherein the control method of the terminal comprises the following steps:

acquiring operation information between a touch device and a terminal;

determining a target operation object according to the operation information;

determining execution information corresponding to the target operation object according to a preset rule;

and controlling the target operation object to operate according to the execution information.
The method according to claim 13, wherein the touch device is an object sensed by the terminal, a component on the terminal, or an external device connected to the terminal.
The method for controlling a terminal according to claim 14, wherein the determining a target operation object according to the operation information comprises:

determining a type of the touch device;

and determining a target operation object according to the type and the operation information.
The method of claim 13, wherein the preset rule includes a current time, a current location where the terminal is located, an operation habit of a user on an operation object, or an operation mode of the terminal.
The method for controlling a terminal according to claim 13, wherein the step of obtaining the operation information between the touch device and the terminal further comprises, before the step of obtaining the operation information between the touch device and the terminal:

when the operation aiming at the terminal is detected, determining an operation object corresponding to the operation;

and when the operation object is a touch device, executing the step of acquiring the operation information between the touch device and the terminal.
A control method of a mobile terminal, wherein the control method of the mobile terminal comprises the following steps:

acquiring operation information between a touch device and a mobile terminal, and acquiring a target application interface according to the operation information, wherein the operation information comprises that a touch pen floats on a display screen of the mobile terminal;

and displaying the target application interface in a target area of the display screen.
The method for controlling a mobile terminal according to claim 18, wherein the step of obtaining operation information between the touch device and the mobile terminal and obtaining the target application interface according to the operation information comprises:

acquiring a target application after detecting that a touch pen floats on a display screen of the mobile terminal;

and acquiring an application interface of the target application as a target application interface.
The method for controlling a mobile terminal according to claim 19, wherein the step of acquiring the target application after detecting that the stylus is hovering over a display screen of the mobile terminal comprises:

after detecting that a touch pen floats on a display screen of a mobile terminal, acquiring the position of the touch pen on the display screen during floating;

and acquiring a target application according to the position of the touch point.
The method for controlling a mobile terminal according to claim 20, wherein after the step of acquiring the position of the touch point of the stylus on the display screen during hovering after detecting that the stylus is hovering on the display screen of the mobile terminal, the method further comprises:

and adjusting the display position of the target area on the display screen according to the position of the touch point.
The method for controlling a mobile terminal according to claim 20, wherein after the step of acquiring the position of the touch point of the stylus on the display screen during hovering after detecting that the stylus is hovering on the display screen of the mobile terminal, the method further comprises:

and adjusting the display scale of the target application interface in the target area according to the movement track of the position of the touch point.
The method for controlling a mobile terminal according to claim 20, wherein after the step of acquiring the position of the touch point of the stylus on the display screen during hovering after detecting that the stylus is hovering on the display screen of the mobile terminal, the method further comprises:

when the moving track of the touch point position corresponds to a preset track, acquiring a quick opening mode associated with the preset track;

and opening the application corresponding to the quick opening mode.
The method for controlling a mobile terminal according to claim 18, wherein the step of displaying the target application interface in the target area of the display screen is followed by further comprising:

and when the selected operation of the target application interface is detected, displaying the target application interface through the main interface of the display screen.
The method for controlling a mobile terminal according to claim 24, wherein the step of displaying the target application interface in the target area of the display screen is followed by further comprising:

when the selection operation of the target application interface is detected, acquiring the selection duration corresponding to the selection operation;

and when the selected duration is less than or equal to a first preset duration, executing the step of displaying the target application interface through a main interface of the display screen.
The method for controlling a mobile terminal according to claim 25, wherein after the step of obtaining the selection duration corresponding to the selection operation when the selection operation of the target application interface is detected, the method further comprises:

and when the selected time length is longer than the first preset time length, copying the interface content of the target application interface to a clipboard.
The method for controlling a mobile terminal according to claim 26, wherein the copying the interface contents of the target application interface to a clipboard comprises:

receiving a first signal and a second signal which are sent by the touch pen in sequence;

selecting interface content serving as the target application interface according to the first signal and the second signal;

and copying the selected interface content to a clipboard.
The control method of the mobile terminal according to claim 26, wherein the control method of the mobile terminal further comprises:

identifying key information in the target application interface;

and taking the key information as the interface content.
The method for controlling a mobile terminal according to claim 25, wherein after the step of obtaining the selection duration corresponding to the selection operation when the selection operation of the target application interface is detected, the method further comprises:

and when the selected duration is longer than the first preset duration, intercepting the interface content of the target application interface and generating a screenshot of the target application interface.
The method for controlling a mobile terminal according to claim 19, wherein the step of displaying the target application interface in the target area of the display screen is followed by further comprising:

and when the stylus is detected to leave the upper part of the display screen, canceling the display of the target application interface.
The control method of the mobile terminal according to claim 19, wherein the control method of the mobile terminal further comprises:

acquiring suspension duration after detecting that a stylus is suspended on a display screen of the mobile terminal;

and executing the step of acquiring the target application interface when the suspension time length is greater than a second preset time length.
A terminal control method of a built-in touch pen is disclosed, wherein the terminal comprises a touch pen provided with a pressing key, the touch pen is fixed at a fixed position, and the terminal control method of the built-in touch pen comprises the following steps:

after operation information between the touch pen and the terminal is detected, the terminal carries out preset operation, and the operation information comprises pressing operation of a pressing key of the touch pen.
The method for controlling a terminal with a built-in stylus pen of claim 32, wherein the step of the terminal performing the preset operation after detecting the operation information between the stylus pen and the terminal comprises:

detecting a fixed state of the stylus after detecting the pressing operation;

and when the fixed state of the touch pen is not pulled out, the terminal carries out preset operation.
The method for controlling a terminal with a built-in stylus pen of claim 32, wherein the step of the terminal performing a preset operation after detecting operation information between the stylus pen and the terminal, further comprises:

after the pressing operation is detected, performing authority verification;

and when the authority verification passes, the terminal carries out preset operation.
The terminal control method of a built-in stylus pen of claim 32, wherein the preset operation includes at least one of:

the terminal clearing inactive applications, including running but unused applications;

the terminal deletes a target file of which the file type is a preset type in all files of the inactive application;

and the terminal starts a preset application.
The method for controlling a terminal with a built-in stylus pen of claim 33, wherein after the step of detecting the fixed state of the stylus pen after detecting the pressing operation, further comprising:

and when the fixed state of the touch control pen is detected to be pulled out, adjusting display parameters when the touch control pen contacts the screen of the terminal.
The method for controlling a terminal with a built-in stylus of claim 36, wherein the adjusting the display parameters when the stylus touches the screen of the terminal comprises at least one of:

adjusting the color of a line displayed when the touch pen is in contact with the screen of the terminal;

and adjusting the thickness of lines displayed when the touch pen is in contact with the screen of the terminal.
The terminal control method of a built-in stylus of claim 32, wherein the terminal control method of a built-in stylus further comprises:

displaying a preset operation setting interface when detecting that the pressed key rotates for a preset angle and the touch control pen is not pulled out;

the preset operation setting interface is used for updating the preset operation according to the setting operation of the user.
A touch reminding method based on a stylus is disclosed, wherein the stylus is applied to a touch screen of a terminal, a pressure sensor is arranged on the touch screen and used for detecting pressure generated by the stylus on the touch screen, and the touch reminding method comprises the following steps:

after operation information of the touch control screen by the touch control pen is detected, acquiring a pressure value detected by the pressure sensor, wherein the operation information comprises writing operation of the touch control pen on the touch control screen;

and outputting touch reminding information according to the pressure value.
The stylus-based touch alert method of claim 39, wherein the outputting touch alert information according to the pressure value comprises:

and when the pressure value is smaller than or equal to a first preset pressure value, outputting touch pressure undersize reminding information.
The stylus-based touch alert method of claim 39, wherein the outputting touch alert information according to the pressure value comprises:

and when the pressure value is greater than or equal to a second preset pressure value, outputting a prompt message of the overlarge touch pressure.
The stylus-based touch alert method of claim 39, wherein prior to the step of obtaining the pressure value detected by the pressure sensor, further comprising:

detecting a report point of the touch screen;

and after the report point is detected, executing the step of acquiring the pressure value detected by the pressure sensor.
The stylus-based touch alert method of claim 42, wherein prior to the step of obtaining the pressure value detected by the pressure sensor, further comprising:

detecting a floating point of the touch screen;

after the floating point is detected, acquiring a pressure value detected by the pressure sensor;

and when the pressure value is larger than a third preset pressure value, executing the step of detecting the report point of the touch screen.
The stylus-based touch alert method of claim 42, wherein after the step of detecting a hit on the touch screen, further comprising:

and outputting first preset reminding information when the report point is not detected.
The stylus-based touch alert method of claim 43, wherein after the detecting the floating point of the touch screen step, further comprising:

and outputting second preset reminding information when the floating point is not detected.
The stylus-based touch alert method of claim 39, wherein prior to the step of obtaining the pressure value detected by the pressure sensor, further comprising:

and when the touch pen is detected to be pulled out, lightening the touch screen.
The stylus-based touch alert method of claim 46, wherein the step of obtaining the pressure value detected by the pressure sensor is followed by further comprising:

and in a preset time, the pressure value is not detected, and the touch screen is extinguished.
The stylus-based touch alert method of claim 39, wherein the outputting touch alert information according to the pressure value comprises:

and outputting corresponding touch prompting information according to the pressure value and the current reference parameter.
The stylus-based touch alert method of claim 48, wherein the outputting corresponding touch alert information according to the pressure value and the current reference parameter comprises:

acquiring a mapping relation between a reference parameter corresponding to the pressure value and the touch prompting information;

and acquiring touch reminding information corresponding to the current reference parameter according to the mapping relation.
A stylus, wherein the stylus comprises a memory, a processor, and a control program stored in the memory and executable on the processor, the control program when executed by the processor implementing the steps of the method of claim 1.
A terminal, wherein the terminal comprises a memory, a processor and a control program stored in the memory and executable on the processor, the control program when executed by the processor implementing the steps of the method of claim 6 or 13 or 18 or 32 or 39.
A computer-readable storage medium, wherein the computer-readable storage medium stores a control program which, when executed by a processor, implements the steps of the method of claim 1 or 6 or 13 or 18 or 32 or 39.