WO2021114690A1 - 触控笔、终端及其控制方法和计算机可读存储介质 - Google Patents

触控笔、终端及其控制方法和计算机可读存储介质 Download PDF

Info

Publication number
WO2021114690A1
WO2021114690A1 PCT/CN2020/106056 CN2020106056W WO2021114690A1 WO 2021114690 A1 WO2021114690 A1 WO 2021114690A1 CN 2020106056 W CN2020106056 W CN 2020106056W WO 2021114690 A1 WO2021114690 A1 WO 2021114690A1
Authority
WO
WIPO (PCT)
Prior art keywords
stylus
terminal
touch
target
preset
Prior art date
Application number
PCT/CN2020/106056
Other languages
English (en)
French (fr)
Inventor
肖明
李凌志
陆伟峰
朱荣昌
沈剑锋
洪帆
夏程杰
朱菊
Original Assignee
上海传英信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201911279109.2A external-priority patent/CN111045566B/zh
Priority claimed from CN201911268427.9A external-priority patent/CN110955379B/zh
Priority claimed from CN201911342018.9A external-priority patent/CN111124159A/zh
Priority claimed from CN201911386064.9A external-priority patent/CN111142761A/zh
Application filed by 上海传英信息技术有限公司 filed Critical 上海传英信息技术有限公司
Priority to CN202080085344.0A priority Critical patent/CN115023683A/zh
Publication of WO2021114690A1 publication Critical patent/WO2021114690A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance

Definitions

  • This application relates to the technical field of terminal touch control, and in particular to a stylus, a terminal and a control method thereof, and a computer-readable storage medium.
  • Portable terminals have become an indispensable daily necessities for people.
  • the terminal can be equipped with a stylus, and the user can operate the terminal through the stylus.
  • the interaction (such as control or reminder) between the stylus and the terminal has the problem of cumbersome or unintelligent process, which affects the user experience.
  • the main purpose of this application is to provide a stylus, a terminal, a control method thereof, and a computer-readable storage medium, aiming to solve the problem of cumbersome touch operation process of the terminal.
  • the present application provides a method for controlling a stylus pen.
  • the method for controlling the stylus pen includes the following steps:
  • the present application also provides a method for controlling a terminal.
  • the terminal includes a stylus and a touch screen.
  • the method for controlling the terminal includes the following steps:
  • the terminal control method includes the following steps:
  • the present application also provides a control method of a mobile terminal.
  • the control method of the mobile terminal includes the following steps:
  • the target application interface is displayed in the target area of the display screen.
  • the present application also provides a terminal control method with a built-in stylus.
  • the terminal includes a stylus provided with a pressing key and a stylus fixing position.
  • the terminal control method with the built-in stylus includes the following steps :
  • the terminal After detecting the operation information between the stylus pen and the terminal, the terminal performs a preset operation, and the operation information includes a pressing operation of a key of the stylus pen.
  • the present application also provides a touch reminder method based on a stylus, the stylus is applied to the touch screen of the terminal, the touch screen is provided with a pressure sensor, the pressure sensor is used To detect the pressure generated by the stylus on the touch screen, the touch reminding method includes the following steps:
  • the present application also provides a stylus, the stylus including a memory, a processor, and a control program stored in the memory and capable of running on the processor, and the control program is controlled by
  • the above-mentioned stylus control method is realized when the processor is executed.
  • the present application also provides a terminal, the terminal including a memory, a processor, and a control program stored in the memory and running on the processor, the control program being executed by the processor When realizing the above-mentioned terminal control method.
  • the present application also provides a computer-readable storage medium storing a control program which, when executed by a processor, implements the above-mentioned stylus control method or The control method of the terminal as described above.
  • the stylus, terminal and control method thereof, and computer-readable storage medium provided in the present application acquires operation information between the stylus and the writing interface, thereby determining the target operation object and operation information according to the operation information, thereby controlling The target operation object runs according to the operation information. Since the stylus can control the terminal to perform corresponding operations based on the operation information between the stylus and the writing interface, there is no need to use the stylus to perform multiple operations on the writing interface to operate the terminal.
  • FIG. 1 is a schematic diagram of the hardware structure of a terminal/stylus involved in a solution according to an embodiment of the application;
  • FIG. 2 is a schematic flowchart of an embodiment of a terminal control method of this application
  • FIG. 3 is a detailed flowchart of step S30 in FIG. 2;
  • Figure 4 is a schematic diagram of an operation of the terminal of the application.
  • Figure 5 is another schematic diagram of the operation of the terminal of the application.
  • FIG. 6 is a schematic diagram of another detailed flow of step S30 in FIG. 2;
  • FIG. 7 is another schematic diagram of the operation of the terminal of the application.
  • FIG. 8 is a schematic flowchart of another embodiment of a terminal control method of this application.
  • FIG. 9 is a schematic flowchart of another embodiment of a terminal control method of this application.
  • FIG. 10 is a detailed flowchart of step S70 in FIG. 9;
  • FIG. 11 is a schematic flowchart of still another embodiment of the terminal control method of this application.
  • FIG. 12 is a schematic flowchart of an embodiment of a method for controlling a stylus according to this application.
  • FIG. 13 is a schematic flowchart of another embodiment of a method for controlling a stylus according to this application.
  • Fig. 14 is a detailed flowchart of step S130 in Fig. 12.
  • 15 is a schematic flowchart of an embodiment of a method for controlling a mobile terminal according to this application.
  • FIG. 16 is an example diagram of a target area in a display screen of an embodiment of a method for controlling a mobile terminal according to this application;
  • FIG. 17 is an example diagram of a target application interface in a target area in an embodiment of a method for controlling a mobile terminal according to this application;
  • FIG. 18 is a diagram showing an example of the position of a touch point of a stylus in an embodiment of a method for controlling a mobile terminal according to this application;
  • FIG. 19 is a diagram showing an example of adjusting the display scale of a target application interface in an embodiment of a method for controlling a mobile terminal according to this application;
  • FIG. 20 is a schematic flowchart of an embodiment of a terminal control method with a built-in stylus according to this application;
  • FIG. 21 is a schematic diagram of a device structure with a built-in stylus according to an embodiment of the application.
  • FIG. 22 is a schematic flowchart of an embodiment of a touch reminder method based on a stylus pen according to the present application
  • FIG. 23 is a schematic diagram of the application for outputting touch reminder information according to the pressure value when the report point is detected
  • FIG. 24 is a schematic diagram of the stylus of the application first detecting the floating point and then detecting the reporting point when operating the mobile terminal;
  • FIG. 25 is a schematic diagram of detecting a floating point but not detecting a report point when the stylus of the present application operates on the mobile terminal.
  • first, second, third, etc. may be used herein to describe various information, the information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other.
  • first information may also be referred to as second information, and similarly, the second information may also be referred to as first information.
  • the word “if” as used herein can be interpreted as “when” or “when” or “in response to determination”.
  • singular forms “a”, “an” and “the” are intended to also include the plural forms, unless the context dictates to the contrary.
  • steps in the flowchart in the embodiment of the present application are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless explicitly stated in this article, the execution of these steps is not strictly limited in order, and they can be executed in other orders. Moreover, at least part of the steps in the figure may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the order of execution is not necessarily sequential. Instead, it may be performed alternately or alternately with other steps or at least a part of other steps or sub-steps or stages.
  • step codes such as S10 and S20 are used. The purpose is to express the corresponding content more clearly and concisely, and does not constitute a substantial restriction on the order. Those skilled in the art may S20 will be executed first and then S10, etc., but these should all fall within the scope of protection of this application.
  • This application provides a solution to obtain operation information between the stylus pen and a writing interface; determine a target operation object and operation information according to the operation information; control the target operation object to operate according to the operation information.
  • the stylus can control the terminal to perform corresponding operations based on the operation information between the stylus and the writing interface, there is no need to use the stylus to perform multiple operations on the writing interface to operate the terminal.
  • the terminal's touch operation process Simple Simple.
  • FIG. 1 is a schematic diagram of the hardware structure of a terminal/stylus pen involved in the solution of the embodiment of the present application.
  • the stylus or terminal may include: a processor 1001, such as a CPU, a memory 1002, a communication bus 1003, and a network interface 1004.
  • the communication bus 1003 is configured to realize the connection and communication between the components in the device.
  • the network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1002 may be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a magnetic disk memory.
  • the memory 1002 may also be a storage device independent of the aforementioned processor 1001.
  • the memory 1002, which is a computer storage medium may include an operating system, a network communication module, and a control program.
  • FIG. 1 does not constitute a limitation on the device, and may include more or fewer components than shown in the figure, or a combination of certain components, or different component arrangements.
  • the processor 1001 may be configured to call the control program stored in the memory 1002, and perform the following operations:
  • the processor 1001 may be configured to call a control program stored in the memory 1002, and further perform the following operations:
  • the processor 1001 may be configured to call a control program stored in the memory 1002, and further perform the following operations:
  • the processor 1001 may be configured to call a control program stored in the memory 1002, and further perform the following operations:
  • the target application interface is displayed in the target area of the display screen.
  • the processor 1001 may be configured to call a control program stored in the memory 1002, and further perform the following operations:
  • the terminal After detecting the operation information between the stylus pen and the terminal, the terminal performs a preset operation, and the operation information includes a pressing operation of a key of the stylus pen.
  • the processor 1001 may be configured to call a control program stored in the memory 1002, and further perform the following operations:
  • FIG. 2 is an embodiment of a terminal control method of this application, and the terminal control method includes:
  • Step S10 obtaining the distance between the stylus pen and the touch screen and the position of the touch point of the stylus pen on the touch screen;
  • the terminal includes a stylus and a touch screen.
  • the touch screen is provided with a signal receiving chip, and the stylus is provided with a signal emitting chip. After the chip on the touch screen receives the signal emitted by the stylus pen through the chip, the terminal determines the strength of the signal, so as to determine the distance between the stylus pen and the touch screen according to the strength of the signal.
  • the receiving angle of the chip receiving the signal in the touch screen covers the upper part of the touch screen. Therefore, the touch screen will only receive the signal emitted by the chip in the stylus when the stylus is hovering above the touch screen. .
  • the stylus is also provided with a signal-receiving chip, which is generally located on the tip of the stylus, which is the contact point of the stylus.
  • the touch screen is also provided with a signal-emitting chip.
  • the chip on the touch screen transmits a signal, so that the chip on the stylus receives the signal, so that the touch screen perceives the position of the touch point on the touch screen, which refers to the stylus on the touch screen
  • the projection position It should be noted that the touch screen determines the distance between the two by receiving the signal emitted by the chip on the stylus, and the touch point of the stylus is set on the tip of the pen, and the projection position of the tip on the touch screen corresponds to
  • the application icon or document of is the object that the user wants to operate.
  • the chip that emits signals on the stylus can be placed close to the tip of the pen, that is, the distance between the tip of the pen and the emitting chip is less than a preset distance, so that the distance between the touch screen and the stylus can represent the touch of the stylus
  • the distance between the point and the target operation object prevents the situation where the touch screen calculates a large distance and the pen tip has touched the touch screen.
  • Step S20 Determine the target operation object of the touch pen on the touch screen according to the position
  • Each icon on the touch screen corresponds to a function of the terminal, a document, or an application drawer including multiple applications or application functions.
  • the terminal can determine the target operation object according to the position of the touch point on the touch screen.
  • the terminal first determines whether the location is on the icon. If the location is on the icon, the application or document corresponding to the icon can be determined as the object operated by the stylus, that is, Is the target operation object; if the position is in the gap between the icons, determine the icon adjacent to the gap, and then calculate the distance between the position and each icon. The application or document corresponding to each icon whose distance is less than the preset distance can be calculated. As the target operation object, or the application or document corresponding to the icon with the minimum distance as the target operation object.
  • Step S30 determining the operation information of the target operation object according to the distance
  • the terminal stores the mapping relationship between the distance and the operation information of the operation object.
  • the operation information includes the operation information including the target submenu in the target operation object, the size of the display interface of the target operation object, the private information of the target operation object, and the target operation. At least one of the control instruction of the object, the display content of the target operation object, the display format of the target operation object, and the to-be-run function of the target operation object.
  • the control instruction when the target operating object is a music player, if the distance is small, the control instruction is to play music, and when the distance is large, the control instruction is to pause playback; for another example, when the target operating object is a document, if the distance is large, the control The command is to page up, the distance is small, and the control command is to page down.
  • Target operation objects include documents, folders, application functions or application drawers.
  • the display content includes at least one of the content of the document, the display size of the image corresponding to the document, and the display interface of the document.
  • Document content refers to the specific content in the document, such as text, pictures, etc. Different distances correspond to different document content.
  • the image corresponding to the document can be the thumbnail of the document, and different distances correspond to the thumbnails of different display sizes, which is the size of the display interface of the document;
  • the display interface of the document is the interface when the document is opened, and the interface has Different formats, different distances, different interface formats, that is, the running information includes the display format of the target operation object.
  • the display content includes the sub-functions of the application function, that is, the application function is actually icons corresponding to multiple functions, that is, the operation information includes the function to be executed of the target operation object.
  • the icon of the settings in the terminal corresponds to the application function
  • the settings include security settings, WIFI settings, Bluetooth settings, etc.
  • the display content is sub-functions such as security settings, WIFI settings, and Bluetooth settings.
  • the displayed sub-functions are different. For example, when the distance is large, the displayed sub-function is Bluetooth setting, and when the distance is small, the displayed sub-function is WIFI setting.
  • the running information may be the target submenu of the target operation object.
  • the display content includes at least one of the image corresponding to the document, the content of the document, the display size of the image corresponding to the document, and the display interface of the document.
  • the folder contains multiple documents, so at different distances, different documents in the file are displayed.
  • the display content may be at least one of the document content, the display size of the image corresponding to the document, and the display interface of the document.
  • the display content includes application icons, application functions, and operation methods of the application programs corresponding to the application icons.
  • the display content is the application icon, that is, different application icons are displayed at different distances.
  • the displayed content is the icon corresponding to the application function.
  • the application corresponding to the application icon has a variety of operation methods.
  • the operation method can be understood as the opening method and setting method of the application; for example, the application can be opened through the application icon on the desktop or through the corresponding applet of WeChat , It can also be opened regularly through the preset time, and different distances correspond to different opening methods of the application.
  • the corresponding private information can be displayed according to the distance, that is, the operation information includes the private information of the target operation object. If the distance is different, the private information of different privacy levels will be displayed.
  • the terminal pre-stores the mapping relationship between the operating information and distance of each operation object on the terminal.
  • the terminal obtains the distance between the stylus and the touch screen and determines the target operation object, that is, The operation information of the target operation object can be determined according to the distance, the target operation object and the mapping relationship.
  • the mapping relationship between the operating information and the distance of the operating object can be set by the user on the terminal, that is, the terminal provides the operating information setting interface corresponding to the application icon and the icon of the document, so as to obtain the selected operating information and distance on the setting interface. Associate and save the selected operating information and distance with the operation object corresponding to the setting interface.
  • Step S40 Control the target operation object to run according to the operation information.
  • the terminal controls the operation of the target operation object according to the operation information. For example, when the operation information is a control instruction, the target operation object is controlled to execute the control instruction.
  • the operating information is the display content
  • the touch screen is controlled to display the display content.
  • the display content may be displayed on the touch screen in the form of preview, that is, the terminal needs to determine the display area of the display content on the touch screen to display the display content in the display area.
  • the display area may be adjacent to the icon corresponding to the target operation object, or the display area may contain the icon corresponding to the target operation object.
  • the terminal obtains the distance between the stylus and the touch screen and the position of the stylus on the touch screen, and determines the target operation of the stylus on the touch screen according to the position Object, and then determine the operating information such as the control instruction and display content of the target operation object according to the distance, so as to control the target operation object to execute the control instruction and control the touch screen to display the display content of the target operation object. Since the terminal can display different display contents of the operating object according to the distance between the stylus and the touch screen, and can make the operating object execute the control instructions corresponding to the distance, there is no need to perform multiple operations on the touch screen with the stylus To search for the corresponding function or display content, the touch operation process of the terminal is simple.
  • FIG. 3 is a detailed flowchart of step S30 in FIG. 2, and step S30 includes:
  • Step S31 Determine the distance interval in which the distance is located
  • Step S32 Determine the operation information of the target operation object according to the distance.
  • the terminal divides the distance between the stylus pen and the touch screen into a plurality of distance intervals, and different distance intervals are associated with different operation information of the operation object.
  • the distance interval can be divided into three distance intervals: far, medium, and near.
  • the target operation object is a document.
  • the touch screen displays the thumbnail of the document; when the distance belongs to the middle-distance interval, the touch screen displays the document Global map; when the distance belongs to the close range, the control instruction to open the document is received to open the document.
  • Fig. 5 is another operation schematic diagram of the terminal.
  • the target operation object is an application function.
  • the touch screen displays the first sub-function; when the distance belongs to the middle-distance interval, The second sub-function is displayed on the touch screen; when the distance belongs to the close range, the third sub-function is displayed on the touch screen.
  • the terminal after acquiring the distance between the touch screen and the stylus, determines the distance interval in which the distance is located, thereby determining the operating information of the target operation object according to the distance interval, and avoiding subtle changes in the distance Cause the control instructions and display content to follow the change.
  • FIG. 6 is another detailed flowchart of step S30 in FIG. 2, and step S30 includes:
  • Step S33 Determine an operation parameter corresponding to the target operation object according to the distance, where the operation parameter includes at least one of the operation time point of the target operation object and the number of operations;
  • Step S34 Determine the operation information of the target operation object according to the operation parameter.
  • the mapping relationship between the operating parameter and the distance can be set for the operating object, and the operating parameter includes at least one of the operating time point and the number of operations of the operating object.
  • the terminal can determine the operating information of the target operating object according to the operating parameters.
  • the application drawer includes multiple applications.
  • the terminal obtains the number of operations of each application, and the number of operations may be the number of runs.
  • the terminal sorts the applications in the order of the number of operations from most to least.
  • FIG. 7 is another operation schematic diagram of the terminal.
  • the touch screen is controlled to display the first application ranked first; when the distance belongs to the middle-distance interval, the touch screen is controlled to display the first application in the order The second application of the second; when the distance belongs to the close range, the third application that controls the touch screen to display the third order.
  • the terminal can determine the usage time period corresponding to each application in the application drawer.
  • the usage time period is calculated according to the operating time point of the application. Specifically, the terminal first determines the application programs that the user may run in the current time period according to the operating time of each application program, and then sorts the operation times of each application program corresponding to the current time period. Refer to the above description for the sorting method. This will not be repeated here.
  • control the touch screen When the distance belongs to the long-distance range, control the touch screen to display the application icon of the application ranked first in the current time period; when the distance belongs to the middle distance range, control the touch screen to display the application of the second-ranked application in the current time period Icon; when the distance belongs to the close range, control the touch screen to display the application icon of the third-ranked application in the current time period.
  • the terminal determines the target application according to the operating time of each application.
  • the operating time of the target application is within the current time period.
  • the distance between the stylus and the touch screen belongs to different distance intervals.
  • the target application displayed is different.
  • the terminal determines the operation time point and operation parameters of the target operation object according to the distance between the stylus and the touch screen, and then determines the operation information of the operation object according to the operation information, so that The operation information of the target operation object matches the user's habits.
  • FIG. 8 is another embodiment of the terminal control method of this application. Based on the embodiment shown in FIG. 2, after the step S40, the method further includes:
  • Step S50 when the selection operation of the display content displayed on the touch screen is detected, the display content is locked, wherein when the distance between the stylus pen and the touch screen changes, the locked The display content remains unchanged.
  • the operation information refers to the display content of the target operation object.
  • the distance between the stylus and the touch screen is not fixed and will change with the user's operation. It is understandable that the display content displayed on the touch screen will vary with the distance between the stylus and the touch screen The change changes.
  • the terminal provides a selection function. The user can use the stylus to select the function in real time to lock the display content currently displayed on the touch screen.
  • the display content in the locked state will not follow the difference between the stylus and the touch screen. The distance between them changes, so that the user can select the locked display content to open or start the target operation object, and the running interface after the target operation object is opened or started is determined by the display content.
  • the display content can also be locked for the user to carefully view the display content.
  • the touch screen can display the selected button when displaying the display content; if the touch point of the stylus stays on the touch screen for a preset length of time, for example, if it stays for 2 seconds, the display content can be locked.
  • the touch screen can display the unlock button when displaying the display content. If the touch point of the stylus stays on the unlock button for a preset length of time, for example, stays for 2 seconds, the display content is unlocked.
  • the terminal When the display content is in the locked state, if the terminal detects the touch operation of the stylus on the touch screen, it will determine the running interface of the target operation object according to the locked display content, such as the display content is part or all of the running interface Content, or configure the running interface according to the displayed content.
  • the touch screen displays a certain running interface.
  • the locked display content is the content of the document
  • the content of the document is the entire content of the third chapter.
  • the running interface is the entire content of the third chapter.
  • the display content of the target operating object is displayed on the touch screen, if a selected operation on the display content on the touch screen is detected, the display content is locked to prevent the display content from being based on distance. It is convenient for the user to view the displayed content or for the user to perform subsequent operations on the displayed content.
  • the icon is set in a corresponding area on the touch screen, and the area contains the icon. After determining the position of the touch point on the touch screen, determine the area where the position is located.
  • the icon corresponding to the area is the target operation object, that is, the document, folder, application function or application drawer corresponding to the area where the position is located is determined as Target operation object.
  • the terminal sets the area for the icon, so that the touch point of the stylus does not need to be located on the icon, and the operation object corresponding to the icon can be controlled to run according to the running information corresponding to the distance, which increases the error tolerance rate of the stylus operation. .
  • the terminal when the user uses the stylus pen, it is not necessary to operate the application on the terminal, but may only be to check the stylus pen. If the user operates the stylus but does not operate the application on the touch screen, the hovering duration of the stylus on the touch screen is relatively small. In this regard, the preset duration is stored in the terminal, and the preset duration does not exceed 5s. When the hovering duration of the stylus on the touch screen reaches the preset duration, it can be determined that the user has a tendency to use the stylus to operate the application. At this time, the terminal executes step S10 to step S40.
  • the terminal obtains the hovering duration of the stylus on the touch screen, so as to determine whether the user has a tendency to operate the application on the terminal according to the hovering duration, which reduces the probability of the terminal responding to the user's misoperation.
  • This application also provides a terminal control method.
  • FIG. 9 is another embodiment of a terminal control method of this application.
  • the terminal control method includes the following steps:
  • Step S60 obtaining operation information between the touch device and the terminal
  • the execution subject is the terminal.
  • the touch device may be an object sensed by the terminal, and the object refers to a non-circuit connection relationship with the terminal and a communication connection relationship.
  • the object may be a user's finger, or any object held by the user.
  • a camera can be set on the terminal to collect images to perceive objects.
  • the touch device can also be a component on the terminal, for example, the rear case of the terminal.
  • the terminal can be provided with a touch area on the rear case so that the user can use his fingers to perform touch operations on the rear case. The touch operation and the mirror effect of the rear shell operation are controlled accordingly.
  • the mirror effect refers to the mirror effect of the touch operation; or directly equates the touch operation on the rear shell with the touch operation on the touch screen of the terminal .
  • the touch device may also be an external device connected to the terminal, for example, the touch device may be a stylus.
  • the operation information includes the position of the touch point of the touch control device on the terminal, the distance between the touch control device and the terminal, or the stay time of the touch control device on the terminal.
  • Step S70 Determine a target operation object according to the operation information
  • the terminal may determine the target operation object according to the position in the operation information, and refer to the foregoing embodiment for the process of determining the target operation object according to the position, which will not be repeated here.
  • the terminal can also determine the target operation object based on the distance. Specifically, the distance has a mapping relationship with each application or file on the terminal. The terminal can determine the target operation object corresponding to the distance in the application and file displayed on the currently displayed interface.
  • the terminal can determine the target operation object according to the length of stay of the touch device on the terminal, and the length of stay refers to the duration of time that the touch device is not moving after being sensed by the terminal.
  • the duration can characterize the current selection state of the user. When the duration is long, it indicates which application or document the user is hesitating to use. At this time, the user's favorite application or document is taken as the target operation object. When the duration is short, it indicates that the user is using an application purposefully. At this time, it can be determined according to the position of the touch device side contact on the terminal; or, according to the distance, the user's recent application or document is displayed For the user to make further selections to determine the target operation object.
  • Step S80 Determine execution information corresponding to the target operation object according to a preset rule
  • the preset rules include the current time, the current location where the terminal is located, the user's operating habits of the operating object, or the operating mode of the terminal.
  • the terminal may determine the execution information corresponding to the target operation object according to the preset rule.
  • the execution information is the aforementioned operation information.
  • the execution information includes the target submenu in the target operation object, the size of the target operation object’s display interface, the target operation object’s private information, the target operation object’s control instructions, and the target operation object’s The display content, the display format of the target operation object, and/or the to-be-run function of the target operation object.
  • the following is a detailed description of how the terminal selects the execution information corresponding to the operation information according to a preset rule.
  • the preset rule is the current time
  • the operation information can correspond to multiple applications or documents.
  • the operation information corresponds to WeChat, Alipay, and Taobao.
  • the execution information is to open the WeChat boarding code; if the current time is dining time, the execution information is to open the payment interface of Alipay; if the current time is approaching Double Eleven, the execution information is to open Taobao The interface of the product concerned in the media, etc.
  • the off-duty time, meal time, etc. are determined according to the user’s actual off-duty time and actual meal time, that is, the above-mentioned off-duty time and meal time are the user’s habitual off-duty time and habitual meal time.
  • the preset rule is the current location where the terminal is located
  • the execution information can be determined according to the current location where the terminal is located. Specifically, when the terminal detects that the location is a subway entrance, the execution information is to open the bus code in WeChat; when the terminal detects that the current location is a tourist attraction, the execution information is to open the camera's shooting interface.
  • the preset rule is the user's operating habits of the operating object
  • the terminal can collect the user's operation record of the application or document, so as to analyze the user's operation habit of the operation object.
  • the target operation object is a music player, and the user often listens to cheerful songs, that is, the operation habit is to find cheerful songs, and the execution information at this time is to automatically find cheerful songs.
  • the target operating object is a video player, and the user's operating habit is to watch animation, the execution information is to automatically display the currently updated animation for the user.
  • the preset rule is the operating mode of the terminal
  • the terminal can determine the execution information according to its own operating mode. For example, the terminal is in the split-screen mode and the target operation object is WeChat. At this time, the execution information is to display the voice chat on the WeChat chat interface to avoid typing occupying the WeChat interface. For another example, the terminal turns on the silent mode, and the target operation object is a game, and the execution information is to modulate the volume of the target operation object to the lowest.
  • the terminal can determine the execution information of the target operation object according to any of the foregoing preset rules.
  • the user can set preset rules on the terminal.
  • the preset rules are also determined by the user on the historical operation information of the terminal.
  • the preset rule set by the user conflicts with the preset rule determined by the terminal according to historical operation information
  • the preset rule set by the user is used as the execution information for accurately determining the target operation object.
  • the preset rule set by the user is to play brisk music at a certain place, and the preset rule determined by the terminal is to play passionately motivated songs at that location. If the terminal is at the location, brisk music is played.
  • Step S90 controlling the target operation object to run according to the execution information.
  • the terminal controls the target operation object to operate according to the execution information.
  • the terminal obtains the operation information between the touch device and the terminal, and then determines the target operation object according to the operation information, and then determines the execution information corresponding to the target operation object according to the preset rules, so that the terminal operates according to the execution information . Since the terminal can automatically determine the target operation object and the execution information of the target operation object according to the operation information between the touch device and the terminal, there is no need to send multiple control instructions to the terminal, and the touch operation of the terminal is simple.
  • FIG. 10 is a detailed flowchart of step S70 in FIG. 9, and step S70 includes:
  • Step S71 determining the type of the touch device
  • Step S72 Determine the target operation object according to the type and operation information.
  • the touch device is an object sensed by the terminal, a component on the terminal, or an external device connected to the terminal.
  • Different touch devices target different operation objects.
  • the object sensed by the terminal is a human finger
  • the corresponding operation object of the finger is a game, a video player, and a music player. Therefore, the terminal first determines the game, video player, and music player, and then selects the three according to the operation information. Determine the target operation object in.
  • the touch device is the rear case of the terminal, and the operation objects corresponding to the rear case are memos, calendars, calculators, etc., that is, the terminal first determines the memo, calendar, and calculator according to the rear case, and then selects the memo, calendar, and , Determine the target operation object in the calculator. It is understandable that the terminal initially determines a plurality of operation objects according to the type of the touch device, and then determines a target operation object based on the operation information in the plurality of operation objects that are preliminarily determined. The terminal determines the target operation object according to the operation information. Refer to the above description, which will not be repeated here.
  • the terminal determines the type of the touch device, and accurately determines the target operation object according to the type and operation information.
  • FIG. 11 is still another embodiment of the terminal control method of this application. Based on the embodiment shown in FIG. 9, before the step S60, the method further includes:
  • Step S100 When an operation for the terminal is detected, an operation object corresponding to the operation is determined;
  • Step S110 when the operating object is a touch device, execute the step of acquiring operation information between the touch device and the terminal.
  • the terminal during the operation of the terminal, it only responds to the operation information of the touch device, and does not respond to the operation of the non-touch device, so as to avoid excessive power consumption of the terminal. For example, if the terminal is placed in a pocket, the cloth in the pocket will be sensed by the terminal. If the terminal responds according to the sensed operation information between the cloth and the terminal, the terminal will perform a misoperation. In this regard, the terminal only responds to the operation information of the touch device.
  • the terminal When the terminal detects an operation for the terminal, it determines the operation object corresponding to the operation, and can use a camera to collect images of the operation object. It is determined whether the operating object is a touch device, and if it is a touch device, the operation information between the touch device and the terminal is acquired, so as to respond according to the operation information.
  • the terminal when the terminal detects an operation, it determines the operation object corresponding to the operation, and when the operation object is a touch device, obtains the operation information between the touch device and the terminal to perform the corresponding operation. Respond to avoid misoperation of the terminal.
  • the application also provides a method for controlling the stylus.
  • FIG. 12 is an embodiment of a method for controlling a stylus according to the present application.
  • the method for controlling the stylus includes the following steps:
  • Step S120 obtaining operation information between the stylus and the writing interface
  • the execution body is a stylus pen, and the stylus pen communicates with the terminal.
  • the stylus includes but is not limited to the form of a pen, and the stylus may have or may not have touch points that are sensed. Any form of object that can be sensed by the terminal can be regarded as a stylus.
  • the form of perception includes, but is not limited to, camera perception, signal perception, and so on.
  • the stylus is a control terminal, and the terminal is a terminal to be controlled, and the terminal may be a mobile phone or the like.
  • the writing interface can be the touch interface of the terminal; it can also be the touch interface that comes with the stylus, or the touch interface connected to the stylus.
  • the stylus can use the touch screen of the air conditioner to control the phone. Control; or the writing interface can also be an air projection interface.
  • the operation information includes the position of the touch point of the stylus on the writing interface, the distance between the stylus and the stylus, or the length of stay of the stylus on the writing interface .
  • Step S130 Determine the target operation object and operation information according to the operation information
  • the terminal can determine the target operation object and the operation information of the target operation object according to the operation information.
  • the operation information includes the target submenu in the target operation object, the size of the display interface of the target operation object, the private information of the target operation object, and the target operation object.
  • the operation information determines the target operation object and the operation information, as well as the distance description of the operation information. For details, please refer to the above description, which will not be repeated here.
  • Step S140 controlling the target operation object to run according to the operation information.
  • the operation information of the target operation object case is controlled. That is, the stylus determines the control instruction according to the operation information, and sends the control instruction to the terminal, so that the terminal operates according to the control instruction.
  • the stylus can directly send the operating information to the terminal, so that the terminal operates according to the operating information.
  • the stylus acquires the operation information between the stylus and the writing interface, thereby determining the target operation object and operation information according to the operation information, thereby controlling the target operation object to operate according to the operation information. Since the stylus can control the terminal to perform corresponding operations based on the operation information between the stylus and the writing interface, there is no need to use the stylus to perform multiple operations on the writing interface to operate the terminal.
  • the terminal's touch operation process Simple Simple.
  • FIG. 13 is another embodiment of a method for controlling a stylus according to the present application. Based on the embodiment shown in FIG. 12, the step S130 includes:
  • Step 131 Obtain a preset rule, and determine a target operation object and operation information according to the preset rule and the operation information.
  • the terminal may first determine the target operation object according to the operation information, and then determine the operation information of the target operation object according to a preset rule.
  • the preset rule can be determined according to the reference feature, which includes the current time, the location of the stylus, the user's operating habits on the operating object, or the operating mode of the terminal controlled by the stylus. That is, the preset rules correspond to the reference features one-to-one.
  • the stylus acquires preset rules, and accurately determines the operation information of the target operation object according to the preset rules and operation information.
  • FIG. 14 is a detailed flowchart of step S130 in FIG. 12.
  • the step S130 includes:
  • Step S132 Determine the user ID corresponding to the stylus
  • Step S133 Determine a target operation object and operation information according to the user identifier and the operation information.
  • the stylus may be an office pen, that is, each member of the office can control the terminal through the stylus.
  • the control needs and control habits of different members of the terminal are not completely the same.
  • the stylus determines the corresponding user identification, and the user identification represents the user.
  • a fingerprint collection device can be provided on the stylus, and the user identification can be determined by the fingerprint collection device.
  • the stylus is equipped with a camera to collect the face to determine the user identification.
  • a voice collection module may be provided on the stylus to determine the user identification through the user's voice.
  • the stylus After determining the user ID, the stylus can determine the target operation object and the operation information of the target operation object according to the user ID and operation information.
  • the stylus determines the user identification, thereby determining the target operation object and the operation information of the target operation object according to the user identification and operation information, so that the stylus accurately determines the operation information that meets the user's intention.
  • the stylus is highly intelligent.
  • the application also provides a control method of the mobile terminal.
  • control method of the mobile terminal includes:
  • Step S150 Obtain operation information between the touch device and the mobile terminal, and obtain a target application interface according to the operation information, where the operation information includes the stylus hovering on the display screen of the mobile terminal.
  • the mobile terminal may be a smart phone, a tablet computer, or the like.
  • the four corner positions of the mobile terminal display screen are respectively provided with signal receivers.
  • the stylus When the stylus is hovering above the display screen, multiple stylus positions corresponding to the four signal receiver positions are selected as calibration points. The distance between each calibration point and the corresponding receiver is relatively closer than the distance between the calibration point and other receivers.
  • the time difference between each receiver receiving the stylus signal and the coordinate position information of the receiver calculates the stylus to four The distance between two receivers, and from this, the space coordinates of the stylus in the display plane coordinate system with the display plane as the reference plane are calculated, and then projected to the display plane to obtain the projection point coordinates, which can be used as The position of the touch point of the stylus on the display. That is, the terminal can detect whether the stylus is currently floating on the display screen through the four signal receivers.
  • the stylus (signal generator) emit signal pulses at a fixed frequency (each pulse can have multiple wavelengths) as the stylus signal, such as ultrasonic pulses.
  • the display screen of the mobile terminal can also detect infrared signals, and the stylus can send infrared signals to the display.
  • the terminal detects the infrared signal sent by the stylus through the display screen
  • the stylus can be determined Floating on the display screen of the mobile terminal.
  • the contact position of the infrared signal on the display screen can be used as the touch point position of the stylus on the display screen.
  • the terminal obtains operation information between the touch device and the mobile terminal, and obtains the target application interface according to the operation information.
  • the touch device is a stylus
  • the operation information is that the stylus is hovering on the display screen of the mobile terminal.
  • the target application interface is obtained.
  • the terminal may acquire at least one preset application interface as the target application interface.
  • the preset application interface may be preset by the user or set by the designer of the mobile terminal (that is, the default setting of the system), and the preset application interface may be an application currently installed on the mobile terminal Application interface, such as the main interface of the WeChat application, the homepage interface of the Weibo application, etc. It should be noted that the preset application interface may be all main interfaces of a certain application; when there are multiple preset application interfaces, it may also be application interfaces of multiple different applications.
  • the user since the user needs to frequently use the main interface of the WeChat application and the homepage interface of the Weibo application, the user can set both the main interface of the WeChat application and the homepage interface of the Weibo application as the preset application interface.
  • the terminal may acquire the target application after detecting that the stylus is hovering on the display screen of the mobile terminal, and then further acquire the application interface of the target application as the target application interface.
  • the target application may be a preset application
  • the preset application interface may be preset by the user or set by the designer of the mobile terminal (ie the default setting of the system), such as WeChat application and Weibo application Wait.
  • the terminal may acquire a preset application as the target application, and use at least one application interface in the target application as the target application interface.
  • the target application interface may include a chat interface, an address book interface, a circle of friends interface, a discovery interface, and a setting interface.
  • Step S160 Display the target application interface in the target area of the display screen.
  • a target area 30 is set in the display area of the display screen 20 of the mobile terminal 10.
  • the target area 30 may be displayed on the display screen 20 in the form of a floating frame after the stylus is hovered on the display screen of the mobile terminal; the target area 30 may also be displayed on the display screen 20 when the stylus is moving. After floating on the display screen of the terminal, it is stored on the display screen 20 in the form of a transparent area.
  • the target area may be used to display multiple target application interfaces.
  • the terminal may display the acquired target application interface 31 in the target area 30.
  • the terminal after the terminal detects that the stylus is hovering on the display of the mobile terminal, it can start to record and acquire the hovering duration of the stylus on the display.
  • the terminal detects that the acquired hovering duration is greater than the second preset
  • the step of obtaining the target application interface is performed again. In this way, the terminal's misjudgment of the display of the target application interface can be reduced, and the frequent display of the target application interface in the target area can be avoided, so that the user can use the stylus at will.
  • the second preset duration can be set according to actual conditions, such as 3 seconds to 5 seconds.
  • the target application interface is acquired; the target application interface is displayed in the target area of the display screen.
  • the target application interface that the user needs to view is displayed in the target area of the display screen, so as to facilitate the user to quickly view the application interface.
  • the terminal may acquire the target application after detecting that the stylus is hovering on the display screen of the mobile terminal, and then further acquire the application interface of the target application as the target application interface.
  • the terminal may, after detecting that the stylus is hovering on the display screen of the mobile terminal, acquire the position of the touch point of the stylus on the display screen when hovering, and then compare the position of the touch point with The relationship between the display positions of the applications on the display screen, and obtain the target application.
  • the terminal may obtain an application whose touch point position 40 is in the display position of the application 21 on the display screen 20, and use the obtained application as a target application.
  • the WeChat application is obtained as the target application; when the touch point position of the stylus is at the display position of the Weibo application icon, the WeChat application is obtained
  • the blog application is the target application.
  • the terminal uses at least one application interface in the target application as the target application interface.
  • the user can change the position of the touch point (that is, the position of the touch pen) by moving the stylus floating on the display screen, and control the position of the touch point to be located in the display position of different applications.
  • the switching of the target application is to realize the switching of the target application interface displayed in the target area. For example, when the position of the touch point is currently in the display position of the WeChat application, the target area displays the application interface of the WeChat application, and when the user subsequently places the touch point position in the Weibo application, the terminal will place the target area on the display position of the WeChat application.
  • the displayed target application interface is switched to the application interface of the Weibo application.
  • the user can quickly preview the application interface of different applications, so that the user can quickly view the application interface.
  • the terminal after detecting that the stylus is hovering on the display screen of the mobile terminal, acquires the position of the touch point of the stylus on the display screen when the stylus is hovering.
  • the terminal may detect whether the position of the touch point is within the range of the target area, and when detecting that the position of the touch point is not within the range of the target area, adjust the display position of the target area , So that the touch point position is within the range of the target area.
  • the user can control the movement of the touch point position to control the movement of the target area, and then adjust the display position of the target area on the display screen.
  • the terminal after detecting that the stylus is hovering on the display screen of the mobile terminal, acquires the position of the touch point of the stylus on the display screen when the stylus is hovering.
  • the stylus when the user hoveres the stylus on the display screen, the stylus can be controlled to move to change the display ratio of the target application interface in the target area.
  • the display ratio of the target application interface is related to the display ratio of the target area
  • the user can adjust the display ratio of the target application interface in the target area by changing the display ratio of the target area.
  • the terminal can form a movement track of the touch point positions by capturing the multiple touch point positions.
  • the terminal may adjust the display scale of the target area according to the movement track of the touch point position, and then adjust the display scale of the target application interface in the target area.
  • the terminal is preset with preset trajectories corresponding to different display scale adjustment instructions, where the display scale adjustment instructions may be display scale scaling instructions and display scale enlargement instructions.
  • the terminal after acquiring the movement trajectory of the touch point position, the terminal detects whether there is a preset trajectory that matches the movement trajectory, and after detecting the same preset trajectory as the movement trajectory, acquires the corresponding preset trajectory
  • the display scale adjustment command implements the display scale adjustment command to adjust the display scale of the target application interface in the target area.
  • the terminal executes the display scaling command, it can increase the display ratio of the target application interface by increasing the area range of the target area; when the terminal executes the display scaling command, it can reduce the area range of the target area. Reduce the display ratio of the target application interface.
  • the terminal can preset the preset trajectory corresponding to the display scale enlargement instruction as the touch point position 40 moves from the corner position of the target area 30 to the area outside the target area 30, then when the user controls the touch point position After 40 is located at the corner position of the target area 30, and the touch point position 40 is further dragged to the area 30 outside the target area, the terminal determines that the movement track of the current touch point position corresponds to the preset display scale enlargement instruction If the trajectory is the same, the terminal executes the display scale enlargement instruction to increase the display scale of the target application interface 31 in the target area 30.
  • the terminal may preset the preset trajectory corresponding to the display scaling instruction to move the touch point position from the corner position of the target area to the center position of the target area, then when the user controls the touch point position to be located at the corner of the target area After the position, and when the touch point position is further dragged to the center position of the target area, the terminal determines that the movement trajectory of the current touch point position is the same as the preset trajectory corresponding to the display scaling instruction, and the terminal executes the display scaling instruction. In order to reduce the display ratio of the target application interface in the target area.
  • the way of setting the preset trajectory is not limited to the above.
  • the preset trajectory corresponding to the display scaling instruction may also be a circular trajectory.
  • the terminal may open the shortcut application according to the movement track of the position of the touch point.
  • the terminal is preset with preset trajectories corresponding to different shortcut opening methods, where the applications associated with different shortcut opening methods may be preset by the user, and these applications may be any application on the mobile terminal, such as WeChat Moments of friends, video shooting applications, etc.
  • the terminal after acquiring the movement trajectory of the touch point position, the terminal detects whether there is a preset trajectory that matches the movement trajectory, and after detecting the same preset trajectory as the movement trajectory, acquires the associated preset trajectory To open the shortcut, and then open the application corresponding to the shortcut.
  • the terminal may preset the preset trajectories corresponding to different shortcut opening methods as the trajectories of the touch point position moving from the middle area of the target area to different boundary lines of the target area.
  • the target area may include four boundary lines, up, down, left, and right.
  • the user can enter the target application interface by selecting the target application interface in the target area.
  • the terminal detects the selection operation of the target application interface in the target area, it displays the target application interface targeted by the selected operation in the main interface of the display screen, and at the same time cancels the display of other target application interfaces.
  • the user can click on the target application interface in the target area by using a stylus to issue a selection operation of the target application interface.
  • the terminal detects a selection operation made by the stylus pen by clicking the target application interface, it starts to record the contact time between the stylus pen and the target application interface as the selection duration corresponding to the selection operation, and compares the selection duration with the first selection operation. The preset time length is compared.
  • the target application interface is displayed through the main interface of the display screen.
  • the terminal when the terminal detects that the selected duration is greater than the first preset duration, it acquires the interface content of the target application interface, and copies the acquired interface content to the clipboard of the mobile terminal to facilitate the user to copy the target application interface The content of the interface in.
  • the stylus is provided with a signal sending button, and the user can send the first signal and the second signal to the terminal by pressing the signal sending button, wherein the terminal uses the signal first sent by the stylus as the first signal, and The signal subsequently sent by the stylus is used as the second signal.
  • the terminal detects that the selected duration is greater than the first preset duration, it starts to receive the first signal and the second signal sent by the stylus, and when the first signal is received, it records the stylus and the target display interface
  • the terminal receives the second signal, it records the second contact point between the stylus and the target display interface.
  • the terminal obtains the content information between the first contact point and the second contact point, and copies the content information as the interface content in the target application interface to the clipboard of the mobile terminal to facilitate the user to copy the content in the target application interface Interface content. For example, through this, it is convenient for the user to intercept a piece of text information on the target application interface.
  • the terminal when the terminal detects that the selected duration is greater than the first preset duration, and in the process of acquiring the interface content of the target application interface, the terminal recognizes the key information in the target application interface, and then recognizes the obtained key information Copy to the clipboard of the mobile terminal as the interface content.
  • the key information includes at least one of credential information (identity card, driver's license, passport, etc.), telephone number, and address information.
  • the credential information may be character information having the same number of characters as the credential number.
  • the character information composed of 18 digits is recognized as the ID number (it should be understood that it can also be the character information composed of 17 numbers and 1 letter).
  • the phone number may be character information consisting of 13 digits, or character information consisting of area code plus 8 digits. Recognize character information consisting of 13 digits as a telephone number, or recognize character information consisting of an area code plus 8 digits as a telephone number.
  • the address information may be a combination of character information having regional administrative region identification characters such as "province”, “city”, “district”, and "town". Combine the character information that appears with the identification characters of the regional administrative regions such as “province”, “city”, “district”, “town”, etc., and recognize it as address information, such as "No. 18 Nanhu Avenue, Donghai District, Handong City, Handong province”. Is the address information.
  • the text information and picture information in the target display interface are identified through machine learning technology, and the identification information (identity card, driver's license, passport, etc.), phone number, and address information obtained through the identification are all used as key information.
  • the terminal when the terminal detects that the selected time period is greater than the first preset time period, it may take a screenshot of the content currently displayed on the target display interface to intercept the interface content of the target application interface, thereby generating a screenshot of the target application interface. Take a screenshot and save it.
  • the user can control the stylus to hover on the target application interface in the target area, and when the terminal detects that the stylus is hovering on the target application interface for longer than the second preset duration, it is determined that the target application is received
  • the selected operation of the interface and obtain the target application interface currently floating with the stylus, and display the obtained target application interface in the main interface of the display screen.
  • the second preset duration can be set according to actual conditions, such as 3 seconds to 5 seconds.
  • the user can directly click the target application interface in the target area by hand to issue a selection operation of the target application interface.
  • the target application interface when a selection operation of the target application interface is detected, the target application interface is displayed through the main interface of the display screen. In this way, it is convenient for users to quickly enter the target application interface.
  • the terminal determines that the stylus is away from the top of the display screen. It can be that the stylus is in contact with the display screen (that is, the stylus clicks on the display screen), or the distance between the stylus pen and the display screen is greater than expected. Set the distance (for example, the user takes away the stylus).
  • the display of the target area may be canceled, so as to cancel the display of the target application interface in the target area.
  • the terminal when the terminal detects that the stylus is off the top of the display screen and the target area is displayed in the form of a transparent area, the terminal may directly cancel the display of the target application interface in the target area.
  • the user can quickly cancel the display of the target application interface when the user does not need to view the target application interface.
  • the application also provides a terminal control method with a built-in stylus
  • the terminal control method of the built-in stylus includes:
  • Step S170 Detecting operation information between the stylus pen and the terminal, where the operation information includes a pressing operation of a key of the stylus pen;
  • the terminal control method with a built-in stylus provided in this application is mainly used for interaction between the terminal and the unplugged stylus.
  • the terminals involved in the method for controlling a terminal with a built-in stylus provided in this application include but are not limited to mobile phones, tablets, computers, etc., and related application systems are pre-loaded on the terminals.
  • the terminal includes a touch panel provided with a pressing key and a stylus fixing position, the stylus fixing position is fixed with a stylus pen, and a pressing key is arranged on the stylus pen.
  • the pressing key can bounce up or be pressed back.
  • the pressing operation includes a pop-up operation and a press-back operation, the pop-up operation corresponds to the bounce of the press key, and the press-back operation corresponds to the press-back of the press key.
  • the stylus pen is also provided with a sending unit for sending a corresponding pressing operation to the terminal when the stylus pen is bounced or pressed back.
  • the existing touch pen can imitate the left-click operation of the mouse by clicking, so as to realize simple interaction with the controlled device such as tablet computer, and input by handwriting on the handwriting input software loaded on the controlled device such as tablet computer Characters (characters include letters, numbers, words and symbols) or drawing, etc.
  • the control pen mobile terminals with a built-in stylus appear on the market. Since a mobile terminal with a built-in stylus cannot implement the above functions when the stylus is not pulled out, the existing terminal with a stylus cannot interact with the terminal when the stylus is not pulled out.
  • the pen end of the stylus is provided with a press key that can be popped up or pressed back.
  • the press key on the stylus can be used to interact with the terminal.
  • the interaction is determined by User-defined settings or default settings.
  • the user needs to interact with the terminal, he presses the pressing key on the stylus, and then the stylus feeds back information corresponding to the pressing operation to the terminal, and the terminal detects the feedback from the stylus in real time. Press the corresponding information.
  • the operation information between the stylus pen and the terminal includes a pressing operation of a key of the stylus pen.
  • Step S180 After detecting the operation information between the stylus pen and the terminal, the terminal performs a preset operation.
  • the terminal performs a preset operation after detecting the pressing operation.
  • the preset operation includes at least one of the following:
  • the terminal deletes the target file whose file type is a preset type among all files of the inactive application
  • the terminal starts a preset application.
  • the preset operation is not limited to the operations listed above.
  • the preset operation may also be other interactive operations such as increasing or decreasing the ringtone of the terminal, and/or displaying unread mail.
  • the user sets in a preset operation setting interface in advance, and sets the preset operation to clear inactive applications of the terminal.
  • the stylus When the stylus is not pulled out and the user presses the key of the stylus, for example, the user bounces the key and presses it back within a preset time, then the touch The pen feeds back the pressing operation information to the terminal, and after detecting the pressing operation information fed back by the stylus pen, the terminal clears inactive applications of the terminal.
  • this implementation does not limit the number of preset operations.
  • the user can preset multiple interactive operations, and execute the preset after the terminal detects the pressing operation information fed back by the stylus pen. Set multiple interactive operations.
  • the pressing operation of the pressing key of the stylus is first detected, and then, after the pressing operation is detected, the terminal performs a preset operation. Because this application can interact with the terminal through the pressing key of the stylus pen when the stylus pen is not pulled out inside the terminal, and make the terminal perform preset operations, it solves the problem of having a stylus pen. Of the terminal cannot interact with the terminal when the stylus is not pulled out.
  • the state of the stylus includes a pulled state and an unplugged state. Since the preset operation set when the stylus is pulled out is different from the control parameter set when it is not pulled out, in order to facilitate the distinction of the next operation, after detecting the pressing operation, pass the fixed position
  • the detection device detects the state of the stylus. When it is detected that the stylus is not pulled out, a preset operation corresponding to the unplugged state is acquired, and the preset operation is performed.
  • the display parameters when the stylus touches the screen of the terminal are adjusted.
  • the adjusting the display parameters when the stylus touches the screen of the terminal includes at least one of the following: changing the line color displayed when the stylus touches the screen of the terminal; The thickness of the lines displayed on the screen of the terminal is described.
  • changing the line color displayed when the stylus touches the screen of the terminal is changed.
  • change the thickness of the line displayed when the stylus touches the screen of the terminal is changed.
  • the color of the line displayed when the stylus pen touches the screen of the terminal and the thickness of the line displayed are changed.
  • the line color and line thickness are preset by the user in the setting interface, or may be default settings.
  • the fixed state of the stylus pen is detected after the pressing operation is detected, and then the corresponding preset operation is performed according to the fixed state of the stylus pen, because it can be based on the fixed state of the stylus pen.
  • Interaction which achieves the effect of enriching the interaction scheme.
  • the authorization of the preset operation needs to be verified first, and the terminal invokes its own verification mechanism to verify the authorization of the preset operation.
  • each application is an application, and each application system is assigned a permission combination.
  • the permission combination is the list of permissions that the application has.
  • Permission verification is to verify the permissions that need to be specified when doing a certain task. , And then judge whether the smart management application is in the applied permission combination according to the required permissions. If the smart management application is in the applied permission combination, the permission verification is passed. If the smart management application is not in the applied permission combination, the permission verification is passed. If the permission is in the combination, the permission verification fails.
  • the terminal performs a preset operation. When the authority verification fails, the preset operation is not performed.
  • the default preset operation may not meet the needs of the user, so it is necessary to provide the user with a way to customize the preset operation.
  • the pressing key of the stylus in this embodiment can also perform a rotation operation.
  • the terminal detects that the pressing key is rotated by a preset angle and the stylus is not pulled out, the terminal obtains the information of the preset operation setting interface, and then according to After the information generates the preset operation setting interface, the preset operation setting interface is displayed.
  • the user's setting operation can be obtained through the preset operation setting interface.
  • the user can customize the preset operation on the preset operation setting interface, and when the terminal detects the setting operation triggered based on the preset operation setting interface, it determines the user-defined settings based on the setting operation. Describe the preset operation.
  • the currently determined preset operation is updated to the preset operation corresponding to the pressing operation and that can be triggered by the pressing operation .
  • the preset operation is updated once. Or wait for the multiple operations of the user to be set and update the multiple operations that are not preset.
  • This embodiment can generate a preset operation setting interface for the user to operate a preset, thereby avoiding that the operation performed by the interaction between the terminal and the stylus is an operation that the user does not want.
  • the present application also provides a device with a built-in stylus, the device with a built-in stylus, and a fixing position for fixing the touchpad.
  • the device 100 with a built-in stylus pen further includes a detection unit 101 for detecting the operation of the stylus pen.
  • the execution unit 102 wherein the execution unit 102 is configured to control the device to perform a preset operation according to the operation of the stylus pen.
  • the operation of the stylus pen includes a pressing operation of a pressing key of the stylus pen, and/or a rotation operation of a pressing key of the stylus pen.
  • the device 100 with a built-in stylus further includes a state detection unit 103 for detecting the fixed state of the stylus, wherein the fixed state includes: Out state and/or unplugged state.
  • the preset operation includes at least one of the following:
  • the device clears inactive applications, and the inactive applications include applications that are running but not in use;
  • the device deletes a target file whose file type is a preset type among all files of an inactive application
  • the terminal starts a preset application.
  • the preset operation is to adjust the display parameters when the stylus pen touches the screen of the device,
  • the display parameters include at least one of the following:
  • the preset operation setting interface When the operation of the stylus is a rotation operation of pressing the key, and the fixed state is the unplugged state, the preset operation setting interface is displayed; the preset operation setting interface updates the preset operation according to the user's setting operation .
  • the device with a built-in stylus includes a stylus provided with a pressing key, a fixed position of the stylus, a detection unit, and an execution unit.
  • a pressing operation of pressing a key and then, after detecting the pressing operation, the terminal performs a preset operation. Because this application can interact with the terminal through the pressing key of the stylus pen when the stylus pen is not pulled out inside the terminal, and make the terminal perform preset operations, it solves the problem of having a stylus pen. Of the terminal cannot interact with the terminal when the stylus is not pulled out.
  • This application also provides a touch reminder method based on a stylus.
  • the first embodiment of the present application provides a touch reminder method based on a stylus, the method including:
  • Step S190 After detecting the operation information of the stylus pen on the touch screen, obtain the pressure value detected by the pressure sensor, and the operation information includes the operation information of the stylus pen on the touch screen. Writing operation
  • the execution subject is the terminal.
  • the terminal can be a device with a touch screen, such as a smart phone, a Pad, a notebook computer, a learning machine, and an e-book.
  • the touch screen is equipped with a pressure sensor for detecting the pressure value acting on the touch screen. After the pressure sensor receives the pressure signal, it converts the pressure signal into an electrical signal, and transmits the electrical signal to the controller.
  • the pressure sensor is preferably a strain sensor. Strain sensor means that the specimen is deformed by force, and the sensitive grid of the strain gauge also obtains the same deformation, so that its resistance also changes accordingly and converted into corresponding electrical signals, such as changes in current or voltage.
  • the stylus is a pen that is made of conductive materials and has conductive properties, and is used to touch the touch screen to complete the man-machine dialogue operation.
  • the stylus is detachably installed on the terminal, used in conjunction with the touch screen of the terminal, and used in software with special functions, such as drawing, handwriting, animation design, etc.
  • the pressure sensor mounted on the touch screen can detect the pressure value generated on the touch screen. It is understandable that the operation information of the stylus on the touch screen includes the writing operation of the stylus on the touch screen
  • Step S200 output touch reminder information according to the pressure value.
  • the terminal After obtaining the pressure value detected by the pressure sensor, the terminal outputs touch reminder information according to the relationship between the pressure value and the preset pressure value.
  • the form of touch reminder information is one or more combinations of text, picture, animation, video, voice, light and vibration.
  • the touch reminder information can be realized by means of a reminder box, and text and pictures can be displayed in the reminder box. , Animation, and video.
  • the step of outputting touch reminder information according to the pressure value includes:
  • the corresponding touch reminder information is output according to the pressure value and the current reference parameter.
  • the current reference parameter includes at least one of current environmental information, current time information, and current user information.
  • the environmental information may include at least one of environmental brightness, location information, environmental temperature, and weather information; and the time information may include current time. At least one of the time period in which the point is located and the duration of use of the terminal; the user information may be user characteristics, which may be identified by fingerprint or image.
  • outputting the corresponding touch reminder information according to the pressure value and the current reference parameter includes: obtaining a mapping relationship between the reference parameter corresponding to the pressure value and the touch reminder information; and according to the mapping The relationship obtains the touch reminder information corresponding to the current reference parameter.
  • the mapping relationship between different reference parameters and the touch reminder information can be set, and different reminders can be realized according to different mapping relationships, and the reminder accuracy can be improved; or Set different mapping relationships between pressure values and touch reminder information for different reference parameters.
  • the terminal uses different reminding methods according to different time periods. It can be reminded through a combination of voice and animation, or through a combination of voice, animation and vibration mode, or voice reminder alone. Or use animation alone to remind. For example, during working hours on weekdays, the corresponding touch pressure is too high or the touch pressure is too small to remind messages in the form of animation and vibration, or alone in the form of animation; from 6 pm to 10 pm, voice and animation Remind by a combination of bullet frame and vibration mode; remind by animated bullet frame from 10 pm to 8 am the next morning; remind by a combination of voice, animation and vibration mode during the day on weekends Wait. In practical applications, users can set one or more reminding methods they prefer.
  • a warning message of excessive touch pressure is output, wherein the first preset pressure value is less than the second preset pressure value.
  • the pressure value is greater than the second preset pressure value, no reminder may be given, or a reminder message to reduce the intensity may be output.
  • step S200 includes: when the pressure value is greater than the second preset pressure value, outputting a reminder message of excessive touch pressure, and when the pressure value is less than the first A preset pressure value is output, and a reminder message that the touch pressure is too low is output, wherein the first preset pressure value is less than the second preset pressure value.
  • the pressure value is less than the second preset pressure value, no reminder may be given, or a reminder message of increasing intensity may be output.
  • the first preset pressure value is the minimum pressure value that the user can touch with the stylus pen. When the pressure value is less than the first preset pressure value, it indicates that when the user is using the stylus, the touch force is too light and cannot be displayed on the touch screen, and the user needs to be reminded to increase the stroke force.
  • the second preset pressure value is the maximum pressure value that does not damage the tip of the stylus pen when the user uses the stylus pen, wherein the first preset pressure value is less than the second preset pressure value.
  • the pressure value is greater than the second preset pressure value, it indicates that when the user uses the stylus pen, the touch force is too heavy. Although the touch can continue, it will damage the stylus tip, and the user needs to be reminded to reduce the touch force.
  • the pressure value is between the first preset pressure value and the second preset pressure value, it means that the user can touch normally, and can output normal touch reminder information, or not remind, and continue to detect the user's touch in the background happening.
  • the terminal judges whether the user's touch strength is normal according to the magnitude relationship between the pressure value detected by the pressure sensor and the preset pressure value, and reminds the user so that the user can grasp the touch strength information in time. When the touch force is abnormal, make the correct adjustment.
  • the method before step S190, the method further includes:
  • the report point is not detected, and the first preset reminder message is output.
  • the stylus touches the touch screen
  • the stylus and the touch screen form a coupling capacitor.
  • the stylus draws a small amount of current, it will cause the current or capacitance on the touch screen to change.
  • the touch screen can detect the position coordinates of the touch point and generate a report point.
  • the principle of calculating the position coordinates of the touch point on the touch screen through the current or capacitance on the touch screen includes:
  • the stylus or finger and the working surface form a coupling capacitor, where a high-frequency current is connected to the working surface, and when the stylus or finger sucks a small part of the current This part of the current flows from the electrodes on the four corners of the screen.
  • the current through the four motors is proportional to the distance from the stylus or finger to the four corners.
  • the terminal performs a precise calculation of the four current ratios. Get the position coordinates;
  • the touch screen can also determine the position coordinates of the touch point by causing a change in capacitance caused by a stylus or finger touching the screen.
  • the driving lines emit signals and the sensing lines detect changes in capacitance.
  • capacitance is a direct conductor.
  • the stylus or finger sucks a small part of the current, it affects the coupling between the two electrodes near the touch point, and changes the capacitance between the two electrodes. .
  • the electrodes in the direction of the drive line send out excitation signals in turn.
  • the electrodes in the direction of the sensing line receive the signal, and the capacitance value changes at the intersection of all vertical and horizontal electrodes are obtained, that is, the capacitance of the entire touch screen.
  • the capacitance change data of the touch screen calculates the coordinates of each touch point.
  • step S190 is executed to obtain the pressure value detected by the pressure sensor.
  • the terminal calculates the position coordinates of the touch point according to the current or capacitance change, and generates a report point.
  • the report point can be displayed on the touch screen as the intersection of two perpendicularly intersecting straight lines or not. After detecting the point reported by the touch screen, it indicates that the user's pen holding posture is correct, and the terminal further obtains the pressure value detected by the pressure sensor, and according to the pressure value, reminds the user of the bad writing strength.
  • the terminal cannot calculate the position coordinates of the touch point, so the report point of the stylus cannot be detected.
  • the terminal does not detect the report point of the touch screen, indicating that the tilt angle between the stylus and the touch screen is too small, and the pen tip does not touch the screen, but the pen body touches the screen, giving the user the illusion of being able to write, and the user needs to be reminded of the wrong gesture of holding the pen , Need to improve the nib.
  • the first preset reminder information may be a reminder that reminds the user of a bad pen holding posture, and the first preset reminder information is expressed in one or more combinations of text, picture, animation, video, voice, light, and vibration.
  • the tip of the stylus touches the screen.
  • the current or touch amount change generated by the touch screen reaches the set threshold.
  • the terminal calculates the position coordinates of the touch point according to the current or touch amount change, and A report point is generated, that is, when a report point is detected, it indicates that the stylus touches the screen.
  • the terminal detects the user's pen holding posture and touch strength in real time according to whether a report point is generated, and reminds the user of poor pen holding posture and touch strength to protect the tip of the stylus and improve The service life of the stylus and the improvement of touch efficiency.
  • the stylus when the stylus and the touch screen are within a certain distance, such as 10mm, the stylus can cause a small change in capacitance or current on the touch screen, that is, the change in current or capacitance exceeds the second predetermined distance.
  • the second preset threshold is smaller than the first preset threshold, and the distance and position coordinates of the stylus can be determined according to the slight change in capacitance or current, which can be expressed as (distance, x, y), and a floating point is generated. Floating point combines the characteristics of distance and coordinates and can be marked on the touch screen.
  • the stylus According to the color of the floating point mark on the touch screen, it can be judged whether the stylus is in a writable state, for example, when it is marked in blue, it can be written; when it is marked in red, it indicates that the stylus is in a low battery state and needs to be charged; no The mark indicates that it cannot be used.
  • the terminal can detect the floating point on the touch screen.
  • the third preset pressure value is the minimum pressure value for generating a report point on the touch screen, and may be less than or equal to the first preset pressure value.
  • the terminal When the terminal detects the floating point and detects that the stylus is pressed on the touch screen, the terminal obtains the pressure value through the pressure sensor. If the pressure value is greater than the third preset pressure value, the terminal detects the report point of the touch screen. If the pressure value is less than the third preset pressure value, the terminal continues to detect in the background.
  • the preset reminder information in this embodiment may be the reminder information of the stylus failure, or the reminder information that the stylus is not used, and the preset reminder information can be expressed in the form of text, picture, animation, video, voice, light, and vibration. One or more combinations of.
  • FIG 24 for a schematic diagram of the stylus first detecting the floating point and then detecting the reporting point when the stylus is operating on the mobile terminal. Since the stylus can be detected as long as the stylus is located above the touch screen, the tip of the stylus and the touch Only the touch of the control screen can generate a report point, then the floating point can be detected first, and the report point is detected after the floating point is detected. After the report point is detected, the touch reminder information is output according to the detected pressure value; refer to Figure 25 for the detection of floating point. Schematic diagram showing the point but the report point is not detected. After the floating point is detected, the report point has not been detected. This means that the tip of the stylus has not touched the touch screen. At this time, it means that the user is operating abnormally on the stylus. A preset reminder message.
  • the terminal combines the floating point and the pressure value to detect and remind the state of the stylus and the user's touch behavior, so that the user can grasp the information of the stylus damage or battery exhaustion and bad touch in time. Posture, and make timely adjustments to improve touch efficiency.
  • the touch screen when it is detected that the stylus is pulled out, the touch screen is turned on.
  • the terminal is provided with a fixed position for fixing the stylus, and the fixed position is provided with a detection device for detecting the state of the stylus.
  • the detection device on the fixed position of the terminal can detect the state of the stylus.
  • the terminal detects that the stylus is pulled out of the fixed position or is within a certain distance from the touch screen, it can detect that the touch screen generates floating points and automatically light the touch screen.
  • the terminal can also automatically light up the touch screen.
  • the touch screen is turned off.
  • the terminal detects the floating point, but does not detect the pressure value, and turns off the touch screen.
  • the preset time can be 5 seconds, 30 seconds, 2 minutes and other different time periods. It is understandable that the stylus is above the touch screen but does not touch the touch screen, and the terminal turns off the touch screen to reduce overall power consumption.
  • the terminal automatically lights up the touch screen by detecting the reporting point or floating point on the touch screen, and if the pressure value is not detected within the preset time, the touch screen is turned off.
  • the terminal automatically turns on the touch screen to reduce user operations, reduce keystrokes, and automatically turn off the touch screen according to preset conditions, which can effectively reduce the additional power consumption of the stylus when it is not touched, reduce power consumption, and increase The standby time of the terminal.
  • the present application also provides a stylus that includes a memory, a processor, and a control program that is stored in the memory and can run on the processor.
  • a control program that is stored in the memory and can run on the processor.
  • the present application also provides a terminal, the terminal including a memory, a processor, and a control program stored in the memory and capable of running on the processor.
  • the control program is executed by the processor, the above embodiment is implemented. Each step of the control method of the terminal.
  • the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a control program, and when the control program is executed by a processor, the terminal control method as described in the above embodiment is implemented or as described in the above embodiment.
  • the various steps of the stylus control method are also provided.
  • the present application also provides a device that includes: a memory, a processor, and a computer program stored on the memory and capable of running on the processor.
  • a device that includes: a memory, a processor, and a computer program stored on the memory and capable of running on the processor.
  • the embodiments of the present application also provide a computer program product.
  • the computer program product includes computer program code.
  • the computer program code runs on a computer, the computer executes the methods described in the various possible implementation manners above.
  • the embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that the chip is installed
  • a chip including a memory and a processor
  • the memory is used to store a computer program
  • the processor is used to call and run the computer program from the memory, so that the chip is installed
  • the device executes the methods described in the various possible implementation manners above.
  • the technical solution of the present application essentially or the part that contributes to the exemplary technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disk, optical disk), including several instructions to make a terminal device (can be a TV, mobile phone, computer, device, air conditioner, or network device, etc.) execute the method described in each embodiment of the present application.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请公开了一种触控笔的控制方法,所述触控笔的控制方法包括以下步骤:获取所述触控笔与书写界面之间的操作信息;根据所述操作信息确定目标操作对象和运行信息;控制所述目标操作对象按照所述运行信息运行。本申请还提供一种触控笔、终端及控制方法、移动终端的控制方法、内置触控笔的终端控制方法、基于触控笔的触控提醒方法和计算机可读存储介质。

Description

触控笔、终端及其控制方法和计算机可读存储介质
本申请要求于2019年12月11日提交中国专利局,申请号201911279109.2、名称为“触控笔、终端及其控制方法和计算机可读存储介质”的中国专利申请;2019年12月11日提交中国专利局,申请号201911268427.9、名称为“移动终端的控制方法、移动终端及存储介质”的中国专利申请;2019年12月26日提交中国专利局,申请号为201911386064.9、名称为“内置触控笔的终端控制方法、装置、存储介质及终端”的中国专利申请;2019年12月20日提交中国专利局,申请号为201911342018.9、名称为“基于触控笔的触控提醒方法、终端及计算机可读存储介质”的中国专利申请的优先权,其全部内容通过引用结合在申请中。
技术领域
本申请涉及终端触控技术领域,尤其涉及一种触控笔、终端及其控制方法和计算机可读存储介质。
背景技术
便携式的终端已成为人们必不可少的生活用品。终端可设有触控笔,用户可通过触控笔对终端进行操作。
一些实现中,触控笔与终端间的交互(如控制或提醒)存在流程繁琐或不智能的问题,进而影响到用户体验。
示例性技术中,用户在需要对终端的应用程序或者文档进行操作时,需通过触控笔进行多次的操作,以显示应用或文档的不同状态,或者使得应用或文档执行多次操作对应的控制指令,终端的触控操作流程繁琐。
前面的叙述在于提供一般的背景信息,并不一定构成现有技术。
申请内容
本申请的主要目的在于提供一种触控笔、终端及其控制方法和计算机可读存储介质,旨在解决终端的触控操作流程繁琐的问题。
为了达到上述目的,本申请提供一种触控笔的控制方法,所述触控笔的控制方法包括以下步骤:
获取所述触控笔与书写界面之间的操作信息;
根据所述操作信息确定目标操作对象和运行信息;
控制所述目标操作对象按照所述运行信息运行。
为实现上述目的,本申请还提供一种终端的控制方法,所述终端包括触控笔以及触控屏,所述终端的控制方法包括以下步骤:
获取所述触控笔与所述触控屏之间的距离和所述触控笔的触点在所述触控屏上的位置;
根据所述位置确定所述触摸笔在所述触控屏上的目标操作对象;
根据所述距离确定所述目标操作对象的运行信息;
控制所述目标操作对象按照所述运行信息运行。
为实现上述目的,本申请还提供一种终端的控制方法,所述终端的控制方法包括以下步骤:
获取触控装置与终端之间的操作信息;
根据所述操作信息确定目标操作对象;
根据预设规则确定所述目标操作对象对应的执行信息;
控制所述目标操作对象按照所述执行信息运行。
为实现上述目的,本申请还提供一种移动终端的控制方法,所述移动终端的控制方法包括以下步骤:
获取触控装置与移动终端之间的操作信息,并根据所述操作信息获取目标应用界面, 所述操作信息包括触控笔在移动终端的显示屏上悬浮;
将所述目标应用界面显示在所述显示屏的目标区域中。
为实现上述目的,本申请还提供一种内置触控笔的终端控制方法,终端包括设置有按压键的触控笔,触控笔固定位,所述内置触控笔的终端控制方法包括以下步骤:
在检测到触控笔与终端之间的操作信息后,所述终端进行预设操作,所述操作信息包括触控笔的按压键的按压操作。
为实现上述目的,本申请还提供一种基于触控笔的触控提醒方法,所述触控笔应用于终端的触控屏,所述触控屏上设置有压力传感器,所述压力传感器用于检测触控笔在所述触控屏上产生的压力,所述触控提醒方法包括以下步骤:
在检测到所述触控笔对所述触控屏的操作信息后,获取所述压力传感器检测到的压力值,所述操作信息包括所述触控笔对所述触控屏的书写操作;
根据所述压力值输出触控提醒信息。
为实现上述目的,本申请还提供一种触控笔,所述触控笔包括存储器、处理器以及存储在所述存储器并可在所述处理器上运行的控制程序,所述控制程序被所述处理器执行时实现如上所述的触控笔的控制方法。
为实现上述目的,本申请还提供一种终端,所述终端包括存储器、处理器以及存储在所述存储器并可在所述处理器上运行的控制程序,所述控制程序被所述处理器执行时实现如上所述的终端的控制方法。
为实现上述目的,本申请还提供一种计算机可读存储介质,所述计算机可读存储介质存储有控制程序,所述控制程序被处理器执行时实现如上所述的触控笔的控制方法或如上所述的终端的控制方法。
本申请提供的触控笔、终端及其控制方法和计算机可读存储介质,触控笔获取触控笔与书写界面之间的操作信息,从而根据操作信息确定目标操作对象和运行信息,从而控制目标操作对象按照运行信息运行。由于触控笔可以根据触控笔与书写界面之间的操作信息即可控制终端进行相应的操作,无需通过触控笔对书写界面进行多次操作以对终端进行操作,终端的触控操作流程简便。
附图说明
附图说明用来提供对本申请的进一步理解,并且构成说明书的一部分,与本申请的实施例一起设置为解释本申请,并不构成对本申请的限制。在附图中:
图1为本申请实施例方案涉及的终端/触控笔的硬件结构示意图;
图2为本申请终端的控制方法一实施例的流程示意图;
图3为图2中步骤S30的一细化流程示意图;
图4为本申请终端的一操作示意图;
图5为本申请终端的另一操作示意图;
图6为图2中步骤S30的另一细化流程示意图;
图7为本申请终端的又一操作示意图;
图8为本申请终端的控制方法另一实施例的流程示意图;
图9为本申请终端的控制方法又一实施例的流程示意图;
图10为图9中步骤S70的细化流程示意图;
图11为本申请终端的控制方法再一实施例的流程示意图;
图12为本申请触控笔的控制方法一实施例的流程示意图;
图13为本申请触控笔的控制方法另一实施例的流程示意图;
图14为图12中步骤S130的细化流程示意图。
图15为本申请移动终端的控制方法一实施例的流程示意图;
图16为本申请移动终端的控制方法一实施例的显示屏中的目标区域示例图;
图17为本申请移动终端的控制方法一实施例的目标区域中的目标应用界面示例图;
图18为本申请移动终端的控制方法一实施例的触控笔的触控点位置示例图;
图19为本申请移动终端的控制方法一实施例的目标应用界面的显示比例调整示例图;
图20为本申请内置触控笔的终端控制方法一实施例的流程示意图;
图21为本申请实施例涉及的内置触控笔的装置结构示意图。
图22为本申请基于触控笔的触控提醒方法一实施例的流程示意图;
图23为本申请为检测到报点根据压力值输出触控提醒信息的示意图;
图24为本申请触控笔对移动终端操作时先检测到浮点再检测到报点的示意图;
图25为本申请触控笔对移动终端操作时检测浮点但未检测到报点的示意图。
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。
具体实施方式
应当理解,此处所描述的具体实施例仅用以解释本申请,并不设置为限定本申请。
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素,此外,本申请不同实施例中具有同样命名的部件、特征、要素可能具有相同含义,也可能具有不同含义,其具体含义需以其在该具体实施例中的解释或者进一步结合该具体实施例中上下文进行确定。
应当理解,尽管在本文可能采用术语第一、第二、第三等来描述各种信息,但这些信息不应限于这些术语。这些术语仅用来将同一类型的信息彼此区分开。例如,在不脱离本文范围的情况下,第一信息也可以被称为第二信息,类似地,第二信息也可以被称为第一信息。取决于语境,如在此所使用的词语"如果"可以被解释成为"在……时"或"当……时"或"响应于确定"。再者,如同在本文中所使用的,单数形式“一”、“一个”和“该”旨在也包括复数形式,除非上下文中有相反的指示。应当进一步理解,术语“包含”、“包括”表明存在所述的特征、步骤、操作、元件、组件、项目、种类、和/或组,但不排除一个或多个其他特征、步骤、操作、元件、组件、项目、种类、和/或组的存在、出现或添加。此处使用的术语“或”和“和/或”被解释为包括性的,或意味着任一个或任何组合。因此,“A、B或C”或者“A、B和/或C”意味着“以下任一个:A;B;C;A和B;A和C;B和C;A、B和C”。仅当元件、功能、步骤或操作的组合在某些方式下内在地互相排斥时,才会出现该定义的例外。
应该理解的是,虽然本申请实施例中的流程图中的各个步骤按照箭头的指示依次显示,但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明,这些步骤的执行并没有严格的顺序限制,其可以以其他的顺序执行。而且,图中的至少一部分步骤可以包括多个子步骤或者多个阶段,这些子步骤或者阶段并不必然是在同一时刻执行完成,而是可以在不同的时刻执行,其执行顺序也不必然是依次进行,而是可以与其他步骤或者其他步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。
需要说明的是,在本文中,采用了诸如S10、S20等步骤代号,其目的是为了更清楚简要地表述相应内容,不构成顺序上的实质性限制,本领域技术人员在具体实施时,可能会先执行S20后执行S10等,但这些均应在本申请的保护范围之内。
本申请提供一种解决方案,获取所述触控笔与书写界面之间的操作信息;根据所述操作信息确定目标操作对象和运行信息;控制所述目标操作对象按照所述运行信息运行。
由于触控笔可以根据触控笔与书写界面之间的操作信息即可控制终端进行相应的操作,无需通过触控笔对书写界面进行多次操作以对终端进行操作,终端的触控操作流程简便。
如图1所示,图1是本申请实施例方案涉及终端/触控笔的硬件结构示意图。
参照图1,本申请实施例涉及是终端以及触控笔,触控笔或终端可以包括:处理器1001,例如CPU,存储器1002,通信总线1003,网络接口1004,。其中,通信总线1003设置为实现该装置中各组成部件之间的连接通信。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1002可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1002可选的还可以是独立于前述处理器1001的存储装置。如图1所示,作为一种计算机存储介质的存储器1002中可以包括操作系统、网络通信模块以及控制程序。
本领域技术人员可以理解,图1中示出的装置结构并不构成对装置的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。
在图1所示的装置所涉及的硬件中处理器1001可以设置为调用存储器1002中存储的控制程序,并执行以下操作:
获取所述触控笔与书写界面之间的操作信息;
根据所述操作信息确定目标操作对象和运行信息;
控制所述目标操作对象按照所述运行信息运行。
在一实施例中,处理器1001可以设置为调用存储器1002中存储的控制程序,还执行以下操作:
获取所述触控笔与所述触控屏之间的距离和所述触控笔的触点在所述触控屏上的位置;
根据所述位置确定所述触摸笔在所述触控屏上的目标操作对象;
根据所述距离确定所述目标操作对象的运行信息;
控制所述目标操作对象按照所述运行信息运行。
在一实施例中,处理器1001可以设置为调用存储器1002中存储的控制程序,还执行以下操作:
获取触控装置与终端之间的操作信息;
根据所述操作信息确定目标操作对象;
根据预设规则确定所述目标操作对象对应的执行信息;
控制所述目标操作对象按照所述执行信息运行。
在一实施例中,处理器1001可以设置为调用存储器1002中存储的控制程序,还执行以下操作:
获取触控装置与移动终端之间的操作信息,并根据所述操作信息获取目标应用界面,所述操作信息包括触控笔在移动终端的显示屏上悬浮;
将所述目标应用界面显示在所述显示屏的目标区域中。
在一实施例中,处理器1001可以设置为调用存储器1002中存储的控制程序,还执行以下操作:
在检测到触控笔与终端之间的操作信息后,所述终端进行预设操作,所述操作信息包括触控笔的按压键的按压操作。
在一实施例中,处理器1001可以设置为调用存储器1002中存储的控制程序,还执行以下操作:
在检测到所述触控笔对所述触控屏的操作信息后,获取所述压力传感器检测到的压力值,所述操作信息包括所述触控笔对所述触控屏的书写操作;
根据所述压力值输出触控提醒信息。
基于上述终端的硬件构建,提出本申请终端的控制方法的实施例。
参照图2,图2为本申请终端的控制方法的一实施例,所述终端的控制方法包括:
步骤S10,获取所述触控笔与所述触控屏之间的距离以及所述触控笔的触点在所述触控屏上的位置;
在本实施例中,终端包括触控笔以及触控屏。触控屏上设有接收信号的芯片,且触控笔上设有发射信号的芯片。触控屏上的芯片在接收到触控笔通过芯片发射的信号后,终端确定信号的强度,从而根据信号的强度确定触控笔与所述触控屏之间的距离。此外,触控屏内接收信号的芯片的接收角度覆盖触控屏的上方,因此,只有触控笔悬浮在触控屏的上方时,触控屏才会接收到触控笔中芯片发射的信号。
触控笔上还设有接收信号的芯片,该芯片一般位于触控笔的笔尖上,笔尖即为触控笔的触点。触控屏上还设有发射信号的芯片。通过触控屏上的芯片发射信号,使得触控笔上的芯片接收该信号,从而使得触控屏感知触点在触控屏上的位置,该位置指的是触控笔在触控屏上的投影位置。需要说明的是,触控屏是通过接收触控笔上芯片发射的信号来确定两者之间的距离,而触控笔的触点是设置在笔尖,笔尖在触控屏上的投影位置对应的应用图标或文档即为用户想要操作的对象。对此,可将触控笔上发射信号的芯片设置于挨近笔尖,也即笔尖与发射芯片的距离小于预设距离,使得触控屏与触控笔之间的距离可表征触控笔得触点与目标操作对象之间的距离,防止触控屏计算的距离较大而笔尖已接触触控屏的情况出现。
步骤S20,根据所述位置确定所述触摸笔在所述触控屏上的目标操作对象;
触控屏上的每一个图标对应终端的功能、文档、或者包括多个应用程序或应用功能的应用抽屉。终端可以根据在触点在触控屏上的位置确定目标操作对象。
具体的,终端在确定触点的位置后,先确定该位置是否位于图标上,若该位置位于图标上,该图标对应的应用程序或文档即可被确定为触控笔操作的对象,也即为目标操作对象;若位置处于图标之间的空隙,则确定空隙相邻的图标,再计算位置与各个图标之间的距离,可将距离小于预设距离的各个图标对应的应用程序或者文档均作为目标操作对象,或者最小距离的图标对应的应用程序或文档作为目标操作对象。
步骤S30,根据所述距离确定所述目标操作对象的运行信息;
终端中存储有距离与操作对象的运行信息的映射关系,运行信息包括所述运行信息包括目标操作对象中的目标子菜单、目标操作对象的显示界面的尺寸、目标操作对象的私密信息、目标操作对象的控制指令、目标操作对象的显示内容、目标操作对象的显示格式以及目标操作对象的待运行功能中的至少一种。例如,在目标操作对象为音乐播放器时,若距离较小时,控制指令为播放音乐,距离较大时,控制指令为暂停播放;又例如,目标操作对象为文档时,若距离较大,控制指令为向上翻页,距离较小,控制指令为向下翻页。
目标操作对象包括文档、文件夹、应用功能或者应用抽屉。在当目标操作对象为文档时,显示内容包括文档内容、文档对应的图像的显示尺寸以及文档的显示界面中的至少一个。文档内容指的是文档内的具体内容,如文字、图片等,不同的距离对应不同的文档内容,如距离较大时,文档内容为该文档的标题,若距离较小时,文档内容则为文档中一部分内容;文档对应的图像可为文档的缩略图,不同的距离对应不同显示尺寸的缩略图,也即为文档的显示界面的尺寸;文档的显示界面即为文档打开时的界面,界面有不同的格式,距离不同,界面的格式不同,也即运行信息包括目标操对象的显示格式。
在目标操作对象为应用功能时,显示内容包括应用功能的子功能,也即应用功能实则为多个功能所对应的图标,也即运行信息包括目标操作对象的待运行功能。例如,终端中的设置的图标对应应用功能,设置中包括安全设置、WIFI设置、蓝牙设置等,显示内容为安全设置、WIFI设置、蓝牙设置等子功能。在距离不同,显示的子功能不同。例如,在距离较大时,显示的子功能为蓝牙设置,在距离较小时,显示的子功能为WIFI设置。而在目标操作对象具有多个控制菜单时,运行信息可以是目标操作对象的目标子菜单。
在目标操作对象为文件夹时,显示内容包括文档对应的图像、文档内容、文档对应的图像的显示尺寸以及文档的显示界面中的至少一个。文件夹中包括多个文档,故,不同的距离下,显示文件内的不同文档。而在文件夹中仅包括一个文档时,显示内容则可为文档内容、文档对应的图像的显示尺寸以及文档的显示界面中的至少一个。
在目标操作对象为应用抽屉时,显示内容包括应用图标、应用功能、以及应用图标对应的应用程序的操作方法。应用抽屉有多个应用图标时,显示内容为应用图标,也即不同的距离,显示不同的应用图标。应用抽屉中有多个应用功能,显示内容则为应用功能对应的图标。此外,应用图标对应的应用程序有多种操作方法,操作方法可以理解为应用程序的打开方式、设置方式等;例如,应用程序可以通过桌面上的应用图标打开、可以通过微信对应的小程序打开、还可以通过预先设置的时间进行定时打开,不同的距离,对应应用程序的不同打开方法。
此外,在目标操作对象为私密文件夹时,可以根据距离显示对应的私密信息,也即运行信息包括目标操作对象的私密信息。距离不同,则显示不同私密等级的私密信息。
可以理解的是,终端中预先存储终端上各个操作对象的运行信息与距离之间的映射关系,在终端获取触控笔与所述触控屏幕之间的距离,并确定目标操作对象后,即可根据距离、目标操作对象以及映射关系即确定目标操作对象的运行信息。操作对象的运行信息与距离的映射关系可由用户在终端上进行设置,也即终端提供应用图标以及文档等图标对应的运行信息设置界面,从而在设置界面上获取选定的运行信息与距离,以将选定的运行信息、距离与设置界面对应的操作对象进行关联保存。
步骤S40,控制所述目标操作对象按照所述运行信息运行。
终端在确定目标操作对象的运行信息后,即控制目标操作对象按照运行信息运行。例如,在运行信息为控制指令时,则控制目标操作对象执行控制指令。在运行信息为显示内容时,则控制触控屏对显示内容进行显示。需要说明的是,显示内容可以以预览的形式显示在触控屏上,也即终端需确定显示内容在触控屏上的显示区域,以将显示内容显示在显示区域中。显示区域可以与目标操作对象对应的图标相邻,或者显示区域内含有目标操作对象对应的图标。
在本实施例提供的技术方案中,终端获取触控笔与触控屏之间的距离以及触控笔在触控屏上的位置,并根据位置确定触控笔在触控屏上的目标操作对象,再根据距离确定目标操作对象的控制指令以及显示内容等运行信息,从而控制目标操作对象执行控制指令以及控制触摸屏显示目标操作对象的显示内容。由于终端可以根据触控笔与触控屏之间的距离进行操作对象的不同显示内容的显示,且可使得操作对象执行距离对应的控制指令,无需通过触控笔对触控屏进行多次操作以进行对应功能或者显示内容的查找,终端的触控操作流程简便。
参照图3,图3为图2中步骤S30的一细化流程示意图,所述步骤S30包括:
步骤S31,确定所述距离所在的距离区间;
步骤S32,根据所述距离确定所述目标操作对象的运行信息。
在本实施例中,终端将触控笔与触控屏之间的距离划分为多个距离区间,不同的距离区间关联操作对象的不同运行信息。例如,可将距离区间划分为远、中、近三个距离区间。终端在获取触控笔与触控屏之间的距离后,确定距离所在的距离区间,从而根据距离区间以及目标操作对象确定运行信息。
参照图4,图4为终端的一操作示意图,目标操作对象为文档,在距离属于远距离区间时,触控屏显示文档的缩略图;在距离属于中距离区间时,触控屏显示文档的全局图;在距离属于近距离区间时,则接收打开文档的控制指令,以打开文档。
进一步的,参照图5,图5为终端的另一操作示意图,目标操作对象为应用功能,在距离属于远距离区间时,触控屏上显示第一子功能;在距离属于中距离区间时,触控屏上显示第二子功能;在距离属于近距离区间时,触控屏上显示第三子功能。
在本实施例提供的技术方案中,终端在获取触控屏与触控笔之间的距离后,确定距离所在的距离区间,从而根据距离区间确定目标操作对象的运行信息,避免距离的细微变化导致控制指令以及显示内容跟随变化。
参照图6,图6为图2中步骤S30的另一细化流程示意图,所述步骤S30包括:
步骤S33,根据所述距离确定所述目标操作对象对应的操作参数,所述操作参数包括目标操作对象的操作时间点以及操作次数中的至少一个;
步骤S34,根据所述操作参数确定所述目标操作对象的运行信息。
在本实施例中,可对操作对象设置操作参数与距离之间的映射关系,操作参数包括操作对象的操作时间点以及操作次数中的至少一个。终端可根据操作参数确定目标操作对象的运行信息。
例如,在目标操作对象为应用抽屉时,应用抽屉中包括多个应用程序。终端获取各个应用程序的操作次数,操作次数可为运行次数。终端再按照操作次数从多到少的顺序,对各个应用程序进行排序。参照图7,图7为终端的又一操作示意图,在距离属于远距离区间时,控制触控屏显示排序第一的第一应用;在距离属于中距离区间时,控制触控屏显示排序第二的第二应用;在距离属于近距离区间时,控制触控屏显示排序第三的第三应用。
此外,终端可以确定应用抽屉中各个应用程序所对应的使用时间段。使用时间段根据应用程序的操作时间点进行统计。具体的,终端先根据各个应用程序的操作时间点,确定用户在当前时间段可能运行的应用程序,再对当前时间段对应的各个应用程序的操作次数进行排序,排序的方式参照上述描述,在此不再进行赘述。在距离属于远距离区间时,控制触控屏显示当前时间段排序第一的应用程序的应用图标;在距离属于中距离区间时,控制触控屏显示当前时间段排序第二的应用程序的应用图标;在距离属于近距离区间时,控制触控屏显示当前时间段排序第三的应用程序的应用图标。
另外,终端根据各个应用程序的操作时间点确定目标应用程序,目标应用程序的操作时间点位于当前时间段内,触控笔与触控屏之间的距离所属的距离区间不同,触控屏上显示的目标应用程序不同。
在本实施例提供的技术方案中,终端根据触控笔与触控屏之间的距离确定目标操作对象的操作时间点以及操作次数等操作参数,再根据操作信息确定操作对象的运行信息,使得目标操作对象的运行信息与用户的习惯相匹配。
参照图8,图8为本申请终端的控制方法的另一实施例,基于图2所示实施例,所述步骤S40之后,还包括:
步骤S50,在检测到所述触控屏上显示的显示内容的选定操作时,锁定所述显示内容,其中,所述触控笔与所述触控屏之间的距离变化时,锁定的所述显示内容不变。
在本实施例中,运行信息指的是目标操作对象的显示内容。触控笔与触控屏之间距离并不是固定不变的,会随着用户的操作而变动,可以理解的是触控屏显示的显示内容会随着触控笔与触控屏之间距离的变化而变化。在当用户对某个显示内容有选择意向时,需要通过触控笔的触点点击该触控屏上的显示内容,但触控笔的触点点击触控屏,会使得距离变化,而导致显示内容变化。对此,终端提供选定功能,用户可通过触控笔实时选定功能以将触控屏当前显示的显示内容进行锁定,锁定状态下的显示内容不会随着触控笔与触控屏之间的距离变化而变化,从而使得用户可选择锁定的显示内容,从而打开或启动目标操作对象,目标操作对象打开或启动后的运行界面由显示内容进行确定。当然,还可锁定显示内容以供用户仔细查看显示内容。
触控屏在显示显示内容时,可显示选定按钮;若触控笔的触点在触控屏上的停留时长达到预设时长,例如,停留2s,即可对显示内容进行锁定。对应的,触控屏在显示显示内容时,可显示解锁按钮,若触控笔的触点在解锁按钮上的停留时长达到预设时长,例如,停留2s,解除显示内容的锁定。
在显示内容处于锁定状态时,若终端检测到触控笔对触控屏的触控操作,则根据锁定的显示内容确定目标操作对象的运行界面,如显示内容为运行界面中的部分内容或全部内容,或根据显示内容配置运行界面。在目标操作对象打开或启动后,触控屏显示确定的运行界面。例如,锁定的显示内容为文档内容,文档内容为第三章的全部内容,目标运行对 象打开后,运行界面即为第三章的全部内容。
在本实施例提供的技术方案中,在触控屏上显示目标操作对象的显示内容后,若检测到触控屏上针对显示内容的选定操作时,则锁定显示内容,避免显示内容根据距离的变化而变化,从而便于用户查看该显示内容或者便于用户对显示内容进行后续操作。
在一实施例中,图标在触控屏上设置对应的区域,该区域内含图标。在确定触点在触控屏上的位置后,确定位置所在的区域,该区域对应的图标即为目标操作对象,也即将位置所在的区域对应的文档、文件夹、应用功能或应用抽屉确定为目标操作对象。终端通过为图标设置区域,使得触控笔的触点在屏幕上的位置无需位于图标上,即可控制图标对应的操作对象按照距离对应的运行信息运行,增大了触控笔的操作容错率。
在一实施例中,用户在使用触控笔时,并不一定是对终端上的应用程序进行操作,可能仅仅是查看下触控笔。若用户操作触控笔但并未对触控屏上的应用程序进行操作时,触控笔在触控屏上的悬浮持续时长是较小的。对此,终端中存储预设时长,预设时长不超过5s。当触控笔在触控屏上的悬浮持续时长达到预设时长时,即可判定用户有采用触控笔操作应用程序的倾向,此时,终端执行步骤S10-步骤S40。
在本实施例中,终端获取触控笔在触控屏上的悬浮持续时长,从而根据悬浮持续时长判断用户对终端上应用程序是否有操作倾向,降低了终端响应用户的误操作的几率。
本申请还提供一种终端的控制方法。
参照图9,图9为本申请终端的控制方法的又一实施例,所述终端的控制方法包括以下步骤:
步骤S60,获取触控装置与终端之间的操作信息;
在本实施例中,执行主体为终端。触控装置可为被终端感知的物体,该物体指的是与终端无电路连接关系以及通信连接关系。例如物体可为用户的手指,或者用户手持的任何物体。终端上可设置摄像头进行图像的采集,以感知物体。触控装置还可为终端上的部件,例如,终端上的后壳,终端可在后壳上设置触控区域,以供用户采用手指进行后壳的触控操作,终端可以根据用户在后面的触控操作以及后壳操作的镜面效果,进行对应的控制,镜面效果指的是触控操作的镜面效果;或者直接将后壳上的触控操作等同于终端上触控屏上的触控操作。触控装置还可为与终端连接的外接设备,例如,触控装置可为触控笔。
操作信息包括触控装置的触点在所述终端上的位置、所述触控装置与所述终端之间的距离或者所述触控装置在所述终端上的停留时长。
步骤S70,根据所述操作信息确定目标操作对象;
终端可以根据操作信息中的位置确定目标操作对象,根据位置确定目标操作对象的流程参照上述实施例,在此不再一一赘述。
终端还可以根据距离确定目标操作对象。具体的,距离与终端上各个应用或者文件具有映射关系。终端可以在当前显示的界面上显示的应用以及文件中确定与距离对应的目标操作对象。
此外,终端可以根据触控装置在终端上的停留时长确定目标操作对象,停留时长指的是触控装置被终端感知后,处于不动的持续时长。持续时长可以表征用户当前的选择状态,在持续时长较长时,则表明用户正在犹豫使用何种应用或者阅读何种文档,此时,将用户所喜爱的应用或者文档作为目标操作对象。而在当持续时长较短,则表明用户有目的的使用某个应用,此时,可以根据触控装置侧触点在终端上的位置进行确定;或者,根据距离显示用户近期使用的应用或者文档以供用户进一步进行选择,从而确定目标操作对象。
步骤S80,根据预设规则确定所述目标操作对象对应的执行信息;
预设规则包括当前时间、终端所在的当前地点、用户对操作对象的操作习惯或者终端的运行模式。终端可以根据预设规则确定目标操作对象对应的执行信息。执行信息即为上述所述的运行信息,执行信息包括目标操作对象中的目标子菜单、目标操作对象的显示界面的尺寸、目标操作对象的私密信息、目标操作对象的控制指令、目标操作对象的显示内 容、目标操作对象的显示格式及/或目标操作对象的待运行功能。执行信息的应用以及举例参照上述说明,在此不再进行赘述。
以下对终端根据预设规则选择操作信息对应的执行信息进行详细的说明。
A、预设规则为当前时间
操作信息可对应多个应用或者文档。例如,操作信息对应有微信、支付宝以及淘宝等。若当前时间为下班时间,则执行信息为打开微信的乘车码;若当前时间为就餐时间,则执行信息为打开支付宝的付款界面;若当前时间为临近双十一,则执行信息为打开淘宝中关注的商品界面等。下班时间、就餐时间等根据用户的实际下班时间以及实际就餐时间进行确定,也即上述的下班时间以及就餐时间为用户的习惯下班时间以及习惯就餐时间。
B、预设规则为终端所在的当前地点
执行信息可以根据终端所在的当前地点进行确定。具体的,在当终端检测到地点为地铁口时,则执行信息为打开微信中的乘车码;在终端检测当前位置为旅游景点时,则执行信息为打开相机的拍摄界面。
C、预设规则为用户对操作对象的操作习惯
终端可采集用户对应用或者文档的操作记录,从而分析得到用户对操作对象的操作习惯。例如,目标操作对象为音乐播放器,而用户经常听欢快的歌曲,也即操作习惯为查找欢快的歌曲,此时执行信息为自动查找欢快曲目。又例如,目标操作对象为视频播放器,而用户的操作习惯为观看动漫,则执行信息为自动为用户显示当前更新的动漫。
D、预设规则为终端的运行模式
终端可以根据自身的运行模式确定执行信息。例如,终端开启了分屏模式,而目标操作对象为微信,此时,执行信息为将微信的聊天界面的语音聊天进行显示,避免打字占用微信界面。又例如,终端开启了静音模式,而目标操作对象为游戏,执行信息为将目标操作对象的音量调制最低。
可以理解的是,终端可以根据上述任意的预设规则确定目标操作对象的执行信息。用户可在终端上设置预设规则,当然,预设规则也由用户对终端的历史操作信息进行确定。在当用户设置的预设规则与终端根据历史操作信息确定的预设规则发生冲突时,以用户设置的预设规则为准确定目标操作对象的执行信息。例如,用户设置的预设规则为某个地点播放轻快音乐,而终端确定的预设规则为该地点播放热血激励的歌曲,若终端处于该地点时,则播放轻快的音乐。
步骤S90,控制所述目标操作对象按照所述执行信息运行。
在确定执行信息后,终端即控制目标操作对象按照执行信息运行。
本实施例提供的技术方案中,终端获取触控装置与终端之间的操作信息,从而根据操作信息目标操作对象,再根据预设规则确定目标操作对象对应的执行信息,使得终端按照执行信息运行。由于终端可以根据触控装置与终端之间的操作信息自动确定目标操作对象以及目标操作对象的执行信息,无需对终端发送多个控制指令,终端的触控操作简便。
参照图10,图10为图9中步骤S70的细化流程示意图,所述步骤S70包括:
步骤S71,确定所述触控装置的类型;
步骤S72,根据所述类型以及操作信息确定目标操作对象。
在本实施例中,触控装置为被终端感知的物体、为终端上的部件或者与终端连接的外界设备。而不同的触控装置所针对的操作对象不同。例如,终端感知的物体为人的手指,而手指对应的操作对象为游戏、视频播放器以及音乐播放器等,因此,终端先确定游戏、视频播放器以及音乐播放器,再根据操作信息从三者中确定目标操作对象。又例如,触控装置为终端的后壳,而后壳对应的操作对象为备忘录、日历、计算器等,也即终端先根据后壳确定备忘录、日历、计算器,再根据操作信息从备忘录、日历、计算器中确定目标操作对象。可以理解的是,终端根据触控装置的类型先初步确定多个操作对象,再根据操作信息在初步确定的多个操作对象确定目标操作对象。终端根据操作信息确定目标操作对象 参照上述说明,在此不再进行赘述。
在本实施例提供的技术方案中,终端确定触控装置的类型,在根据类型以及操作信息准确的确定目标操作对象。
参照图11,图11为本申请终端的控制方法的再一实施例,基于图9所示实施例,所述步骤S60之前,还包括:
步骤S100,在检测到针对所述终端的操作时,确定所述操作对应的操作物体;
步骤S110,在所述操作物体为触控装置时,执行所述获取触控装置与终端之间的操作信息的步骤。
在本实施例中,终端在运行过程中,仅对触控装置的操作信息进行响应,而不会响应非触控装置的操作,以避免终端的功耗损耗过大。例如,终端放置于口袋中,口袋的布料会被终端所感知,若终端根据感知的布料与终端之间的操作信息进行响应,则会使得终端进行误操作。对此,终端仅对触控装置的操作信息进行响应。
终端在检测到针对终端的操作时,确定操作所对应的操作物体,可采用摄像头对操作物体进行图像采集。在判断操作物体是否为触控装置,若为触控装置,则执行获取触控装置与终端之间的操作信息,从而根据操作信息进行响应。
在本实施例提供的技术方案中,终端在检测到操作时,确定操作对应的操作物体,并在操作物体为触控装置时,获取触控装置与终端之间的操作信息,以进行对应的响应,避免终端进行误操作。
本申请还提供一种触控笔的控制方法。
参照图12,图12为本申请触控笔的控制方法的一实施例,所述触控笔的控制方法包括以下步骤:
步骤S120,获取所述触控笔与书写界面之间的操作信息;
在本实施例中,执行主体为触控笔,触控笔与终端进行通信连接。触控笔包括但不限于笔的形式,且触控笔上可具有被感知的触点,也可不具备触点,任何形式的可被终端所感知的物体均可视为触控笔,终端的感知的形式包括但不限于摄像头感知、信号感知等。
触控笔为控制终端,而终端为待控终端,终端可为手机等。书写界面可以为终端的触控界面;也可以为触控笔自带的触控界面,或者,触控笔连接的触控界面,例如,触控笔可基于空调器的触控屏对手机进行控制;或者书写界面还可为空气投影界面。
操作信息包括所述触控笔的触点在所述书写界面上的位置、所述触控笔与所述触控笔之间的距离或者所述触控笔在所述书写界面上的停留时长。
步骤S130,根据所述操作信息确定目标操作对象和运行信息;
终端可以根据操作信息确定目标操作对象以及目标操作对象的运行信息,所述运行信息包括目标操作对象中的目标子菜单、目标操作对象的显示界面的尺寸、目标操作对象的私密信息、目标操作对象的控制指令、目标操作对象的显示内容、目标操作对象的显示格式及/或目标操作对象的待运行功能。操作信息确定目标操作对象以及运行信息,以及运行信息的距离说明,具体请参照上述说明,在此不再进行赘述。
步骤S140,控制所述目标操作对象按照所述运行信息运行。
在确定目标操作对象后,控制目标操作对象案子运行信息运行。也即触控笔根据运行信息确定控制指令,将控制指令发送至终端,使得终端根据控制指令运行。当然,触控笔可将运行信息直接发送至终端,使得终端按照运行信息运行。
在本实施例提供的技术方案中,触控笔获取触控笔与书写界面之间的操作信息,从而根据操作信息确定目标操作对象和运行信息,从而控制目标操作对象按照运行信息运行。由于触控笔可以根据触控笔与书写界面之间的操作信息即可控制终端进行相应的操作,无需通过触控笔对书写界面进行多次操作以对终端进行操作,终端的触控操作流程简便。
参照图13,图13为本申请触控笔的控制方法的另一实施例,基于图12所示实施例,所述步骤S130包括:
步骤131,获取预设规则,并根据所述预设规则以及所述操作信息确定目标操作对象以及运行信息。
在本实施例中,终端可先根据操作信息确定目标操作对象,再根据预设规则确定目标操作对象的运行信息。预设规则可根据参考特征进行确定,参考特征包括当前时间、触控笔所在的位置、用户对操作对象的操作习惯或者触控笔控制的终端的运行模式。也即预设规则与参考特征一一对应。
而根据预设规则确定目标操作对象的运行信息可参照上述说明,在此不再进行赘述。
在本实施例提供的技术方案中,触控笔获取预设规则,并根据预设规则以及操作信息准确的确定目标操作对象的运行信息。
参照图14,图14为图12中步骤S130的细化流程示意图,所述步骤S130包括:
步骤S132,确定所述触控笔对应的用户标识;
步骤S133,根据所述用户标识以及所述操作信息确定目标操作对象以及运行信息。
在本实施例中,触控笔可为办公用笔,也即办公室的各个成员均可通过触控笔控制终端。而不同的成员对终端的控制需求以及控制习惯并不完全相同。对此,触控笔确定对应的用户标识,用户标识表征用户。触控笔上可设置指纹采集装置,通过指纹采集装置确定用户标识。或者触控笔上设有摄像头,采集人脸确定用户标识。又或者,触控笔上可设有语音采集模块,以通过用户的声音确定用户标识。
触控笔在确定用户标识后,即可根据用户标识以及操作信息确定目标操作对象以及目标操作对象的运行信息。
在本实施例提供的技术方案中,触控笔确定用户标识,从而根据用户标识以及操作信息确定目标操作对象以及目标操作对象的运行信息,使得触控笔准确的确定符合用户本意的运行信息以供终端根据运行信息运行,触控笔的智能化程度高。
本申请还提供一种移动终端的控制方法。
参照图15,在一实施例中,所述移动终端的控制方法包括:
步骤S150、获取触控装置与移动终端之间的操作信息,并根据所述操作信息获取目标应用界面,所述操作信息包括触控笔在移动终端的显示屏上悬浮。
本实施例中,移动终端可以是智能手机、平板电脑等。
可选地,移动终端显示屏的四个角位置分别设置信号接收器,当触控笔悬浮在显示屏上方时,对应四个信号接收器位置选择多个触控笔位置处作为标定点,要求每个标定点与对应接收器的距离比该标定点与其他接收器的距离相对更近,通过各接收器接收到触控笔信号的时间差和接收器的坐标位置信息计算出触控笔到四个接收器的距离,并由此计算出触控笔在以显示平面为基准面的显示平面坐标系内的空间坐标,再向显示平面进行投影,得到投影点坐标,该投影点坐标即可作为触控笔在显示屏上的触控点位置。即终端可通过四个信号接收器检测触控笔当前是否悬浮在显示屏上。
需要说明的是,让触控笔(信号发生器)以固定频率发射信号脉冲(每个脉冲可以是多个波长)作为触控笔信号,如超声波脉冲。
可选地,移动终端的显示屏也可检测红外信号,而触控笔可发送红外信号至显示屏上,当终端通过显示屏检测到触控笔发送的红外信号时,即可判定触控笔悬浮在移动终端的显示屏上。而红外信号在显示屏上的接触位置,即可作为触控笔在显示屏上的触控点位置。
可选地,终端获取触控装置与移动终端之间的操作信息,并根据操作信息获取目标应用界面,触控装置即为触控笔,操作信息为触控笔在移动终端的显示屏上悬浮,此时,即获取目标应用界面。
可选地,终端可以是获取至少一个预设应用界面作为目标应用界面。所述预设应用界面可以是由用户预先设置的,也可以是由移动终端的设计人员设置的(即系统的默认设置),而预设应用界面可以是移动终端当前安装的某个应用上的应用界面,如微信应用的主界面,微博应用的首页界面等。需要说明的是,所述预设应用界面可以是某个应用的所 有主要的界面;在具有多个预设应用界面时,也可以是多个不同应用的应用界面。
例如,由于用户需要经常使用微信应用的主界面和微博应用的首页界面,则用户可将微信应用的主界面和微博应用的首页界面均设置为预设应用界面。
可选地,终端可以是检测到触控笔在移动终端的显示屏上悬浮后,获取目标应用,然后进一步获取所述目标应用的应用界面作为目标应用界面。其中,目标应用可以是预设应用,所述预设应用界面可以是由用户预先设置的,也可以是由移动终端的设计人员设置的(即系统的默认设置),如微信应用、微博应用等。可选地,终端可以获取预设应用作为目标应用,并将目标应用中的至少一个应用界面作为目标应用界面。例如,在预设应用为微信应用时,则目标应用界面可以包括聊天界面、通讯录界面、朋友圈界面、发现界面和设置界面等。
步骤S160、将所述目标应用界面显示在所述显示屏的目标区域中。
可选地,参见图16,移动终端10的显示屏20的显示区域中,设置有目标区域30。其中,所述目标区域30可以是在触控笔在移动终端的显示屏上悬浮后,才以悬浮框的形式显示在显示屏20上;所述目标区域30也可以是在触控笔在移动终端的显示屏上悬浮后,以透明区域的形式存在显示屏20上。
可选地,所述目标区域可用于显示多个目标应用界面。
可选地,参见图17,终端可将获取到的目标应用界面31显示在目标区域30中。
可选地,终端在检测到触控笔在移动终端的显示屏上悬浮后,可以开始记录并获取触控笔在显示屏上的悬浮时长,当终端在检测到获取的悬浮时长大于第二预设时长时,则再执行所述获取目标应用界面的步骤。这样,可以减少终端对目标应用界面显示的误判,避免在目标区域频繁显示目标应用界面,使得用户可以随意使用触控笔。需要说明的是,所述第二预设时长可以根据实际情况需要设置,如3秒-5秒。
在一实施例中,检测到触控笔在移动终端的显示屏上悬浮后,获取目标应用界面;将所述目标应用界面显示在所述显示屏的目标区域中。这样,基于触控笔的悬浮检测,在触控笔悬浮在显示屏上时,获取用户需要查看的目标应用界面显示在显示屏的目标区域中,实现方便用户快速查看应用界面。
在一实施例中,终端可以是检测到触控笔在移动终端的显示屏上悬浮后,获取目标应用,然后进一步获取所述目标应用的应用界面作为目标应用界面。
可选地,终端可在检测到触控笔在移动终端的显示屏上悬浮后,获取悬浮时的所述触控笔在所述显示屏上的触控点位置,然后根据触控点位置与显示屏上的应用的显示位置之间的关系,获取目标应用。
可选地,参见图18,终端可获取触控点位置40处于显示屏20上的应用21的显示位置中的应用,并将获取到的应用作为目标应用。
例如,当触控笔的触控点位置处于微信应用的图标显示处时,则获取微信应用作为目标应用;当触控笔的触控点位置处于微博应用的图标显示处时,则获取微博应用作为目标应用。
可选地,终端获取到目标应用后,将目标应用中的至少一个应用界面作为目标应用界面。
这样,用户可以通过移动悬浮在显示屏上的触控笔,以改变触控点位置(即触控笔的落点位置),通过控制触控点位置位于不同的应用的显示位置中,以实现目标应用的切换,即实现目标区域中所显示的目标应用界面的切换。例如,在触控点位置当前位于微信应用的显示位置中时,目标区域所显示的是微信应用的应用界面,而在随后用户将触控点位置位于微博应用中时,终端将目标区域所显示的目标应用界面切换为微博应用的应用界面。
这样,可以帮助用户快速预览不同应用的应用界面,以方便用户快速查看应用界面。
在一实施例中,终端检测到触控笔在移动终端的显示屏上悬浮后,获取悬浮时的所述触控笔在所述显示屏上的触控点位置。
可选地,终端在得到触控点位置后,可检测触控点位置是否处于目标区域的范围内,并在检测到触控点位置不处于目标区域的范围内时,调整目标区域的显示位置,以使触控点位置处于目标区域的范围内。
这样,用户可以通过控制触控点位置移动,以实现控制目标区域移动,继而调整目标区域在显示屏上的显示位置。
在一实施例中,终端检测到触控笔在移动终端的显示屏上悬浮后,获取悬浮时的所述触控笔在所述显示屏上的触控点位置。
可选地,当用户将触控笔悬浮在显示屏上时,可通过控制触控笔移动,以改变目标区域中的所述目标应用界面的显示比例。可选地,在目标应用界面的显示比例与目标区域的显示比例相关时,则用户可通过改变目标区域的显示比例,以调整目标区域中的目标应用界面的显示比例。
可选地,在悬浮在显示屏上的触控笔移动时,会产生多个触控点位置,终端可通过捕捉多个触控点位置形成触控点位置的移动轨迹。
可选地,终端可根据触控点位置的移动轨迹调整目标区域的显示比例,进而调整目标区域中的目标应用界面的显示比例。
可选地,终端预先设置有对应不同显示比例调节指令的预设轨迹,其中,显示比例调节指令可以是显示比例缩放指令和显示比例放大指令。
可选地,终端在获取到触控点位置的移动轨迹后,检测是否存在与移动轨迹吻合的预设轨迹,并在检测到与移动轨迹相同的预设轨迹后,获取该预设轨迹对应的显示比例调节指令,通过执行显示比例调节指令实现调整目标区域中的目标应用界面的显示比例。其中,终端在执行显示比例放大指令时,则可通过增大目标区域的区域范围以增大目标应用界面的显示比例;终端在执行显示比例缩放指令时,则可通过减少目标区域的区域范围以减少目标应用界面的显示比例。
例如,参见图19,终端可预先设置显示比例放大指令对应的预设轨迹为触控点位置40在目标区域30的边角位置往目标区域30外的区域移动,那么当用户控制触控点位置40位于目标区域30的边角位置后,并进一步将触控点位置40往目标区域外30的区域拖拽时,则终端判定当前触控点位置的移动轨迹与显示比例放大指令对应的预设轨迹相同,则终端执行显示比例放大指令,以增大目标区域中30的目标应用界面31的显示比例。
可选地,终端可预先设置显示比例缩放指令对应的预设轨迹为触控点位置在目标区域的边角位置往目标区域中心位置移动,那么当用户控制触控点位置位于目标区域的边角位置后,并进一步将触控点位置往目标区域中心位置拖拽时,则终端判定当前触控点位置的移动轨迹与显示比例缩放指令对应的预设轨迹相同,则终端执行显示比例缩放指令,以减少目标区域中的目标应用界面的显示比例。
应当理解的是,预设轨迹的设定方式不限于上述所述,例如,显示比例放大指令对应的预设轨迹还可以是一段圆形轨迹。
这样,可以方便用户随意调节目标应用界面的显示比例,使得用户查看目标区域中的应用界面更加方便。
可选地,终端可根据触控点位置的移动轨迹打开快捷应用。
可选地,终端预先设置有对应不同快捷打开方式的预设轨迹,其中,不同快捷打开方式所关联的应用可以是由用户预先设置的,这些应用可以是移动终端上的任一应用,如微信朋友圈、视频拍摄应用等。
可选地,终端在获取到触控点位置的移动轨迹后,检测是否存在与移动轨迹吻合的预设轨迹,并在检测到与移动轨迹相同的预设轨迹后,获取该预设轨迹所关联的快捷打开方式,然后打开该快捷打开方式对应的应用。
可选地,终端可预先设置不同快捷打开方式对应的预设轨迹为触控点位置在目标区域中部区域往目标区域的不同边界线移动的轨迹。例如,目标区域可以包括上下左右四个边 界线,那么在上边界线对应的预设轨迹所关联的快捷打开方式为微信朋友圈时,当终端检测到当前触控点位置的移动轨迹为往目标区域的上边界线移动时,则快速打开微信朋友圈。
这样,可以方便用户快速打开快捷打开方式对应的应用。
在一实施例中,在将目标应用界面显示在目标区域后,用户可通过选中目标区域中的目标应用界面,以进入该目标应用界面。终端在检测到目标区域中的目标应用界面的选中操作时,则将选中操作针对的目标应用界面显示在显示屏的主界面中,同时,取消其他目标应用界面的显示。
可选地,用户可通过使用触控笔点击目标区域中的目标应用界面,以发出目标应用界面的选中操作。
进一步地,终端在检测到触控笔通过点击目标应用界面发出的选中操作时,则开始记录触控笔与目标应用界面的接触时间作为该选中操作对应的选中时长,并将选中时长与第一预设时长进行比对。
可选地,当终端检测到选中时长小于或者等于第一预设时长时,则通过所述显示屏的主界面显示所述目标应用界面。
可选地,当终端检测到选中时长大于第一预设时长时,则获取目标应用界面的界面内容,并将获取到的界面内容复制至移动终端的剪切板,以方便用户复制目标应用界面中的界面内容。
可选地,触控笔设置有信号发送按键,用户可以通过按压信号发送按键,以向终端发送第一信号和第二信号,其中,终端将触控笔首先发送的信号作为第一信号,以及将触控笔后续发送的信号作为第二信号。进一步地,终端当终端检测到选中时长大于第一预设时长时,开始接收触控笔发送的第一信号和第二信号,并在接收到第一信号时,记录触控笔与目标显示界面之间的第一接触点,以及终端在接收到第二信号时,记录触控笔与目标显示界面之间的第二接触点。然后,终端获取第一接触点和第二接触点之间的内容信息,并将该内容信息作为目标应用界面中的界面内容复制至移动终端的剪切板,以方便用户复制目标应用界面中的界面内容。比如,通过这样,可以方便用户截获到目标应用界面上的一段文字信息。
可选地,当终端检测到选中时长大于第一预设时长时,并在终端获取目标应用界面的界面内容的过程中,识别所述目标应用界面中的关键信息,然后将识别得到的关键信息作为界面内容复制至移动终端的剪切板。
需要说明的是,所述关键信息包括证件信息(身份证、驾驶证、护照等)、电话号码和地址信息中的至少一个。
可选地,证件信息可以是具有与证件号码的字符数相同的字符信息。如,将18位数字组成的字符信息识别为身份证号码(应当理解的是,也可以是17为数字与1位字母组合的字符信息)。
可选地,电话号码可以是13位数字组成的字符信息,或者区号加8位数字组成的字符信息。将13位数字组成的字符信息识别为电话号码,或者将区号加8位数字组成的字符信息识别为电话号码。
可选地,地址信息可以是具有“省”、“市”、“区”、“镇”等地区行政区域标识字符的字符信息组合。将出现有“省”、“市”、“区”、“镇”等地区行政区域标识字符的字符信息组合,识别为地址信息,如“汉东省汉东市东海区南湖大道18号”即为地址信息。
可选地,通过机器学习技术识别目标显示界面中的文本信息和图片信息,并将识别得到的证件信息(身份证、驾驶证、护照等)、电话号码、地址信息均作为关键信息。
这样,可以方便用户选取目标显示界面中的关键信息。
可选地,当终端检测到选中时长大于第一预设时长时,可以是将目标显示界面当前所 显示的内容进行截屏处理,以截取所述目标应用界面的界面内容,从而生成目标应用界面的截图并保存。
这样,可以方便用户对目标显示界面进行截图操作。
可选地,用户可通过控制触控笔悬浮在目标区域的目标应用界面上,当终端检测到触控笔在目标应用界面上的悬浮时长大于第二预设时长时,则判定接收到目标应用界面的选中操作,并获取当前有触控笔悬浮的目标应用界面,且将获取到的目标应用界面显示在显示屏的主界面中。需要说明的是,所述第二预设时长可以根据实际情况需要设置,如3秒-5秒。
可选地,用户可直接用手点击目标区域中的目标应用界面,以发出目标应用界面的选中操作。
在一实施例中,检测到所述目标应用界面的选中操作时,通过所述显示屏的主界面显示所述目标应用界面。这样,方便用户快速进入目标应用界面。
在一实施例中,终端判定触控笔离开显示屏上方的情形,可以是触控笔与显示屏接触(即触控笔点击显示屏),也可以是触控笔与显示屏的距离大于预设距离(例如用户拿开触控笔)。
可选地,在终端检测到触控笔离开显示屏上方时,可以通过取消目标区域的显示,以实现取消目标区域中的目标应用界面的显示。
可选地,在终端检测到触控笔离开显示屏上方时,且在目标区域以透明区域的形式显示时,终端可以是直接取消目标区域中的目标应用界面的显示。
这样,可以在用户不需要查看目标应用界面时,帮助用户快速取消目标应用界面的显示。
本申请还提供一种内置触控笔的终端控制方法
参照图20,在本申请内置触控笔的终端控制方法的一实施例中,所述内置触控笔的终端控制方法包括:
步骤S170、检测到触控笔与终端之间的操作信息,所述操作信息包括触控笔的按压键的按压操作;
本申请提供的内置触控笔的终端控制方法主要用于终端与未拔出的触控笔进行交互。本申请提供的内置触控笔的终端控制方法涉及的终端包括但不限于手机、平板电脑和电脑等,所述终端上预先加载有相关的应用系统。
在本实施例中,终端包括设置有按压键的触控板和触控笔固定位,所述触控笔固定位上固定有触控笔,所述触控笔上设置有按压键。所述按压键能弹起或被压回。所述按压操作包括弹起操以及压回操作,所述弹起操作对应按压键的弹起,所述压回操作对应按压键的压回。可以理解的是,所述触控笔中还设置有发送单元,用于所述触控笔被弹起或压回时向所述终端发送对应的按压操作。现有使用触摸笔可以采用点击的方式模仿鼠标的左击操作,从而实现与平板电脑等被控装置进行简单交互,可以在平板电脑等被控装置所装载的手写输入软件上通过手写的方式输入字符(字符包括字母、数字、文字和符号)或者画图等。为了防止触控笔的丢失以及快速找到控制笔,市面上出现了内置触控笔的移动终端。由于内置触控笔的移动终端在该触控笔未拔出时无法实现上述功能,导致现有的带有触控笔的终端在触控笔未拔出时无法与终端产生交互,故在触控笔笔端处设置能弹起或压回的按压键,即使该触控笔在终端的触控笔固定位内,也可通过该触控笔上的按压键与该终端进行交互,该交互由用户自定义设置或为默认设置。用户在有与终端交互的需求时,对该触控笔上的按压键进行按压操作,然后该触控笔将按压操作对应的信息反馈至该终端,所述终端实时检测该触控笔反馈的按压操作对应的信息。可以理解的是,触控笔与终端之间的操作信息包括触控笔的按压键的按压操作。
步骤S180、在检测到触控笔与终端之间的操作信息后,所述终端进行预设操作。
在本实施例中,终端在检测到所述按压操作后,进行预设操作。其中,所述预设操作包括以下至少一个:
所述终端清除非活跃应用,所述非活跃应用包括正在运行但未使用的应用;
所述终端删除非活跃应用的所有文件中文件类型为预设类型的目标文件;
所述终端启动预设应用。
可以理解的是,所述预设操作并不限定为上述列举的操作。所述预设操作还可以是将终端的铃声调大或调小,及/或显示未读邮件等其它交互操作。
为了更好的理解本实施例,以下举例进行阐述。例如,用户预先在预设操作设置界面中设置,将所述预设操作设置为清除终端的非活跃应用。当所述触控笔未拔出,且所述用户对所述触控笔的按压键进行按压操作,比如,用户对按压键进行弹起并在预设时间内压回,则所述触控笔将按压操作的信息反馈至所述终端,所述终端检测到所述触控笔反馈的按压操作信息后,清除所述终端的非活跃应用。可以理解的是,本实施另并不限定所述预设操作的个数,用户可以预先设置多个交互操作,并在所述终端检测到所述触控笔反馈的按压操作信息后,执行预设的多个交互操作操作。
在本实施例公开的技术方案中,先检测触控笔的按压键的按压操作,然后,在检测到所述按压操作后,所述终端进行预设操作。因本申请能够在内置于所述终端触控笔未拔出时通过所述触控笔的按压键与所述终端产生交互并使所述终端进行预设操作,从而解决了带有触控笔的终端在触控笔未拔出时无法与终端产生交互的问题。
在一实施例中,所述触控笔的状态包括拔出状态以及未拔出状态。由于触控笔的拔出状态下设置的预设操作与未拔出时设置的控制参数不同,故为了方便区分接下来执行的操作,在检测到所述按压操作后,通过所述固定位上的检测装置检测触控笔的状态。在检测到所述触控笔未拔出时,获取未拔出的状态对应的预设操作,并进行该预设操作。
在检测到所述触控笔已拔出时,调整触控笔接触所述终端的屏幕时的显示参数。
具体地,所述调整触控笔接触所述终端的屏幕时的显示参数包括以下至少一个:改变所述触控笔接触所述终端的屏幕时显示的线条颜色;改变所述触控笔接触所述终端的屏幕时显示的线条粗细。在检测到按压操作且所述触控笔已拔出时,改变所述触控笔接触所述终端的屏幕时显示的线条颜色。或者,改变所述触控笔接触所述终端的屏幕时显示的线条粗细。或者,在检测到按压操作且所述触控笔已拔出时,改变所述触控笔接触所述终端的屏幕时显示的线条颜色以及显示的线条粗细。所述线条颜色以及线条粗细为用户在设置界面中预先设置的,也可以是默认设置。
在本实施例公开的技术方案中,在检测到按压操作后检测触控笔的固定状态,然后根据所述触控笔的固定状态进行对应的预设操作,由于可以根据触控笔的固定状态进行交互,这样达成了丰富了交互方案的效果。
在一实施例中,当预设操作被执行时需要先对该预设操作进行权限验证,所述终端调用自身验证机制对预设操作的权限进行权限验证。可以理解的是,每个应用都是一个应用,每个应用系统都会分配一个权限组合,该权限组合就是这个应用拥有的权限列表,权限验证就是在做某项任务时对需要指定的权限进行验证,然后根据所述需要的权限判断该智能管理应用是否在已申请的权限组合内,若该智能管理应用在已申请的权限组合内时,则权限验证通过,若该智能管理应用不在已申请的权限组合内时,则权限验证不通过。在权限验证通过时,则所述终端进行预设操作。在权限验证不通过时,则不执行所述预设操作。
在本实施例公开的技术方案中,在检测到所述按压操作后,先进行权限验证,在权限验证通过时,所述终端进行预设操作,这样达成了避免预设操作的执行影响终端系统的使用的效果。
在一实施例中,由于用户的交互需求多样化,默认的预设操作可能不能满足用户的需求,故需要为用户提供一个预设操作自定义的方式。本实施例中的触控笔的按压键还可以进行旋转操作,终端在检测到按压键旋转预设角度且所述触控笔未拔出时,获取预设操作 设置界面的信息,并在根据所述信息生成预设操作设置界面后,显示所述预设操作设置界面。以通过所述预设操作设置界面获取用户的设置操作。
具体地,用户可以在所述预设操作设置界面进行预设操作的自定义,终端在检测到基于所述预设操作设置界面触发的设置操作时,根据所述设置操作确定用户自定义的所述预设操作。
进一步地,当面根据所述设置操作确定用户自定义的所述预设操作后,将当前确定的所述预设操作更新为所述按压操作对应的,并可由所述按压操作触发的预设操作。
可以理解的是,用户每设置一个预设操作,则更新一次预设操作。或者等用户的多个操作设置完后更新该多个操作未预设操作。
本实施例能够生成预设操作设置界面供用户进行操作的预设,从而避免了终端与触控笔之间的交互所进行的操作是用户不想要的操作。
为实现上述目的,本申请还提供一种内置触控笔的装置,所述内置触控笔的装置,及用于固定所述触控板的固定位。
如图21所示,所述内置触控笔的装置100还包括检测单元101,所述检测单元用于检测所述触控笔的操作。执行单元102,其中,所述执行单元102用于根据所述触控笔的操作控制所述装置执行预设操作。
可选地,所述触控笔的操作包括所述触控笔的按压键的按压操作,和/或所述触控笔的按压键的旋转操作。
作为一种实施方式,所述内置触控笔的装置100还包括状态检测单元103,所述状态检测单元103用于检测所述触控笔的固定状态,其中,所述固定状态包括,未拔出状态和/或拔出状态。其中,在所述触控笔的操作为所述按压键的按压操作,且所述固定状态为所述未拔出状态时,所述预设操作包括以下至少一项:
所述装置清除非活跃应用,所述非活跃应用包括正在运行但未使用的应用;
所述装置删除非活跃应用的所有文件中文件类型为预设类型的目标文件;
所述终端启动预设应用。
进一步地,在所述触控笔的操作为按压键的按压操作,且固定状态为拔出状态时,所述预设操作为调整所述触控笔接触所述装置的屏幕时的显示参数,所述显示参数包括以下至少一项:
调整所述触控笔接触所述装置的屏幕时显示的线条颜色;
调整所述触控笔接触所述装置的屏幕时显示的线条粗细。
在所述触控笔的操作为按压键的旋转操作,且固定状态为未拔出状态时,显示预设操作设置界面;所述预设操作设置界面根据用户的设置操作更新所述预设操作。
在本实施例公开的技术方案中,所述内置触控笔的装置包括设置有按压键的触控笔、所述触控笔的固定位,检测单元以及执行单元,通过先检测触控笔的按压键的按压操作,然后,在检测到所述按压操作后,所述终端进行预设操作。因本申请能够在内置于所述终端触控笔未拔出时通过所述触控笔的按压键与所述终端产生交互并使所述终端进行预设操作,从而解决了带有触控笔的终端在触控笔未拔出时无法与终端产生交互的问题。
本申请还提供一种基于触控笔的触控提醒方法。
参考图22,本申请第一实施例提供一种基于触控笔的触控提醒方法,所述方法包括:
步骤S190,在检测到所述触控笔对所述触控屏的操作信息后,获取所述压力传感器检测到的压力值,所述操作信息包括所述触控笔对所述触控屏的书写操作;
在本实施例中,执行主体为终端。终端可以是智能手机、Pad、笔记本电脑、学习机和电子书等具有触控屏的设备。触控屏上装载有压力传感器,用于检测作用于触控屏上的压力值。压力传感器在接收到压力信号后,将压力信号转换成电信号,并将电信号传输至控制器。其中,压力传感器优选为应变传感器。应变传感器是指试件受力变形,应变片的灵敏栅也获得同样的变形,使其电阻也随之发生变化,转换成相应的电信号,如电流或电 压变化。
触控笔是利用导体材料制作的具有导电特性,用来触控触控式触摸屏完成人机对话操作的笔。触控笔可拆卸地安装在终端上,结合终端的触控屏进行使用,应用在具有特殊功能的软件上,如绘图,手写,动漫设计等。
当触控笔按压触控屏,装载在触控屏上的压力传感器能检测到触控屏上产生的压力值。可以理解的是,触控笔对触控屏的操作信息包括所述触控笔对所述触控屏的书写操作
步骤S200,根据所述压力值输出触控提醒信息。
终端在获取压力传感器检测的压力值后,根据压力值与预设压力值的大小关系,输出触控提醒信息。
触控提醒信息表现形式为文字、图片、动画、视频、语音、灯光以及振动中的一种或多种组合,触控提示信息可通过提示框的方式实现,可在提示框中显示文字、图片、动画以及视频中的任意一个。
其中,根据所述压力值输出触控提醒信息的步骤包括:
根据所述压力值以及当前的参考参数输出对应的触控提醒信息。
当前的参考参数包括当前的环境信息、当前的时间信息以及当前的用户信息中的至少一个,环境信息可包括环境亮度、位置信息、环境温度以及天气信息中的至少一个;时间信息可包括当前时间点所在的时间段以及终端的使用时长中的至少一个;用户信息可为用户特征,可通过指纹识别或者图像识别。
在本实施实施例中,根据所述压力值以及当前的参考参数输出对应的触控提醒信息包括:获取所述压力值对应的参考参数与所述触控提醒信息的映射关系;根据所述映射关系获取当前的参考参数对应的触控提醒信息。
可在压力值大于预设阈值以及压力值小于预设阈值时设置不同的参考参数与所述触控提醒信息的映射关系,根据不同的映射关系实现不同的提醒,提高提醒准确度;或者也可针对不同的参考参数设置不同的压力值与触控提醒信息的映射关系。
例如,终端根据不同的时间段以不同的提醒方式进行,可以通过语音和动画相结合的方式进行提醒,也可以通过语音、动画和振动模式相结合的方式进行提醒,也可以单独使用语音提醒,或单独使用动画进行提醒。比如,在工作日的上班时间,以动画与振动,或单独以动画的形式进行相应的触控压力过大或触控压力过小提醒信息;在晚上六点到晚上十点,以语音、动画弹框和振动模式相结合的方式进行提醒;在晚上十点到次日早上八点,以动画弹框的方式进行提醒;在周末的白天,以语音、动画和振动模式相结合的方式进行提醒等。在实际应用中,用户可设置自己偏好的一种或多种提醒方式。
在本实施例中,通过获取压力值,根据压力值输出触控提醒信息,对用户不良的触控力度进行语音和动画提醒,使用户准确地掌握触控力度错误的信息,以进行及时的调整,提高触控效率。
在一实施例中,当所述压力值大于第二预设压力值,输出触控压力过大提醒信息,其中,所述第一预设压力值小于所述第二预设压力值。也可在压力值大于第二预设压力值时,不进行提醒,或者输出减小力度的提醒信息。
可以理解的是,在本实施例的其它变形实施例中,步骤S200包括:当所述压力值大于第二预设压力值,输出触控压力过大提醒信息,当所述压力值小于第一预设压力值,输出触控压力过小提醒信息,其中,所述第一预设压力值小于所述第二预设压力值。也可在压力值小于第二预设压力值时,不进行提醒,或者输出增大力度的提醒信息。
第一预设压力值是用户使用触控笔能进行触控的最小压力值。当压力值小于第一预设压力值,说明用户在使用触控笔时,触控力度过轻,在触控屏上无法显示,需要提醒用户加大划线力度。
第二预设压力值为用户使用触控笔时不损害触控笔笔尖的最大压力值,其中,第一预设压力值小于第二预设压力值。当压力值大于第二预设压力值,说明用户在使用触控笔时, 触控力度过重,尽管触控仍能继续,但会损害触控笔笔尖,需要提醒用户减小触控力度。
当压力值在第一预设压力值与第二预设压力值之间时,说明用户能正常触控,可以输出正常触控提醒信息,也可以不用提醒,并在后台继续检测用户的触控情况。
本实施例中,终端根据压力传感器检测到的压力值与预设压力值之间的大小关系,判断用户的触控力度是否正常,对用户进行提醒,以使用户及时掌握触控力度信息,当处于触控力度异常的时候,做出正确的调整。
在一实施例中,步骤S190之前,还包括:
检测所述触控屏的报点;
判断是否检测到报点;
未检测到报点,输出第一预设提醒信息。
当触控笔触摸触控屏时,触控笔和触控屏形成一个耦合电容,当触控笔吸走一小部分电流后,会引起触控屏上电流或电容量的变化。当电流或电容量的变化超过第一预设阈值,触控屏能检测出触摸点的位置坐标,并产生报点。
通过触控屏上的电流或电容计算出触控屏上的触摸点的位置坐标的原理包括:
一、当触控笔或手指触摸触控屏时,触控笔或手指和工作面形成一个耦合电容,其中,工作面上接有高频电流,当触控笔或手指吸走一小部分电流,这部分电流分别从屏的四个角上的电极中流出,且理论上经四个电机的电流与触控笔或手指到四角的距离成比例,终端对这四个电流比例进行精密计算,得出位置坐标;
二、触控屏也可以通过触控笔或手指触摸屏引起电容变化而确定触摸点的位置坐标。触控屏上具有驱动线与感应线,其中,驱动线发射信号,感应线侦测电容值的变化。当触控笔或手指触摸触控屏时,触控笔或手指与触控屏表面形成耦合电容。对于高频电流来说,电容是直接导体,当触控笔或手指吸走一小部分电流后,影响了触摸点附近两个电极之间的耦合,而改变这两个电极之间的电容量。检测互动电容时,驱动线方向的电极依次发出激励信号,与此同时,感应线方向的电极接收信号,得到所有纵向和横向电极交汇点的电容值变化,即整个触控屏的电容大小,根据触控屏电容的变化量数据,计算出每一个触摸点的坐标。
检测到报点后,执行步骤S190,获取所述压力传感器检测到的压力值。
当触控笔接触触控屏产生的电流或电容量变化达到设定的阈值,终端根据电流或电容量变化计算出触摸点的位置坐标,而产生报点。报点可以以两条垂直交叉直线的交点显示在触控屏上,也可以不显示。在检测到触控屏的报点后,说明用户的握笔姿势正确,终端进一步获取压力传感器检测到的压力值,根据压力值,对用户的不良书写力度进行提醒。
当触控笔接触触控屏产生的电流或电容量变化没达到设定的阈值,终端不能计算出触摸点的位置坐标,因而检测不到触控笔的报点。终端未检测到触控屏的报点,说明触控笔与触摸屏的倾斜角太小,笔尖未接触到屏幕,但笔身接触到屏幕,给用户能够书写的错觉,需要提醒用户握笔姿势错误,需要提高笔尖。第一预设提醒信息可为提醒用户握笔姿势不良的提醒,第一预设提醒信息表现形式为文字、图片、动画、视频、语音、灯光以及振动中的一种或多种组合。
如图23所示,触控笔的笔尖接触屏幕,此时触控屏产生的电流或触控量变化达到设定的阈值,终端根据电流或触控量变化计算出触摸点的位置坐标,而产生报点,即在检测到报点时,说明触控笔接触屏幕。
在本实施例中,终端根据是否产生报点,对用户的握笔姿势和触控力度进行实时检测,对用户不良的握笔姿势和触控力度给予提醒,以保护触控笔的笔尖,提高触控笔的使用寿命和提高触控效率。
在一实施例中,当触控笔与触控屏在一定距离内时,比如10mm,触控笔能引起触控屏上电容或电流的微小变化,即电流或电容量的变化超过第二预设阈值,第二预设阈值小于第一预设阈值,根据电容或电流的微小变化可以确定触控笔的距离和位置坐标,可表 示为(distance,x,y),而产生浮点。浮点综合了距离与坐标特性,能被标记在触控屏上。根据浮点在触控屏上的标记的颜色,可以判断触控笔是否处于可书写状态,比如蓝色标记时可书写;红色标记时表明触控笔处于电量过低的状态,需要充电;不标记表明不能使用。
当触控笔从终端拔出,或触控笔距触控屏在预设距离内时,终端能检测到触控屏上的浮点。
在所述压力值大于第三预设压力值时,检测所述触控屏的报点。
第三预设压力值为触控屏上产生报点的最小压力值,可小于或等于第一预设压力值。
当终端检测浮点后,且检测到触控笔按压触控屏,终端通过压力传感器获取压力值。如果压力值大于第三预设压力值,终端检测触控屏的报点。如果压力值小于第三预设压力值,终端继续在后台检测。
在触控笔接触触控屏或离触控笔在一定距离内时,检测不到触控屏的浮点,可能出现触控笔电量耗尽,也可能出现触控笔损坏的情况,需要提醒用户触控笔出现故障。本实施例中的预设提醒信息可为触控笔故障的提示信息,或者触控笔未使用的提示信息,该预设提醒信息表现形式为文字、图片、动画、视频、语音、灯光以及振动中的一种或多种组合。
参照图24为触控笔对移动终端操作时先检测到浮点再检测到报点的示意图,由于只要触控笔位于触控屏幕的上方即可检测到浮点,触控笔的笔尖与触控屏接触才能产生报点,则即可先检测浮点,在检测到浮点后检测报点,在检测到报点后根据检测到的压力值输出触控提醒信息;参照图25为检测浮点但未检测到报点的示意图,检测到浮点后一直未检测到报点说明触控笔的笔尖一直未接触触控屏,此时说明用户对触控笔操作异常,此时可输出第一预设提示信息。
在本实施例中,终端结合浮点与压力值,对触控笔的状态和用户的触控行为进行检测与提醒,便于用户及时掌握触控笔损坏或电量耗尽的信息和不良的触控姿势,并进行及时调整,提高触控效率。
在一实施例中,在检测到触控笔拔出,点亮所述触控屏。
终端上设置有固定触控笔的固定位,而固定位上设置有检测触控笔状态的检测装置。终端固定位上的检测装置可以检测到触控笔的状态。当终端检测到触控笔从固定位拔出,或距离触控屏在一定距离内时,能检测到触控屏产生浮点,自动点亮触控屏。与此同时,当触控笔接触触控屏,触控屏上产生报点时,终端也能自动点亮触控屏。
在预设时间内,未检测到所述压力值,熄灭所述触控屏。
在预设时间内,终端检测到浮点,但没有检测到压力值,熄灭触控屏。预设时间可以为5秒,30秒,2分钟等不同的时间段。可以理解的是,触控笔在触控屏的上方,但没有接触触控屏,终端熄灭触控屏以减少整体耗电量。
在本实施例中,终端通过检测到触控屏上的报点或浮点,自动点亮触控屏,若在预设时间内,没有检测到压力值,熄灭触控屏。终端自动点亮触控屏可以减少用户的操作,减少按键,根据预设条件,自动熄灭触控屏,可有效减少触控笔在未触控时产生额外的耗电,减少耗电量,提高终端的待机时长。
本申请还提供一种触控笔,所述触控笔包括存储器、处理器以及存储在所述存储器并可在所述处理器上运行的控制程序,所述控制程序被所述处理器执行时实现如上实施例所述的触控笔的控制方法的各个步骤。
本申请还提供一种终端,所述终端包括存储器、处理器以及存储在所述存储器并可在所述处理器上运行的控制程序,所述控制程序被所述处理器执行时实现如上实施例所述的终端的控制方法的各个步骤。
本申请还提供一种计算机可读存储介质,所述计算机可读存储介质存储有控制程序,所述控制程序被处理器执行时实现如上实施例所述的终端的控制方法或者如上实施例所述的触控笔的控制方法的各个步骤。
本申请还提供一种设备,所述设备包括:存储器、处理器及存储在所述存储器上并可 在所述处理器上运行的计算机程序,所述计算机程序被所述处理器执行时实现如上所述的方法的步骤。
本申请实施例还提供一种计算机程序产品,所述计算机程序产品包括计算机程序代码,当所述计算机程序代码在计算机上运行时,使得计算机执行如上各种可能的实施方式中所述的方法。
本申请实施例还提供一种芯片,包括存储器和处理器,所述存储器用于存储计算机程序,所述处理器用于从所述存储器中调用并运行所述计算机程序,使得安装有所述芯片的设备执行如上各种可能的实施方式中所述的方法。
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对示例性技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是电视机,手机,计算机,装置,空调器,或者网络设备等)执行本申请各个实施例所述的方法。
以上仅为本申请的可选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。

Claims (52)

  1. 一种触控笔的控制方法,其中,所述触控笔的控制方法包括以下步骤:
    获取所述触控笔与书写界面之间的操作信息;
    根据所述操作信息确定目标操作对象和运行信息;
    控制所述目标操作对象按照所述运行信息运行。
  2. 如权利要求1所述的触控笔的控制方法,其中,所述书写界面包括终端的触控界面、触控笔连接的触控界面或空气投影界面。
  3. 如权利要求1所述的触控笔的控制方法,其中,所述根据所述操作信息确定目标操作对象和运行信息的步骤包括:
    获取预设规则,并根据所述预设规则以及所述操作信息确定目标操作对象以及运行信息。
  4. 如权利要求3所述的触控笔的控制方法,其中,所述获取预设规则的步骤包括:
    获取参考特征,并获取所述参考特征对应的预设规则。
  5. 如权利要求1所述的触控笔的控制方法,其中,所述根据所述操作信息确定目标操作对象和运行信息的步骤包括:
    确定所述触控笔对应的用户标识;
    根据所述用户标识以及所述操作信息确定目标操作对象以及运行信息。
  6. 一种终端的控制方法,其中,所述终端包括触控笔以及触控屏,所述终端的控制方法包括以下步骤:
    获取所述触控笔与所述触控屏之间的距离和所述触控笔的触点在所述触控屏上的位置;
    根据所述位置确定所述触摸笔在所述触控屏上的目标操作对象;
    根据所述距离确定所述目标操作对象的运行信息;
    控制所述目标操作对象按照所述运行信息运行。
  7. 如权利要求6所述的终端的控制方法,其中,所述根据所述距离确定所述目标操作对象的运行信息的步骤包括:
    确定所述距离所在的距离区间;
    根据所述距离确定所述目标操作对象的运行信息。
  8. 如权利要求7所述的终端的控制方法,其中,所述根据所述距离确定所述目标操作对象的运行信息的步骤包括:
    根据所述距离确定所述目标操作对象对应的操作参数,所述操作参数包括目标操作对象的操作时间点以及操作次数中的至少一个;
    根据所述操作参数确定所述目标操作对象的运行信息。
  9. 如权利要求7所述的终端的控制方法,其中,所述运行信息包括显示内容,所述根据所述距离确定所述目标操作对象的运行信息的步骤之后,还包括:
    在检测到所述触控屏上显示的显示内容的选定操作时,锁定所述显示内容,其中,所述触控笔与所述触控屏之间的距离变化时,锁定的所述显示内容不变。
  10. 如权利要求9所述的终端的控制方法,其中,所述锁定所述显示内容的步骤之后,还包括:
    在检测到所述触控笔对所述触控屏的触控操作时,打开或启动所述目标操作对象,其中,打开或启动后的所述目标操作对象的运行界面根据所述显示内容确定。
  11. 如权利要求6所述的控制方法,其中,所述根据所述位置确定所述触摸笔在所述触控屏上的目标操作对象的步骤包括:
    确定所述位置在所述触控屏上的区域;
    将所述区域对应的文档、文件夹、应用功能、或者应用抽屉确定为目标操作对象。
  12. 如权利要求6所述的终端的控制方法,其中,所述终端的控制方法,还包括:
    获取所述触控笔在所述触控屏上的悬浮持续时长;
    所述悬浮持续时长达到预设时长,执行所述获取所述触控笔与所述触控屏之间的距离的步骤。
  13. 一种终端的控制方法,其中,所述终端的控制方法包括以下步骤:
    获取触控装置与终端之间的操作信息;
    根据所述操作信息确定目标操作对象;
    根据预设规则确定所述目标操作对象对应的执行信息;
    控制所述目标操作对象按照所述执行信息运行。
  14. 如权利要求13所述的终端的控制方法,其中,所述触控装置为被所述终端感知的物体、所述触控装置为所述终端上的部件、或者所述触控装置为与所述终端连接的外接设备。
  15. 如权利要求14所述的终端的控制方法,其中,所述根据所述操作信息确定目标操作对象的步骤包括:
    确定所述触控装置的类型;
    根据所述类型以及操作信息确定目标操作对象。
  16. 如权利要求13所述的终端的控制方法,其中,所述预设规则包括当前时间、终端所在的当前地点、用户对操作对象的操作习惯或者终端的运行模式。
  17. 如权利要求13所述的终端的控制方法,其中,所述获取触控装置与终端之间的操作信息的步骤之前,还包括:
    在检测到针对所述终端的操作时,确定所述操作对应的操作物体;
    在所述操作物体为触控装置时,执行所述获取触控装置与终端之间的操作信息的步骤。
  18. 一种移动终端的控制方法,其中,所述移动终端的控制方法包括以下步骤:
    获取触控装置与移动终端之间的操作信息,并根据所述操作信息获取目标应用界面,所述操作信息包括触控笔在移动终端的显示屏上悬浮;
    将所述目标应用界面显示在所述显示屏的目标区域中。
  19. 如权利要求18所述的移动终端的控制方法,其中,所述获取触控装置与移动终端之间的操作信息,并根据所述操作信息获取目标应用界面的步骤包括:
    检测到触控笔在移动终端的显示屏上悬浮后,获取目标应用;
    获取所述目标应用的应用界面作为目标应用界面。
  20. 如权利要求19所述的移动终端的控制方法,其中,所述检测到触控笔在移动终端的显示屏上悬浮后,获取目标应用的步骤包括:
    检测到触控笔在移动终端的显示屏上悬浮后,获取悬浮时的所述触控笔在所述显示屏上的触控点位置;
    根据所述触控点位置获取目标应用。
  21. 如权利要求20所述的移动终端的控制方法,其中,所述检测到触控笔在移动终端的显示屏上悬浮后,获取悬浮时的所述触控笔在所述显示屏上的触控点位置的步骤之后,还包括:
    根据所述触控点位置调整所述目标区域在所述显示屏上的显示位置。
  22. 如权利要求20所述的移动终端的控制方法,其中,所述检测到触控笔在移动终端的显示屏上悬浮后,获取悬浮时的所述触控笔在所述显示屏上的触控点位置的步骤之后,还包括:
    根据所述触控点位置的移动轨迹调整所述目标区域中的所述目标应用界面的显示比例。
  23. 如权利要求20所述的移动终端的控制方法,其中,所述检测到触控笔在移动终 端的显示屏上悬浮后,获取悬浮时的所述触控笔在所述显示屏上的触控点位置的步骤之后,还包括:
    在所述触控点位置的移动轨迹与预设轨迹对应时,获取与所述预设轨迹关联的快捷打开方式;
    打开所述快捷打开方式对应的应用。
  24. 如权利要求18所述的移动终端的控制方法,其中,所述将所述目标应用界面显示在所述显示屏的目标区域中的步骤之后,还包括:
    检测到所述目标应用界面的选中操作时,通过所述显示屏的主界面显示所述目标应用界面。
  25. 如权利要求24所述的移动终端的控制方法,其中,所述将所述目标应用界面显示在所述显示屏的目标区域中的步骤之后,还包括:
    检测到所述目标应用界面的选中操作时,获取所述选中操作对应的选中时长;
    在所述选中时长小于或者等于第一预设时长时,执行所述通过所述显示屏的主界面显示所述目标应用界面的步骤。
  26. 如权利要求25所述的移动终端的控制方法,其中,所述检测到所述目标应用界面的选中操作时,获取所述选中操作对应的选中时长的步骤之后,还包括:
    在所述选中时长大于所述第一预设时长时,将所述目标应用界面的界面内容复制至剪切板。
  27. 如权利要求26所述的移动终端的控制方法,其中,所述将所述目标应用界面的界面内容复制至剪切板的步骤包括:
    接收所述触控笔先后发送的第一信号和第二信号;
    根据所述第一信号和所述第二信号选取作为所述目标应用界面的界面内容;
    将选取得到的所述界面内容复制至剪切板。
  28. 如权利要求26所述的移动终端的控制方法,其中,所述移动终端的控制方法还包括:
    识别所述目标应用界面中的关键信息;
    将所述关键信息作为所述界面内容。
  29. 如权利要求25所述的移动终端的控制方法,其中,所述检测到所述目标应用界面的选中操作时,获取所述选中操作对应的选中时长的步骤之后,还包括:
    在所述选中时长大于所述第一预设时长时,截取所述目标应用界面的界面内容,生成所述目标应用界面的截图。
  30. 如权利要求19所述的移动终端的控制方法,其中,所述将所述目标应用界面显示在所述显示屏的目标区域中的步骤之后,还包括:
    检测到所述触控笔离开显示屏上方时,取消所述目标应用界面的显示。
  31. 如权利要求19所述的移动终端的控制方法,其中,所述移动终端的控制方法还包括:
    检测到触控笔在移动终端的显示屏上悬浮后,获取悬浮时长;
    所述悬浮时长大于第二预设时长,执行所述获取目标应用界面的步骤。
  32. 一种内置触控笔的终端控制方法,其中,终端包括设置有按压键的触控笔,触控笔固定位,所述内置触控笔的终端控制方法包括以下步骤:
    在检测到触控笔与终端之间的操作信息后,所述终端进行预设操作,所述操作信息包括触控笔的按压键的按压操作。
  33. 如权利要求32所述的内置触控笔的终端控制方法,其中,所述在检测到触控笔与终端之间的操作信息后,所述终端进行预设操作的步骤包括:
    在检测到所述按压操作后,检测所述触控笔的固定状态;
    当所述触控笔的固定状态为未拔出时,所述终端进行预设操作。
  34. 如权利要求32所述的内置触控笔的终端控制方法,其中,所述在检测到触控笔与终端之间的操作信息后,所述终端进行预设操作的步骤,还包括:
    在检测到所述按压操作后,进行权限验证;
    在权限验证通过时,所述终端进行预设操作。
  35. 如权利要求32所述的内置触控笔的终端控制方法,其中,所述预设操作包括以下至少一个:
    所述终端清除非活跃应用,所述非活跃应用包括正在运行但未使用的应用;
    所述终端删除非活跃应用的所有文件中文件类型为预设类型的目标文件;
    所述终端启动预设应用。
  36. 如权利要求33所述的内置触控笔的终端控制方法,其中,所述在检测到所述按压操作后,检测所述触控笔的固定状态的步骤之后,还包括:
    在检测到所述触控笔的固定状态为已拔出时,调整触控笔接触所述终端的屏幕时的显示参数。
  37. 如权利要求36所述的内置触控笔的终端控制方法,其中,所述调整触控笔接触所述终端的屏幕时的显示参数包括以下至少一个:
    调整所述触控笔接触所述终端的屏幕时显示的线条颜色;
    调整所述触控笔接触所述终端的屏幕时显示的线条粗细。
  38. 如权利要求32所述的内置触控笔的终端控制方法,其中,所述内置触控笔的终端控制方法还包括:
    在检测到按压键旋转预设角度且所述触控笔未拔出时,显示预设操作设置界面;
    所述预设操作设置界面用于根据用户的设置操作更新所述预设操作。
  39. 一种基于触控笔的触控提醒方法,其中,所述触控笔应用于终端的触控屏,所述触控屏上设置有压力传感器,所述压力传感器用于检测触控笔在所述触控屏上产生的压力,所述触控提醒方法包括以下步骤:
    在检测到所述触控笔对所述触控屏的操作信息后,获取所述压力传感器检测到的压力值,所述操作信息包括所述触控笔对所述触控屏的书写操作;
    根据所述压力值输出触控提醒信息。
  40. 如权利要求39所述的基于触控笔的触控提醒方法,其中,所述根据所述压力值输出触控提醒信息的步骤包括:
    当所述压力值小于或等于第一预设压力值,输出触控压力过小提醒信息。
  41. 如权利要求39所述的基于触控笔的触控提醒方法,其中,所述根据所述压力值输出触控提醒信息的步骤包括:
    当所述压力值大于或等于第二预设压力值,输出触控压力过大提醒信息。
  42. 如权利要求39所述的基于触控笔的触控提醒方法,其中,在所述获取所述压力传感器检测到的压力值的步骤之前,还包括:
    检测所述触控屏的报点;
    在检测到报点后,执行所述获取所述压力传感器检测到的压力值的步骤。
  43. 如权利要求42所述的基于触控笔的触控提醒方法,其中,在所述获取所述压力传感器检测到的压力值的步骤之前,还包括:
    检测所述触控屏的浮点;
    在检测到浮点后,获取所述压力传感器检测到的压力值;
    在所述压力值大于第三预设压力值时,执行所述检测所述触控屏的报点的步骤。
  44. 如权利要求42所述的基于触控笔的触控提醒方法,其中,在所述检测所述触控屏的报点的步骤之后,还包括:
    未检测到报点,输出第一预设提醒信息。
  45. 如权利要求43所述的基于触控笔的触控提醒方法,其中,在所述检测所述触控 屏的浮点步骤之后,还包括:
    未检测到浮点,输出第二预设提醒信息。
  46. 如权利要求39所述的基于触控笔的触控提醒方法,其中,在所述获取所述压力传感器检测到的压力值的步骤之前,还包括:
    检测到触控笔拔出,点亮所述触控屏。
  47. 如权利要求46所述的基于触控笔的触控提醒方法,其中,所述获取所述压力传感器检测到的压力值的步骤之后,还包括:
    在预设时间内,未检测到所述压力值,熄灭所述触控屏。
  48. 如权利要求39所述的基于触控笔的触控提醒方法,其中,所述根据所述压力值输出触控提醒信息的步骤,包括:
    根据所述压力值以及当前的参考参数输出对应的触控提醒信息。
  49. 如权利要求48所述的基于触控笔的触控提醒方法,其中,所述根据所述压力值以及当前的参考参数输出对应的触控提醒信息的步骤包括:
    获取所述压力值对应的参考参数与所述触控提醒信息的映射关系;
    根据所述映射关系获取当前的参考参数对应的触控提醒信息。
  50. 一种触控笔,其中,所述触控笔包括存储器、处理器以及存储在所述存储器并可在所述处理器上运行的控制程序,所述控制程序被所述处理器执行时实现如权利要求1所述方法的步骤。
  51. 一种终端,其中,所述终端包括存储器、处理器以及存储在所述存储器并可在所述处理器上运行的控制程序,所述控制程序被所述处理器执行时实现如权利要求6或13或18或32或39所述方法的步骤。
  52. 一种计算机可读存储介质,其中,所述计算机可读存储介质存储有控制程序,所述控制程序被处理器执行时实现如权利要求1或6或13或18或32或39所述方法的步骤。
PCT/CN2020/106056 2019-12-11 2020-07-31 触控笔、终端及其控制方法和计算机可读存储介质 WO2021114690A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202080085344.0A CN115023683A (zh) 2019-12-11 2020-07-31 触控笔、终端及其控制方法和计算机可读存储介质

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
CN201911279109.2 2019-12-11
CN201911268427.9 2019-12-11
CN201911279109.2A CN111045566B (zh) 2019-12-11 2019-12-11 触控笔、终端及其控制方法和计算机可读存储介质
CN201911268427.9A CN110955379B (zh) 2019-12-11 2019-12-11 移动终端的控制方法、移动终端及存储介质
CN201911342018.9A CN111124159A (zh) 2019-12-20 2019-12-20 基于触控笔的触控提醒方法、终端及计算机可读存储介质
CN201911342018.9 2019-12-20
CN201911386064.9A CN111142761A (zh) 2019-12-26 2019-12-26 内置触控笔的终端控制方法、装置、存储介质及终端
CN201911386064.9 2019-12-26

Publications (1)

Publication Number Publication Date
WO2021114690A1 true WO2021114690A1 (zh) 2021-06-17

Family

ID=76328823

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/106056 WO2021114690A1 (zh) 2019-12-11 2020-07-31 触控笔、终端及其控制方法和计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN115023683A (zh)
WO (1) WO2021114690A1 (zh)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114816139A (zh) * 2022-06-24 2022-07-29 基合半导体(宁波)有限公司 一种电容屏、电容屏与触控笔的交互方法及存储介质
CN115128387A (zh) * 2022-08-19 2022-09-30 北京东舟技术股份有限公司 机器人末端触屏测试系统、触屏测试系统及触屏测试方法
CN115686252A (zh) * 2021-09-24 2023-02-03 荣耀终端有限公司 触控屏中的位置信息计算方法和电子设备

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116680154A (zh) * 2022-09-26 2023-09-01 荣耀终端有限公司 触控笔操作的处理方法及装置
CN115938244B (zh) * 2023-02-20 2023-06-02 深圳市英唐数码科技有限公司 一种适配多笔形的电纸书显示方法、系统和存储介质

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130322951A1 (en) * 2012-06-04 2013-12-05 Topbound Technology Inc. Stylus Structure
CN103543944A (zh) * 2012-07-17 2014-01-29 三星电子株式会社 执行包括笔识别面板的终端的功能的方法及其终端
CN104598109A (zh) * 2015-01-08 2015-05-06 天津三星通信技术研究有限公司 在便携式终端预览应用程序的方法和设备
CN105335043A (zh) * 2014-08-08 2016-02-17 宏碁股份有限公司 窗口切换方法及执行该方法的电子装置
CN106249921A (zh) * 2016-08-04 2016-12-21 捷开通讯科技(上海)有限公司 触控笔的控制系统与方法
CN110955379A (zh) * 2019-12-11 2020-04-03 上海传英信息技术有限公司 移动终端的控制方法、移动终端及存储介质
CN111045566A (zh) * 2019-12-11 2020-04-21 上海传英信息技术有限公司 触控笔、终端及其控制方法和计算机可读存储介质
CN111124159A (zh) * 2019-12-20 2020-05-08 上海传英信息技术有限公司 基于触控笔的触控提醒方法、终端及计算机可读存储介质
CN111142761A (zh) * 2019-12-26 2020-05-12 上海传英信息技术有限公司 内置触控笔的终端控制方法、装置、存储介质及终端
CN111338535A (zh) * 2020-03-02 2020-06-26 深圳传音控股股份有限公司 终端屏幕中信息的展示方法、设备及存储介质
CN111459343A (zh) * 2020-03-04 2020-07-28 深圳传音控股股份有限公司 一种移动终端及其输入操作方法、计算机存储介质

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9342162B2 (en) * 2013-01-29 2016-05-17 Lg Electronics Inc. Mobile terminal and controlling method thereof
KR101575650B1 (ko) * 2014-03-11 2015-12-08 현대자동차주식회사 단말기, 그를 가지는 차량 및 그 제어 방법
CN106445199A (zh) * 2015-08-13 2017-02-22 天津三星通信技术研究有限公司 触控笔、移动终端以及实现数据的连续应用的方法
KR102382478B1 (ko) * 2017-10-13 2022-04-05 삼성전자주식회사 전자 장치 및 그 제어 방법
CN108958511B (zh) * 2018-06-15 2021-04-09 广州视源电子科技股份有限公司 交互显示设备、书写控制方法、移动终端及存储介质

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130322951A1 (en) * 2012-06-04 2013-12-05 Topbound Technology Inc. Stylus Structure
CN103543944A (zh) * 2012-07-17 2014-01-29 三星电子株式会社 执行包括笔识别面板的终端的功能的方法及其终端
CN105335043A (zh) * 2014-08-08 2016-02-17 宏碁股份有限公司 窗口切换方法及执行该方法的电子装置
CN104598109A (zh) * 2015-01-08 2015-05-06 天津三星通信技术研究有限公司 在便携式终端预览应用程序的方法和设备
CN106249921A (zh) * 2016-08-04 2016-12-21 捷开通讯科技(上海)有限公司 触控笔的控制系统与方法
CN110955379A (zh) * 2019-12-11 2020-04-03 上海传英信息技术有限公司 移动终端的控制方法、移动终端及存储介质
CN111045566A (zh) * 2019-12-11 2020-04-21 上海传英信息技术有限公司 触控笔、终端及其控制方法和计算机可读存储介质
CN111124159A (zh) * 2019-12-20 2020-05-08 上海传英信息技术有限公司 基于触控笔的触控提醒方法、终端及计算机可读存储介质
CN111142761A (zh) * 2019-12-26 2020-05-12 上海传英信息技术有限公司 内置触控笔的终端控制方法、装置、存储介质及终端
CN111338535A (zh) * 2020-03-02 2020-06-26 深圳传音控股股份有限公司 终端屏幕中信息的展示方法、设备及存储介质
CN111459343A (zh) * 2020-03-04 2020-07-28 深圳传音控股股份有限公司 一种移动终端及其输入操作方法、计算机存储介质

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115686252A (zh) * 2021-09-24 2023-02-03 荣耀终端有限公司 触控屏中的位置信息计算方法和电子设备
CN115686252B (zh) * 2021-09-24 2023-10-20 荣耀终端有限公司 触控屏中的位置信息计算方法和电子设备
CN114816139A (zh) * 2022-06-24 2022-07-29 基合半导体(宁波)有限公司 一种电容屏、电容屏与触控笔的交互方法及存储介质
CN114816139B (zh) * 2022-06-24 2022-11-01 基合半导体(宁波)有限公司 一种电容屏、电容屏与触控笔的交互方法及存储介质
CN115128387A (zh) * 2022-08-19 2022-09-30 北京东舟技术股份有限公司 机器人末端触屏测试系统、触屏测试系统及触屏测试方法

Also Published As

Publication number Publication date
CN115023683A (zh) 2022-09-06

Similar Documents

Publication Publication Date Title
WO2021114690A1 (zh) 触控笔、终端及其控制方法和计算机可读存储介质
US10656756B1 (en) Gesture-equipped touch screen system, method, and computer program product
US20210112070A1 (en) Method for Limiting Usage of Application, and Terminal
US11837038B2 (en) User interfaces for managing locks
CN104660799B (zh) 移动终端及其控制方法
US20140078091A1 (en) Terminal Device and Method for Quickly Starting Program
US11824898B2 (en) User interfaces for managing a local network
JP2018518751A (ja) 指紋認識を用いる操作方法、装置、およびモバイル端末
CN111488111A (zh) 虚拟计算机键盘
US20230262420A1 (en) User interfaces for tracking and finding items
EP2889749B1 (en) Electronic device and method for displaying user interface thereof
US20190187887A1 (en) Information processing apparatus
US11941910B2 (en) User interface display method of terminal, and terminal
US11703996B2 (en) User input interfaces
JP5173001B2 (ja) 情報処理装置、画面表示方法、制御プログラムおよび記録媒体
US9442580B2 (en) Electronic apparatus and touch operating method thereof
KR101919515B1 (ko) 터치스크린을 구비하는 단말에서 데이터 입력 방법 및 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20899129

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20899129

Country of ref document: EP

Kind code of ref document: A1