CN113050810A - Control method, electronic equipment and stylus pen - Google Patents
Control method, electronic equipment and stylus pen Download PDFInfo
- Publication number
- CN113050810A CN113050810A CN202110341186.7A CN202110341186A CN113050810A CN 113050810 A CN113050810 A CN 113050810A CN 202110341186 A CN202110341186 A CN 202110341186A CN 113050810 A CN113050810 A CN 113050810A
- Authority
- CN
- China
- Prior art keywords
- signal
- stylus pen
- electronic equipment
- signal receiving
- plane
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/043—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves
Abstract
The application discloses a control method, electronic equipment and a stylus pen, wherein the method comprises the following steps: the method comprises the steps of obtaining first parameter information of a sound signal received by a first signal receiving device on the electronic equipment, determining the position of a stylus pen according to the first parameter information, and controlling the electronic equipment to respond according to position changes of the stylus pen at different times, wherein the sound signal comprises: the original sound signal emitted by the signal emitting device on the electronic equipment and the reflection signal formed by reflecting the original sound signal by the operation body containing the handwriting pen. Therefore, the position of the stylus pen can be determined by capturing and analyzing the sound signals in the interactive control scene of the stylus pen and the electronic equipment, the electronic equipment is subjected to automatic response control according to the position change of the stylus pen, the interactive function between the stylus pen and the electronic equipment is expanded, and the use viscosity between the stylus pen and the electronic equipment is improved.
Description
Technical Field
The application belongs to the field of interactive control, and particularly relates to a control method, electronic equipment and a stylus pen.
Background
Some electronic devices such as smart phones and tablet computers are equipped with the function of a stylus pen, and the stylus pen can be used for drawing, writing, creating and the like on the electronic devices. However, the interaction function of the existing stylus and the electronic equipment is relatively single, and the stylus and the electronic equipment cannot be matched to perform more experience expansion, so that the combined use experience of the stylus and the electronic equipment cannot be maximized, and the use viscosity is influenced.
Disclosure of Invention
Therefore, the application discloses the following technical scheme:
a control method is applied to an electronic device, wherein a signal transmitting device for transmitting a sound signal and a first signal receiving device for receiving the sound signal are arranged on the electronic device;
the method comprises the following steps:
obtaining first parameter information of a sound signal received by the first signal receiving device; the sound signal includes at least: the original sound signal emitted by the signal emitting device and a reflection signal formed by reflecting the original sound signal by an operation body containing a handwriting pen;
determining the position of the handwriting pen according to the first parameter information;
controlling the electronic equipment to respond according to the position change of the stylus pen at different time;
the position of the stylus pen at least comprises a plane position corresponding to the stylus pen on a display screen plane of the electronic device, and the response processing comprises processing at least part of interface objects corresponding to the plane position.
Optionally, the number of the signal transmitting devices arranged on the electronic device is at least two, and the number of the first signal receiving devices arranged on the electronic device is at least two;
the obtaining of the first parameter information of the sound signal received by the first signal receiving apparatus includes:
obtaining first electric signals of ultrasonic signals respectively received by at least two first signal receiving devices;
determining a first signal strength of the corresponding ultrasonic signal according to each first electric signal;
the determining the position of the stylus according to the first parameter information includes:
and determining the plane position of the handwriting pen corresponding to the display screen plane of the electronic equipment according to the first signal intensity.
Optionally, the controlling the electronic device to perform response processing according to the position change of the stylus pen at different times includes:
determining interface objects to be processed from interface object sets corresponding to different positions included in a display screen interface of the electronic equipment according to changes of corresponding plane positions of the stylus pen on the display screen plane of the electronic equipment at different times;
and processing the interface object to be processed.
Optionally, the method further includes:
acquiring second parameter information of the sound signal received by a second signal receiving device on the stylus pen; wherein the second signal receiving device can at least receive the sound signal emitted by the signal emitting device;
the determining the position of the stylus according to the first parameter information includes:
and determining the position of the stylus pen according to the first parameter information and the second parameter information.
Optionally, the number of the signal transmitting devices arranged on the electronic device is at least two, and the number of the first signal receiving devices arranged on the electronic device is at least two;
the first parameter information comprises first signal strength of ultrasonic signals respectively received by at least two first signal receiving devices; the second parameter information includes a second signal strength of the ultrasonic signal received by the second signal receiving device;
the determining the position of the stylus according to the first parameter information and the second parameter information includes:
determining the distance between the preset part of the stylus and the plane of the display screen according to at least the second signal intensity; the predetermined part is provided with the second signal receiving device;
determining the plane position of the preset part of the stylus pen on the plane of the display screen according to the first signal strength of the ultrasonic signals received by at least two first signal receiving devices;
the controlling the electronic device to perform response processing according to the position change of the stylus pen at different times includes:
determining whether the stylus pen meets a close condition close to the electronic equipment or a far condition far from the electronic equipment according to the distance between the preset part and the plane of the display screen at different time;
if the approaching condition is met, object parameters of at least part of interface objects corresponding to the plane position are promoted;
and if the distance condition is met, reducing the object parameters of at least part of the interface objects corresponding to the plane position.
Optionally, wherein:
the at least two first signal receiving devices are arranged at different positions corresponding to the same side of the display screen of the electronic equipment; the at least two signal transmitting devices are arranged at different positions corresponding to two opposite side edges of the display screen of the electronic equipment, and the two opposite side edges are adjacent to the side edges corresponding to the first signal receiving devices;
the predetermined portion is a nib portion of the stylus pen.
A control method is applied to a stylus pen, and a second signal receiving device used for receiving a sound signal is arranged on the stylus pen;
the method comprises the following steps:
obtaining a sound signal received by the second signal receiving device; the received sound signals at least comprise sound signals emitted by a signal emitting device arranged on the electronic equipment;
and transmitting the obtained sound signal or second parameter information corresponding to the obtained sound signal to the electronic equipment.
An electronic device, comprising:
signal emitting means for emitting a sound signal;
first signal receiving means for receiving a sound signal;
a memory for storing at least a set of computer instructions;
a processor for implementing the control method applied to the electronic device as described in any one of the above by executing the set of computer instructions stored on the memory.
9. The electronic device of claim 8, wherein:
the number of the signal transmitting devices arranged on the electronic equipment is at least two, and the number of the first signal receiving devices is at least two;
the at least two first signal receiving devices are arranged at different positions corresponding to the same side of the display screen of the electronic equipment; the at least two signal transmitting devices are arranged at different positions corresponding to two opposite sides of the display screen of the electronic equipment, and the two opposite sides are adjacent to the sides corresponding to the first signal receiving devices.
A stylus, comprising:
a main body member;
the second signal receiving device is arranged at a first preset part of the main body part and is used for receiving a sound signal;
and the communication device is arranged at a second preset part of the main body part and is used for transmitting the sound signal received by the second signal receiving device or the signal intensity information of the sound signal to the electronic equipment.
According to the above scheme, the control method disclosed by the application comprises the following steps: the method comprises the steps of obtaining first parameter information of a sound signal received by a first signal receiving device on the electronic equipment, determining the position of a stylus pen according to the first parameter information, and controlling the electronic equipment to respond according to position changes of the stylus pen at different times, wherein the sound signal comprises: the original sound signal emitted by the signal emitting device on the electronic equipment and the reflection signal formed by reflecting the original sound signal by the operation body containing the handwriting pen. Therefore, the position of the stylus pen can be determined by capturing and analyzing the sound signals in the interactive control scene of the stylus pen and the electronic equipment, the electronic equipment is subjected to automatic response control according to the position change of the stylus pen, the interactive function between the stylus pen and the electronic equipment is expanded, and the use viscosity between the stylus pen and the electronic equipment is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic flow chart of a control method applied to an electronic device according to an embodiment of the present disclosure;
fig. 2 is a schematic diagram of a signal transmitting and receiving device provided in an electronic device according to an embodiment of the present application;
fig. 3 is a schematic diagram of a first signal receiving apparatus on an electronic device receiving an acoustic signal in multipath according to an embodiment of the present application;
fig. 4 is another schematic flowchart of a control method applied to an electronic device according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a second signal receiving device and a switch assembly provided on a stylus pen according to an embodiment of the present disclosure;
FIG. 6 is a flowchart illustrating a control method applied to a stylus pen according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
fig. 8 is a schematic structural diagram of a stylus pen provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The application discloses a control method, electronic equipment and a stylus pen, which are used for expanding the interaction function between the stylus pen and the electronic equipment and improving the use viscosity between the stylus pen and the electronic equipment aiming at the scene of using the stylus pen to carry out operation interaction on the electronic equipment.
Referring to fig. 1, a schematic flow chart of a control method provided in the embodiment of the present application is shown, where the method is applicable to an electronic device, and the electronic device applying the method may be, but is not limited to, an intelligent terminal device such as a smart phone, a tablet computer, and a personal digital assistant that has a display screen and supports an operation interaction function based on a stylus.
As shown in fig. 1, in this embodiment, the control method applied to the electronic device specifically includes:
In the embodiment of the application, a signal transmitting device for transmitting a sound signal and a first signal receiving device for receiving the sound signal are added to the electronic device in advance to assist in positioning the position of the electronic pen. For example, at least one Speaker (SPK) and at least one microphone (mic) for transmitting and receiving sound signals, respectively, are added to the electronic device.
Preferably, the sound signal emitted by the signal emitting device is an ultrasonic signal.
In order to position the stylus pen with high accuracy by means of the transmission and reception of the sound signal by the signal transmitting means and the first signal receiving means, respectively, it may be preferred to provide at least two signal transmitting means and at least two first signal receiving means on the electronic device, wherein the respective signal transmitting means and first signal receiving means may be, but are not limited to, arranged discretely in a predetermined area near the respective side frame or side frame of the electronic device.
Preferably, the at least two first signal receiving devices are arranged at different positions corresponding to the same side of the display screen of the electronic device, the at least two signal transmitting devices are arranged at different positions corresponding to two opposite sides of the display screen of the electronic device, and the two opposite sides are adjacent to the sides corresponding to the first signal receiving devices. Through test verification, the relative position relation can enable the position of the stylus pen to be positioned with high accuracy by means of the transmission and the reception of the sound signals respectively by the signal transmitting device and the first signal receiving device.
Referring to fig. 2, the relative positional relationship of the signal transmitting devices and the first signal receiving device when the electronic device is laid out is exemplarily provided.
In the process of operating and interacting with the electronic device by using the stylus pen, each signal transmitting device on the electronic device transmits a sound signal to the environment, for example, transmits an ultrasonic signal to the environment, and each first signal receiving device correspondingly receives the sound signal in the environment.
Wherein, the sound signal received by each first signal receiving device at least comprises: the original sound signals emitted by the signal emitting devices and the reflection signals formed by reflecting the original sound signals emitted by the signal emitting devices by an operation body containing a handwriting pen.
The above-mentioned operation body including the stylus pen may be specifically an integral body formed by a hand of the operator holding the stylus pen and the stylus pen, or may be an integral body formed by another member (e.g., a robot arm) and the stylus pen when the stylus pen is held by the other member.
In view of this, in step 101, first parameter information of the sound signal received by the first signal receiving apparatus on the electronic device is obtained, which is to say that the first parameter information of the mixed signal corresponding to the original sound signal and the reflected sound signal received by each first signal receiving apparatus is obtained.
The first parameter information is, optionally, a first signal strength of the sound signal received by the first signal receiving device.
Taking the sound signal emitted by the signal emitting device as the ultrasonic signal as an example, the first electrical signals of the ultrasonic signals respectively received by the at least two first signal receiving devices can be obtained, and the first signal strength of the corresponding ultrasonic signal is determined according to each first electrical signal.
And step 102, determining the position of the stylus according to the first parameter information.
The position of the handwriting pen determined according to the first parameter information at least comprises a plane position of the handwriting pen corresponding to a display screen plane of the electronic equipment.
In the process of operating and interacting with the electronic device by using the stylus pen, "a part holding the stylus pen (such as a hand of a user or an end of a mechanical arm) + the stylus pen" is equivalent to a moving obstacle, and signals received by each first signal receiving device of the electronic device mainly include original ultrasonic signals transmitted by each signal transmitting device on the electronic device and reflected signals of the obstacle to the original ultrasonic signals. As shown in fig. 3 (only the reception of the original signal of SPK3 by MIC2 and the reflected signal of its original signal by the stylus pen are provided in fig. 3 by way of example).
When the plane position corresponding to the display screen plane of the electronic device changes due to movement of the stylus pen, the intensity of the ultrasonic signal received by each first signal receiving device on the electronic device correspondingly changes, and the signal intensity characteristics corresponding to the real-time plane position of the stylus pen are respectively presented, wherein the intensity of the ultrasonic signal received by the first signal receiving device which is closer to the plane position corresponding to the stylus pen is stronger, and conversely, the intensity is weaker.
In the process of using the stylus pen to perform operation interaction with the electronic device, the "part holding the stylus pen + the stylus pen" is generally the obstacle which is closest to the electronic device and has moving characteristics in the environment, and the other obstacles in the environment have no moving attributes, or even if there is moving attributes, the distance from the electronic device is relatively far, so that the ultrasonic signal reflected by the electronic device is weak, and on the other hand, the change characteristic of the intensity of the ultrasonic signal reflected by the first signal receiving device does not affect the change characteristic of the intensity of the ultrasonic signal reflected by the obstacle of the "part holding the stylus pen + the stylus pen", so that according to the intensity of different ultrasonic signals received by the first signal receiving devices on the electronic device, and effectively determining the corresponding plane position of the stylus on the screen interface.
In the implementation, the corresponding relationship between the different plane positions where the stylus pen is located and the signal intensity of the ultrasonic signal received by the first signal receiving device may be preset based on the test verification work.
The different plane positions of the stylus specifically refer to the corresponding plane positions of the stylus on the display screen of the electronic device, and specifically may be represented in the form of plane position coordinates, or the display screen of the electronic device may be subjected to grid area division in advance, and the position of the stylus is correspondingly represented in the form of grid positions.
Optionally, the correspondence relationship may be specifically but not limited to be implemented as: and the corresponding relation between the plane position corresponding to the stylus pen and the signal intensity or the signal intensity range of the ultrasonic signal received by the first signal receiving device. In the case where the number of the first signal receiving devices is plural, the installation positions of the first signal receiving devices on the electronic device are different, so that the signal intensities of the sound signals received by the first signal receiving devices at the same time are different, and the correspondence relationship may be further implemented for the case: the plane position corresponding to the stylus pen is respectively corresponding to the signal intensity or the signal intensity range of the ultrasonic signal received by each first signal receiving device.
Based on this, when the first parameter information of the sound signal received by the first signal receiving device is obtained, such as the signal intensity of the ultrasonic signal received by the first signal receiving device, the position information matched with the received signal intensity can be determined according to the corresponding relation, so as to realize the position positioning of the stylus pen.
And 103, controlling the electronic equipment to perform response processing according to the position change of the stylus pen at different time.
The position of the stylus pen determined according to the first parameter information at least includes a plane position of the stylus pen on a display screen plane of the electronic device, and correspondingly, when the electronic device is controlled to perform response processing according to position changes of the stylus pen at different times, the response processing includes: and processing at least part of interface objects corresponding to the plane position of the stylus on the display screen of the electronic equipment.
In implementation, interface objects to be processed can be determined from interface object sets corresponding to different positions included in a display screen interface of the electronic equipment according to changes of corresponding plane positions of the stylus pen on the display screen plane of the electronic equipment at different times; the interface object to be processed is specifically at least a part of interface objects corresponding to the plane position where the stylus pen is located on the display screen of the electronic device.
The interface object corresponding to the plane position where the stylus pen is located on the display screen of the electronic device may be, but is not limited to, an application icon, a file icon, an application window, a control in the application window corresponding to the plane position (or a sub-region to which the plane position belongs on the display screen of the electronic device) on the display screen of the electronic device, or a display object (such as a text and a picture) corresponding to the plane position of a webpage/drawing board/reading app page, and the like. The processing of the interface object may then accordingly be: opening an application, opening a file, activating a window, activating and using a control in the window, or processing/controlling a display object corresponding to the plane position of a webpage page/drawing board/reading APP page, and the like.
Now, the following examples are given:
for example, if a plurality of application windows are located on the desktop of the electronic device at different positions, and a stylus pen is moved to which position, the window at the position is automatically selected and activated, for example, the first application window and the second window are located at different positions of the display screen, and the first window is partially shielded by the second window and is in an inactive state, when the stylus pen is moved to the position corresponding to the first window, the first window may be activated and switched from the state partially shielded by the second window to the uppermost layer. For another example, assuming that there are multiple app icons on the desktop of the electronic device, the app at the location is automatically started when the electronic pen moves to the location.
When the plane position of the electronic pen (or the sub-area of the plane position on the display screen of the electronic device) corresponds to a plurality of interface objects, a target interface object can be determined according to the historical use information corresponding to each interface object, and only the determined target interface object is processed. The historical use information corresponding to the interface object includes, but is not limited to, any one or more of the historical use times, the historical use frequency, the latest use time, and the like of the interface object.
According to the above scheme, the control method disclosed in this embodiment may determine the position of the stylus pen by capturing and analyzing the corresponding sound signal (the original sound signal emitted by the signal emitting device on the electronic device and the reflected signal formed by reflecting the original sound signal by the operating body including the stylus pen) in the interactive control scene between the stylus pen and the electronic device, and perform automatic response control on the electronic device according to the change of the position of the stylus pen, thereby expanding the interactive function between the stylus pen and the electronic device and improving the use viscosity between the stylus pen and the electronic device.
Optionally, in an embodiment, the located position of the stylus includes, in addition to a corresponding planar position of the stylus on a display screen plane of the electronic device, a distance between the predetermined portion of the stylus and the display screen plane of the electronic device.
That is, in this embodiment, the located stylus pen position specifically includes a stereoscopic spatial position of the stylus pen, and in implementation, the stereoscopic spatial position may specifically be represented in a spatial position coordinate form that a display screen plane of the electronic device is taken as an xy plane and a direction perpendicular to the display screen plane is taken as a z axis.
Wherein, the predetermined position of the stylus pen can be but is not limited to: the distance between the pen point part of the stylus pen and the pen point part of the stylus pen does not exceed a preset threshold value.
Preferably, the predetermined portion may be a nib portion of the stylus pen.
In this embodiment, referring to fig. 4, the control method disclosed in the present application can be specifically realized through the following processing procedures:
This step 401 is the same as step 101 in the above embodiment, and specifically, refer to the above description of step 101, and will not be described in detail here.
And 402, acquiring second parameter information of the sound signal received by the second signal receiving device on the stylus pen.
In this embodiment, not only the signal transmitter and the first signal receiver are added to the electronic device, but also the second signal receiver is added to the predetermined position of the stylus pen, and the second signal receiver at least can receive the sound signal transmitted by the signal transmitter on the electronic device, so as to perform the position location of the stylus pen by combining the sound signal parameter information received by the first signal receiver on the electronic device and the second signal receiver on the stylus pen.
For example, referring to fig. 5, a mic for receiving ultrasonic signals may be added to the pen tip of the stylus pen.
In addition, optionally, a switch component for controlling the on and off of the second signal receiving device may be further added to the stylus pen, as shown in fig. 5, specifically, but not limited to, a switch button may be disposed at a top end portion of the stylus pen, the button may be connected to the second signal interface device at the pen point portion through a connecting line disposed in a cavity of the stylus pen, when the stylus pen needs to be used for operation interaction with the electronic device, the second signal interface device at the pen point portion may be opened by operating the button for receiving the ultrasonic signal emitted by the electronic device, and when the use is finished, the second signal interface device may be closed by means of the button.
In view of this, in controlling the electronic apparatus to perform the response processing by locating the position of the stylus pen, in addition to the first parameter information of the sound signal received by the first signal receiving means, the second parameter information of the sound signal received by the second signal receiving means on the stylus pen is obtained.
The second parameter information may be a second signal strength of the sound signal received by the second signal receiving apparatus. Specifically, in one embodiment, the electronic device specifically obtains a second electrical signal of the ultrasonic signal received by the second signal receiving device transmitted by the stylus pen, and determines a second signal strength of the ultrasonic signal received by the second signal receiving device according to the second electrical signal.
In another embodiment, the handwriting pen performs parameter extraction of the received ultrasonic signal, and specifically, the handwriting pen determines a second signal strength corresponding to the ultrasonic signal according to a second electrical signal of the received ultrasonic signal, and transmits the second signal strength to the electronic device.
The electronic device may interact with the stylus pen through any short-distance communication mode of bluetooth or Wi-fi (wireless fidelity), and receive the second electrical signal transmitted by the stylus pen or the second signal strength of the received ultrasonic signal determined by the stylus pen based on the second electrical signal.
And step 403, determining the position of the stylus pen according to at least the first parameter information and the second parameter information.
This step 403 may be specifically implemented as:
1) determining the distance between the preset part of the stylus and the plane of the display screen of the electronic equipment at least according to the second signal intensity;
the predetermined portion is a portion of the stylus at which the second signal receiving device is disposed, such as a tip portion of the stylus.
In the operation interaction with the electronic device by using the stylus pen, the second signal receiving device on the stylus pen receives the ultrasonic wave signal transmitted by the signal transmitting device on the electronic device, and exemplarily, based on 4 speakers arranged on the electronic device in fig. 2 or fig. 3: the second signal receiving device on the stylus pen specifically receives the mixed signal of the ultrasonic signals of the 4 speakers, and the greater the distance between the stylus pen and the display screen plane of the electronic device in the moving process, the smaller the signal intensity of the ultrasonic signal transmitted by each signal transmitting device on the electronic device, and conversely, the smaller the distance between the stylus pen and the display screen plane of the electronic device, the greater the signal intensity of the ultrasonic signal received by the stylus pen.
Based on this feature, optionally, the distance between the predetermined portion (e.g. the pen tip portion) of the stylus and the display screen plane of the electronic device may be determined according to a second signal strength of the ultrasonic signal received by the second receiving device (in the case of receiving the ultrasonic signal transmitted by the plurality of sound transmitting devices on the electronic device, specifically according to an average value or a sum of the plurality of second signal strengths). In this embodiment, the information of the correspondence between the different signal strength values of the ultrasonic signal received by the stylus pen and the different distances from the stylus pen to the plane of the display screen of the electronic device may be preset, so as to be used as a basis for determining the distance from the stylus pen to the plane of the display screen of the electronic device.
In addition, when the distance between the stylus pen and the plane of the display screen of the electronic equipment is changed due to the movement of the stylus pen, the ultrasonic signal received by each first signal receiving device on the electronic equipment is also changed due to the movement of an obstacle which can be used for reflecting the ultrasonic signal, namely 'hand + stylus', in addition, as the stylus pen approaches the plane of the display screen of the electronic device, the signal strength of the ultrasonic signal received by each first signal receiving device gradually increases, otherwise, as the stylus pen leaves the plane of the display screen of the electronic device, the signal strength of the ultrasonic signal received by each first signal receiving device gradually decreases, the distance from the stylus pen to the plane of the display screen of the electronic equipment can be further determined by combining the second signal strength of the ultrasonic signal received by the second signal receiving device on the stylus pen and the first signal strength of the ultrasonic signal received by the first signal receiving device on the electronic equipment.
Because the distance between the pen point of the stylus pen and the plane of the display screen of the electronic device can be effectively determined only according to the second signal strength of the ultrasonic signal received by the second signal receiving device on the stylus pen, in implementation, an implementation mode of positioning the distance between the pen point of the stylus pen and the plane of the display screen of the electronic device only based on the signal strength of the ultrasonic signal received by the second signal receiving device on the stylus pen can be preferably adopted.
2) Determining the plane position of the preset part of the stylus pen on the plane of the display screen according to the first signal strength of the ultrasonic signals received by at least two first signal receiving devices;
the implementation process of determining the corresponding plane position of the predetermined portion (e.g., the pen tip portion) of the stylus pen on the display screen plane of the electronic device according to the first signal strength of the ultrasonic signal received by each first signal receiving device on the electronic device may refer to the above description, and is not described in detail here.
wherein, the approaching condition may be set as: the distance between a predetermined part (such as a pen point) of the stylus and the plane of the display screen of the electronic device is smaller than a predetermined threshold (such as 10cm or 15 cm) and the distance between the predetermined part and the plane of the display screen of the electronic device is gradually reduced at different times.
Correspondingly, the above-mentioned departing condition may be set as: the distance between a predetermined part (such as a pen point) of the stylus and the plane of the display screen of the electronic device is smaller than a predetermined threshold value (such as 10cm or 15 cm) and the distance between the predetermined part (such as the pen point) of the stylus and the plane of the display screen of the electronic device is gradually increased at different times.
And 405, if the approaching condition is met, promoting object parameters of at least part of the interface objects corresponding to the plane position.
And 406, if the distance condition is met, reducing the object parameters of at least part of the interface objects corresponding to the plane position.
The object parameter of at least part of the interface object corresponding to the plane position where the stylus pen is located is raised or lowered, which may be, but is not limited to, information such as size, color, brightness, and/or volume of the at least part of the interface object.
The following are exemplified:
for example, in a scene of drawing, reading or browsing a webpage, when it is detected that the distance between the stylus pen and the display screen plane of the electronic device is smaller than a predetermined threshold value and the pen tip of the stylus pen is continuously close to the plane of the electronic device, display information such as characters and/or pictures in a corresponding sub-area (a sub-area corresponding to the plane position where the stylus pen is located) of the pen tip of the stylus pen in the drawing board/reading app page/webpage is enlarged (directly enlarged to a target size or gradually enlarged to the target size); on the contrary, when it is detected that the pen point of the stylus pen is continuously away from the plane of the electronic device, the display information such as the text and/or the picture in the corresponding sub-region (the sub-region corresponding to the plane position where the stylus pen is located) of the pen point of the stylus pen in the drawing board/reading app page/webpage page is reduced (may be directly reduced to the original size, or gradually reduced to the original size).
For another example, if the pen point of the stylus pen is displayed at a corresponding plane position on the display screen plane of the electronic device, when it is detected that the distance between the stylus pen and the display screen plane of the electronic device is smaller than the predetermined threshold and the pen point of the stylus pen is continuously close to the plane of the electronic device, the playing volume and/or the picture brightness of the video player may be increased, otherwise, if it is detected that the pen point of the stylus pen is continuously far from the plane of the electronic device, the playing volume and/or the picture brightness of the video player may be correspondingly decreased.
Based on the embodiment, the user can zoom in and zoom out the information of the required area without clicking an enlargement/reduction button or performing gesture operation of enlargement/reduction; the volume and/or brightness of objects such as a video player and the like in the area can be adjusted without operating buttons, control bars and other components of the volume, the brightness and the like by a user, so that convenience is brought to the user, and the use viscosity of the stylus pen and the electronic equipment is improved.
In addition, the present application further provides a control method applied to a stylus pen, referring to a flow diagram of the method shown in fig. 6, specifically including:
The stylus pen is provided with a second signal receiving device for receiving the sound signal, wherein the second signal receiving device can be specifically arranged at a predetermined position such as a pen point of the stylus pen.
The sound signal received by the second signal receiving device obtained by the stylus pen may specifically be, but is not limited to, an electric signal of an ultrasonic signal.
The second parameter information includes a second signal strength of the sound signal received by the second signal receiving apparatus.
Taking the sound signal received by the second signal receiving device as an ultrasonic signal as an example, after the stylus pen obtains the ultrasonic signal received by the second signal receiving device, optionally, the stylus pen can transmit the electric signal of the ultrasonic signal to the electronic device directly through short-distance communication modes such as bluetooth or Wi-Fi without performing any processing on the ultrasonic signal, and the electronic device determines the second signal strength of the ultrasonic signal received by the second signal receiving device of the stylus pen according to the electric signal of the ultrasonic signal transmitted by the stylus pen, so as to be used for subsequent position positioning processing on the stylus pen.
Or, optionally, after the handwriting pen obtains the ultrasonic signal received by the second signal receiving device, the handwriting pen may further determine, at the handwriting pen end, a second signal strength corresponding to the obtained ultrasonic signal according to the electric signal of the obtained ultrasonic signal, and transmit the determined second signal strength to the electronic device through bluetooth or Wi-Fi, so as to be used for positioning the position of the handwriting pen at the electronic device end.
According to the control method disclosed by the embodiment, the stylus pen can be positioned through the second parameter information of the sound signal received by the stylus pen, so that the electronic equipment is automatically controlled in response, the interaction function between the stylus pen and the electronic equipment is expanded, and the use viscosity between the stylus pen and the electronic equipment is improved.
In addition, the embodiment of the application also discloses electronic equipment which can be realized in the forms of intelligent terminal products such as smart phones, tablet computers, personal digital assistants and the like which are provided with display screens and support the operation interaction function based on the stylus pen.
Fig. 7 shows a schematic structural diagram of an electronic device, which at least includes:
a signal emitting device 701 for emitting a sound signal;
a first signal receiving means 702 for receiving a sound signal;
the number of the signal emitting devices 701 arranged on the electronic device is at least two, and the number of the first signal receiving devices 702 is at least two.
At least two first signal receiving devices 702 are disposed at different positions corresponding to the same side of the display screen of the electronic device; the at least two signal emitting devices 701 are disposed at different positions corresponding to two opposite sides of the display screen of the electronic device, and the two opposite sides are adjacent to the sides corresponding to the first signal receiving devices 702.
A memory 703 for storing a set of computer instructions;
the set of computer instructions may be embodied in the form of a computer program.
The memory 703 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
A processor 704 for implementing the processing method disclosed in any of the above method embodiments by executing a set of instructions stored in a memory.
The processor 704 may be a Central Processing Unit (CPU), an application-specific integrated circuit (ASIC), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA), or other programmable logic devices.
Besides, the electronic device may further include a communication interface, a communication bus, and the like. The memory, the processor and the communication interface communicate with each other via a communication bus.
The communication interface is used for communication between the electronic device and other devices. The communication bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like, and may be divided into an address bus, a data bus, a control bus, and the like.
In addition, the present application also discloses a stylus pen, referring to the structural schematic diagram of the stylus pen shown in fig. 8, the stylus pen includes:
a body member 801;
a second signal receiving means 802 disposed at a first predetermined portion of the body member 801 for receiving a sound signal;
and a communication device 803 provided at a second predetermined position of the body member 801, for transmitting the sound signal or the signal strength information of the sound signal received by the second signal receiving device 802 to the electronic apparatus.
Wherein, the first predetermined part is preferably a pen point part of the stylus pen; the second predetermined location may be, but is not limited to, a tip, a top, and/or a corresponding location in a cavity of the stylus, and is not limited thereto.
In addition, optionally, the stylus pen may further include a switch assembly for controlling the second signal receiving device to be turned on and off, as shown in fig. 5, specifically, but not limited to, a switch button may be disposed at a top portion of the stylus pen, the button may be connected to the second signal interface device at the pen tip portion through a connection line disposed in the cavity of the stylus pen, when the stylus pen needs to be used for performing operation interaction with the electronic device, the second signal interface device at the pen tip portion may be turned on by operating the button to receive the ultrasonic signal emitted from the electronic device, and when the stylus pen is used, the second signal interface device may be turned off by using the button.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other.
For convenience of description, the above system or apparatus is described as being divided into various modules or units by function, respectively. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the embodiments or some parts of the embodiments of the present application.
Finally, it is further noted that, herein, relational terms such as first, second, third, fourth, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (10)
1. A control method is applied to an electronic device, wherein a signal transmitting device for transmitting a sound signal and a first signal receiving device for receiving the sound signal are arranged on the electronic device;
the method comprises the following steps:
obtaining first parameter information of a sound signal received by the first signal receiving device; the sound signal includes at least: the original sound signal emitted by the signal emitting device and a reflection signal formed by reflecting the original sound signal by an operation body containing a handwriting pen;
determining the position of the handwriting pen according to the first parameter information;
controlling the electronic equipment to respond according to the position change of the stylus pen at different time;
the position of the stylus pen at least comprises a plane position corresponding to the stylus pen on a display screen plane of the electronic device, and the response processing comprises processing at least part of interface objects corresponding to the plane position.
2. The method of claim 1, wherein the number of the signal transmitting devices provided on the electronic equipment is at least two, and the number of the first signal receiving devices provided is at least two;
the obtaining of the first parameter information of the sound signal received by the first signal receiving apparatus includes:
obtaining first electric signals of ultrasonic signals respectively received by at least two first signal receiving devices;
determining a first signal strength of the corresponding ultrasonic signal according to each first electric signal;
the determining the position of the stylus according to the first parameter information includes:
and determining the plane position of the handwriting pen corresponding to the display screen plane of the electronic equipment according to the first signal intensity.
3. The method of claim 2, wherein controlling the electronic device to perform a response process according to the position change of the stylus pen at different times comprises:
determining interface objects to be processed from interface object sets corresponding to different positions included in a display screen interface of the electronic equipment according to changes of corresponding plane positions of the stylus pen on the display screen plane of the electronic equipment at different times;
and processing the interface object to be processed.
4. The method of claim 1, further comprising:
acquiring second parameter information of the sound signal received by a second signal receiving device on the stylus pen; wherein the second signal receiving device can at least receive the sound signal emitted by the signal emitting device;
the determining the position of the stylus according to the first parameter information includes:
and determining the position of the stylus pen according to the first parameter information and the second parameter information.
5. The method of claim 4, wherein the number of the signal transmitting devices provided on the electronic equipment is at least two, and the number of the first signal receiving devices provided is at least two;
the first parameter information comprises first signal strength of ultrasonic signals respectively received by at least two first signal receiving devices; the second parameter information includes a second signal strength of the ultrasonic signal received by the second signal receiving device;
the determining the position of the stylus according to the first parameter information and the second parameter information includes:
determining the distance between the preset part of the stylus and the plane of the display screen according to at least the second signal intensity; the predetermined part is provided with the second signal receiving device;
determining the plane position of the preset part of the stylus pen on the plane of the display screen according to the first signal strength of the ultrasonic signals received by at least two first signal receiving devices;
the controlling the electronic device to perform response processing according to the position change of the stylus pen at different times includes:
determining whether the stylus pen meets a close condition close to the electronic equipment or a far condition far from the electronic equipment according to the distance between the preset part and the plane of the display screen at different time;
if the approaching condition is met, object parameters of at least part of interface objects corresponding to the plane position are promoted;
and if the distance condition is met, reducing the object parameters of at least part of the interface objects corresponding to the plane position.
6. The method of claim 2 or 5, wherein:
the at least two first signal receiving devices are arranged at different positions corresponding to the same side of the display screen of the electronic equipment; the at least two signal transmitting devices are arranged at different positions corresponding to two opposite side edges of the display screen of the electronic equipment, and the two opposite side edges are adjacent to the side edges corresponding to the first signal receiving devices;
the predetermined portion is a nib portion of the stylus pen.
7. A control method is applied to a stylus pen, and a second signal receiving device used for receiving a sound signal is arranged on the stylus pen;
the method comprises the following steps:
obtaining a sound signal received by the second signal receiving device; the received sound signals at least comprise sound signals emitted by a signal emitting device arranged on the electronic equipment;
and transmitting the obtained sound signal or second parameter information corresponding to the obtained sound signal to the electronic equipment.
8. An electronic device, comprising:
signal emitting means for emitting a sound signal;
first signal receiving means for receiving a sound signal;
a memory for storing at least a set of computer instructions;
a processor for implementing the control method of any one of claims 1-6 by executing a set of computer instructions stored on the memory.
9. The electronic device of claim 8, wherein:
the number of the signal transmitting devices arranged on the electronic equipment is at least two, and the number of the first signal receiving devices is at least two;
the at least two first signal receiving devices are arranged at different positions corresponding to the same side of the display screen of the electronic equipment; the at least two signal transmitting devices are arranged at different positions corresponding to two opposite sides of the display screen of the electronic equipment, and the two opposite sides are adjacent to the sides corresponding to the first signal receiving devices.
10. A stylus, comprising:
a main body member;
the second signal receiving device is arranged at a first preset part of the main body part and is used for receiving a sound signal;
and the communication device is arranged at a second preset part of the main body part and is used for transmitting the sound signal received by the second signal receiving device or the signal intensity information of the sound signal to the electronic equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110341186.7A CN113050810A (en) | 2021-03-30 | 2021-03-30 | Control method, electronic equipment and stylus pen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110341186.7A CN113050810A (en) | 2021-03-30 | 2021-03-30 | Control method, electronic equipment and stylus pen |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113050810A true CN113050810A (en) | 2021-06-29 |
Family
ID=76516493
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110341186.7A Pending CN113050810A (en) | 2021-03-30 | 2021-03-30 | Control method, electronic equipment and stylus pen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113050810A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202043190U (en) * | 2011-03-23 | 2011-11-16 | 上海优熠电子科技有限公司 | Cellphone with ultrasonic hand input function |
| CN105630321A (en) * | 2015-07-24 | 2016-06-01 | 宇龙计算机通信科技(深圳)有限公司 | Interface interaction method and device, and electronic equipment |
| CN106775057A (en) * | 2016-11-23 | 2017-05-31 | 广州视源电子科技股份有限公司 | Interactive device, distance detection method and device |
| CN110519450A (en) * | 2019-07-31 | 2019-11-29 | Oppo广东移动通信有限公司 | Ultrasonic processing method, device, electronic equipment and computer-readable medium |
| CN111966242A (en) * | 2020-08-17 | 2020-11-20 | 京东方科技集团股份有限公司 | Touch display panel and display device |
-
2021
- 2021-03-30 CN CN202110341186.7A patent/CN113050810A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN202043190U (en) * | 2011-03-23 | 2011-11-16 | 上海优熠电子科技有限公司 | Cellphone with ultrasonic hand input function |
| CN105630321A (en) * | 2015-07-24 | 2016-06-01 | 宇龙计算机通信科技(深圳)有限公司 | Interface interaction method and device, and electronic equipment |
| CN106775057A (en) * | 2016-11-23 | 2017-05-31 | 广州视源电子科技股份有限公司 | Interactive device, distance detection method and device |
| CN110519450A (en) * | 2019-07-31 | 2019-11-29 | Oppo广东移动通信有限公司 | Ultrasonic processing method, device, electronic equipment and computer-readable medium |
| CN111966242A (en) * | 2020-08-17 | 2020-11-20 | 京东方科技集团股份有限公司 | Touch display panel and display device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101983725B1 (en) | Electronic device and method for controlling of the same | |
| KR101580914B1 (en) | Electronic device and method for controlling zooming of displayed object | |
| US11237703B2 (en) | Method for user-operation mode selection and terminals | |
| US9201521B2 (en) | Storing trace information | |
| CN109324749B (en) | Drawing method, drawing device, storage medium and electronic equipment | |
| CN109857245B (en) | Gesture recognition method and terminal | |
| AU2014312569A1 (en) | Multi display method, storage medium, and electronic device | |
| CN110795949A (en) | Card swiping method and device, electronic equipment and medium | |
| CN109558000B (en) | Man-machine interaction method and electronic equipment | |
| CN108257208B (en) | Three-dimensional graph drawing method and mobile terminal | |
| CN108769299B (en) | Screen control method and device and mobile terminal | |
| CN104123093A (en) | Information processing method and device | |
| CN105824400A (en) | Control method and control apparatus of electronic device, and electronic device | |
| WO2023284418A1 (en) | Positioning method and apparatus, and electronic device and computer-readable storage medium | |
| JP2017525076A (en) | Character identification method, apparatus, program, and recording medium | |
| CN108073405B (en) | Application program unloading method and mobile terminal | |
| CN105306819A (en) | Gesture-based photographing control method and device | |
| US20150002417A1 (en) | Method of processing user input and apparatus using the same | |
| CN105824509A (en) | Method and device for arranging icons | |
| CN109194810B (en) | Display control method and related product | |
| CN105573692A (en) | Projection control method, associated terminal and system | |
| CN108920052B (en) | Page display control method and related product | |
| CN108614263B (en) | Mobile terminal, position detection method and related product | |
| CN110667287B (en) | Trace removal method and related product | |
| CN110531905B (en) | Icon control method and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |