CN115202527A - Global writing implementation method based on hovering state - Google Patents
Global writing implementation method based on hovering state Download PDFInfo
- Publication number
- CN115202527A CN115202527A CN202210904186.8A CN202210904186A CN115202527A CN 115202527 A CN115202527 A CN 115202527A CN 202210904186 A CN202210904186 A CN 202210904186A CN 115202527 A CN115202527 A CN 115202527A
- Authority
- CN
- China
- Prior art keywords
- pen
- global
- writing
- method based
- implementation method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 25
- 241001422033 Thestylus Species 0.000 claims abstract description 9
- 230000001133 acceleration Effects 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 230000005484 gravity Effects 0.000 claims description 4
- 238000012300 Sequence Analysis Methods 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000001422 normality test Methods 0.000 claims description 3
- 238000007781 pre-processing Methods 0.000 claims description 3
- 238000012731 temporal analysis Methods 0.000 claims description 3
- 238000000700 time series analysis Methods 0.000 claims description 3
- 230000009286 beneficial effect Effects 0.000 abstract description 3
- 241001123248 Arma Species 0.000 description 10
- 238000002474 experimental method Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000009897 systematic effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
- G06F3/0383—Signal control means within the pointing device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Position Input By Displaying (AREA)
Abstract
The invention discloses a global writing realization method based on a hovering state, which comprises the following steps of; starting a global pen writing function; judging the position of the handwriting pen when the handwriting pen is suspended, and judging whether the handwriting pen is in an editable control area; if so, displaying the global pen writing transparent View, and after writing is finished, leaving the editing frame by the handwriting pen and hiding the global pen writing transparent View; if not, hiding the handwriting pen, and not displaying the global pen-written transparent View. The invention has the beneficial effects that: the invention realizes the global writing function of the stylus pen, optimizes the user input scene of the large-screen device and improves the user efficiency.
Description
Technical Field
The invention relates to the technical field of mobile terminals, in particular to a global writing implementation method based on a hovering state.
Background
Most of the existing handwriting functions are integrated in the input method keyboard, and when the handwriting function is used by a user, the user needs to call the input method keyboard to write. In some scenes, when the keyboard is popped up, the editable area is moved upwards, and the edited content cannot be viewed in real time.
And judging whether the position of the drop point belongs to an editable control area or not by using Android native barrier-free system service and combining the change of the hovering state of the handwriting pen when the handwriting pen is close to the screen, and confirming whether the transparent view for writing is displayed or not.
Therefore, it is necessary to provide a global pen writing implementation method based on a hovering state for the above problem.
Disclosure of Invention
In view of the above-mentioned shortcomings in the prior art, the present invention provides a global pen writing implementation method based on a hovering state to solve the above-mentioned problems.
A global writing implementation method based on a hovering state comprises the following steps:
(1) Starting a global pen writing function;
(2) Judging the position of the handwriting pen when the handwriting pen is suspended, and judging whether the handwriting pen is in an editable control area;
(3) If yes, displaying the global pen writing transparent View (window ), and after writing is finished, enabling the handwriting pen to leave the editing frame and hiding the global pen writing transparent View;
(4) If not, hiding the handwriting pen, and not displaying the global pen writing transparent View.
And (3) judging the hovering position of the stylus pen in the step (2) through an Android barrier-free system service.
Wherein the transparency of the global pen-written transparent View is 100%.
The window range of the global pen writing transparent View is the global range.
The Android barrier-free system applies for the access Service authority, and adds a barrier-free Service configuration file to meta-data.
Wherein the Android barrier-free system further comprises configuration Android d Manifest.xml; the operation of opening barrier-free service, access Event, is turned on.
The judgment of the hovering of the stylus adopts an inertial navigation signal algorithm to judge.
The inertial navigation signal algorithm comprises the following steps: the input signal is then processed, the trajectory reconstructed, and the trajectory output.
The input signal comprises an acceleration and a gyroscope, and the processing steps of the input signal are as follows: firstly, acquiring an acceleration and an original signal of a gyroscope, then correcting the acceleration and the original signal, namely removing zero offset and noise, and then carrying out coordinate conversion to eliminate the influence of gravity; secondly, acquiring camera data, and performing feature extraction to obtain a posture; and fusing the data of the two types of data through an extended Kalman filter to obtain the track information of the data, and finally identifying the data through DTW.
The basis of establishing a time sequence analysis model is that the original signal needs to be preprocessed to obtain a zero-mean, stable and normal time sequence, for the requirement of the zero-mean, the signal after a constant component is removed can meet the requirement, the original random signal of the MEMS inertial device is a non-stable signal and presents an obvious trend term, the original signal can be subjected to first-order or multi-order differential processing, and after the preprocessing, the signal is subjected to normality test; to determine whether the time series analysis modeling requirements are met.
Compared with the prior art, the invention has the beneficial effects that: the invention realizes the global writing function of the stylus pen, optimizes the user input scene of the large-screen device and improves the user efficiency.
Drawings
FIG. 1 is a flow chart of a global pen-writing implementation method based on hovering state of the present invention;
FIG. 2 is a flow chart of an inertial navigation signal algorithm of the present invention;
fig. 3 is a flow chart of the input signal method steps of the present invention.
Detailed Description
It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict.
The embodiments of the invention will be described in detail below with reference to the drawings, but the invention can be implemented in many different ways as defined and covered by the claims.
As shown in fig. 1 in combination with fig. 2 and fig. 3, a global pen writing implementation method based on a hovering state includes the following steps:
(1) Starting a global pen writing function;
(2) Judging the position of the handwriting pen when the handwriting pen is suspended, and judging whether the handwriting pen is in an editable control area;
(3) If so, displaying the global pen writing transparent View, and after writing is finished, leaving the editing frame by the handwriting pen and hiding the global pen writing transparent View;
(4) If not, hiding the handwriting pen, and not displaying the global pen-written transparent View.
And (3) judging the hovering position of the stylus pen in the step (2) through barrier-free system service of android.
Wherein the transparency of the global pen-written transparent View is 100%.
The window range of the global pen writing transparent View is the global range.
The Android barrier-free system applies for the permission of the accessitivyservice and adds a configuration file of barrier-free service of your in meta-data.
Wherein the Android barrier-free system further comprises configuration Android manifest.xml; and starting the barrier-free service and the operation of the accessitivyevent.
The judgment of the hovering of the stylus adopts an inertial navigation signal algorithm to judge.
The inertial navigation signal algorithm comprises the following steps: the input signal is then processed, the trajectory reconstructed, and the trajectory output.
Compared with the prior art, the invention has the beneficial effects that: the invention realizes the global writing function of the stylus, optimizes the user input scene of the large-screen equipment and improves the user efficiency.
Starting a global pen writing function; judging the position of the handwriting pen when the handwriting pen is suspended, and judging whether the handwriting pen is in an editable control area; if yes, displaying the global pen writing transparent View, after the writing is finished, enabling the handwriting pen to leave the edit box, and hiding the global pen writing transparent View; if not, hiding the handwriting pen, and not displaying the global pen-written transparent View.
The input signals of the inertial navigation signal algorithm comprise an acceleration and a gyroscope, and the signals of the acceleration and the gyroscope are corrected and low-pass filtered through signal processing; the track reconstruction firstly carries out direction estimation, coordinate conversion, gravity compensation and position estimation.
The input signal comprises an acceleration and a gyroscope, and the processing steps of the input signal are as follows: firstly, acquiring an acceleration and an original signal of a gyroscope, then correcting the acceleration and the original signal, namely removing zero offset and noise, and then carrying out coordinate conversion to eliminate the influence of gravity; secondly, acquiring camera data, and performing feature extraction to obtain a posture; and fusing the data of the two types of data through an extended Kalman filter to obtain the track information of the data, and finally identifying the data through DTW.
The basis of establishing a time sequence analysis model is that the original signal needs to be preprocessed to obtain a zero-mean, stable and normal time sequence, for the requirement of the zero-mean, the signal after a constant component is removed can meet the requirement, the original random signal of the MEMS inertial device is a non-stable signal and presents an obvious trend term, the original signal can be subjected to first-order or multi-order differential processing, and after the preprocessing, the signal is subjected to normality test; to determine whether the time series analysis modeling requirements are met.
The data of the MEMS inertial device collected in the experiment under the static state is analyzed and processed by taking the data of an x-axis gyroscope as an example, and the signals are processed by zero mean value and trend removing items.
The autoregressive moving average model (ARMA (p, q)) is of the form:
in the formula, x k Representing a time sequence of gyroscope signals, a k Representing white noise with zero mean and variance a, and p and q represent autoregressive orders and moving average orders; in the formula, if q =0, ARMA (p, q) is reduced to an autoregressive model of order p, i.e. an AR (p) model, of the form:
because the order of the random error drift model of the MEMS inertial device is lower, five time sequence judgment models of AR (1), AR (2), AR (3), ARMA (1,1) and ARMA (2,1) are respectively selected for modeling in the modeling process, and then one model with the minimum FPE value is selected as the final model of the random drift error of the MEMS inertial device according to the FPE criterion.
The inertial device MPU9250 used for the experiment has data of a three-axis accelerometer and a three-axis gyroscope, wherein the data of the x-axis gyroscope and the data of the x-axis accelerometer are respectively selected, and after zero-mean, stable and normal inspection processing, the results of the inspection according to the FPE criterion are shown in tables 2.1 and 2.2 and are respectively the values of the FPE calculated by each model where the x-axis accelerometer and the x-axis gyroscope are located.
TABLE 2.1 model FPE-value comparison of x axial accelerometer
| AR(1) | AR(2) | AR(3) | ARMA(1，1) | ARMA(2，1) | |
| FPE | 0.0039 | 0.0034 | 0.0032 | 0.0027 | 0.0026 |
TABLE 2.2 model FPE-value comparison of x axis gyroscopes
| AR(1) | AR(2) | AR(3) | ARMA(1，1) | ARMA(2，1) | |
| FPE | 2.3667e-04 | 1.9765e-04 | 1.6490e-04 | 1.4327e-04 | 1.3761e-04 |
As can be seen from tables 2.1 and 2.2, the FPE value of the ARMA (2,1) model is the minimum, so we choose to use the ARMA (2,1) model, choose the x-axis gyroscope data as an example, and can conveniently find the correlation coefficient of the random drift error of the MEMS inertial device by means of the armax0 function in matlab, and the expression is:
x k ＝0.0202x k-1 -0.2002x k-2 +a k -0.9896a k-1
X k is formed by y k The expression of the random drift time sequence model of the MEMS inertial device obtained through the first-order difference is as follows:
y k+1 ＝1.0202y k -0.2204y k-1 +0.2002y k-2 +a k -0.9896a k-1
in the formula, y x+1 Is the output of the model, ax is white noise
y k+1 ＝1.0261y k -0.237y k-1 +0.2109y k-2 +a k -0.9793a k-1
y k+1 ＝1.0145y k -0.1881y k-1 +0.1736y k-2 +a k -0.9217a k-1
Error sources [23] [24 ] affecting the precision of the accelerometer and gyroscope of the MEMS inertial device include imperfections in the structure of the inertial device itself, temperature variations, violent motion of the carrier, and the like, and are mainly classified into random errors and systematic errors, and the random errors are mainly caused by uncertain factors, so analyzing and processing the random errors can improve the precision of the MEMS inertial device, and the systematic errors are also called deterministic errors, establishing a deterministic error model of the inertial device, and determining error coefficients of the model to calibrate and compensate.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A global writing implementation method based on a hovering state is characterized in that: the method comprises the following steps:
(1) Starting a global pen writing function;
(2) Judging the position of the handwriting pen when the handwriting pen is suspended, and judging whether the handwriting pen is in an editable control area;
(3) If so, displaying the global pen writing transparent View, and after writing is finished, leaving the editing frame by the handwriting pen and hiding the global pen writing transparent View;
(4) If not, hiding the handwriting pen, and not displaying the global pen-written transparent View.
2. The global pen-writing implementation method based on hovering state of claim 1, characterized in that: and (3) judging the hovering position of the stylus pen in the step (2) through an Android barrier-free system service.
3. The global pen-writing implementation method based on hovering state of claim 1, characterized in that: wherein the transparency of the global pen-written transparent View is 100%.
4. The global pen-writing implementation method based on hovering state of claim 1, characterized in that: the window range of the global pen writing transparent View is a global range.
5. The global pen-writing implementation method based on hovering state of claim 1, characterized in that: the Android barrier-free system applies for the permission of the access Service and adds a configuration file of barrier-free Service to meta-data.
6. The global pen-writing implementation method based on hovering state of claim 1, characterized in that: wherein the Android barrier-free system further comprises configuration Android manifest.xml; and starting the barrier-free service and the operation of the Access Event.
7. The global pen-writing implementation method based on hovering state of claim 1, characterized in that: the judgment of the hovering of the stylus adopts an inertial navigation signal algorithm to judge.
8. The global pen-writing implementation method based on hovering state of claim 1, characterized in that: the inertial navigation signal algorithm comprises the following steps: the input signal is then processed, the trajectory reconstructed, and the trajectory output.
9. The global pen-writing implementation method based on the hovering state of claim 1, wherein: the input signal comprises an acceleration and a gyroscope, and the processing steps of the input signal are as follows: firstly, acquiring an acceleration and an original signal of a gyroscope, then correcting the acceleration and the original signal, namely removing zero offset and noise, and then carrying out coordinate conversion to eliminate the influence of gravity; secondly, acquiring camera data, and performing feature extraction to obtain a posture; and fusing the data of the two types of data through an extended Kalman filter to obtain the track information of the data, and finally identifying the data through DTW.
10. The global pen-writing implementation method based on the hovering state of claim 1, wherein: the basis of establishing a time sequence analysis model is that the original signal needs to be preprocessed to obtain a zero-mean, stable and normal time sequence, for the requirement of the zero-mean, the signal after a constant component is removed can meet the requirement, the original random signal of the MEMS inertial device is a non-stable signal and presents an obvious trend term, the original signal can be subjected to first-order or multi-order differential processing, and after the preprocessing, the signal is subjected to normality test; to determine whether the time series analysis modeling requirements are met.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210904186.8A CN115202527A (en) | 2022-07-28 | 2022-07-28 | Global writing implementation method based on hovering state |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210904186.8A CN115202527A (en) | 2022-07-28 | 2022-07-28 | Global writing implementation method based on hovering state |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115202527A true CN115202527A (en) | 2022-10-18 |
Family
ID=83584301
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210904186.8A Pending CN115202527A (en) | 2022-07-28 | 2022-07-28 | Global writing implementation method based on hovering state |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115202527A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6084577A (en) * | 1996-02-20 | 2000-07-04 | Ricoh Company, Ltd. | Pen-shaped handwriting input apparatus using accelerometers and gyroscopes and an associated operational device for determining pen movement |
| CN103380413A (en) * | 2011-02-21 | 2013-10-30 | 夏普株式会社 | Electronic device, content display method and content display program |
| CN112119370A (en) * | 2018-06-03 | 2020-12-22 | 苹果公司 | Device, method, and user interface for communicating proximity-based and contact-based input events |
| CN113625932A (en) * | 2021-08-04 | 2021-11-09 | 北京鲸鲮信息系统技术有限公司 | Full screen handwriting input method and device |
-
2022
- 2022-07-28 CN CN202210904186.8A patent/CN115202527A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6084577A (en) * | 1996-02-20 | 2000-07-04 | Ricoh Company, Ltd. | Pen-shaped handwriting input apparatus using accelerometers and gyroscopes and an associated operational device for determining pen movement |
| CN103380413A (en) * | 2011-02-21 | 2013-10-30 | 夏普株式会社 | Electronic device, content display method and content display program |
| CN112119370A (en) * | 2018-06-03 | 2020-12-22 | 苹果公司 | Device, method, and user interface for communicating proximity-based and contact-based input events |
| CN113625932A (en) * | 2021-08-04 | 2021-11-09 | 北京鲸鲮信息系统技术有限公司 | Full screen handwriting input method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109544629B (en) | Camera position and posture determining method and device and electronic equipment | |
| Sola | Towards visual localization, mapping and moving objects tracking by a mobile robot: a geometric and probabilistic approach | |
| JP2020533654A (en) | Holographic anti-counterfeit code inspection method and equipment | |
| CN111136660A (en) | Robot pose positioning method and system | |
| CN111160256A (en) | Automatic identification method and system for transformer substation pointer instrument | |
| CN112037223B (en) | Image defect detection method and device and electronic equipment | |
| CN106813679A (en) | The method and device of the Attitude estimation of moving object | |
| JP7170605B2 (en) | Defect inspection device, defect inspection method, and program | |
| Saadallah et al. | Simulation and sensor data fusion for machine learning application | |
| Li et al. | Research on the UWB/IMU fusion positioning of mobile vehicle based on motion constraints | |
| CN111399021A (en) | Navigation positioning method | |
| Ding et al. | The method of MEMS gyroscope random error compensation based on ARMA | |
| CN115202527A (en) | Global writing implementation method based on hovering state | |
| CN110487269A (en) | GPS/INS Combinated navigation method, device, storage medium and electronic equipment | |
| CN111815748B (en) | Animation processing method and device, storage medium and electronic equipment | |
| Shen et al. | Fast adaptive optimization of weighted vector median filters | |
| WO2022036792A1 (en) | Multi-data source slam method, device, and computer readable storage medium | |
| CN111339494A (en) | Gyroscope data processing method based on Kalman filtering | |
| US20240160222A1 (en) | Method and system for localizing a mobile robot | |
| CN115239758A (en) | Timestamp correction method, apparatus, device, medium, and computer program product | |
| CN104615438A (en) | Feature slicing model checking method of software product line | |
| CN112200832B (en) | Denoising method and device for motion trajectory data | |
| CN114460743A (en) | Imaging effect analysis method, device, equipment and medium of image display equipment | |
| CN107833278B (en) | Terrain simulation method and device and electronic equipment | |
| CN114972042B (en) | Pantograph point cloud splicing method, system, equipment and medium based on standard model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20221018 |
|
| RJ01 | Rejection of invention patent application after publication |