TW201516770A - Method and system for controlling digital pen - Google Patents

Abstract

The present invention provides a method and system for controlling a digital pen. The system is operable to: receive position data of the digital pen when a head of the digital pen touches three position points; create a three-dimensional coordinate system according to a first position point, and create a fictitious writing plane according to coordinates of the three position points; receive a detection data of the digital pen when the digital pen writes on a writing plane, to obtain a locus of the head of the digital pen on the fictitious writing plane; transform the locus into a penmanship and display the penmanship on a screen.

Description

Digital pen writing control method and system

The invention relates to a control method and system, in particular to a digital pen writing control method and system.

At present, electronic whiteboard has been widely used in teaching and briefing. The existing electronic whiteboard technology can be divided into electromagnetic induction type, infrared induction type, pressure sensing type, ultrasonic induction type, and image sensing type. These methods require specific whiteboards, pens, etc., which are more troublesome to deploy and have more environmental restrictions.

In view of the above, it is necessary to provide a digital pen writing control method and system, which can make the digital pen achieve the effect of real writing in a simple deployment environment.

The digital pen writing control method includes: a positioning step of: displaying three non-collinear positioning points on the display screen and the writing plane, and receiving the position of the three pointed points contacting the pen tip transmitted by the digital pen; establishing steps: The position of the first positioning point is a three-dimensional coordinate system of the origin of the nib, and the coordinates of the three positioning points in the three-dimensional coordinate system are calculated according to the position data when the nib contacts the three positioning points, and according to the three a coordinate of the positioning point establishes a virtual writing plane in the three-dimensional coordinate system; and a calculating step: calculating a distance between any two of the three positioning points in the three-dimensional coordinate system and displaying the screen entity at the two points The ratio between the distances on the screen; the receiving step: when writing on the writing plane using the digital pen, receiving the sensing data of the pressure sensing module of the digital pen and the inertial sensing module, obtaining the nib in the virtual a motion trajectory on the writing plane; a conversion step: converting the trajectory of the nib on the virtual writing plane into a display screen according to the calculated ratio Handwriting is displayed; and a display step: The results showed that the conversion of the digital pen stroke written on the display screen.

The digital pen writing control system includes: a positioning module, configured to display three non-collinear positioning points on the display screen and the writing plane, and receive the position information of the pen tip transmitted by the digital pen to contact the three positioning points; The module is configured to establish a three-dimensional coordinate system of the nib movement by using the position of the first positioning point as an origin, and calculate the coordinates of the three positioning points in the three-dimensional coordinate system according to the position data when the nib contacts the three positioning points. And establishing a virtual writing plane in the three-dimensional coordinate system according to the coordinates of the three positioning points; and calculating a module for calculating any two points of the three positioning points in the three-dimensional coordinate system The ratio between the distance and the distance between the two points on the display screen physical screen; the receiving module is configured to receive the pressure sensing module and the inertial sensing mode of the digital pen when writing on the writing plane using the digital pen The sensing data of the group obtains the movement track of the nib on the virtual writing plane; the conversion module is configured to transport the nib on the virtual writing plane according to the calculated ratio Handwriting track into display on the display screen; and a display module for displaying digital pen written images displayed on the display screen based on the conversion result.

Compared with the prior art, the digital pen writing control method and system of the present invention can establish a virtual writing plane and calculate the movement track of the nib according to the data provided by the pressure sensing module and the inertial sensing module in the digital pen. And display the writing stroke of the digital pen on the display screen. The writing plane can be a screen or any plane, and the deployment is fast, through positioning and arithmetic processing, to achieve the effect of real writing.

1 is a diagram showing the operating environment of a preferred embodiment of the digital pen writing control system of the present invention.

2 is a structural diagram of a preferred embodiment of a digital pen used in the present invention.

3A-3C are schematic diagrams showing the application of the preferred embodiment of the digital pen writing control system of the present invention.

4 is a functional block diagram of a preferred embodiment of the digital pen writing control system of the present invention.

FIG. 5 is a schematic diagram of a three-dimensional coordinate system and a virtual writing plane established in the present invention.

6 is a flow chart of a preferred embodiment of the digital pen writing control method of the present invention.

Referring to FIG. 1, it is an operating environment diagram of a preferred embodiment of the digital pen writing control system of the present invention. The digital pen writing control system 10 is operated in the computing device 1. In the embodiment, the computing device 1 may be a computer, a notebook computer, a tablet computer, a smart phone, a smart TV, or the like. The computing device 1 further includes a storage device 11 and a processor 12 connected to each other through a data line or a signal line, and the storage unit 11 is configured to store data such as code of the digital pen writing control system 10, and the processing The device 12 is configured to execute various functional modules of the digital pen writing control system 10 to complete the present invention. The computing device 1 performs data communication with the digital pen 2, the display screen 3, and the writing plane 4.

The digital pen 2 is used for writing on the writing plane 4, and includes a pressure sensing module 21, an inertial sensing module 22, a communication module 23, and a power module 24 (see FIG. 2). The pressure sensing module 21 can be a pressure sensor for acquiring the pressure generated when the pen tip 20 of the digital pen 2 contacts the writing plane 4, thereby determining whether the pen tip 20 contacts the writing plane 4. The inertial sensing module 22 can be a three-axis accelerometer and a three-axis gyroscope or a miniature inertial measurement component (IMU) packaged by the two, providing three degrees of freedom acceleration output and three degrees of freedom. The angular velocity output is used to track the trajectory of the pen tip 20. The communication module 23 is configured to transmit the data sensed by the pressure sensing module 21 and the inertial sensing module 22 to the computing device 1 . In this embodiment, the communication module 23 may be NFC (Near Field Communication), WIFI (Wireless Fidelity), or an infrared wireless device. The power module 24 is configured to provide driving power of the digital pen 2.

The display screen 3 is used to display the positioning point and the content written by the digital pen 2, which may be a computer screen, a television screen, a projector screen, or the like.

The writing plane 4 is used for positioning the digital pen 2 and writing by the digital pen 2, which may be a computer screen, a television screen, a projector screen or a plane of any material. It should be noted that in the embodiment, the writing plane 4 and the display screen 3 may be the same screen or different screens. The computing device 1 can also be connected to a plurality of display screens 3 or writing planes 4.

3A-3C are schematic diagrams showing the application of the preferred embodiment of the digital pen writing control system of the present invention. Wherein, in FIG. 3A, the writing plane 4 and the display screen 3 are both computer screens. In FIG. 3B, the writing plane 4 and the display screen 3 are both tablet screens. In FIG. 3C, the writing plane 4 is a projector screen, and the display screen 3 is a projector screen and a computer screen.

Referring to FIG. 4, it is a functional module diagram of a preferred embodiment of the digital pen writing control system of the present invention.

The digital pen writing control system 10 includes a positioning module 100, a setting module 200, a computing module 300, a receiving module 400, a conversion module 500, and a display module 600.

The positioning module 100 is configured to display three positioning points on the display screen 3 and the writing plane 4 (see FIGS. 3A-3C), and receive the position data of the pen tip 20 transmitted by the digital pen 2 contacting the three positioning points. . The three anchor points are not on the same line. In the present embodiment, the three positioning points are displayed on the display screen 3 and the writing plane 4 in a certain ratio. For example, on the display screen 3 and the writing plane 4, the orientation relations of the three positioning points are the same, and the distance between each two positioning points is displayed in accordance with the ratio of the screen sizes of the display screen 3 and the writing plane 4.

After the user touches the nib 20 of the pen 2 to the first positioning point, the pen tip 20 is lifted to the next positioning point position for contact. When the pen tip 20 is in contact with the position of the three positioning points displayed on the writing plane 4, the pressure sensing module 21 receives the pressure signal, determines that the pen tip 20 has touched the positioning point, and the inertial sensing module 22 senses the digital pen. 2 The position data at the time of contacting each positioning point is transmitted to the positioning module 100.

The establishing module 200 is configured to establish a three-dimensional coordinate system of the movement of the nib 20 with the position of the first positioning point (the positioning point that the digital pen 2 first contacts) as the origin (see FIG. 5). The inertial sensing module 22 uses the origin of the three-dimensional coordinate system as a starting point, converts the acceleration and angular velocity of the movement of the pen tip 20 into a moving distance and a direction, and calculates the pen tip 20 each time it touches the writing plane 4 The coordinates of the nib 20 can be obtained by the coordinates in the coordinate system of the three-dimensional space.

The establishing module 200 is further configured to calculate coordinates of the three positioning points in the three-dimensional coordinate system according to the position data when the pen tip 20 contacts the three positioning points, and according to the coordinates of the three positioning points, A virtual writing plane is created in the three-dimensional coordinate system. The virtual writing plane is a plane in which the three positioning points are located in the three-dimensional coordinate system (see FIG. 5).

The calculation module 300 is configured to calculate a distance (actual physical quantity) of any two of the three positioning points in the three-dimensional coordinate system and a distance between the two points on the display screen 3 (picture element) The ratio between the two.

The receiving module 400 is configured to receive the sensing data sent by the pressure sensing module 21 and the inertial sensing module 22 when the digital pen 2 is used to write on the writing plane 4, and obtain the pen tip 20 in the virtual writing. Motion trajectory on the plane.

The conversion module 500 is configured to convert the motion track of the pen tip 20 on the virtual writing plane into the writing handwriting that should be displayed on the display screen 3 according to the calculated ratio. In the present embodiment, the ratio of the size of the motion track of the pen tip 20 on the virtual writing plane to the writing handwriting that should be displayed on the display screen 3 is equal to the calculated ratio.

The display module 600 is configured to display a written handwriting on the display screen 3 according to the conversion result.

It should be noted that in other embodiments, when the writing plane 4 is a plane of any material other than the aforementioned various screens, the three positioning points are three non-collinear selected by the user on the writing plane 4. Point, the calculated ratio is set by the user to adjust the scale of the movement track when the pen tip 20 is written on the display screen.

Referring to FIG. 6, it is a flowchart of a preferred embodiment of the digital pen writing control method of the present invention.

In step S10, the positioning module 100 displays three positioning points on the display screen 3 and the writing plane 4, and receives the position data of the three positioning points that the pen tip 20 transmitted by the digital pen 2 transmits.

In step S12, the establishing module 200 establishes a three-dimensional coordinate system of the movement of the nib 20 with the position of the first positioning point as an origin.

Step S14, the establishing module 200 calculates the coordinates of the three positioning points in the three-dimensional coordinate system according to the position data when the pen tip 20 contacts the three positioning points, and according to the coordinates of the three positioning points, A virtual writing plane is created in the three-dimensional coordinate system.

In step S16, the calculation module 300 calculates a ratio between the distance between any two of the three positioning points in the three-dimensional coordinate system and the distance between the two points on the physical screen of the display screen 3.

In step S18, when the digital pen 2 is used for writing on the writing plane 4, the receiving module 400 receives the sensing data of the pressure sensing module 21 and the inertial sensing module 22 sent by the digital pen 2 to obtain the pen tip 20 A trajectory of motion on the virtual writing plane.

In step S20, the conversion module 500 converts the motion track of the pen tip 20 on the virtual writing plane into the writing handwriting that should be displayed on the display screen 3 according to the calculated ratio.

In step S22, the display module 600 displays the writing stroke of the digital pen 2 on the display screen 3 according to the conversion result.

In summary, the present invention complies with the requirements of the invention patent and submits a patent application according to law. However, the above description is only a preferred embodiment of the present invention, and the scope of the present invention is not limited to the above-described embodiments, and equivalent modifications or variations made by those skilled in the art in accordance with the spirit of the present invention are It should be covered by the following patent application.

1‧‧‧ arithmetic device

2‧‧‧ digital pen

3‧‧‧ Display screen

4‧‧‧ writing plane

10‧‧‧Digital pen writing control system

11‧‧‧Storage

12‧‧‧ Processor

20‧‧‧ nib

21‧‧‧ Pressure Sensing Module

22‧‧‧Inertial Sensing Module

23‧‧‧Communication module

24‧‧‧Power Module

100‧‧‧ Positioning Module

200‧‧‧Create module

300‧‧‧Computation Module

400‧‧‧ receiving module

500‧‧‧ conversion module

600‧‧‧ display module

no

10‧‧‧Digital pen writing control system

100‧‧‧ Positioning Module

200‧‧‧Create module

300‧‧‧Computation Module

400‧‧‧ receiving module

500‧‧‧ conversion module

600‧‧‧ display module

Claims (10)

A digital pen writing control method, the method comprising:
Positioning step: displaying three non-collinear positioning points on the display screen and the writing plane, and receiving the position information of the three positioning points touched by the pen tip transmitted by the digital pen;
The establishing step is: establishing a three-dimensional coordinate coordinate system of the nib movement by using the position of the first positioning point as an origin, and calculating the coordinates of the three positioning points in the three-dimensional coordinate system according to the position data when the nib contacts the three positioning points, and according to The coordinates of the three positioning points establish a virtual writing plane in the three-dimensional coordinate system;
a calculating step: calculating a ratio between a distance between any two of the three positioning points in the three-dimensional coordinate system and a distance between the two points on the display screen physical screen;
Receiving step: when writing on the writing plane by using the digital pen, receiving the sensing data of the pressure sensing module of the digital pen and the inertial sensing module, and obtaining a movement track of the pen tip on the virtual writing plane;
Conversion step: converting the movement track of the pen tip on the virtual writing plane into the writing handwriting displayed on the display screen according to the calculated ratio; and displaying step: displaying the writing handwriting of the digital pen on the display screen according to the conversion result. The digital pen writing control method according to claim 1, wherein when the writing plane is a plane of any material instead of a screen, the three positioning points are three pre-selected on the writing plane. A point of collinearity, the ratio being a preset value. The digital pen writing control method according to claim 1, wherein the pressure sensing module is a pressure sensor for acquiring a pressure generated when a pen tip of the digital pen contacts the writing plane, thereby determining a pen tip. Whether to touch the writing plane. The digital pen writing control method according to claim 1, wherein the inertial sensing module is a three-axis accelerometer and a three-axis gyroscope or a miniature inertial measuring component encapsulated by the two. It is used to provide an acceleration output of three degrees of freedom and an angular velocity output of three degrees of freedom to track the trajectory of the nib. The digital pen writing control method according to claim 4, wherein the inertial sensing module uses the origin of the three-dimensional coordinate system as a starting point, and converts the acceleration and angular velocity of the pen tip motion into a moving distance. And the direction, calculating the coordinates of the nib in the three-dimensional coordinate system each time the pen tip contacts the writing plane, and obtaining the movement track of the nib. A digital pen writing control system, the system comprising:
a positioning module, configured to display three non-collinear positioning points on the display screen and the writing plane, and receive the position information of the three positioning points touched by the pen tip transmitted by the digital pen;
A module is established for establishing a three-dimensional coordinate coordinate system of the nib movement with the position of the first positioning point as an origin, and calculating the coordinates of the three positioning points in the three-dimensional coordinate system according to the position data when the nib contacts the three positioning points And establishing a virtual writing plane in the three-dimensional coordinate system according to the coordinates of the three positioning points;
a calculation module, configured to calculate a ratio between a distance between any two of the three positioning points in the three-dimensional coordinate system and a distance between the two points on the display screen physical screen;
a receiving module, configured to receive the sensing data of the pressure sensing module of the digital pen and the inertial sensing module when the digital pen is used to write on the writing plane, to obtain the movement track of the pen tip on the virtual writing plane ;
a conversion module, configured to convert a movement track of the pen tip on the virtual writing plane into a writing handwriting displayed on the display screen according to the calculated ratio; and a display module, configured to display the digital pen on the display screen according to the conversion result Write handwriting. The digital pen writing control system according to claim 6, wherein when the writing plane is a plane of any material instead of a screen, the three positioning points are three pre-selected on the writing plane. A point of collinearity, the ratio being a preset value. The digital pen writing control system of claim 6, wherein the pressure sensing module is a pressure sensor for acquiring a pressure generated when a pen tip of the digital pen contacts the writing plane, thereby determining a pen tip. Whether to touch the writing plane. The digital pen writing control system according to claim 6, wherein the inertial sensing module is a three-axis accelerometer and a three-axis gyroscope or a miniature inertial measuring component encapsulated by the two. It is used to provide an acceleration output of three degrees of freedom and an angular velocity output of three degrees of freedom to track the trajectory of the nib. The digital pen writing control system according to claim 9, wherein the inertial sensing module uses the origin of the three-dimensional coordinate system as a starting point, and converts the acceleration and angular velocity of the pen tip motion into a moving distance. And the direction, calculating the coordinates of the nib in the three-dimensional coordinate system each time the pen tip contacts the writing plane, and obtaining the movement track of the nib.