CN215932585U - Screen writing device - Google Patents

Abstract

The utility model relates to a screen writing device, which comprises a position information film and a writing pen, wherein the position information film comprises a transparent substrate and a position coding pattern arranged on the substrate; the position information film is movably laid in a display area of the display screen; the writing pen comprises a shell, a pen point and a control circuit. The utility model solves the problem of screen input on a non-position sensing type display, can display the information corresponding to writing and painting on the display screen in real time, and has the advantages of low cost, simple structure of the writing pen, accurate acquisition of image data and convenient use.

Description

Screen writing device

Technical Field

The utility model relates to the technical field of electronic products, in particular to a screen writing device.

Background

Displays play an important role in modern fields as an information output device of computer systems. According to the transmission direction of information, the display can be divided into two types, one type is a position sensing type display, which not only can display information, but also can sense the point touch position of a screen, for example, a mobile phone display screen, a tablet computer display screen, a touch screen used in various industrial control fields and the like are all position sensing type displays. The display screen can sense the point touch and sliding of the screen, and the sensed screen position is sent to the relevant processing system as input information. The other is a display for outputting and displaying information simply, such as a Personal Computer (PC) display, a notebook computer display, a monitor with various sizes, a television display screen, and the like. For some occasions where an input is required on the screen, for example, when a user discusses with others about the currently displayed content of the display, various marks are often required to be made about the currently displayed content of the screen. Since the non-position sensing type display cannot respond to such an operation on the screen, it is often necessary to resort to a writing pad or the like. When the handwriting board is utilized, the handwriting board application needs to be opened to carry out corresponding setting, hardware equipment needs to be added, the cost is improved, corresponding operation needs to be carried out before use, and the process is complicated. Another way of marking is to open the document including the currently displayed content in some specific software, in which the marking operation is performed. For example, the content is opened and displayed by software such as Word, PowerPoint, or the like, and operations such as underlining, bolding, setting a highlight color, and the like are performed where necessary to highlight the emphasized portion. However, such added tags are added to the original document, thus changing the content of the original document. After document protection is set for the original document, the marking cannot be performed. Therefore, for the current non-position sensing type display, it is necessary to provide a method for conveniently sensing the position of the screen to solve the problem of screen information input.

SUMMERY OF THE UTILITY MODEL

Aiming at the technical problems in the prior art, the utility model provides a screen writing device which is used for identifying the point contact position on a non-position sensing type display and realizing the digitization of writing on a common display screen.

In order to solve the above technical problems, the present invention provides a screen writing pen comprising a position information film and a writing pen, wherein the position information film comprises a transparent substrate and a position coding pattern disposed on the substrate; the position information film is movably laid in a display area of the display screen; the writing pen comprises a shell, a pen point and a control circuit, wherein a detection port is formed in the tail end of the shell; the first end of the pen point is fixed in the shell, and the second end of the pen point extends out of the detection port at the tail end of the shell; the control circuit is arranged on the circuit board and fixed in the shell, and comprises a detection element, an image acquisition assembly, a processor and a communication module; the detection element is connected with the first end of the pen point and outputs an electric signal when the pen point is sensed to write the display screen on which the position information film is laid; the image acquisition assembly is connected with the detection element, and when an electric signal output by the detection element is received, image data and corresponding time information in an acquisition area corresponding to a point contact position are acquired through the detection port, wherein the image data comprises position coding pattern information on a display screen; the processor is connected with the image acquisition assembly, establishes a position coding coordinate system of the position information film on the display area of the display screen, and identifies the point contact position of the position information film on the display screen and generates a point contact track image when the position information film touches the display area of the display screen; the communication module is connected with the processor and sends the point touch track image to a host which can drive the display screen.

Preferably, the detection element is a pressure sensor, and outputs an electrical signal when sensing the pressure of the display screen at the pen tip.

Preferably, the detection element is a proximity sensor or a distance sensor, and outputs an electric signal when the distance between the second end of the pen tip and the display screen reaches a detection distance.

Preferably, the substrate of the position information film is a PET film, an ARM film, a PE film, an OCA film, a toughened glass film or transparent paper; the position-coding pattern is coated or engraved on the substrate.

Preferably, the position-coding pattern engraved on the substrate is lower or higher than the substrate, or a part of the coding pattern is higher than the substrate and a part of the coding pattern is lower than the substrate.

Preferably, the image acquisition assembly comprises:

a lens assembly disposed within the detection port with a field of view compatible with the acquisition region; and

an image sensor optically connected to the lens assembly and configured to acquire image data within an acquisition area through the lens assembly upon receiving an electrical signal from the detection assembly.

Preferably, the image acquisition assemblies are multiple and are fixed in the detection port around the pen point, and the acquisition area of each image acquisition assembly is connected to cover the area around the pen point.

Preferably, the image capturing assembly may further include:

a first signal emitter configured to send a probing signal through a detection port to the acquisition region upon receiving an electrical signal of the detection element;

a first signal receiver configured to receive a detection signal reflection signal reflected from the acquisition region through a detection port and generate image data of the acquisition region according to the reflection signal; and

an analog-to-digital conversion circuit configured to convert an analog signal of the image data generated by the signal receiver into a digital signal.

Preferably, the communication module includes a second signal transmitter and a second signal receiver, the second signal transmitter is located on the circuit board in the housing, and modulates data to be transmitted into a wireless carrier signal according to a predetermined protocol to be transmitted; the second signal receiver comprises a data interface which is used for being connected with a host which drives the display screen; the wireless carrier signal sent by the signal transmitter is received by the wireless carrier signal receiving device, data is demodulated from the wireless carrier signal, and the data is sent to the host through the data interface.

The screen writing device provided by the utility model solves the screen input problem on the non-position sensing type display, and can change the common display screen into the position sensing display screen by adding the position information film on the common non-position sensing type display screen, thereby realizing the digitization of screen writing, solving the screen input problem on the non-position sensing type display screen and adding functions for the common display screen. The position information film used in the utility model is made of common materials and is easy to manufacture, and compared with the material and the manufacturing complexity of a position sensing display screen, the utility model greatly reduces the device cost. The position information film is convenient to lay on the display screen, can be laid at any time, can be taken down from the display screen when not in use, and is simple and convenient to operate. The writing pen provided by the utility model has a simple structure, can accurately identify and position the point contact position of the screen, and can display writing, painting and operation tracks on the display screen in real time.

Drawings

Preferred embodiments of the present invention will now be described in further detail with reference to the accompanying drawings, in which:

FIG. 1 is a schematic diagram of a screen writing system according to an embodiment of the present invention;

FIG. 2 is a partial schematic view of a display screen with a position information film laid down according to one embodiment of the present invention;

FIGS. 3A-3C are partial schematic views of a display screen having a position information film applied thereto according to another embodiment of the present invention;

FIGS. 4A-4C are schematic diagrams of coding pattern units according to three embodiments of the present invention, respectively;

FIGS. 5A-5B are schematic diagrams of a configuration of a screen writing pen according to an embodiment of the present invention;

FIG. 6 is a functional block diagram of a stylus control circuit according to one embodiment of the present invention;

FIG. 7 is a functional block diagram of the image acquisition assembly according to one embodiment of the present invention;

FIGS. 8A-8B are schematic end sectional views of a screen writing pen according to two embodiments of the present invention, respectively;

FIG. 9 is a functional block diagram of the image acquisition assembly according to another embodiment of the present invention;

FIG. 10 is a functional block diagram of a processor provided in accordance with one embodiment of the present invention; and

fig. 11 is a flowchart of an application operating process of the screen writing apparatus according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the following detailed description, reference is made to the accompanying drawings that form a part hereof and in which is shown by way of illustration specific embodiments of the application. In the drawings, like numerals describe substantially similar components throughout the different views. Various specific embodiments of the present application are described in sufficient detail below to enable those skilled in the art to practice the teachings of the present application. It is to be understood that other embodiments may be utilized and structural, logical or electrical changes may be made to the embodiments of the present application.

The utility model provides a screen writing device which comprises a position information film and a writing pen, wherein the position information film is laid on a display screen, and the writing pen is in communication connection with a host driving the display screen, so that screen writing digitization can be realized, and specific reference is made to the following description.

Fig. 1 is a schematic structural diagram of a screen writing system according to an embodiment of the present invention, in this embodiment, the system includes a display 1, a host 2 and a screen writing pen 3, the display 1 in this embodiment is a desktop pc display, but may also be an all-in-one display screen, a notebook computer display, a monitor, a tv screen, etc., the display is connected to the corresponding host 2, and is driven by the host 2 to display corresponding information. The display 1 comprises a display screen 11 and a position information film 12, wherein the display screen 11 can be any non-position sensing type hard display screen, the position information film 12 is movably laid on the outer surface of the display screen 11, a transparent sensing area on the position information film is matched with the display area of the display screen 11, and a position coding pattern is arranged on the position information film 12. The position information film 12 and the writing pen 3 are the screen writing device provided by the utility model, and the screen writing digitization can be realized by matching the position information film 12 and the writing pen with the existing display system.

The position information film 12 is a transparent film, and the way of laying the position information film on the display screen 1 is different according to the material of the film. For example, when the position information film 12 is a PET film, the PET film can be attached to the outer surface of the display panel 11 by static electricity, and the placement is simple and easy to operate, and the PET film can be removed at any time to be cleaned when stains are present on the surface and then attached to the display panel 11. The position information film 12 may be an ARM film. The ARM film is generally a film with a multilayer structure, the inner layer of the ARM film is an adsorption layer, and a silica gel layer obtained by chemical treatment can be well adsorbed on the display screen 11 and does not leave glue marks when being taken off. The middle layer is a PET layer, and the outer layer is a special treatment layer, such as an AG treatment layer subjected to anti-glare treatment or an HC treatment layer subjected to hardness treatment. The position information film 12 may also be a PE film whose main raw material is LLDPE, which relies on electrostatic adsorption on the display screen 11. The position information film 12 may be a film made of OCA material or a tempered glass film. The tempered glass film is generally composed of an AB glue layer, a tempered glass layer and a coating layer, and is adhered to the display screen 11 through the AB glue layer. In addition, the position information film 12 may be made of a transparent paper obtained by adding acrylic resin to pulp in a paper making process, wherein the pulp accounts for about 30% and the acrylic resin accounts for about 70%, and the weight and thickness thereof are as large as those of general copy paper.

The position information film 12 uses the films of the above-mentioned various materials as a base layer, and a position-coding pattern is provided thereon, wherein the position-coding pattern is provided in various ways. For example, the coating is applied to the base layer film using a coating process. As shown in fig. 2, which is a partial schematic view of a display screen on which a position information film is laid according to an embodiment of the present invention, in the present embodiment, the position information film 12a is located on the outer surface of the display screen 11a, and the present embodiment uses paint to coat a position coding pattern 122a on a substrate layer 121 a. In order not to affect the display screen displaying information, the dots or lines forming the position-coding pattern are as small as possible, the maximum size of which should not be larger than the human eye resolution. For example, the largest dot forming the position-coding pattern has a largest dimension of less than 5 microns. Fig. 3A to 3C are partial schematic views of a display panel on which a position information film is laid according to another embodiment of the present invention, in which the position information film 12b is positioned on the outer surface of the display panel 11b, and the position-coding pattern 122b is engraved on the base layer 121 b. In fig. 3A, the same parts as the position-coding pattern are removed from the base layer 121B during engraving, so that the resulting position-coding pattern layer 122B is lower than the base layer 121B, whereas in fig. 3B, the same parts as the position-coding pattern remain on the base layer 121c during engraving, so that the resulting position-coding pattern layer 122c is higher than the base layer 121 c. Alternatively, as shown in FIG. 3C, the dots or lines that make up the position-coding pattern are engraved to different depths, as shown in the figure, with the dots 122d being deeper and the dots 123d being shallower, coded by the depth of the dots being characteristic, and if the size of the dots is further combined, another more complex code may be made.

The position-coding pattern in the present invention may be a pattern formed by any coding rule. Fig. 4A is a 4 × 4 coding pattern unit, in which large dots and small dots respectively denote 1 and 0 that can be recognized by a computer. Different information can be obtained by different dot arrangements, which respectively correspond to the corresponding screen positions. FIG. 4B shows another type of coding pattern unit, which is coded according to the different deviation directions and positions of the dots from their reference lines. Alternatively, as shown in fig. 4C, the encoding is performed by the length of the line segment or the rotation direction of the line segment around the reference point.

Fig. 5A-5B are schematic diagrams of a configuration of a screen writing pen according to an embodiment of the present invention. In this embodiment, the screen writing pen 3 includes a housing 31, a pen tip 33, and an internal control circuit. Wherein, the distal end of the housing 31 is provided with a detection port 32, a first end of the pen tip 33 is fixed in the housing 31, and a second end thereof protrudes from the detection port 32 at the distal end of the housing. A circuit board 34 in which various electric components constituting a control circuit are disposed is fixed inside the housing 31. Further, the screen writing pen 3 further includes a cap 305 which covers the tip of the pen to protect the pen tip and prevent dust and the like from entering the inside of the housing through the detection port to contaminate the relevant components when the screen writing pen 3 is not in use. The top end of the pen is provided with a hanging hole 37 or a groove 36 for arranging the hanging rope 4. In addition, the charging circuit of the screen writing pen 3 in this embodiment is disposed on the circuit board to supply power to each electronic component, and the charging circuit is connected to the charging interface 38, and displays information of insufficient power through the indicator light 39 when the power is insufficient, for example, the indicator light is made to flash to prompt the user that the power is insufficient. In addition, a power indicator light, a work indicator light and the like are included to indicate the corresponding states.

FIG. 6 is a functional block diagram of a control circuit according to one embodiment of the present invention. The control circuit 35 includes a detection element 351, an image capturing component 352, a processor 353 and a communication module 354, wherein the detection element 351 is used for sensing the point touch operation of the pen tip 33 on the display screen. The detecting element 351 may be a pressure sensor, such as the pressure sensor 341 in fig. 5, connected to the first end of the pen tip 33 through an interface, and outputs an electrical signal to the image capturing assembly 352 when the pressure of the pen tip 33 is sensed. In addition, the detecting element 351 may be a proximity sensor or a distance sensor, such as an infrared proximity sensor or a photoelectric sensor, which is connected to the first end of the pen tip and outputs an electrical signal to the image capturing assembly when the distance between the second end of the pen tip and the screen reaches a detection distance.

The image capturing assembly 352 is connected to the detecting element 351, and when the touch operation of the pen tip on the display screen is detected, the image data and the corresponding time information in the capturing area corresponding to the touch position are obtained through the detecting port 32. Wherein the image data includes position-coding pattern information on a display screen. FIG. 7 is a functional block diagram of the image acquisition assembly according to one embodiment of the present invention. In this embodiment, the position information film on the display is formed by coating the position-coding pattern on the transparent substrate film with paint, and the image capturing assembly 352 captures the image of the position-coding pattern on the position information film by using the principle of photosensitive imaging. At this time, the image pickup assembly 352 includes a lens assembly 3521 and an image sensor 3522. The lens assembly 3521 is optically connected to the image sensor 3522, and both may be provided in one barrel for convenience of installation. When the detecting elements 351 transmit electrical signals to the image sensor 3522, the image sensor 3522 may capture image data within the capture zone 30 through the lens assembly 3521. In some embodiments, in order to avoid the influence of the position-coding pattern on the vision of human eyes, the distance between the points or lines constituting the position-coding pattern is relatively large, in which case the area of the acquisition region should be made sufficiently large in order to meet the accuracy requirement of position recognition. One way is to increase the area of the detection opening to increase the capture area, and the lens assembly 3521 is a wide-angle lens composed of multiple lenses to increase the field of view of image capture. As shown in FIG. 8A, which is a schematic cross-sectional view of the distal end of a screen writing pen, lens assembly 3521 is located at the lower portion of nib 33 and corresponding capture area 30 is shown. The advantage of this embodiment is that the requirements can be met with one lens barrel, saving costs. Alternatively, as shown in fig. 8B, 4 lens barrels are used, each lens barrel including one lens assembly and one image sensor, i.e. 4 image capturing assemblies 352. The pen point 33 is located at the middle of the detection port 32, and 4 lens barrels are arranged around the pen point 33, and each lens barrel is provided with one collection area 30 which are connected together to cover the area around the pen point. The advantage of this embodiment is that there is no requirement for the user to hold the pen, and enough image of the position-coding pattern can be acquired in any holding posture. The image sensor 3522 may be a CMOS device or a CCD device, and may acquire image data at a high speed according to a set frequency.

FIG. 9 is a functional block diagram of the image acquisition assembly according to another embodiment of the present invention. In the present embodiment, when the position information film on the display is formed by engraving the position-coding pattern on the transparent base film, as shown in fig. 3A to 3C, the image pickup assembly 352 includes a signal transmitter 3524, a signal receiver 3525, and an analog-to-digital conversion circuit 3526. Wherein the signal emitter 3524 is configured to send a probe signal, including an infrared signal, an ultraviolet signal, an ultrasonic signal, or the like, through the detection port 32 to the acquisition region. By setting the position of the signal transmitter 3524 and the transmitting angle thereof in the pen barrel, the effective acquisition region range can be determined, and the reflected signal thereof can be determined to return to the pen barrel to be received by the signal receiver 3525. The signal receiver 3525 receives the reflected signal reflected back from the acquisition region and generates image data from the reflected signal. Since the generated image data is an analog signal, the analog-to-digital conversion circuit 3526 converts the analog signal of the image data generated by the signal receiver 3525 into a digital signal for the convenience of processing and transmission.

FIG. 10 is a functional block diagram of a processor provided in accordance with one embodiment of the present invention. In this embodiment, the processor 353 includes a coding pattern recognition unit 3531, a positioning system establishing unit 3532, a position recognition unit 3533, a layer unit 3534, a point contact trajectory generation unit 3535 and an image generation unit 3536, wherein the coding pattern recognition unit 3531 is connected to the image capturing assembly 352, and recognizes a position coding pattern from image data transmitted from the image capturing assembly 352. Since the display screen itself displays different contents, the collected touch position may include pattern information of the display content on the original display screen in addition to the position-coding pattern on the position information film, and the coding pattern recognition unit 3531 extracts the position-coding pattern from the current image by using the existing image analysis method. When the writing pen is started, a position coding coordinate system is established firstly, at the moment, a user needs to touch four corners of a display area of a display screen, and collected images of four touch positions are obtained at the moment. The encoding pattern recognition unit 3531 extracts the position encoding pattern and transmits the position encoding pattern to the positioning system establishing unit 3532. The positioning system establishing unit 3532 determines a position-coding coordinate system on the position information film corresponding to the display area of the display screen according to the four position-coding patterns for positioning. Specifically, one of the four position-coding patterns is taken out as a first position-coding pattern, and a position-coding unit is determined from the first position-coding pattern and taken as a first point; determining a position coding unit which is in the same line with the first point from other three coding patterns according to a coding rule, and taking the position coding unit as a second point, wherein the position coding pattern with the second point is a second position coding pattern; and determining a position coding unit which is in the same column with the first point from the other two coding patterns according to the coding rule, and taking the position coding unit as a third point, wherein the position coding pattern with the third point is a third position coding pattern, determining a position coding unit which is in the same row with the third point in a fourth position coding pattern, and taking the position coding unit which is in the same column with the second point as a fourth point, thereby obtaining four points corresponding to four point contact positions. And establishing the boundary of the positioning area by taking the four points as vertexes, reading all position coding patterns in the positioning area, and determining the coordinates of each position coding unit in the position coding patterns in the positioning area, so that the established position coding coordinate system can enable the position information film to be in one-to-one correspondence with the position of the current display screen. After the position coding coordinate system is established, the layer unit 3534 establishes a transparent layer with the same size as the positioning area, and the position coordinate system of the transparent layer is the same as the position coding coordinate system. Because the size and the position of the positioning area are the same as those of the display area of the display screen, the transparent layer can be completely displayed by the display screen, and the positions on the transparent layer correspond to the positions of the display screen one by one. The image generation unit 3536 generates a frame image from the generated transparent layer, and transmits the generated frame image to the host computer 2 as image data to be displayed on the display screen. When the writing pen writes on the display screen, the image capturing module acquires an image of the touch position at a high speed, and accordingly, the code pattern recognition unit 3531 recognizes a corresponding position code pattern therefrom and transmits it to the position recognition unit 3533. The position recognition unit 3533 determines the touch position of the position-coding pattern recognized by each position recognition unit 3533 on the display screen according to the position-coding coordinate system, so as to obtain a plurality of touch positions. The point contact track generating unit 3535 maps the plurality of point contact positions to a plurality of second positions of the transparent layer respectively, and since the position coordinate system of the transparent layer is the same as the position coding coordinate system, the aforementioned point contact positions are the same as the positions on the transparent layer, and the point contact track generating unit 3535 is in the plurality of second positions (or called point contact positions) on the transparent layer, and sequentially connects the plurality of second positions to obtain the point contact track according to the time of each point contact position. When connecting, if there is no user's intervention, the multiple touch positions are connected roughly by a preset color and line. In the process of generating the point contact track in the transparent layer, the image generating unit 3536 generates a plurality of frames of point contact track images according to a preset frequency. The communication module 354 transmits the multi-frame point touch trajectory image to the host 2 of the display device. The communication module 354 may employ a bluetooth communication protocol or a near field communication protocol. Because most host systems are integrated with the Bluetooth communication module, the writing pen 3 can be paired with the host 2 to establish communication connection before use. Alternatively, the communication module 354 of the writing pen 3 includes a signal transmitter and a signal receiver. The signal emitter is positioned on a circuit board in the shell 301, and modulates image data to be sent into a wireless carrier signal according to a predetermined protocol to be emitted; the signal receiver comprises a data interface, such as a USB interface, and when the writing pen is used, the signal receiver is inserted into the USB interface of the host 2 to connect the two. The signal receiver receives the wireless carrier signal sent by the signal transmitter and demodulates and integrates image data from the wireless carrier signal, and the host 2 receives the image data through the data interface. And then the image data is sent to the display screen 11 for display.

In the foregoing embodiment, when the layer unit 3534 establishes the transparent layers with the same size as the positioning region, a tool region including a plurality of editing tools is generated in the transparent layers. The tool area may be located at the edge of the transparent layer, e.g. near four borders, as shown in fig. 1, and located in the tool area 13 below the layer. Editing tools are for example delete, move, copy, change color or change line thickness, save etc. The image generation unit 3536 generates one frame of image with the transparent layer of the tool area at this time, and transmits the image data to the host computer 2 as image data by the communication module 354, and displays the image data on the display screen 11. In this case, the user may perform corresponding deletion, movement, copying, saving, etc. on the written content during the writing process on the screen, and may set the color, thickness, etc. of the line when the point touch trajectory is displayed. When the touch position identified by the position identifying unit 3533 corresponds to a certain editing tool, the touch trajectory generating unit 3535 performs a corresponding operation on the touch trajectory on the current transparent layer according to the corresponding editing tool. Since the image generating unit 3536 acquires the image of the current layer at a predetermined frequency during the operation of the point-touch trajectory generating unit 3535 on the transparent layer, the edited process is also displayed on the display screen 11 in real time.

As can be seen from the above description, the screen writing device provided by the present invention can implement screen writing on a common display screen. Through increasing the position information membrane at ordinary display screen, can demonstrate ordinary display screen into position sensing display screen, realize the digitization that the screen was write, increased the function for ordinary display screen. The position information film is made of common materials and is easy to manufacture, and compared with the material and the manufacturing complexity of a position sensing display screen, the position information film greatly reduces the device cost. The position information film is convenient to lay on the display screen, can be laid at any time, can be taken down from the display screen when not in use, and is simple and convenient to operate. The utility model has accurate identification and positioning of the point contact position of the screen, can display writing, painting and operation tracks in real time and has good real-time property.

FIG. 11 is a flow diagram of an application operating process of the screen writing apparatus according to one embodiment of the present invention. In this embodiment, when the currently displayed content needs to be marked on the display of the general personal computer, and the marked content is displayed on the display screen, the screen writing device provided by the present invention can be used to implement the marking, and the specific operations include the following steps:

and step S1, turning on the power supply of the writing pen, and establishing communication connection between the writing pen and the personal computer. The personal computer comprises a host and a display, and the display screen of the display is a common display screen. Of course, the personal computer may also be a unitary device that integrates a host and a display. When the writing pen provides a receiver for wireless communication, the receiver is inserted into a data interface of a computer. And if the writing pen is provided with the Bluetooth module, carrying out Bluetooth pairing on the writing pen and the computer, and establishing wireless communication connection.

Step S2, a piece of position information film is attached to the display screen of the display so as to completely cover the display area of the display screen.

And step S3, touching the four corners of the display area of the display screen with a writing pen to determine the positioning area and establishing a position coding coordinate system of the position information film on the display area of the display screen.

In this step, when the writing pen makes a point touch on the display area of the display screen, the detection module of the writing pen may detect the point touch operation of the writing pen, for example, a pressure sensor in the writing pen senses the pressure, or a proximity sensor in the writing pen senses that the distance between the pen tip and the screen reaches a predetermined distance, and then the point touch operation of the writing pen is determined, and at this time, the image acquisition module in the writing pen acquires an acquisition area image corresponding to the point touch position and corresponding time information through a detection port at the tip end of the writing pen.

Because the position information film is laid on the display screen, the collected image comprises the position coding pattern on the position information film. Since four corners are touched at one time, images of four touched positions are obtained. Because the image acquisition module acquires images according to a certain frequency, each position may obtain a plurality of images, in an optional scheme, the plurality of images are preprocessed to obtain an image serving as an image to be identified, the image is identified to obtain a position coding pattern, or all the images are identified and then analyzed to obtain the position coding pattern corresponding to the point contact position.

After the position coding patterns of the four touch positions are obtained, one position coding unit is determined from the position coding pattern of each touch position to be used as four vertexes of the positioning area. For example, one position-coding unit in the position-coding pattern of the first click-to-touch position is taken as the first point; taking a position coding unit which is in a second point contact position adjacent to the first point contact position and is in the same row with the first point contact position as a second point; taking a position coding unit which is in a third touch position adjacent to the first touch position and is in the same column with the first point as a third point; and taking the position coding units in the fourth point contact position, which are in the same column with the position coding units of the second point and in the same row with the position coding units of the third point, as fourth points. And establishing the boundary of the positioning area by taking the four points as four vertexes. And acquiring the position coding patterns in the positioning area, and determining the coordinates of each position coding unit in the position coding patterns in the positioning area.

And obtaining a position code coordinate system on the position information film corresponding to the display area of the display screen through the steps.

And after a position coding coordinate system of the position information film on the display area of the display screen is established, establishing a transparent layer with the same size as the positioning area, wherein the position coordinate system of the transparent layer is the same as the position coding coordinate system. Optionally, a tool area image is generated on the transparent layer, wherein the tool area image includes a plurality of editing tool images, such as icons of deleting, moving, copying, saving, changing color or changing line thickness. And then the transparent layer generates an image and sends the image to a display screen for display.

If the transparent layer does not have the tool area image, the current display screen is not changed for the user, and if the transparent layer has the tool area image, the user can see icons such as delete, move, copy, save, change color or change line thickness on the display screen after finishing the step.

In step S4, a pen is used to mark the position to be marked, such as circle drawing, underlining, annotation, or deletion, copy, move, and save from the current mark. When the user marks, as the pen moves on the screen, its trajectory is displayed synchronously at the position of its point on the display.

In the step, when a user marks on a screen by using a writing pen, the writing pen collects an acquisition area image corresponding to a point contact position of the writing pen when the writing pen touches the display screen according to a preset frequency and corresponding time; then, identifying a position coding pattern in the image acquired each time from the image of the acquisition area, and determining a touch position of a display screen corresponding to the position coding pattern according to the position coding coordinate system; and mapping the point contact position to be a second position (or called a point contact position) of the transparent layer. And connecting a plurality of second positions on the transparent layer in sequence according to the time of each point contact position to obtain a point contact track. In the process of generating the point touch trajectory, a point touch trajectory image is generated according to a predetermined frequency, and the point touch trajectory image is displayed to a corresponding point touch position of the display screen. Visually, as the writing pen moves on the screen, the track of the writing pen is synchronously displayed at the writing position, the position is accurately determined, and the real-time performance is good.

And step S5, after the use, the power supply of the writing pen is closed, and the position information film is taken down. When the power supply of the writing pen is turned off and the communication connection with the host computer is disconnected, the host computer does not display the transparent layer any more, so that all the marks on the display screen disappear visually, and the state before the writing pen is not used is recovered.

The screen writing device provided by the utility model can meet the requirement of a user on display content marking through a screen. For example, when the user is discussing with others about the currently displayed contents, the power of the screen writing pen 3 is turned on to establish its communication connection with the host, and then the position information film is laid on the display screen. When a user needs to emphasize and annotate a certain place in the discussion process, marking operations such as circles and underlines can be performed at corresponding positions on a display screen through a screen writing pen or annotations can be written at proper positions beside the displayed content, all the screen input operations performed by the user can generate corresponding images to be displayed at the original positions of the screen in real time, the original document is not required to be modified, a writing board is not required to be additionally arranged, only one screen writing pen is required, and the operation is simple and the use is convenient. In addition, the position information film laid on the display screen can not only provide a position coding pattern for position identification, but also play a role in protecting the display screen, and reduce the damage of the pen point of the screen writing pen to the display screen. The pen point can be specially processed, and the damage to the display screen can be further reduced by adopting a softer material to make the pen point. The utility model solves the problem of screen input on the non-position sensing type display through the screen writing pen and the position information film, can display writing and painting on the display screen in real time, has simple and convenient operation and low cost, and has simple writing pen structure, accurate acquisition of image data and convenient use.

The above embodiments are provided only for illustrating the present invention and not for limiting the present invention, and those skilled in the art can make various changes and modifications without departing from the scope of the present invention, and therefore, all equivalent technical solutions should fall within the scope of the present invention.

Claims (7)

1. A screen writing apparatus, comprising:

a position information film including a transparent substrate and a position-coding pattern disposed on the substrate; the position information film is movably laid in a display area of the display screen; and

a writing pen including a housing, a pen tip, and a control circuit;

wherein, the tail end of the shell is provided with a detection port;

the first end of the pen point is fixed in the shell, and the second end of the pen point extends out of the detection port at the tail end of the shell;

the control circuit is arranged on the circuit board and fixed in the shell, and comprises a detection element, an image acquisition assembly, a processor and a communication module;

the detection element is connected with the first end of the pen point and outputs an electric signal when the pen point is sensed to write the display screen on which the position information film is laid;

the image acquisition assembly is connected with the detection element, and when an electric signal output by the detection element is received, image data and corresponding time information in an acquisition area corresponding to a point contact position are acquired through the detection port, wherein the image data comprises position coding pattern information on a display screen;

the processor is connected with the image acquisition assembly, establishes a position coding coordinate system of the position information film on the display area of the display screen, and identifies the point contact position of the position information film on the display screen and generates a point contact track image when the position information film touches the display area of the display screen;

the communication module is connected with the processor and sends the point touch track image to a host which can drive the display screen;

the substrate of the position information film is a PET film, an ARM film, a PE film, an OCA film, a toughened glass film or transparent paper; the position-coding pattern is coated or engraved on the substrate;

the position-coding pattern engraved on the substrate is lower or higher than the substrate, or part of the coding pattern is higher than the substrate and part of the coding pattern is lower than the substrate.

2. A screen writing apparatus according to claim 1, wherein the sensing element is a pressure sensor which outputs an electrical signal when pressure of the pen tip against the display screen is sensed.

3. A screen writing apparatus according to claim 1, wherein the sensing element is a proximity sensor or a distance sensor which outputs an electrical signal when the second end of the pen tip is at a sensing distance from the display screen.

4. The screen writing apparatus of claim 1, wherein the image capture assembly comprises:

a lens assembly disposed within the detection port with a field of view compatible with the acquisition region; and

an image sensor optically connected to the lens assembly and configured to acquire image data within an acquisition area through the lens assembly upon receiving the electrical signal of the detection element.

5. The screen writing apparatus of claim 4 wherein the image capturing assembly is a plurality of image capturing assemblies secured within the detection port around the nib, the capturing region of each image capturing assembly being connected to cover the area around the nib.

6. The screen writing apparatus of claim 1, wherein the image capture assembly comprises:

a first signal emitter configured to send a probing signal through a detection port to the acquisition region upon receiving an electrical signal of the detection element;

a first signal receiver configured to receive a detection signal reflection signal reflected from the acquisition region through a detection port and generate image data of the acquisition region according to the reflection signal; and

an analog-to-digital conversion circuit configured to convert an analog signal of the image data generated by the signal receiver into a digital signal.

7. The screen writing apparatus of claim 1, wherein the communication module comprises:

the second signal emitter is positioned on the circuit board in the shell and modulates data to be sent into a wireless carrier signal according to a preset protocol to be emitted; and

the second signal receiver comprises a data interface and is used for being connected with a host which drives the display screen; the wireless carrier signal sent by the signal transmitter is received by the wireless carrier signal receiving device, data is demodulated from the wireless carrier signal, and the data is sent to the host through the data interface.

Images