CN215932586U - Screen writing system - Google Patents

Abstract

The utility model relates to a screen writing system, which comprises a display device, a position information film and a writing device, wherein the display device is configured to comprise a non-position sensing display screen and a host; the position information film comprises a transparent substrate and a position coding pattern arranged on the substrate; the position information film is movably laid in a display area of the display screen; the writing device is in wireless communication with the host, is configured to establish a position coding coordinate system of the position information film on the display area of the display screen, identify the point touch position of the position information film on the display screen when the position information film touches the display area of the display screen and generate a point touch track image, and send the point touch track image to the host so as to display a corresponding point touch track at the point touch position of the display screen. The utility model can display the writing and painting on the non-position sensing display screen on the display screen in real time, and has accurate positioning, low cost and simple and convenient operation.

Description

Screen writing system

Technical Field

The utility model relates to the technical field of electronic devices, in particular to a screen writing system.

Background

Displays play an important role in modern fields as an information output device of computer systems. According to the transmission direction of information, the display can be divided into two types, one type is a position sensing type display, which not only can display information, but also can sense the point touch position of a screen, for example, a mobile phone display screen, a tablet computer display screen, a touch screen used in various industrial control fields and the like are all position sensing type displays. The display screen can sense the point touch and sliding of the screen, and the sensed screen position is sent to the relevant processing system as input information. The other is a display for outputting and displaying information simply, such as a Personal Computer (PC) display, a notebook computer display, a monitor with various sizes, a television display screen, and the like. For some occasions where an input is required on the screen, for example, when a user discusses with others about the currently displayed content of the display, various marks are often required to be made about the currently displayed content of the screen. Since the non-position sensing type display cannot respond to such an operation on the screen, it is often necessary to resort to a writing pad or the like. When the handwriting board is utilized, the handwriting board application needs to be opened to carry out corresponding setting, hardware equipment needs to be added, the cost is improved, corresponding operation needs to be carried out before use, and the process is complicated. Another way of marking is to open the document including the currently displayed content in some specific software, in which the marking operation is performed. For example, the content is opened and displayed by software such as Word, PowerPoint, or the like, and operations such as underlining, bolding, setting a highlight color, and the like are performed where necessary to highlight the emphasized portion. However, such added tags are added to the original document, thus changing the content of the original document. After document protection is set for the original document, the marking cannot be performed. Therefore, for the current non-position sensing type display, it is necessary to provide a method for conveniently sensing the position of the screen to solve the problem of screen information input.

SUMMERY OF THE UTILITY MODEL

Aiming at the technical problems in the prior art, the utility model provides a screen writing system which is used for identifying the point contact position on a non-position sensing type display and realizing the digitization of writing on a common display screen.

In order to solve the above technical problems, the present invention provides a screen writing system, comprising a display device, a position information film and a writing device, wherein the display device is configured to comprise a non-position sensing type display screen and a host; the position information film comprises a transparent substrate and a position coding pattern arranged on the substrate; the position information film is movably laid in a display area of the display screen; the writing device is in wireless communication with the host, is configured to establish a position coding coordinate system of the position information film on the display area of the display screen, identify the point touch position of the position information film on the display screen when the position information film touches the display area of the display screen and generate a point touch track image, and send the point touch track image to the host so as to display a corresponding point touch track at the point touch position of the display screen.

Preferably, the substrate of the position information film is a PET film, an ARM film, a PE film, an OCA film, a toughened glass film or transparent paper; the position-coding pattern is coated or engraved on the substrate.

Preferably, the position-coding pattern engraved on the substrate is lower or higher than the substrate, or a part of the coding pattern is higher than the substrate and a part of the coding pattern is lower than the substrate.

Preferably, the writing device comprises a shell, a pen point, a detection module, an image acquisition module, a processing module and a first wireless communication module, wherein the detection module, the image acquisition module, the processing module and the first wireless communication module are positioned in the shell; wherein the content of the first and second substances,

the tail end of the shell is provided with a detection port;

the first end of the pen point is fixed in the shell, and the second end of the pen point extends out of the detection port at the tail end of the shell;

the detection module is configured to output an electrical signal when a writing operation of the pen tip on the display screen is sensed;

the image acquisition module is connected with the detection module and is configured to acquire an acquisition area image corresponding to a point contact position and corresponding time information through the detection port when receiving an electric signal output by the detection module, wherein the image comprises a position coding pattern on a display screen;

the processing module is connected with the image acquisition module and is configured to receive image data acquired by the image acquisition module and establish a position coding coordinate system of the position information film on a display area of the display screen; recognizing a point touch position of a pen point on a display screen, and generating a point touch track image according to corresponding time information;

the first wireless communication module is configured to be connected with the host, and sends the point touch track image to the host so as to display a corresponding point touch track at a point touch position of the display screen.

Preferably, the detection module comprises a pressure sensor or a proximity sensor or a distance sensor.

Preferably, the image acquisition module comprises a lens assembly and an image sensor, the lens assembly being configured with its field of view adapted to the acquisition area; the image sensor is optically connected with the lens assembly and is configured to acquire image data within an acquisition area through the lens assembly.

Preferably, the image acquisition module may further comprise a first signal transmitter configured to send a detection signal to the acquisition region, a first signal receiver, and analog-to-digital conversion circuitry; the first signal receiver is configured to accept a detection signal reflection signal reflected back from the acquisition region and generate image data of the acquisition region from the reflection signal; the analog-to-digital conversion circuit is connected with the first signal receiver and is configured to convert the analog signal of the image data generated by the first signal receiver into a digital signal.

Preferably, the wireless communication module comprises a second signal transmitter and a second signal receiver, the second signal transmitter is located on the circuit board in the housing and modulates transmission data including the point contact track image into a wireless carrier signal according to a predetermined protocol to be transmitted; the second signal receiver comprises a data interface for connecting with the host; the wireless carrier signal sent by the second signal transmitter is received by the wireless carrier signal receiving device, data are demodulated from the wireless carrier signal, and the data are sent to the host through the data interface.

Preferably, the writing device comprises a writing pen and a processing device which are separated, wherein the writing pen comprises a shell, a pen point, a detection module, an image acquisition module and a second wireless communication module, wherein the detection module, the image acquisition module and the second wireless communication module are positioned in the shell; the processing device comprises a processor, a third wireless communication module and a data interface, wherein the processor receives data sent by the writing pen through the third wireless communication module and sends the generated point touch track image to the host through the data interface.

Preferably, the processing device further comprises a fourth wireless communication module to communicate with the host.

The utility model can change the common display screen into the position sensing display screen by adding the position information film on the common display screen, thereby realizing the digitization of screen writing, solving the screen input problem on the non-position sensing type display and adding functions to the common display screen. The position information film used in the utility model is made of common materials and is easy to manufacture, and compared with the material and the manufacturing complexity of a position sensing display screen, the utility model greatly reduces the device cost. The position information film is convenient to lay on the display screen, can be laid at any time, can be taken down from the display screen when not in use, and is simple and convenient to operate. The utility model has accurate identification and positioning of the point contact position of the screen, can display writing, painting and operation tracks in real time and has good real-time property.

Drawings

Preferred embodiments of the present invention will now be described in further detail with reference to the accompanying drawings, in which:

FIG. 1 is a schematic diagram of the structural connections of a screen writing system according to one embodiment of the present invention;

FIG. 2 is a partial schematic view of a display screen with a positional information film applied thereto according to one embodiment of the present invention;

FIG. 3A is a partial schematic view of a display screen with a position information film applied thereto according to another embodiment of the present invention;

FIG. 3B is a partial schematic view of a display screen with a position information film laid down according to another embodiment of the present invention;

FIG. 3C is a partial schematic view of a display screen with a position information film applied thereto according to another embodiment of the present invention;

FIG. 4A is a schematic diagram of a position-coding pattern unit according to one embodiment of the present invention;

FIG. 4B is a schematic diagram of a position-coding pattern unit according to another embodiment of the present invention;

FIG. 4C is a schematic diagram of a position-coding pattern unit according to yet another embodiment of the present invention;

FIG. 5 is a schematic diagram of a pen configuration according to one embodiment of the present invention;

FIG. 6 is a functional block diagram of a stylus according to one embodiment of the present invention;

FIG. 7 is a functional block diagram of an image acquisition module according to one embodiment of the present invention;

FIG. 8 is a functional block diagram of an image acquisition module according to another embodiment of the present invention;

FIG. 9 is a functional block diagram of a processing module provided in accordance with one embodiment of the present invention;

FIG. 10 is a schematic diagram of the structural connections of a screen writing system provided in accordance with another embodiment of the present invention; and

fig. 11 is a flowchart of a screen writing operation procedure according to another embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the following detailed description, reference is made to the accompanying drawings that form a part hereof and in which is shown by way of illustration specific embodiments of the application. In the drawings, like numerals describe substantially similar components throughout the different views. Various specific embodiments of the present application are described in sufficient detail below to enable those skilled in the art to practice the teachings of the present application. It is to be understood that other embodiments may be utilized and structural, logical or electrical changes may be made to the embodiments of the present application.

The utility model provides a display system capable of carrying out screen position identification, which comprises a display module, a position acquisition module and a display processing module, wherein the display module is provided with a non-position sensing display screen, and the display screen can be an independent personal computer display, a flat panel display and the like, and can also be a notebook computer display and a display of an all-in-one machine which are integrated with a host. The outer surface of the non-position sensing type display screen is paved with a transparent position information film, and a position coding pattern is arranged on the position information film. The position acquisition module or the position acquisition module and the display processing module are manufactured into a pen shape and used as an independent writing pen, so that the operation is convenient. The position acquisition module and the display processing module can be respectively made into two independent devices, for example, the position acquisition module is made into a writing pen, the display processing module is made into a small box, and the position acquisition module and the display processing module can be used for wireless or wired data transmission. When a user writes and paints on the display screen by using a writing pen, the position acquisition module in the display screen can acquire the position coding pattern image of the acquisition area corresponding to the point touch position and the corresponding time, and sends the position coding pattern image to the display processing module. The display processing module is communicated with the position acquisition device in the writing pen, receives the data sent by the position acquisition device, identifies the position coding pattern when the position acquisition device performs point touch on the display device, and generates a point touch track to be displayed on a display screen. The display processing module may also be a module integrated in a personal computer or a notebook computer. When the display processing device is a single device, the display processing device is connected with a personal computer or a notebook computer or the like which drives the display device, so that the generated point touch track image is sent to the personal computer or the notebook computer and is displayed on a display screen of the display device.

Fig. 1 is a schematic structural connection diagram of a screen writing system according to an embodiment of the present invention, the screen writing system including a display device 1, a transparent position information film 2, and a writing pen 3, wherein the display device 1 includes a non-position sensing type display screen 11 and a host 12. The display screen 11 may be any non-position sensing type hard display screen, such as a desktop personal computer display, an all-in-one machine display screen, a notebook computer display, a monitor, a television screen, etc., and the display screen 11 is connected with a corresponding host 12 to display corresponding information, such as a personal computer display, an all-in-one machine display screen, a notebook computer display, etc., and displays various programs, documents, pictures, video information, etc. operated by the respective computer host; the monitor is connected with the monitoring camera to display the picture of the monitoring area; the television screen displays television video information. The transparent position information film 2 is movably laid on the outer surface of the display screen 11, a transparent sensing area on the transparent position information film is matched with a display area of the display screen 11, and a position coding pattern is arranged on the transparent sensing area. The position information film 2 is a transparent film, and the way of laying the position information film on the display screen 1 is different according to different materials of the film. For example, when the position information film 2 is a PET film (chemical name is polyester film), the PET film can be attached to the outer surface of the display panel 11 by static electricity, and the placement is simple and easy to operate, and the PET film can be removed at any time to clean when stains are present on the surface and then attached to the display panel 11. The position information film 2 may also be an ARM film, which is generally a film of a multilayer structure. The inner layer is an adsorption layer which is a silica gel layer obtained by chemical treatment, can be well adsorbed on the display screen 11, and does not leave glue marks when being taken off; the middle part is a PET layer; the outer layer is a special treatment layer, such as an AG treatment layer subjected to anti-glare treatment or an HC treatment layer subjected to hardness treatment. The positional information film 2 may also be a PE film whose main raw material is LLDPE, which relies on electrostatic adsorption on the display screen 11. The position information film 2 may be a film made of OCA material or a tempered glass film. The tempered glass film is generally composed of an AB glue layer, a tempered glass layer and a coating layer, and is adhered to the display screen 11 through the AB glue layer. In addition, the position information film 2 may be made of a transparent paper obtained by adding acrylic resin to the paper during the paper making process, wherein the paper pulp accounts for about 30% and the acrylic resin accounts for about 70%, and the weight and thickness of the paper are almost the same as those of the general copy paper.

The position information film 2 uses the films of the above-mentioned various materials as a substrate, and a position coding pattern is provided thereon, wherein the position coding pattern is provided in various ways. For example, the coating is applied to the base film using a coating process. As shown in fig. 2, which is a partial schematic view of a display panel on which a position information film is laid according to an embodiment of the present invention, in this embodiment, a position information film 2a is disposed on an outer surface of a display panel 11a, and a position-coding pattern 22a is coated on a substrate 21a using paint. In order not to affect the display information of the display screen, the dots or lines forming the position-coding pattern are as small as possible, the distance between the dots or lines is as large as possible, and the maximum size of the largest dot forming the position-coding pattern should not be larger than the resolution of the human eye. For example, the largest dot forming the position-coding pattern has a largest dimension of less than 5 microns. Fig. 3A-3B are partial schematic views of a display panel on which a position information film is laid according to another embodiment of the present invention, in which the position information film 2B is positioned on the outer surface of the display panel 11B, and the position-coding pattern 22B is engraved on the base 21B. In fig. 3A, the same part as the position-coding pattern is removed from the substrate 21B during engraving, so that the resulting position-coding pattern 22B is lower than the substrate 21B, while in fig. 3B, the same part as the position-coding pattern remains on the substrate 21c during engraving, so that the resulting position-coding pattern 22c is higher than the substrate 21 c. Alternatively, as shown in FIG. 3C, the dots or lines that make up the position-coding pattern are engraved to different depths, as shown in the figure, dots 22d are deeper and dots 23d are shallower, coded by featuring the depth of the dots, and if the size of the dots is further combined, another more complex code can be made.

The position-coding pattern in the present invention may be a pattern formed by any coding rule. Fig. 4A is a 4 × 4 coding pattern unit, in which large dots and small dots respectively denote 1 and 0 that can be recognized by a computer. Different information can be obtained by different dot arrangements, which respectively correspond to the corresponding screen positions. FIG. 4B shows another type of coding pattern unit, which is coded according to the different deviation directions and positions of the dots from their reference lines. Alternatively, as shown in fig. 4C, the encoding is performed by the length of the line segment or the rotation direction of the line segment around the reference point.

Fig. 5 is a schematic structural diagram of a writing pen according to an embodiment of the present invention. The writing pen 3 includes a housing 301, a pen tip 303, and an internal circuit. The distal end of the housing 301 is provided with a detection port 302, a first end of the pen tip 303 is fixed in the housing 301, and a second end of the pen tip protrudes from the detection port 302 at the distal end of the housing. A circuit board 304 in which various electric components are arranged is fixed inside the housing 301. Further, the screen writing pen 3 further includes a cap 305 which covers the tip of the pen to protect the pen tip and prevent dust and the like from entering the inside of the housing through the detection port to contaminate the relevant components when the writing pen 3 is not in use. The top end of the pen is provided with a hanging hole 307 or a groove 306 for arranging the hanging rope 4. In addition, the charging circuit of the screen writing pen 3 in this embodiment is disposed on the circuit board to supply power to each electronic component, and the charging circuit is connected to the charging interface 308, and displays information of insufficient power through the indicator 309 when the power is insufficient, for example, the indicator flickers to prompt a user that the power is insufficient. In addition, a power indicator light, a work indicator light and the like are included to indicate the corresponding states.

Fig. 6 is a schematic block diagram of a writing pen according to an embodiment of the present invention, and the writing pen 3 includes a detection module 31, an image capturing module 32, a processing module 33, and a communication module 34, wherein the detection module 31 is connected to a pen tip and generates an electrical signal when the pen tip touches or approaches a screen. The detection module 31 is, for example, a proximity sensor or a pressure sensor. When the proximity sensor is used, the proximity sensor generates an electric signal when the distance between the pen tip and the display screen 11 (including the position information film) reaches a detection distance. When a pressure sensor is used, the pressure sensor emits an electrical signal when the pen tip is pressed against the display screen 11. Other distance measuring sensors are of course possible, functioning in the same way as the proximity sensors.

The image acquisition module 32 is connected to the detection module 31, and starts to acquire image data of an acquisition area after receiving the electric signal sent by the detection module. FIG. 7 is a functional block diagram of an image acquisition module according to one embodiment of the present invention. In this embodiment, the image acquisition module 32 includes a lens assembly 321 and an image sensor 322. The lens assembly 321 is optically connected to the image sensor 322, the lens assembly 321 can acquire light from the acquisition region, and the image sensor 322 can acquire image data in the acquisition region when the detection module 31 sends an electrical signal to the image sensor 322. The image sensor 322 may be a CMOS device or a CCD device, which can collect data at a predetermined frequency. In order to be able to better acquire image data of an acquisition area. In the present embodiment, the detection port 302 at the tip of the writing pen 3 is large, and the lens assembly 321 is distributed around the tip, so that the capture area is large enough to acquire enough image data even if the dots or lines forming the position-coding pattern are separated by a large distance. Fig. 8 is a functional block diagram of the image acquisition module according to another embodiment of the present invention. In this embodiment, the image acquisition module 32 includes a signal transmitter 324, a signal receiver 325, and an analog-to-digital conversion circuit 326. Wherein the signal transmitter 324 is configured to send a probe signal to the acquisition region, the probe signal comprising an infrared signal, an ultraviolet signal, an ultrasonic signal, or the like. By setting the position of the signal transmitter 324 within the barrel and its angle of emission, the effective acquisition zone range can be determined, and its reflected signal can be determined to return to the barrel for reception by the signal receiver 325. Signal receiver 325 receives the reflected signal reflected from the acquisition region and generates image data of the acquisition region from the reflected signal. Since the generated image data is an analog signal, the analog-to-digital conversion circuit 326 converts the analog signal of the image data generated by the signal receiver 325 into a digital signal for the convenience of processing and transmission.

The processing module 33 is connected to the image capturing module 32, and configured to receive image data captured by the image capturing module 32, establish a position-coding coordinate system of the position information film on the display area of the display screen 11, identify a touch position on the display screen 11, and generate a touch trajectory image according to corresponding time information.

FIG. 9 is a functional block diagram of a processing module according to an embodiment of the present invention. The processing module 33 includes a coding pattern recognition unit 331, a positioning system establishing unit 332, a position recognition unit 333, a layer unit 334, a point contact trajectory generation unit 335, and an image generation unit 336, where the coding pattern recognition unit 331 is connected to the image acquisition module 32, and recognizes a position coding pattern from image data sent from the image acquisition module 32. Since the display screen itself displays different contents, the collected point-touch position may include pattern information of the display content on the original display screen in addition to the position-coding pattern on the position information film, and the coding pattern recognition unit 331 extracts the position-coding pattern from the current image by using the existing image analysis method. When the writing pen is started, a position coding coordinate system is established firstly, at the moment, a user needs to touch four corners of a display area of a display screen, and collected images of four touch positions are obtained at the moment. The coding pattern recognition unit 331 extracts the position coding pattern and sends the position coding pattern to the positioning system establishing unit 332. The positioning system establishing unit 332 determines a position-coding coordinate system on the position information film corresponding to the display area of the display screen based on the four position-coding patterns for positioning. Specifically, one of the four position-coding patterns is taken out as a first position-coding pattern, and a position-coding unit is determined from the first position-coding pattern and taken as a first point; determining a position coding unit which is in the same line with the first point from other three coding patterns according to a coding rule, and taking the position coding unit as a second point, wherein the position coding pattern with the second point is a second position coding pattern; and determining a position coding unit which is in the same column with the first point from the other two coding patterns according to the coding rule, and taking the position coding unit as a third point, wherein the position coding pattern with the third point is a third position coding pattern, determining a position coding unit which is in the same row with the third point in a fourth position coding pattern, and taking the position coding unit which is in the same column with the second point as a fourth point, thereby obtaining four points corresponding to four point contact positions. And establishing the boundary of the positioning area by taking the four points as vertexes, reading all position coding patterns in the positioning area, and determining the coordinates of each position coding unit in the position coding patterns in the positioning area, so that the established position coding coordinate system can enable the position information film to be in one-to-one correspondence with the position of the current display screen. After the position coding coordinate system is established, the layer unit 334 establishes a transparent layer having the same size as the positioning area, and the position coordinate system of the transparent layer is the same as the position coding coordinate system. Because the size and the position of the positioning area are the same as those of the display area of the display screen, the transparent layer can be completely displayed by the display screen, and the positions on the transparent layer correspond to the positions of the display screen one by one. The image generation unit 336 generates one frame image from the generated transparent layer, transmits the generated frame image to the host computer 12 as image data, and displays the image on the display screen. When the writing pen writes on the display screen, the image acquisition module acquires an image of the touch position at a high speed, and correspondingly, the coding pattern recognition unit 331 recognizes a corresponding position coding pattern therefrom and sends it to the position recognition unit 333. The position recognition unit 333 determines a touch position of the position-coding pattern recognized by each position recognition unit 333 on the display screen according to the position-coding coordinate system, thereby obtaining a plurality of touch positions. The point-touch trajectory generating unit 335 maps the multiple point-touch positions to multiple second positions of the transparent layer, where the position coordinate system of the transparent layer is the same as the position-coding coordinate system, and thus the aforementioned point-touch positions are the same as the positions on the transparent layer, and the point-touch trajectory generating unit 335 connects the multiple second positions (or called point-touch positions) in sequence on the transparent layer according to the time of each point-touch position to obtain a point-touch trajectory. When connecting, if there is no user's intervention, the multiple touch positions are connected roughly by a preset color and line. In the process of generating the point contact track in the transparent layer, the image generating unit 336 generates a plurality of frames of point contact track images according to a preset frequency. The communication module 34 transmits the plurality of frames of the point contact trajectory images to the host 12 of the display apparatus 1. The communication module 34 may adopt a bluetooth communication protocol or a near field communication protocol. Since most host systems are integrated with bluetooth communication modules, the writing pen 3 can be paired with the host 12 to establish a communication connection before use. Alternatively, the communication module 34 of the writing pen 3 includes a signal transmitter and a signal receiver. The signal emitter is positioned on a circuit board in the shell 301, and modulates image data to be sent into a wireless carrier signal according to a predetermined protocol to be emitted; the signal receiver includes a data interface, such as a USB interface, which is connected to the host 12 when the writing pen is used. The signal receiver receives the wireless carrier signal sent by the signal transmitter and demodulates and integrates image data from the wireless carrier signal, and the host 12 receives the image data through the data interface. And then the image data is sent to the display screen 11 for display.

In the foregoing embodiment, when the layer unit 334 creates the transparent layer with the same size as the positioning area, a tool area including a plurality of editing tools is generated in the transparent layer. The tool area may be located at the edge of the transparent layer, such as near the four borders. As shown in FIG. 1, the tool area 110 is located below the layer. Editing tools are for example delete, move, copy, change color or change line thickness, save etc. The image generation unit 336 generates a frame image of the transparent layer having the tool area at this time, and transmits the frame image as image data to the host computer 12 by the communication module 34, and displays the image data on the display screen. In this case, the user may perform corresponding deletion, movement, copying, saving, etc. on the written content during the writing process on the screen, and may set the color, thickness, etc. of the line when the point touch trajectory is displayed. When the touch position identified by the position identifying unit 333 corresponds to an editing tool, the touch trajectory generating unit 335 performs a corresponding operation on the touch trajectory on the current transparent layer according to the corresponding editing tool. Since the image generating unit 336 acquires the image of the current layer at a predetermined frequency during the operation of the point-contact trajectory generating unit 335 on the transparent layer, the edited process is also displayed on the display screen 11 in real time.

In this embodiment, a position information film is added to a common display screen, so that the common display screen can be converted into a position sensing display screen, thereby realizing the digitization of screen writing and adding functions to the common display screen. The position information film is made of common materials and is easy to manufacture, and compared with the material and the manufacturing complexity of a position sensing display screen, the position information film greatly reduces the device cost. The position information film is convenient to lay on the display screen, can be laid at any time, can be taken down from the display screen when not in use, and is simple and convenient to operate. The utility model has accurate identification and positioning of the point contact position of the screen, can display writing, painting and operation tracks in real time and has good real-time property.

In the above embodiments, the processing module 34 is located in the writing pen 3, and in other embodiments, the processing module 34 may also be located in the host 12. After acquiring the image of the acquisition area corresponding to the point-touch position, the writing pen 3 synthesizes the image and the corresponding time into transmission data, and sends the transmission data to the host 12 via the communication module. The processing module in the host 12 performs operations such as location system establishment, location identification, and the like. In yet other embodiments, as shown in fig. 10, the book and apparatus includes a writing pen 3 and a display processing apparatus 7. The display processing device 7 is a single device, which includes a wireless module to communicate with the writing pen 3, and performs the function of the processing module 34, and it can communicate with the personal notebook computer 6 through another wireless module, and can also connect with the personal notebook computer 6 through a data interface such as a USB interface, and the generated point touch trajectory image is sent to the personal notebook computer 6 to be displayed on the display screen of the personal notebook computer 6.

FIG. 11 is a flow diagram of a screen writing operation process, according to one embodiment of the utility model. In this embodiment, when a user marks a currently displayed content on a display of a general personal computer using a writing pen, the operation of causing the marked content to be displayed on the display screen includes the steps of:

and step S1, turning on the power supply of the writing pen, and establishing communication connection between the writing pen and the personal computer. The personal computer comprises a host and a display, and the display screen of the display is a common display screen. Of course, the personal computer may also be a unitary device that integrates a host and a display. When the writing pen provides a receiver for wireless communication, the receiver is inserted into a data interface of a computer. And if the writing pen is provided with the Bluetooth module, carrying out Bluetooth pairing on the writing pen and the computer, and establishing wireless communication connection.

Step S2, a piece of position information film is attached to the display screen of the display so as to completely cover the display area of the display screen.

And step S3, touching the four corners of the display area of the display screen with a writing pen to determine the positioning area and establishing a position coding coordinate system of the position information film on the display area of the display screen.

In this step, when the writing pen makes a point touch on the display area of the display screen, the detection module of the writing pen may detect the point touch operation of the writing pen, for example, a pressure sensor in the writing pen senses the pressure, or a proximity sensor in the writing pen senses that the distance between the pen tip and the screen reaches a predetermined distance, and then the point touch operation of the writing pen is determined, and at this time, the image acquisition module in the writing pen acquires an acquisition area image corresponding to the point touch position and corresponding time information through a detection port at the tip end of the writing pen.

Because the position information film is laid on the display screen, the collected image comprises the position coding pattern on the position information film. Since four corners are touched at one time, images of four touched positions are obtained. Because the image acquisition module acquires images according to a certain frequency, each position may obtain a plurality of images, in an optional scheme, the plurality of images are preprocessed to obtain an image serving as an image to be identified, the image is identified to obtain a position coding pattern, or all the images are identified and then analyzed to obtain the position coding pattern corresponding to the point contact position.

After the position coding patterns of the four touch positions are obtained, one position coding unit is determined from the position coding pattern of each touch position to be used as four vertexes of the positioning area. For example, one position-coding unit in the position-coding pattern of the first click-to-touch position is taken as the first point; taking a position coding unit which is in a second point contact position adjacent to the first point contact position and is in the same row with the first point contact position as a second point; taking a position coding unit which is in a third touch position adjacent to the first touch position and is in the same column with the first point as a third point; and taking the position coding units in the fourth point contact position, which are in the same column with the position coding units of the second point and in the same row with the position coding units of the third point, as fourth points.

And establishing the boundary of the positioning area by taking the four points as four vertexes.

And acquiring the position coding patterns in the positioning area, and determining the coordinates of each position coding unit in the position coding patterns in the positioning area.

And obtaining a position code coordinate system on the position information film corresponding to the display area of the display screen through the steps.

And after a position coding coordinate system of the position information film on the display area of the display screen is established, establishing a transparent layer with the same size as the positioning area, wherein the position coordinate system of the transparent layer is the same as the position coding coordinate system. Optionally, a tool area image is generated on the transparent layer, wherein the tool area image includes a plurality of editing tool images, such as icons of deleting, moving, copying, saving, changing color or changing line thickness. And then the transparent layer generates an image and sends the image to a display screen for display.

If the transparent layer does not have the tool area image, the current display screen is not changed for the user, and if the transparent layer has the tool area image, the user can see icons such as delete, move, copy, save, change color or change line thickness on the display screen after finishing the step.

The processing process can be completed by the writing pen, or the writing pen can send the acquired image to the personal computer, and the processing process is completed by a specific processing module in the personal computer.

In step S4, a pen is used to mark the position to be marked, such as circle drawing, underlining, annotation, or deletion, copy, move, and save from the current mark. When the user marks, as the pen moves on the screen, its trajectory is displayed synchronously at the position of its point on the display.

In the step, when a user marks on a screen by using a writing pen, the writing pen collects an acquisition area image corresponding to a point contact position of the writing pen when the writing pen touches the display screen according to a preset frequency and corresponding time; then, identifying a position coding pattern in the image acquired each time from the image of the acquisition area, and determining a touch position of a display screen corresponding to the position coding pattern according to the position coding coordinate system; mapping the point contact position to be a second position (or called a point contact position) of the transparent layer; and connecting a plurality of second positions on the transparent layer in sequence according to the time of each point contact position to obtain a point contact track. In the process of generating the point touch trajectory, a point touch trajectory image is generated according to a predetermined frequency, and the point touch trajectory image is displayed to a corresponding point touch position of the display screen. Visually, as the writing pen moves on the screen, the track of the writing pen is synchronously displayed at the writing position, the position is accurately determined, and the real-time performance is good.

And step S5, after the use, the power supply of the writing pen is closed, and the position information film is taken down. When the power supply of the writing pen is turned off and the communication connection with the host computer is disconnected, the host computer does not display the transparent layer any more, so that all the marks on the display screen disappear visually, and the state before the writing pen is not used is recovered.

The above-mentioned processing procedure can be implemented by writing pen, also can be implemented by specific processing module in the personal computer.

The screen writing system provided by the utility model can meet the requirements of a user on marking, annotating and the like of the display content through the screen. For example, when the user is discussing with others about the currently displayed content, the power of the writing pen 3 is turned on, and a communication connection with the host 12 is established. When a user needs to emphasize and annotate a certain place in the discussion process, marking operations such as circle drawing, underline drawing and the like at corresponding positions on a display screen through the writing pen 3 or writing annotations at proper positions beside the displayed content, all the screen input operations performed by the user can generate corresponding images to be displayed at the original positions of the screen in real time, the original document is not required to be modified, a writing board is not required to be additionally arranged, only one writing pen 3 is required, and the operation is simple and the use is convenient. Moreover, the position information film laid on the display screen not only can provide a position coding pattern for position identification, but also plays a role in protecting the display screen, and reduces the damage of the pen point of the writing pen 3 to the display screen. The pen point can be specially processed, and the damage to the display screen can be further reduced by adopting a softer material to make the pen point. The utility model solves the problem of screen input on the non-position sensing type display, can display writing and painting on the outer surface of the display screen in real time, and has simple and convenient operation and low cost.

The above embodiments are provided only for illustrating the present invention and not for limiting the present invention, and those skilled in the art can make various changes and modifications without departing from the scope of the present invention, and therefore, all equivalent technical solutions should fall within the scope of the present invention.

Claims (8)

1. A screen writing system, comprising:

a display device configured to include a non-position sensing type display screen and a host;

a position information film including a transparent substrate and a position-coding pattern disposed on the substrate; the position information film is movably laid in a display area of the display screen;

the writing device is in wireless communication with the host computer and is configured to establish a position coding coordinate system of the position information film on the display area of the display screen, identify the point touch position of the position information film on the display screen when the position information film touches the display area of the display screen and generate a point touch track image, and send the point touch track image to the host computer so as to display a corresponding point touch track at the point touch position of the display screen;

the substrate of the position information film is a PET film, an ARM film, a PE film, an OCA film, a toughened glass film or transparent paper; the position-coding pattern is coated or engraved on the substrate;

wherein the position-coding pattern on the substrate in the position information film is lower or higher than the substrate, or a part of the coding pattern is higher than the substrate and a part of the coding pattern is lower than the substrate.

2. The screen writing system of claim 1, wherein the writing device comprises a housing, a pen tip, and a detection module, an image acquisition module, a processing module, and a first wireless communication module located within the housing; wherein the content of the first and second substances,

the tail end of the shell is provided with a detection port;

the first end of the pen point is fixed in the shell, and the second end of the pen point extends out of the detection port at the tail end of the shell;

the detection module is configured to output an electrical signal when a writing operation of the pen tip on the display screen is sensed;

the image acquisition module is connected with the detection module and is configured to acquire an acquisition area image corresponding to a point contact position and corresponding time information through the detection port when receiving an electric signal output by the detection module, wherein the image comprises a position coding pattern on a display screen;

the processing module is connected with the image acquisition module and is configured to receive image data acquired by the image acquisition module and establish a position coding coordinate system of the position information film on a display area of the display screen; recognizing a point touch position of a pen point on a display screen, and generating a point touch track image according to corresponding time information;

the first wireless communication module is configured to be connected with the host, and sends the point touch track image to the host so as to display a corresponding point touch track at a point touch position of the display screen.

3. The screen writing system of claim 2, wherein the detection module comprises a pressure sensor or a proximity sensor or a distance sensor.

4. The screen writing system of claim 2, wherein the image capture module comprises:

a lens assembly configured to have a field of view that is compatible with the acquisition region; and

an image sensor optically connected with the lens assembly configured to acquire image data within an acquisition area through the lens assembly.

5. The screen writing system of claim 2, wherein the image capture module comprises:

a first signal transmitter configured to send a probe signal to the acquisition region;

a first signal receiver configured to accept a detection signal reflection signal reflected back from the acquisition region and to generate image data of the acquisition region from the reflection signal; and

an analog-to-digital conversion circuit connected with the signal receiver and configured to convert an analog signal of the image data generated by the first signal receiver into a digital signal.

6. The screen writing system of claim 2, wherein the first wireless communication module comprises:

the second signal emitter is positioned on the circuit board in the shell and modulates the transmission data comprising the point contact track image into a wireless carrier signal according to a preset protocol to be emitted; and

a second signal receiver comprising a data interface for connection with the host; the wireless carrier signal sent by the second signal transmitter is received by the wireless carrier signal receiving device, data are demodulated from the wireless carrier signal, and the data are sent to the host through the data interface.

7. The screen writing system of claim 1, wherein the writing device comprises a separate writing pen and processing device, the writing pen comprising a housing, a tip, and a detection module, an image acquisition module, and a second wireless communication module located within the housing; the processing device comprises a processor, a third wireless communication module and a data interface, wherein,

the tail end of the shell is provided with a detection port;

the first end of the pen point is fixed in the shell, and the second end of the pen point extends out of the detection port at the tail end of the shell;

the detection module is configured to output an electrical signal when a writing operation of the pen tip on the display screen is sensed;

the image acquisition module is connected with the detection module and is configured to acquire an acquisition area image corresponding to a point contact position and corresponding time information through the detection port when receiving an electric signal output by the detection module, wherein the image comprises a position coding pattern on a display screen;

the second wireless communication module sends the image data acquired by the image acquisition module to the processing device;

the processing device receives data sent by a writing pen through a third wireless communication module and sends the data to the processor, and the processor establishes a position coding coordinate system of a position information film on a display area of a display screen by processing the image data; recognizing a point touch position of a pen point on a display screen, and generating a point touch track image according to corresponding time information; and sending the point touch track image to the host through the data interface.

8. The screen writing system of claim 7, wherein the processing device further comprises a fourth wireless communication module to communicate with the host.

Images