System for writing whiteboard on non-touch screen type terminal equipment
Technical Field
The invention relates to the field of digital display, in particular to a system for realizing whiteboard writing on a non-touch screen of terminal equipment by utilizing a webpage with a dot matrix code or a invisible code in the terminal equipment.
Background
The digital pen is a novel input device adopting an ultrasonic tracking and positioning technology, and can write and draw on any computer screen and A4 paper. The pen point can adopt a common ball-point pen core, and can write on paper completely according to natural habits, and writing handwriting is left on a paper surface and a computer simultaneously during writing; meanwhile, an anhydrous plastic pen core can be adopted to directly write and operate a computer on a PC or notebook computer screen, so that a common computer is changed into a handwriting computer.
However, the above all aim at the application of the digital pen on the touch screen, and in the non-touch screen, the industry has not yet formed a more complete solution to the above technical difficulties.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a system for writing a whiteboard on a non-touch screen type terminal device, aiming at the defects of the prior art in the aspect of practical application.
The invention provides a system for writing a whiteboard on non-touch screen type terminal equipment, which comprises a digital pen for carrying out optical identification, storage and data transmission, terminal display equipment comprising a non-touch screen and used for displaying a moving track of the digital pen on a blank display page, and a data receiving and transmitting module and a moving track calculating module which are arranged in the pen, computer equipment or a server, wherein:
a plurality of dot matrix codes or invisible codes are distributed on a blank display page in the terminal display equipment;
the front end of the digital pen is provided with a camera, and a dot matrix identification module is arranged in the digital pen; when the digital pen is powered on and a user operates the digital pen to write on a blank display page, a camera arranged at the front end of the digital pen shoots and transmits a moving area image of the current digital pen on the page to the dot matrix identification module; finally, identifying the dot matrix information of the digital pen moving area on the current display page at different moments by the dot matrix identification module; the dot matrix information is a group of position data formed by a plurality of dot matrix codes;
the lattice identification module transmits the identified lattice information to the data transceiver module in a wireless transmission mode; after receiving the dot matrix information data, the module further outputs the dot matrix information data to a motion track processing module, the motion track is processed into a motion track image of the digital pen through the motion track module, the motion track image is received by the data receiving and sending module and further transmitted back to the terminal display equipment, and real-time display is carried out on a blank display page.
Furthermore, a central control module and a control switch connected with the central control module are arranged in the digital pen.
Furthermore, a pressure sensor is arranged at one end, in contact with the screen, of the digital pen, the central control module is connected to the pressure sensor, when a user operates the digital pen to press the screen, pressure data generated by the user is measured through the pressure sensor and transmitted to the central control module, the central control module controls and starts the control switch, the digital pen enters a working mode at present, and the camera is adjusted to shoot a moving area of the digital pen on a current page.
Furthermore, an infrared distance sensor is arranged at one end, in the digital pen, in contact with the screen, the central control module is connected to the infrared distance sensor, when a user operates the digital pen on the screen or in front of the screen and at a position with a certain distance from the screen, and operates the data pen to write on the screen, the central control module controls and controls the switch via the central control module after the focusing distance between the current camera and the screen is measured and transmitted to the central control module by the infrared distance sensor, and the received focusing distance value is compared with a preset distance threshold value in the central control module, so that the working mode of the camera is further controlled.
Furthermore, in the motion trail processing module, the recognized dot matrix information is analyzed into screen coordinate positions of pen points at different times, and the motion trail of the digital pen at the current time is further calculated by combining each independent coordinate position.
Further, after the motion trail of the digital pen is processed into corresponding picture data by utilizing an image processing technology, the picture data is transmitted back to the terminal display equipment through the data transceiving module and displayed on a blank display page.
Furthermore, a control software is run in the terminal display device, and the control software comprises a data processing module for receiving, storing and processing received data and a visualization module for displaying the moving effect of the digital pen; the moving track image of the digital pen which is transmitted back to the terminal display equipment by the data transceiving module is received, processed and stored by the data processing module, and then is further transmitted to the visualization module to be displayed on a blank display page in real time.
Further, the control software further comprises a message reminding module, which is used for transmitting a blank image to the data processing module when the moving range of the digital pen exceeds the display screen of the terminal display device, wherein the data processing module triggers the message reminding module to display prompt information on the screen to remind a user that the moving range of the digital pen exceeds the screen.
Furthermore, the front end of the digital pen is also provided with an optical sensor, the optical sensor is used for sensing the brightness of the current screen and transmitting the brightness value to the motion trail module through the data transceiver module, and the motion trail module is used for adjusting the brightness value of the digital pen moving trail image according to the received brightness value of the current screen.
Furthermore, a withdrawal control switch is arranged on the digital pen and connected to a central control module arranged in the digital pen; the other end of the central control module is connected to the dot matrix identification module;
when a user triggers a withdrawal control switch for n times continuously, a withdrawal signal generated in the current control process is transmitted to the central control module, and the central control module drives the dot matrix identification module to delete the dot matrix information of the digital pen moving area at the first n multiplied by k moments according to the received withdrawal signal, so that the function of withdrawing the moving track on the display screen is realized; where n is greater than 0 and k is the time required for pullback by a single trigger to the pullback control switch.
The system for writing the whiteboard on the non-touch screen type terminal equipment has the following beneficial effects:
1. after the user uses the whiteboard, the common liquid crystal display in the office can be upgraded to the touch display. After the whiteboard is opened in a computer connected with the display, the digital pen is held by hands, the digital pen can be used for writing pictures on the whiteboard displayed in the screen, and corresponding writing handwriting can be correspondingly displayed in the screen.
2. The touch control method has the advantages that the touch control capability of the display is achieved with low cost, the touch control method is different from other schemes, the hidden codes which are not easy to perceive (do not influence normal image display) by naked eyes are displayed on a screen, the hidden codes are collected, identified and calculated through a camera, and the touch control method is achieved through calculation and restoration, and is low in cost, low in requirement on hardware, wide in application range and good in commercial application prospect.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
fig. 1 is a structural diagram of a whiteboard writing system according to embodiment 1 of the present invention;
fig. 2 is a schematic structural diagram of a digital pen according to embodiment 2 of the present invention;
fig. 3 is another schematic structural diagram of a digital pen according to embodiment 3 of the present invention;
fig. 4 is another structural schematic diagram of the digital pen according to embodiment 4 of the present invention;
fig. 5 is another schematic structural diagram of a digital pen according to embodiment 5 of the present invention;
fig. 6 is a schematic structural diagram of a terminal display device according to embodiment 6 of the present invention;
fig. 7 is a schematic structural diagram of another terminal display device proposed in embodiment 7 of the present invention.
Detailed Description
For a more clear understanding of the technical features, objects and effects of the present invention, embodiments of the present invention will now be described in detail with reference to the accompanying drawings.
Example 1:
referring to fig. 1, which is a structural diagram of a whiteboard writing system according to embodiment 1 of the present invention, in this embodiment, the whiteboard writing system includes a digital pen for performing optical identification, storing and transmitting data, a terminal display device including a non-touch screen and configured to display a movement track of the digital pen on a blank display page, and a data transceiver module and a movement track calculation module (which may be specifically set according to an actual application scenario) disposed in the pen, the computer device, or the server, wherein:
in this embodiment, the terminal display device is an LED large screen, a plurality of dot matrix codes or invisible codes are distributed on a blank display page in the LED large screen, and a moving coordinate of the digital pen in the page is identified by the dot matrix codes or the invisible codes;
the front end of the digital pen is provided with a camera, and a dot matrix identification module is arranged in the digital pen; when the digital pen is powered on and a user operates the digital pen to write on a blank display page, a camera arranged at the front end of the digital pen shoots and transmits a moving area image of the current digital pen on the page to the dot matrix identification module; finally, identifying the dot matrix information of the digital pen moving area on the current display page at different moments by the dot matrix identification module; the dot matrix information is a group of position data formed by a plurality of dot matrix codes;
in this embodiment, the data calculated by the dot matrix identification module is transmitted to the data transceiver module in a wireless transmission manner; after receiving the dot matrix information data, the data transceiver module further outputs the dot matrix information data to the motion track processing module, the motion track processing module processes the dot matrix information data into a moving track image of the digital pen, the moving track image is received by the data transceiver module and further transmitted back to the terminal display equipment, and the moving track image is displayed on a blank display page in real time; wherein:
in the motion trail processing module, analyzing the recognized dot matrix information into screen coordinate positions of pen points at different times, and further calculating the motion trail of the digital pen at the current time by combining each independent coordinate position; meanwhile, the motion trail of the digital pen is processed into corresponding picture data by utilizing an image processing technology.
Example 2:
please refer to fig. 2, which is a schematic structural diagram of a digital pen according to embodiment 2 of the present invention, wherein a central control module and a control switch connected to the central control module are disposed in the digital pen;
in the embodiment, a pressure sensor is arranged in a pen point of the digital pen, and the central control module is connected to the pressure sensor; when a user operates the digital pen to press the screen, pressure data generated when the user presses the screen is measured through the pressure sensor and transmitted to the central control module, the central control module controls and starts the control switch, the current digital pen enters a working mode, and the camera is called to shoot a moving area of the digital pen on the current page; the effect that the moving track of the current digital pen is displayed on the screen when the user operates the digital pen to write on the screen is achieved.
Example 3:
referring to fig. 3, it is another schematic structural diagram of the digital pen provided in embodiment 3, in this embodiment, considering that the digital pen implements an application scenario of writing on a non-touch display screen in a contact mode or a non-contact mode, specifically, an infrared distance sensor is fixed in a pen tip of the digital pen, the central control module is connected to the infrared distance sensor, and after a focusing distance between a current camera and a screen is measured and transmitted to the central control module by the infrared distance sensor, a received focusing distance value is compared with a preset distance threshold in the central control module, where when the measured focusing distance is greater than the distance threshold, the central control module controls and turns off a control switch, and at this time, the digital pen enters a non-working mode; under other conditions, the central control module controls and starts a control switch, the current digital pen enters a working mode, and the camera is transferred to shoot a moving area of the digital pen on the current page; wherein the focusing distance value and a preset distance threshold value are both greater than or equal to 0;
under the action of the infrared distance sensor, the effect that the current digital pen moving track is displayed on the screen when a user operates the digital pen to write on the screen or the digital pen is separated from the screen by a certain focusing distance is achieved.
Example 4:
referring to fig. 4, another schematic structural diagram of a digital pen according to embodiment 4 of the present invention is shown, in this embodiment, an application scenario for automatically adjusting the brightness of a displayed picture under the condition of dark screen luminosity is considered, specifically, an optical sensor is fixed in a pen tip of the digital pen, the brightness of a current screen is sensed by the optical sensor, and is transmitted to a motion trajectory module through a data transceiver module, and the motion trajectory module adjusts the brightness value of a moving trajectory image of the digital pen according to the received current screen brightness value, where the specific adjustment scheme is as follows: if the current screen brightness value is smaller than the preset brightness value, the brightness of the digital pen moving track image is adjusted to be bright, so that a user can effectively observe the image displayed on the screen under the condition that the screen brightness is small; in other cases, the brightness of the digital pen moving track image is not adjusted or reduced according to the actual user requirements.
Example 5:
please refer to fig. 5, which is another schematic structural diagram of a digital pen according to embodiment 5 of the present invention, in this embodiment, an application scenario that a user needs to erase written content within a past period of time, that is, to cancel the written content, is considered, specifically, a cancel control switch is disposed at a position on the digital pen convenient for the user to operate by hand, and the cancel control switch is connected to a central control module; the other end of the central control module is connected to the dot matrix identification module;
when a user triggers a withdrawal control switch for n times continuously, a withdrawal signal generated in the current control process is transmitted to a central control module, and the central control module drives a dot matrix identification module to delete dot matrix information of a digital pen moving area under the previous n multiplied by k moments according to the received withdrawal signal, so that the function of withdrawing the moving track on a display screen is realized; wherein n is greater than 0, and k is the revocation time triggered by clicking the revocation switch once.
Example 6:
please refer to fig. 6, which is a schematic structural diagram of a terminal display device according to embodiment 6 of the present invention, where a control software is run in the terminal display device, and the control software includes a data processing module for receiving, storing, and processing received data, and a visualization module for displaying a moving effect of a digital pen; the moving track image of the digital pen which is transmitted back to the terminal display equipment by the data transceiving module is received, processed and stored by the data processing module, and then is further transmitted to the visualization module to be displayed on a blank display page in real time.
Example 7:
please refer to fig. 7, which is another schematic structural diagram of the terminal display device according to embodiment 7 of the present invention, where the control software further includes a message reminding module, which is configured to transmit a blank image to the data processing module when the moving range of the digital pen is inserted into the display screen of the terminal display device, and the data processing module triggers the message reminding module to display prompt information such as "moving area exceeds screen" on the screen to remind the user that the moving range of the digital pen exceeds the screen;
in other application scenarios, when the digital pen moves at a high speed and the current moving track image of the digital pen cannot be restored through the moving track module, the data processing module triggers the message reminding module to display alarm information on the screen to remind a user that the current moving track of the digital pen cannot be displayed on the screen.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.