CN111314628A - Method and device for converting infrared track into video stream, electronic whiteboard and storage medium - Google Patents
Method and device for converting infrared track into video stream, electronic whiteboard and storage medium Download PDFInfo
- Publication number
- CN111314628A CN111314628A CN202010189266.0A CN202010189266A CN111314628A CN 111314628 A CN111314628 A CN 111314628A CN 202010189266 A CN202010189266 A CN 202010189266A CN 111314628 A CN111314628 A CN 111314628A
- Authority
- CN
- China
- Prior art keywords
- track
- infrared
- picture
- canvas
- video stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000009471 action Effects 0.000 claims abstract description 20
- 230000015654 memory Effects 0.000 claims description 25
- 238000001514 detection method Methods 0.000 claims description 10
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000005538 encapsulation Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
- H04N21/8153—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
The invention discloses a method and a device for converting an infrared track into a video stream, an electronic whiteboard and a storage medium. The method comprises the following steps: acquiring track instruction data; analyzing the track instruction data to obtain the contact action and the size of a writing frame; generating a corresponding track on the canvas according to the contact action, wherein the canvas and the writing box are generated in a corresponding proportion; and converting the canvas with the track into pictures and then coding to obtain the video stream. By implementing the invention, the track data is stored in the canvas, the track data stored in the canvas is converted into the picture for coding, the written video can be obtained without other camera equipment, and the technical problem that the screen can not be collected for sharing when the software connected with the electronic whiteboard is minimized in the prior art is solved. Meanwhile, a plurality of coordinate data are analyzed from the infrared tracks, and the data of each frame are stored and coded by taking 'page' as a unit, so that the data volume needing to be processed is reduced, and the coding delay is further reduced.
Description
Technical Field
The invention relates to the technical field of electronic whiteboards, in particular to a method and a device for converting an infrared track into a video stream, an electronic whiteboard and a storage medium.
Background
The electronic whiteboard is used as a paperless office and teaching tool, can be in information communication with a computer, is connected to a PC (personal computer), and projects the content on the PC to a screen of the electronic whiteboard by using a projector, so that the electronic whiteboard is equivalent to a handwriting board with a large area and can be used for writing and drawing at will. At present, electronic whiteboards can be classified into various types according to their technical principles. Among them, the infrared electronic whiteboard has become the first choice of touch technology under various severe application environment requirements by virtue of various characteristics of light resistance, dust resistance, water resistance and the like.
The infrared electronic whiteboard has the working principle that infrared rays between a whiteboard transmitting tube and a receiving tube form an infrared ray optical network, the infrared ray optical network covers the surface of the whiteboard, any opaque object can block the infrared rays from the surface of the whiteboard when contacting the surface of the whiteboard, so that the received signals are not received or the signals are weakened, and the touched position can be judged by calculating the strength of the signals and the position of an infrared device. When the infrared frame sharing device is used, the infrared frame can be connected with a computer through the usb, the computer runs software to communicate data information and control instructions with the infrared frame, the position where touch positioning is conducted, namely a writing track, is displayed on the software, a video file is recorded by collecting a computer screen through the camera of other equipment and the like, and the video file is captured or converted into a video stream to be live broadcast, so that the sharing purpose is achieved.
However, when operating other software on the computer, such as PPT and other files, the software connected to the infrared frame on the computer needs to be minimized, and at this time, the computer screen cannot be collected for sharing. How to convert the written content into a video stream for live broadcasting or storing without the help of other shooting equipment is a problem to be solved urgently by the electronic whiteboard at present.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method and an apparatus for converting an infrared track into a video stream, an electronic whiteboard, and a storage medium, so as to solve the technical problem in the prior art that a screen cannot be acquired for sharing when software connected to the electronic whiteboard is minimized.
The technical scheme provided by the invention is as follows:
the first aspect of the embodiments of the present invention provides a method for converting an infrared trajectory into a video stream, where the method includes: acquiring track instruction data, wherein the track instruction data comprises: the width of the writing frame, the height of the writing frame and the writing contact track; analyzing the track instruction data to obtain contact action and writing frame size; generating a corresponding track on a canvas according to the contact action, wherein the canvas and the writing box are generated in a corresponding proportion of size; and converting the canvas with the track into pictures and then coding to obtain the video stream.
Further, the canvas is generated in proportion to the writing box in size, and comprises the following steps: converting the writing box size into corresponding pixel coordinates; and generating the canvas with the corresponding proportion according to the pixel coordinates.
Further, the canvas with the track is converted into a picture and then encoded to obtain a video stream, and the method comprises the following steps: sequentially converting the canvas with the track into a plurality of pictures according to the frame number of the track instruction data; and sequentially inputting the plurality of pictures into an encoder to obtain a video stream.
Further, sequentially inputting a plurality of pictures into the encoder to obtain a video stream, including: inputting the converted first picture into an encoder; merging and overlapping the converted second picture and the first picture, and inputting the merged and overlapped second picture and the first picture into an encoder; merging and overlapping the converted third picture, the second picture and the first picture, and inputting the merged and overlapped third picture, the second picture and the first picture into an encoder; in the same way, each converted picture and the previous picture are merged and superposed and then input into an encoder; and coding according to the pictures input into the coder to obtain the video stream.
A second aspect of the embodiments of the present invention provides a device for converting an infrared trajectory into a video stream, where the device includes: the data acquisition module is used for acquiring track instruction data, wherein the track instruction data comprises: the width of the writing frame, the height of the writing frame and the writing contact track; the analysis module is used for analyzing the track instruction data to obtain the contact action and the size of the writing frame; the track generation module is used for generating a corresponding track on a canvas according to the contact action, wherein the canvas and the writing box are generated in a corresponding proportion of size; and the coding module is used for coding after converting the canvas with the track into the picture to obtain the video stream.
A third aspect of the embodiments of the present invention provides an electronic whiteboard, including: the infrared frame detection module and the microprocessor; the microprocessor acquires the trajectory instruction data generated by the infrared frame detection module, and generates a video stream according to the method for converting the infrared trajectory into the video stream according to any one of the first aspect and the first aspect of the embodiments of the present invention.
Further, the infrared frame detection module includes: the infrared frame comprises an infrared transmitting array and an infrared receiving array; and the electronic processing unit acquires the track data in the infrared frame, packages the track data, generates track instruction data and inputs the track instruction data to the microprocessor.
A fourth aspect of the embodiments of the present invention provides a computer-readable storage medium, where computer instructions are stored, and the computer instructions are configured to cause the computer to execute the method for converting an infrared track into a video stream according to any one of the first aspect and the first aspect of the embodiments of the present invention.
A fifth aspect of an embodiment of the present invention provides an electronic device, including: the device comprises a memory and a processor, wherein the memory and the processor are communicatively connected with each other, the memory stores computer instructions, and the processor executes the computer instructions to execute the method for converting infrared track into video stream according to the first aspect of the embodiments of the present invention.
The technical scheme provided by the invention has the following effects:
according to the method and device for converting the infrared track into the video stream, the electronic whiteboard and the storage medium, the track data are stored in the canvas, the track data stored in the canvas are converted into the pictures for coding, the written video can be obtained without other camera equipment, and the technical problem that the screen cannot be collected for sharing when software connected with the electronic whiteboard is minimized in the prior art is solved. Meanwhile, the method for converting the infrared track into the video stream provided by the embodiment of the invention analyzes the infrared track subjected to protocol encapsulation to divide a plurality of coordinate data, and stores and encodes each frame of data by taking 'page' as a unit, so that each page of data can be traced back, the data amount required to be processed is reduced, the encoding delay is reduced, and the shielding of application operation during sharing is not influenced.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flow chart of a method of infrared track-to-video streaming according to an embodiment of the invention;
FIG. 2 is a block diagram of an apparatus for infrared track-to-video streaming according to an embodiment of the present invention;
fig. 3 is a block diagram of an electronic whiteboard configuration according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of an infrared frame detection module according to an embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a computer-readable storage medium provided according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a method for converting an infrared track into a video stream, which comprises the following steps as shown in figure 1:
step S101: acquiring track instruction data, wherein the track instruction data comprises: the width of the writing box, the height of the writing box and the trace of the writing contact.
In one embodiment, when a user writes on the infrared electronic whiteboard, corresponding writing data can be acquired through an infrared frame of the infrared electronic whiteboard. The writing data may include the size of the writing box being written, such as the width of the writing box, the height of the writing box, etc.; writing contact tracks may also be included, such as contact id, contact x-axis coordinate "x", contact y-axis coordinate "y", contact width "w", contact height "h", contact depth "d", which may range from 0-100, with smaller values indicating deeper contacts; the contact motion "s" can be represented by numbers 0, 1, 2, etc., where 0 represents Touch Up, 1 represents Touch Down, and 2 represents Touch Move. For writing a contact trace, a plurality of data sets can be formed into an array for storage. Meanwhile, the writing data including the size of the writing frame, the writing contact track and the like can be packaged according to a preset protocol to form track instruction data.
In an embodiment, the track instruction data may also be obtained from other apparatuses capable of performing touch writing, such as other devices with an infrared border, and the source of the track instruction data is not limited in the present invention. In addition, when acquiring the trajectory instruction data, the data may be acquired according to a preset time, for example, once every ten seconds, or according to other time intervals, or may be acquired uninterruptedly, which is not limited in the present invention.
Step S102: and analyzing the track instruction data to obtain the contact action and the size of the writing frame. Specifically, the acquired trajectory instruction data may be analyzed according to a preset protocol to obtain a corresponding touch point and a touch point action during writing, such as a start point coordinate and an end point coordinate. Meanwhile, the size of the writing frame corresponding to writing can be obtained.
Step S103: and generating a corresponding track on the canvas according to the contact action, wherein the canvas is generated in a proportion corresponding to the size of the writing box.
In one embodiment, the physical dimensions coordinates of the writing box may be first converted to corresponding display pixel coordinates, e.g., 1 meter ＊ 1.5.5 meters for the writing box and 1024 × 768 for the pixel resolution of the device used to generate the canvas, the dimensions of the writing box may be converted in the corresponding proportions such that the writing box coordinates and pixel coordinates correspond, and then a canvas panel corresponding to the writing box size proportions may be generated and saved at the device.
In an embodiment, a corresponding trace may be generated on the canvas according to the contact action. Specifically, the corresponding coordinates of the starting point can be written on the generated canvas according to the ratio of the writing box to the canvas according to the analyzed contact actions, a stroke is generated according to each contact obtained through analysis, and finally the coordinates of the ending point are completed, so that the original writing track is obtained.
Step S104: and converting the canvas with the track into pictures and then coding to obtain the video stream. Specifically, when the user is writing, a plurality of trajectory instruction data may be obtained. For received data, a corresponding track generated on a canvas can be analyzed and converted into a plurality of pictures; and then, the plurality of pictures can be sequentially input into an encoder according to the generated sequence to be encoded, so that the corresponding written video is obtained.
In one embodiment, the first picture of the transform may be first input to the encoder; for the second converted picture, the second converted picture and the first picture can be merged and overlapped and then input into an encoder; the converted third picture can be merged and superposed with the second picture and the first picture and then input into an encoder; in the same way, each converted picture and the previous picture are merged and superposed and then input into an encoder; and finally, coding is carried out according to the pictures input into the coder, so as to obtain the video stream. By encoding each frame of data by merging and overlapping, each page can be separated, and each canvas can operate similarly to the content of each ppt page. And the merging re-entering coding can reduce the data volume and the coding delay.
According to the method for converting the infrared track into the video stream, provided by the embodiment of the invention, the track data is stored in the canvas, and the track data stored in the canvas is converted into the picture for coding, so that the written video can be obtained without other camera equipment, and the technical problem that the screen cannot be acquired for sharing when software connected with the electronic whiteboard is minimized in the prior art is solved. Meanwhile, the method for converting the infrared track into the video stream provided by the embodiment of the invention analyzes the infrared track subjected to protocol encapsulation into a plurality of coordinate data, and stores and encodes each frame of data by taking 'page' as a unit, so that each page of data can be traced back, the data amount required to be processed is reduced, the encoding delay is reduced, and the shielding of application operation during sharing is not influenced.
An embodiment of the present invention further provides a device for converting an infrared trajectory into a video stream, as shown in fig. 2, the device includes:
the data acquisition module 1 is used for acquiring track instruction data; wherein the trajectory instruction data includes: the width of the writing box, the height of the writing box and the trace of the writing contact.
In one embodiment, when a user writes on the infrared electronic whiteboard, corresponding writing data can be acquired through an infrared frame of the infrared electronic whiteboard. The writing data may include the size of the writing box being written, such as the width of the writing box, the height of the writing box, etc.; writing contact tracks may also be included, such as contact id, contact x-axis coordinate "x", contact y-axis coordinate "y", contact width "w", contact height "h", contact depth "d", which may range from 0-100, with smaller values indicating deeper contacts; the contact motion "s" can be represented by numbers 0, 1, 2, etc., where 0 represents Touch Up, 1 represents Touch Down, and 2 represents Touch Move. For writing a contact trace, a plurality of data sets can be formed into an array for storage. Meanwhile, the writing data including the size of the writing frame, the writing contact track and the like can be packaged according to a preset protocol to form track instruction data.
In an embodiment, the track instruction data may also be obtained from other apparatuses capable of performing touch writing, such as other devices with an infrared border, and the source of the track instruction data is not limited in the present invention. In addition, when acquiring the trajectory instruction data, the data may be acquired according to a preset time, for example, once every ten seconds, or according to other time intervals, or may be acquired uninterruptedly, which is not limited in the present invention.
The analysis module 2 is used for analyzing the track instruction data to obtain the contact action and the size of the writing frame; specifically, the acquired trajectory instruction data may be analyzed according to a preset protocol to obtain a corresponding touch point and a touch point action during writing, such as a start point coordinate and an end point coordinate. Meanwhile, the size of the writing frame corresponding to writing can be obtained.
And the track generation module 3 is used for generating a corresponding track on the canvas according to the contact action, wherein the canvas and the writing box are generated in a corresponding proportion.
In one embodiment, the physical dimensions coordinates of the writing box may be first converted to corresponding display pixel coordinates, e.g., 1 meter ＊ 1.5.5 meters for the writing box and 1024 × 768 for the pixel resolution of the device used to generate the canvas, the dimensions of the writing box may be converted in the corresponding proportions such that the writing box coordinates and pixel coordinates correspond, and then a canvas panel corresponding to the writing box size proportions may be generated and saved at the device.
In an embodiment, a corresponding trace may be generated on the canvas according to the contact action. Specifically, the corresponding coordinates of the starting point can be written on the generated canvas according to the ratio of the writing box to the canvas according to the analyzed contact actions, a stroke is generated according to each contact obtained through analysis, and finally the coordinates of the ending point are completed, so that the original writing track is obtained.
And the coding module 4 is used for coding the picture after converting the canvas with the track into the picture to obtain the video stream. Specifically, when the user is writing, a plurality of trajectory instruction data may be obtained. For received data, a corresponding track generated on a canvas can be analyzed and converted into a plurality of pictures; and then, the plurality of pictures can be sequentially input into an encoder according to the generated sequence to be encoded, so that the corresponding written video is obtained.
In one embodiment, the first picture of the transform may be first input to the encoder; for the second converted picture, the second converted picture and the first picture can be merged and overlapped and then input into an encoder; the converted third picture can be merged and superposed with the second picture and the first picture and then input into an encoder; in the same way, each converted picture and the previous picture are merged and superposed and then input into an encoder; and finally, coding is carried out according to the pictures input into the coder, so as to obtain the video stream. By encoding each frame of data by merging and overlapping, each page can be separated, and each canvas can operate similarly to the content of each ppt page. And the merging re-entering coding can reduce the data volume and the coding delay.
For a detailed description of the functions of the apparatus for converting an infrared trajectory into a video stream according to the embodiment of the present invention, reference is made to the description of the method for converting an infrared trajectory into a video stream in the above embodiment.
According to the device for converting the infrared track into the video stream, provided by the embodiment of the invention, the track data is stored in the canvas, and the track data stored in the canvas is converted into the picture for coding, so that the written video can be obtained without other camera equipment, and the technical problem that the screen cannot be acquired for sharing when software connected with the electronic whiteboard is minimized in the prior art is solved. Meanwhile, the device for converting the infrared track into the video stream provided by the embodiment of the invention analyzes the infrared track subjected to protocol encapsulation into a plurality of coordinate data, and stores and encodes each frame of data by taking 'page' as a unit, so that each page of data can be traced back, the data amount required to be processed is reduced, the encoding delay is reduced, and the shielding of application operation during sharing is not influenced.
An embodiment of the present invention further provides an electronic whiteboard, as shown in fig. 3, the electronic whiteboard includes: an infrared frame detection module 10 and a microprocessor 20; the microprocessor 20 obtains the trajectory instruction data generated by the infrared frame detection module 10, and generates a video stream according to the method for converting the infrared trajectory into the video stream described in the above embodiment.
In an embodiment, as shown in fig. 4, the infrared frame detection module 10 includes: the infrared frame 11 comprises an infrared emitting array 12 and an infrared receiving array 13; the electronic processing unit 21 obtains the trajectory data in the infrared frame 11, packages the trajectory data, generates trajectory instruction data, and inputs the trajectory instruction data to the microprocessor 20. The electronic processing unit 21 may analyze the coordinates of the touch point, package the analyzed corresponding data according to a preset protocol to generate trajectory instruction data, and input the trajectory instruction data to the microprocessor 20 for processing.
According to the electronic whiteboard provided by the embodiment of the invention, the track data is stored in the canvas, and the track data stored in the canvas is converted into the picture for coding, so that the written video can be obtained without other camera equipment, and the technical problem that the screen cannot be acquired for sharing when the software connected with the electronic whiteboard is minimized in the prior art is solved. Meanwhile, according to the electronic whiteboard provided by the embodiment of the invention, the infrared track subjected to protocol encapsulation is analyzed to obtain a plurality of coordinate data, and the data of each frame is stored and encoded by taking 'page' as a unit, so that each page of data can be traced back, the data amount required to be processed is reduced, the encoding delay is reduced, and the shielding of application operation during sharing is not influenced.
The function description of the electronic whiteboard provided by the embodiment of the invention refers to the description of the method for converting the infrared track into the video stream in the above embodiment in detail.
An embodiment of the present invention further provides a storage medium, as shown in fig. 5, on which a computer program 601 is stored, where the instructions are executed by a processor to implement the steps of the method for converting an infrared track into a video stream in the foregoing embodiment. The storage medium is also stored with audio and video stream data, characteristic frame data, an interactive request signaling, encrypted data, preset data size and the like. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
An embodiment of the present invention further provides an electronic device, as shown in fig. 6, the electronic device may include a processor 51 and a memory 52, where the processor 51 and the memory 52 may be connected by a bus or in another manner, and fig. 6 takes the connection by the bus as an example.
The processor 51 may be a Central Processing Unit (CPU). The Processor 51 may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, or combinations thereof.
The memory 52, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as the corresponding program instructions/modules in the embodiments of the present invention. The processor 51 executes various functional applications and data processing of the processor by running non-transitory software programs, instructions and modules stored in the memory 52, namely, the method for converting infrared traces into video streams in the above method embodiments is implemented.
The memory 52 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor 51, and the like. Further, the memory 52 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 52 may optionally include memory located remotely from the processor 51, and these remote memories may be connected to the processor 51 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more modules are stored in the memory 52 and when executed by the processor 51, perform the method of infrared track-to-video streaming as in the embodiment of fig. 1.
The details of the electronic device may be understood with reference to the corresponding related description and effects in the embodiment shown in fig. 1, and are not described herein again.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.
Claims (9)
1. A method for converting an infrared track into a video stream is characterized by comprising the following steps:
acquiring track instruction data, wherein the track instruction data comprises: the width of the writing frame, the height of the writing frame and the writing contact track;
analyzing the track instruction data to obtain contact action and writing frame size;
generating a corresponding track on a canvas according to the contact action, wherein the canvas and the writing box are generated in a corresponding proportion of size;
and converting the canvas with the track into pictures and then coding to obtain the video stream.
2. The method for converting an infrared track into a video stream according to claim 1, wherein the canvas is generated in proportion to the size of the writing box, and comprises the following steps:
converting the writing box size into corresponding pixel coordinates;
and generating the canvas with the corresponding proportion according to the pixel coordinates.
3. The method for converting the infrared track into the video stream according to claim 1, wherein the canvas with the track is converted into the picture and then encoded to obtain the video stream, comprising:
sequentially converting the canvas with the track into a plurality of pictures according to the frame number of the track instruction data;
and sequentially inputting the plurality of pictures into an encoder to obtain a video stream.
4. The method of claim 3, wherein inputting a plurality of pictures into the encoder in sequence to obtain the video stream comprises:
inputting the converted first picture into an encoder;
merging and overlapping the converted second picture and the first picture, and inputting the merged and overlapped second picture and the first picture into an encoder;
merging and overlapping the converted third picture, the second picture and the first picture, and inputting the merged and overlapped third picture, the second picture and the first picture into an encoder;
in the same way, each converted picture and the previous picture are merged and superposed and then input into an encoder;
and coding according to the pictures input into the coder to obtain the video stream.
5. An apparatus for converting infrared track into video stream, comprising:
the data acquisition module is used for acquiring track instruction data, wherein the track instruction data comprises: the width of the writing frame, the height of the writing frame and the writing contact track;
the analysis module is used for analyzing the track instruction data to obtain the contact action and the size of the writing frame;
the track generation module is used for generating a corresponding track on a canvas according to the contact action, wherein the canvas and the writing box are generated in a corresponding proportion of size;
and the coding module is used for coding after converting the canvas with the track into the picture to obtain the video stream.
6. An electronic whiteboard, comprising: the infrared frame detection module and the microprocessor;
the microprocessor acquires track instruction data generated by the infrared frame detection module, and generates a video stream according to the method for converting the infrared track into the video stream as claimed in any one of claims 1 to 4.
7. The electronic whiteboard of claim 6, wherein the infrared frame detection module comprises: an infrared frame and an electronic processing unit,
the infrared frame comprises an infrared transmitting array and an infrared receiving array;
and the electronic processing unit acquires the track data in the infrared frame, packages the track data, generates track instruction data and inputs the track instruction data to the microprocessor.
8. A computer-readable storage medium having stored thereon computer instructions for causing a computer to perform the method of infrared track-to-video streaming according to any of claims 1-4.
9. An electronic device, comprising: a memory and a processor, the memory and the processor being communicatively coupled, the memory storing computer instructions, the processor executing the computer instructions to perform the method of infrared track-to-video streaming according to any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010189266.0A CN111314628A (en) | 2020-03-17 | 2020-03-17 | Method and device for converting infrared track into video stream, electronic whiteboard and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010189266.0A CN111314628A (en) | 2020-03-17 | 2020-03-17 | Method and device for converting infrared track into video stream, electronic whiteboard and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111314628A true CN111314628A (en) | 2020-06-19 |
Family
ID=71158773
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010189266.0A Pending CN111314628A (en) | 2020-03-17 | 2020-03-17 | Method and device for converting infrared track into video stream, electronic whiteboard and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111314628A (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1556498A (en) * | 2004-01-06 | 2004-12-22 | 东华大学 | Non identification type hand wrighting input method and its device |
| CN102436330A (en) * | 2011-12-22 | 2012-05-02 | 广东威创视讯科技股份有限公司 | Embedded type electronic whiteboard and realizing method thereof |
| CN103677268A (en) * | 2013-12-12 | 2014-03-26 | 无锡格林波特科技有限公司 | Multimedia presentation system with handwriting function |
| CN104331192A (en) * | 2014-10-20 | 2015-02-04 | 深圳市天时通科技有限公司 | Display method for electronic whiteboard |
| CN104408978A (en) * | 2014-12-11 | 2015-03-11 | 北京轩文文化发展有限公司 | Optical-principle-based calligraphy presentation system |
| CN108549879A (en) * | 2018-04-28 | 2018-09-18 | 北京奇禄管理咨询有限公司 | A kind of processing method of dot matrix image |
| CN108564639A (en) * | 2018-04-27 | 2018-09-21 | 广州视源电子科技股份有限公司 | Person's handwriting store method, device, intelligent interaction device and readable storage medium storing program for executing |
| CN108763320A (en) * | 2018-04-28 | 2018-11-06 | 广东蜂助手网络技术股份有限公司 | A kind of writing note data storage method, device, terminal and storage medium |
| CN208197930U (en) * | 2018-02-02 | 2018-12-07 | 姚苏栩 | The blackboard of recordable handwriting information |
| CN109032390A (en) * | 2018-08-01 | 2018-12-18 | 广州视源电子科技股份有限公司 | Handwriting data caching method, device, equipment and storage medium |
| CN109050091A (en) * | 2018-07-25 | 2018-12-21 | 成都瑞德利科技有限公司 | A kind of multimedia clipboard and its display methods |
| CN110096209A (en) * | 2019-04-01 | 2019-08-06 | 北京新界教育科技有限公司 | Handwriting trace display methods and device |
| CN110298777A (en) * | 2019-07-24 | 2019-10-01 | 深圳市华熠致源科技有限公司 | The generation system and method for classroom video |
| CN110798638A (en) * | 2019-10-30 | 2020-02-14 | 深圳市闪联信息技术有限公司 | Electronic whiteboard and picture storage and backtracking method based on time axis |
-
2020
- 2020-03-17 CN CN202010189266.0A patent/CN111314628A/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1556498A (en) * | 2004-01-06 | 2004-12-22 | 东华大学 | Non identification type hand wrighting input method and its device |
| CN102436330A (en) * | 2011-12-22 | 2012-05-02 | 广东威创视讯科技股份有限公司 | Embedded type electronic whiteboard and realizing method thereof |
| CN103677268A (en) * | 2013-12-12 | 2014-03-26 | 无锡格林波特科技有限公司 | Multimedia presentation system with handwriting function |
| CN104331192A (en) * | 2014-10-20 | 2015-02-04 | 深圳市天时通科技有限公司 | Display method for electronic whiteboard |
| CN104408978A (en) * | 2014-12-11 | 2015-03-11 | 北京轩文文化发展有限公司 | Optical-principle-based calligraphy presentation system |
| CN208197930U (en) * | 2018-02-02 | 2018-12-07 | 姚苏栩 | The blackboard of recordable handwriting information |
| CN108564639A (en) * | 2018-04-27 | 2018-09-21 | 广州视源电子科技股份有限公司 | Person's handwriting store method, device, intelligent interaction device and readable storage medium storing program for executing |
| CN108763320A (en) * | 2018-04-28 | 2018-11-06 | 广东蜂助手网络技术股份有限公司 | A kind of writing note data storage method, device, terminal and storage medium |
| CN108549879A (en) * | 2018-04-28 | 2018-09-18 | 北京奇禄管理咨询有限公司 | A kind of processing method of dot matrix image |
| CN109050091A (en) * | 2018-07-25 | 2018-12-21 | 成都瑞德利科技有限公司 | A kind of multimedia clipboard and its display methods |
| CN109032390A (en) * | 2018-08-01 | 2018-12-18 | 广州视源电子科技股份有限公司 | Handwriting data caching method, device, equipment and storage medium |
| CN110096209A (en) * | 2019-04-01 | 2019-08-06 | 北京新界教育科技有限公司 | Handwriting trace display methods and device |
| CN110298777A (en) * | 2019-07-24 | 2019-10-01 | 深圳市华熠致源科技有限公司 | The generation system and method for classroom video |
| CN110798638A (en) * | 2019-10-30 | 2020-02-14 | 深圳市闪联信息技术有限公司 | Electronic whiteboard and picture storage and backtracking method based on time axis |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109766879B (en) | Character detection model generation method, character detection device, character detection equipment and medium | |
| CN110321054B (en) | Writing brush handwriting drawing method, device, equipment and readable storage medium | |
| US10521700B2 (en) | Methods and systems for converting a line drawing to a rendered image | |
| CN112929582A (en) | Special effect display method, device, equipment and medium | |
| CN102662498A (en) | Wireless control method and system for projection demonstration | |
| JP7395070B1 (en) | Video processing methods and devices, electronic equipment and computer-readable storage media | |
| CN106778434A (en) | The method and its device of a kind of adjustment Quick Response Code of dynamic on the display region | |
| CN112051961A (en) | Virtual interaction method and device, electronic equipment and computer readable storage medium | |
| GB2598015A (en) | Action recognition method and device for target object, and electronic apparatus | |
| JP7213291B2 (en) | Method and apparatus for generating images | |
| CN104301788A (en) | Method and device for providing video interaction | |
| CN111246196B (en) | Video processing method and device, electronic equipment and computer readable storage medium | |
| CN113902789A (en) | Image feature processing method, depth image generating method, depth image processing apparatus, depth image generating medium, and device | |
| CN111314628A (en) | Method and device for converting infrared track into video stream, electronic whiteboard and storage medium | |
| CN106713739A (en) | Identification method of two-dimensional code displayed based on electronic screen | |
| US11265594B2 (en) | Data processing method and device, storage medium, electronic device | |
| CN115460353B (en) | Teaching tracking camera equipment configuration method and device, electronic equipment and medium | |
| WO2020093879A1 (en) | Video synthesis method and apparatus, computer device and readable storage medium | |
| CN105812813A (en) | Teaching video compressing and playing methods, and compressing and playing devices | |
| WO2023273621A1 (en) | Script generation method and apparatus, device and medium | |
| CN114327140B (en) | Screen touch method, device, system, equipment and storage medium | |
| US20220210508A1 (en) | Method and electronic device for displaying video | |
| CN114740975A (en) | Target content acquisition method and related equipment | |
| CN104092958A (en) | Video signal labeling method, system and device | |
| CN103713729A (en) | Man-machine interactive system and infrared image capture device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 247100 workshop C2, science and Technology Incubation Park, Jiangnan industrial concentration zone, Chizhou City, Anhui Province Applicant after: Anhui Wenxiang Technology Co.,Ltd. Address before: Room 1101, 11 / F, building 2, No.15, Ronghua South Road, Daxing Economic and Technological Development Zone, Beijing 100176 Applicant before: BEIJING WENXIANG INFORMATION TECHNOLOGY Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200619 |
|
| RJ01 | Rejection of invention patent application after publication |