CN109324776B - Handwriting synchronization method, device and system - Google Patents
Handwriting synchronization method, device and system Download PDFInfo
- Publication number
- CN109324776B CN109324776B CN201811131653.8A CN201811131653A CN109324776B CN 109324776 B CN109324776 B CN 109324776B CN 201811131653 A CN201811131653 A CN 201811131653A CN 109324776 B CN109324776 B CN 109324776B
- Authority
- CN
- China
- Prior art keywords
- handwriting
- interactive intelligent
- handwriting information
- information
- intelligent device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
- G06F40/117—Tagging; Marking up; Designating a block; Setting of attributes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a handwriting synchronization method, device and system. Wherein, the method comprises the following steps: the first handwriting information in the handwriting queue is read by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the method comprises the steps that a first interactive intelligent device determines processing time corresponding to first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time; when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment. The invention solves the technical problem that the handwriting displayed by the receiving end is not smooth after the handwriting is transmitted to the receiving end due to network jitter in the prior art.
Description
Technical Field
The invention relates to the field of interactive intelligent panels, in particular to a handwriting synchronization method, device and system.
Background
In the application of screen transmission or video conference, the stroke synchronization function can be used, and at present, the implementation scheme of the stroke synchronization function is as follows: 1. a user annotates on a white board of a sending end, and the sending end collects coordinate points and event types of a mouse or a writing event and sends the coordinate points and the event types to a receiving end; 2. after receiving the message of the painting brush, the receiving end draws a second-order or third-order Bezier curve by taking the received coordinate point as a control point, so that a user at the receiving end can see the handwriting as same as that at the sending end.
The scheme has the defects that if network jitter occurs, the receiving end is fast and slow in receiving the brush pen message, and the effect seen by a user at the receiving end is that strokes are jammed in the session process or a plurality of handwriting are all displayed in a moment, so that the user is difficult to see the process of fluent handwriting drawing.
Aiming at the problem that in the prior art, after handwriting is transmitted to a receiving end due to network jitter, the receiving end displays the handwriting smoothly, an effective solution is not provided at present.
Disclosure of Invention
The embodiment of the invention provides a handwriting synchronization method, a handwriting synchronization device and a handwriting synchronization system, which are used for at least solving the technical problem that in the prior art, after handwriting is transmitted to a receiving end due to network jitter, the handwriting displayed by the receiving end is not smooth.
According to an aspect of the embodiments of the present invention, there is provided a method for synchronizing handwriting, including: the first handwriting information in the handwriting queue is read by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the method comprises the steps that a first interactive intelligent device determines processing time corresponding to first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time; when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment.
Further, the time represented by the timestamp is postponed backwards by the buffering time to obtain the processing time.
Further, when the processing time is up, the first interactive intelligent device processes the first handwriting information, and compares the current time with the processing time corresponding to the first handwriting information before obtaining the handwriting corresponding to the handwriting information; if the current time does not reach the processing time, waiting for the processing time, and then processing the first handwriting information; and if the current time reaches the processing time or exceeds the processing time, entering first interactive intelligent equipment to process the first handwriting information.
Further, before the first handwriting information in the handwriting queue is read by the first interactive intelligent device, the first interactive intelligent device receives the handwriting information sequentially sent by the second interactive intelligent device; and the first interactive intelligent equipment stores the received handwriting information to the tail part of the handwriting queue.
Further, in the process that the second interactive intelligent device is projected to the first interactive intelligent device, the first interactive intelligent device receives handwriting information sent by the second interactive intelligent device; or in the process of video communication between the first interactive intelligent device and the second interactive intelligent device, the first interactive intelligent device receives handwriting information sent by the second interactive intelligent device.
According to another aspect of the embodiments of the present invention, there is also provided a handwriting synchronization system, including: the second interactive intelligent device receives the writing event, collects handwriting information from the writing event and sends the handwriting information to the first interactive intelligent device, wherein the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the first interactive intelligent device stores the received handwriting information to the tail of the handwriting queue, reads the first handwriting information in the handwriting queue, determines the processing time corresponding to the first handwriting information, and processes the first handwriting information when the processing time is up to obtain the handwriting corresponding to the handwriting information; and the first interactive intelligent equipment displays the handwriting corresponding to the handwriting information, wherein the processing time of the handwriting information is determined according to the time stamp in the handwriting information and the preset buffering time.
Further, the processing time of the handwriting information is a time obtained by delaying the time represented by the time stamp backward by the buffering time.
And further, the first interactive intelligent device is also used for comparing the current time with the processing time corresponding to the first handwriting information, waiting for the processing time if the current time does not reach the processing time, then drawing the first handwriting information, and entering the first interactive intelligent device to process the first handwriting information if the current time reaches the processing time or exceeds the processing time.
According to another aspect of the embodiments of the present invention, there is also provided a device for synchronizing handwriting, including: the reading module is used for reading first handwriting information in the handwriting queue by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the determining module is used for determining the processing time corresponding to the first handwriting information by the first interactive intelligent equipment, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffer time; the comparison module is used for processing the first handwriting information by the first interactive intelligent equipment when the processing time is up to obtain the handwriting corresponding to the handwriting information; and the display module is used for displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment.
According to another aspect of the embodiments of the present invention, there is also provided a storage medium including a stored program, wherein when the program runs, a device on which the storage medium is located is controlled to perform the following steps: the first handwriting information in the handwriting queue is read by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the method comprises the steps that a first interactive intelligent device determines processing time corresponding to first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time; when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment.
According to another aspect of the embodiments of the present invention, there is also provided a processor, configured to execute a program, where the program executes the following steps: the first handwriting information in the handwriting queue is read by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the method comprises the steps that a first interactive intelligent device determines processing time corresponding to first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time; when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment.
In the embodiment of the invention, the first handwriting information in the handwriting queue is read by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the method comprises the steps that position information of a writing event, the type of the writing event and a timestamp corresponding to the writing event are read and judged by first interactive intelligent equipment, whether the current time reaches the processing time corresponding to first handwriting information is judged, and the processing time of the handwriting information is determined according to the timestamp in the handwriting information and preset buffer time; when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment. According to the scheme, the time for processing the handwriting information by the receiving end is delayed, and the received handwriting information is buffered to a certain extent through the network, so that the receiving end can cope with certain network jitter when drawing the handwriting, the drawing process is smooth, and the technical problem that the handwriting is not smoothly displayed by the receiving end after the handwriting is transmitted to the receiving end due to the network jitter in the prior art is solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow chart of a method for synchronizing handwriting according to an embodiment of the invention;
FIG. 2 is a diagram of a first interactive intelligent device synchronizing handwriting on a second interactive intelligent device according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a system for synchronization of handwriting according to an embodiment of the invention; and
FIG. 4 is a schematic diagram of a device for synchronizing handwriting according to an embodiment of the invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1
According to an embodiment of the invention, there is provided an embodiment of a method for handwriting synchronization, it being noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer executable instructions, and that while a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than here.
FIG. 1 is a flow chart of a method for synchronizing handwriting according to an embodiment of the invention, as shown in FIG. 1, the method comprises the following steps:
step S102, the first handwriting information in the handwriting queue is read by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and the timestamp corresponding to the writing event.
Specifically, the handwriting queue may be a queue in a receiving end (in this embodiment, the receiving end is the first interactive intelligent device) for storing handwriting information sent by the second interactive intelligent device. The writing event received by the second interactive intelligent device can be a mouse event or a touch event generated by a user on a touch screen of the second interactive intelligent device, the position information of the writing event can be coordinates of a control point generated by the writing event, and the type of the writing event can include: down, move, up, etc., and the time stamp of the written event is used to indicate the point in time corresponding to the control point.
In an optional embodiment, when the second interactive smart device and the first interactive smart device are in a video conference, the second interactive smart device shares a PPT file in the second interactive smart device with the first interactive smart device, and when a user annotates the PPT file, the first interactive smart device needs to synchronize handwriting annotated by the user, so that the user of the first interactive smart device can see content annotated by the user of the second interactive smart device.
Under the scene, after receiving the writing event, the second interactive intelligent device extracts the coordinate position of the control point generated by the writing event, the type of the writing event and the timestamp corresponding to the writing event, packages the information as handwriting information and sends the handwriting information to the first interactive intelligent device.
And S104, the first interactive intelligent device determines the processing time corresponding to the first handwriting information, wherein the processing time of the handwriting information is determined according to the timestamp in the handwriting information and the preset buffer time.
In order to synchronize the handwriting generated according to the writing event in the second interactive intelligent device, the first interactive intelligent device needs to sequentially read the handwriting information from the queue and generate the handwriting according to the read handwriting information.
In an optional embodiment, the first interactive intelligent device extends the preset buffering time backwards on the basis of the timestamp of the handwriting information according to the timestamp of the taken-out handwriting information, and determines the extended time as the processing time of the handwriting information.
And S106, when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information.
Specifically, the handwriting information is drawn, and the handwriting information may be sent to the brush thread, and the brush thread draws the handwriting according to the handwriting information.
In an optional embodiment, after the processing time corresponding to the handwriting information is determined, whether the current time reaches the processing time of the handwriting information or not can be judged, and when the current time reaches the processing time corresponding to the first handwriting information, the handwriting corresponding to the handwriting information is immediately rendered.
In the scheme, the first interactive intelligent device processes the handwriting information according to the processing time corresponding to the handwriting information, but does not process the received handwriting information immediately, so that when the network environment is deteriorated, buffering time is reserved for the handwriting information, and the handwriting observed by a user at the first interactive intelligent device end is kept smooth to a certain extent.
And S108, displaying the handwriting corresponding to the handwriting information by the first interactive intelligent device.
After the first interactive intelligent device processes the handwriting information, the handwriting to be displayed is obtained, and the first interactive intelligent device displays the handwriting corresponding to the handwriting information, so that the synchronization of the handwriting is completed.
It is worth noting that, according to the scheme, when the first interactive intelligent device processes the handwriting information, the first interactive intelligent device does not take out the handwriting information and immediately processes the handwriting information, but determines whether the handwriting information is directly processed according to the processing time corresponding to the handwriting information, and if the network state is good and the received handwriting information is timely, the first interactive intelligent device processes the handwriting information after the processing time of the handwriting information is up; if the received handwriting information is delayed due to network jitter, the first interactive intelligent device can still draw handwriting smoothly when receiving the handwriting information in the buffering time due to the existence of the buffering time; and if the network state is very poor, the delay time of the received handwriting information is long, the first interactive intelligent device can be stuck to a certain extent when drawing the handwriting, but the sticking degree is small due to the existence of the buffering time.
As can be seen from the above, in the above embodiment of the present application, the first interactive intelligent device reads the first handwriting information in the handwriting queue, where the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least includes: the method comprises the steps that position information of a writing event, the type of the writing event and a timestamp corresponding to the writing event are read and judged by first interactive intelligent equipment, whether the current time reaches the processing time corresponding to first handwriting information is judged, and the processing time of the handwriting information is determined according to the timestamp in the handwriting information and preset buffer time; the method comprises the steps that first interactive intelligent equipment reads and judges whether the current time reaches the processing time corresponding to first handwriting information or not, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffer time; when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment. According to the scheme, the time for processing the handwriting information by the receiving end is delayed, and the received handwriting information is buffered to a certain extent through the network, so that the receiving end can cope with certain network jitter when drawing the handwriting, the drawing process is smooth, and the technical problem that the handwriting is not smoothly displayed by the receiving end after the handwriting is transmitted to the receiving end due to the network jitter in the prior art is solved.
As an optional embodiment, the determining, by the first interactive intelligent device, the processing time corresponding to the first handwriting information includes: and delaying the time represented by the timestamp backwards by the buffering time to obtain the processing time.
In an optional embodiment, assuming that the buffering time is set to be Δ t, the sending end collects a writing event at t1, and sends the type of the writing event, the coordinates of a control point generated by the writing event and a timestamp t1 as handwriting information to the receiving end; the processing time t2 of the handwriting information is t1 +. DELTA.t.
As an optional embodiment, before the first interactive intelligent device processes the first handwriting information and obtains the handwriting corresponding to the handwriting information when the processing time is reached, the method further includes: comparing the current time with the processing time corresponding to the first handwriting information; if the current time does not reach the processing time, waiting for the processing time, and then processing the first handwriting information; and if the current time reaches the processing time or exceeds the processing time, entering first interactive intelligent equipment to process the first handwriting information.
In the above scheme, the current time is compared with the processing time corresponding to the first handwriting information, and the processing time corresponding to the first handwriting information is used for determining whether the processing time corresponding to the first handwriting information is reached, so as to determine whether the handwriting information is processed.
In the embodiment, the receiving end receiving thread receives the handwriting information and then puts the handwriting information into the tail part of the buffer queue; the receiving end brush thread takes out handwriting information from the head of the buffer queue and calculates the processing time of the handwriting; since the buffer time is set to Δ t, the processing time t2 is t1 +/Δ t. After the processing time t2 is obtained, comparing the current time with t2, if the current time is less than t2, indicating that the current time does not reach t2, waiting for a period of time by the painting brush thread, adding the coordinate point to the painting brush thread when the current time reaches t2, and if the current time is t2 or is more than t2, immediately adding the coordinate point to the painting brush thread; and after the brush thread finishes processing one message, the next handwriting information is continuously taken out from the buffer queue for processing.
As an optional embodiment, before the first interactive intelligent device reads the first handwriting information in the handwriting queue, the method further includes: the method comprises the steps that first interactive intelligent equipment receives handwriting information sequentially sent by second interactive intelligent equipment; and the first interactive intelligent equipment stores the received handwriting information to the tail part of the handwriting queue.
Specifically, the handwriting queue may be a queue in a receiving end (in this embodiment, the receiving end is the first interactive intelligent device) for storing handwriting information sent by the second interactive intelligent device. And after the first interactive intelligent device receives the handwriting information, storing the handwriting information to the tail of the team.
As an optional embodiment, the receiving, by the first interactive intelligent device, handwriting information sequentially sent by the second interactive intelligent device includes: in the process of screen projection of the second interactive intelligent device to the first interactive intelligent device, the first interactive intelligent device receives handwriting information sent by the second interactive intelligent device; or in the process of video communication between the first interactive intelligent device and the second interactive intelligent device, the first interactive intelligent device receives handwriting information sent by the second interactive intelligent device.
The handwriting synchronization method of the embodiment can be applied to a wireless screen transmission scene, or a video conference scene, and in the process of screen projection of the second interactive intelligent device to the first interactive intelligent device, or in the process of video conference between the first interactive intelligent device and the second interactive intelligent device, the first interactive intelligent device can synchronize handwriting information generated on the second interactive intelligent device by using the handwriting synchronization method.
Fig. 2 is a schematic diagram of a first interactive intelligent device synchronizing handwriting on a second interactive intelligent device according to an embodiment of the present invention, and in this example, as shown in fig. 2, the second interactive intelligent device casts a document to the first interactive intelligent device, and when the second interactive intelligent device and the first interactive intelligent device jointly display the document, if a user performs annotation operation on document content on the second interactive intelligent device, handwriting information corresponding to the annotation operation is transmitted to the first interactive intelligent device, and the first interactive intelligent device receives the handwriting information.
And after the first interactive intelligent device receives the handwriting information, processing the handwriting information, namely displaying the annotation handwriting which is the same as the annotation handwriting in the first interactive intelligent device. In this example, although the completed handwriting has been displayed on the second interactive intelligent device, the processing time corresponding to the handwriting information received by the first interactive intelligent device is extended backward by the preset buffer time, so that the complete handwriting has not been displayed on the first interactive intelligent device.
Example 2
According to an embodiment of the present invention, a handwriting synchronization system is provided, and fig. 3 is a schematic diagram of a handwriting synchronization system according to an embodiment of the present invention, which is shown in fig. 3, and the system includes a second interactive intelligent device and a first interactive intelligent device, where the second interactive intelligent device and the first interactive intelligent device may be two terminals for performing a video conference, and the first interactive intelligent device synchronizes a handwriting generated on the second interactive intelligent device.
In the process of carrying out the video conference, a user writes on the second interactive intelligent device (for example, annotates in a whiteboard application), the first interactive intelligent device can synchronously display handwriting written on the second interactive intelligent device, and at the moment, the second interactive intelligent device is a sending end, and the first interactive intelligent device is a receiving end.
The second interactive intelligent device 10 receives the writing event, collects handwriting information from the writing event, and sends the handwriting information to the first interactive intelligent device, wherein the handwriting information at least comprises: the position information of the writing event, the type of the writing event and the timestamp corresponding to the writing event.
Specifically, the writing event received by the second interactive intelligent device may be a mouse event or a touch event generated by a user on a touch screen of the second interactive intelligent device, the position information of the writing event may be coordinates of a control point generated by the writing event, and the type of the writing event may include: down, move, up, etc., and the time stamp of the written event is used to indicate the point in time corresponding to the control point.
In an optional embodiment, when the second interactive smart device and the first interactive smart device are in a video conference, the second interactive smart device shares a PPT file in the second interactive smart device with the first interactive smart device, and when a user annotates the PPT file, the first interactive smart device needs to synchronize handwriting annotated by the user, so that the user of the first interactive smart device can see content annotated by the user of the second interactive smart device.
Under the scene, after receiving the writing event, the second interactive intelligent device extracts the coordinate position of the control point generated by the writing event, the type of the writing event and the timestamp corresponding to the writing event, packages the information as handwriting information and sends the handwriting information to the first interactive intelligent device.
The first interactive intelligent device 20 stores the received handwriting information to the tail of the handwriting queue, reads the first handwriting information in the handwriting queue, determines the processing time corresponding to the first handwriting information, and processes the first handwriting information when the processing time is up to obtain the handwriting corresponding to the handwriting information; and the first interactive intelligent equipment displays the handwriting corresponding to the handwriting information, wherein the processing time of the handwriting information is determined according to the time stamp in the handwriting information and the preset buffering time.
Specifically, the handwriting queue may be a queue in a receiving end (in this embodiment, the receiving end is the first interactive intelligent device) for storing handwriting information sent by the second interactive intelligent device. And after the first interactive intelligent device receives the handwriting information, storing the handwriting information to the tail of the team. And drawing the handwriting information, wherein the handwriting information can be sent to a painting brush thread, and the painting brush thread draws the handwriting according to the handwriting information.
In order to synchronize the handwriting generated according to the writing event in the second interactive intelligent device, the first interactive intelligent device needs to sequentially read the handwriting information from the queue and generate the handwriting according to the read handwriting information.
In the above scheme, the first interactive intelligent device prolongs the preset buffer time backwards on the basis of the timestamp of the handwriting information according to the timestamp of the taken-out handwriting information, and determines the prolonged time as the processing information of the handwriting information.
After the processing time corresponding to the handwriting information is determined, whether the current time reaches the processing time of the handwriting information is judged, if the current time does not reach the processing time of the handwriting information, the processing time of the handwriting information is waited, and if the current time reaches or exceeds the processing time of the handwriting information, the handwriting information is immediately processed.
It is worth noting that, according to the scheme, when the first interactive intelligent device processes the handwriting information, the first interactive intelligent device does not take out the handwriting information and immediately processes the handwriting information, but determines whether the handwriting information is directly processed according to the processing time corresponding to the handwriting information, and if the network state is good and the received handwriting information is timely, the first interactive intelligent device processes the handwriting information after the processing time of the handwriting information is up; if the received handwriting information is delayed due to network jitter, the first interactive intelligent device can still draw handwriting smoothly when receiving the handwriting information in the buffering time due to the existence of the buffering time; and if the network state is very poor, the delay time of the received handwriting information is long, the first interactive intelligent device can be stuck to a certain extent when drawing the handwriting, but the sticking degree is small due to the existence of the buffering time.
By the above, in the scheme of the application, the second interactive intelligent device receives the writing event, collects handwriting information from the writing event, and sends the handwriting information to the first interactive intelligent device, wherein the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the method comprises the steps that received handwriting information is stored to the tail of a handwriting queue by first interactive intelligent equipment, the first handwriting information in the handwriting queue is read, whether the current time reaches the processing time corresponding to the first handwriting information or not is judged, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffer time, and when the processing time is reached, the first interactive intelligent equipment processes the first handwriting information to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment. According to the scheme, the time for processing the handwriting information by the receiving end is delayed, and the received handwriting information is buffered to a certain extent through the network, so that the receiving end can cope with certain network jitter when drawing the handwriting, the drawing process is smooth, and the technical problem that the handwriting is not smoothly displayed by the receiving end after the handwriting is transmitted to the receiving end due to the network jitter in the prior art is solved.
As an alternative embodiment, the processing time of the handwriting information is to postpone the time represented by the time stamp backwards by the buffering time.
In an optional embodiment, assuming that the buffering time is set to be Δ t, the sending end collects a writing event at t1, and sends the type of the writing event, the coordinates of a control point generated by the writing event and a timestamp t1 as handwriting information to the receiving end; the processing time t2 of the handwriting information is t1 +. DELTA.t.
As an optional embodiment, the first interactive intelligent device is further configured to compare the current time with the processing time corresponding to the first handwriting information, wait for the processing time if the current time does not reach the processing time, process the first handwriting information, and enter the first interactive intelligent device to process the first handwriting information if the current time reaches the processing time or exceeds the processing time.
In the embodiment, the receiving end receiving thread receives the handwriting information and then puts the handwriting information into the tail part of the buffer queue; the receiving end brush thread takes out handwriting information from the head of the buffer queue and calculates the processing time of the handwriting; since the buffer time is set to Δ t, the processing time t2 is t1 +/Δ t, if the current time is less than t2, the brush thread waits for a period of time until t2 and then adds the coordinate point to the brush thread, and if the current time is t2 or more than t2, immediately adding the coordinate point to the brush thread; and after the brush thread finishes processing one message, the next handwriting information is continuously taken out from the buffer queue for processing.
Example 3
According to an embodiment of the present invention, an embodiment of a device for synchronizing handwriting is provided, fig. 4 is a flowchart of a method for synchronizing handwriting according to an embodiment of the present invention, as shown in fig. 4, the device includes:
a reading module 40, configured to read, by a first interactive intelligent device, first handwriting information in a handwriting queue, where the handwriting information in the handwriting queue is generated by a second interactive intelligent device according to a received handwriting event, and the handwriting information at least includes: the position information of the writing event, the type of the writing event and the timestamp corresponding to the writing event.
And the determining module 42 is configured to determine, by the first interactive intelligent device, processing time corresponding to the first handwriting information, where the processing time of the handwriting information is determined according to a timestamp in the handwriting information and a preset buffer time.
And the processing module 44 is configured to, when the processing time is up, process the first handwriting information by the first interactive intelligent device to obtain the handwriting corresponding to the handwriting information.
And the display module 46 is used for displaying the handwriting corresponding to the handwriting information by the first interactive intelligent device.
As an alternative embodiment, the determining module includes: and the delay submodule is used for delaying the time represented by the timestamp backwards by the buffering time to obtain the processing time.
As an alternative embodiment, the apparatus further comprises: the comparison module is used for comparing the current time with the processing time corresponding to the first handwriting information: the waiting submodule is used for waiting for the processing time and then processing the first handwriting information if the current time does not reach the processing time; and the processing submodule is used for entering first interactive intelligent equipment to process the first handwriting information if the current time reaches the processing time or exceeds the processing time.
As an alternative embodiment, the apparatus further comprises: before the first interactive intelligent device reads the first handwriting information in the handwriting queue, a receiving module is used for receiving the handwriting information sequentially sent by the second interactive intelligent device by the first interactive intelligent device; and the storage module is used for storing the received handwriting information to the tail part of the handwriting queue by the first interactive intelligent equipment.
As an alternative embodiment, the receiving module comprises: the first receiving submodule is used for receiving handwriting information sent by the second interactive intelligent device by the first interactive intelligent device in the process of screen projection of the second interactive intelligent device to the first interactive intelligent device; or the second receiving submodule is used for receiving the handwriting information sent by the second interactive intelligent device by the first interactive intelligent device in the process of carrying out video communication between the first interactive intelligent device and the second interactive intelligent device.
Example 4
According to an embodiment of the present invention, there is provided a storage medium including a stored program, wherein, when the program runs, a device on which the storage medium is located is controlled to execute the following steps: the first handwriting information in the handwriting queue is read by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the method comprises the steps that a first interactive intelligent device determines processing time corresponding to first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time; when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment.
Example 5
According to an embodiment of the present invention, there is provided a processor, configured to execute a program, where the program executes the following steps: the first handwriting information in the handwriting queue is read by the first interactive intelligent device, wherein the handwriting information in the handwriting queue is generated by the second interactive intelligent device according to the received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the method comprises the steps that a first interactive intelligent device determines processing time corresponding to first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time; when the processing time is up, the first handwriting information is processed by the first interactive intelligent equipment to obtain the handwriting corresponding to the handwriting information; and displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.
Claims (10)
1. A method for synchronizing handwriting, comprising:
the method comprises the following steps that first handwriting information in a handwriting queue is read by first interactive intelligent equipment, wherein the handwriting information in the handwriting queue is generated by second interactive intelligent equipment according to a received handwriting event, and the handwriting information at least comprises the following steps: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event;
the first interactive intelligent device determines processing time corresponding to the first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time;
when the processing time is up, the first interactive intelligent device processes the first handwriting information to obtain handwriting corresponding to the handwriting information;
the first interactive intelligent device displays handwriting corresponding to the handwriting information;
before the first interactive intelligent device reads the first handwriting information in the handwriting queue, the method further comprises the following steps:
the first interactive intelligent device receives handwriting information sequentially sent by the second interactive intelligent device;
and the first interactive intelligent equipment stores the received handwriting information to the tail part of the handwriting queue.
2. The method according to claim 1, wherein the determining, by the first interactive intelligent device, the processing time corresponding to the first handwriting information comprises:
and postponing the time represented by the timestamp backwards by the buffering time to obtain the processing time.
3. The method according to claim 1, wherein before the first handwriting information is processed by the first interactive intelligent device when the processing time is reached to obtain the handwriting corresponding to the handwriting information, the method further comprises:
comparing the current time with the processing time corresponding to the first handwriting information;
if the current time does not reach the processing time, waiting for the processing time, and then processing the first handwriting information;
and if the current time reaches the processing time or exceeds the processing time, entering the first interactive intelligent equipment to process the first handwriting information.
4. The method according to claim 1, wherein the receiving, by the first interactive intelligent device, handwriting information sequentially sent by the second interactive intelligent device comprises:
in the process that the second interactive intelligent device is projected to the first interactive intelligent device, the first interactive intelligent device receives handwriting information sent by the second interactive intelligent device; or
In the process of video communication between the first interactive intelligent device and the second interactive intelligent device, the first interactive intelligent device receives handwriting information sent by the second interactive intelligent device.
5. A system for synchronizing handwriting, comprising:
the second interactive intelligent device receives a writing event, collects handwriting information from the writing event and sends the handwriting information to the first interactive intelligent device, wherein the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event;
the first interactive intelligent device stores the received handwriting information to the tail of a handwriting queue, reads the first handwriting information in the handwriting queue, determines the processing time corresponding to the first handwriting information, and processes the first handwriting information when the processing time is up to obtain the handwriting corresponding to the handwriting information; and the first interactive intelligent equipment displays the handwriting corresponding to the handwriting information, wherein the processing time of the handwriting information is determined according to the timestamp in the handwriting information and the preset buffer time.
6. A system as claimed in claim 5, wherein the processing time of the handwriting information is a time obtained by deferring the time represented by the time stamp back by the buffering time.
7. The system according to claim 5, wherein the first interactive intelligent device is further configured to compare a current time with a processing time corresponding to the first handwriting information, wait for the processing time if the current time does not reach the processing time, and then perform rendering processing on the first handwriting information, and enter the first interactive intelligent device to process the first handwriting information if the current time reaches the processing time or exceeds the processing time.
8. A device for synchronizing handwriting, comprising:
the reading module is used for reading first handwriting information in a handwriting queue by first interactive intelligent equipment, wherein the handwriting information in the handwriting queue is generated by second interactive intelligent equipment according to a received handwriting event, and the handwriting information at least comprises: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event;
the determining module is used for determining the processing time corresponding to the first handwriting information by the first interactive intelligent device, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and a preset buffer time;
the processing module is used for processing the first handwriting information by the first interactive intelligent equipment when the processing time is up to obtain the handwriting corresponding to the handwriting information;
the display module is used for displaying the handwriting corresponding to the handwriting information by the first interactive intelligent equipment;
the device further comprises:
a receiving module, configured to receive, by a first interactive intelligent device, handwriting information sequentially sent by a second interactive intelligent device before the first interactive intelligent device reads first handwriting information in a handwriting queue
And the storage module is used for storing the received handwriting information to the tail part of the handwriting queue by the first interactive intelligent equipment.
9. A storage medium, characterized in that the storage medium includes a stored program, wherein when the program runs, a device on which the storage medium is located is controlled to execute the following steps: the method comprises the following steps that first handwriting information in a handwriting queue is read by first interactive intelligent equipment, wherein the handwriting information in the handwriting queue is generated by second interactive intelligent equipment according to a received handwriting event, and the handwriting information at least comprises the following steps: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the first interactive intelligent device determines processing time corresponding to the first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time; when the processing time is up, the first interactive intelligent device processes the first handwriting information to obtain handwriting corresponding to the handwriting information; the first interactive intelligent device displays handwriting corresponding to the handwriting information; before the first interactive intelligent device reads the first handwriting information in the handwriting queue, the first interactive intelligent device receives the handwriting information sequentially sent by the second interactive intelligent device; and the first interactive intelligent equipment stores the received handwriting information to the tail part of the handwriting queue.
10. A processor, wherein the processor is configured to execute a program, wherein the program executes to perform the following steps: the method comprises the following steps that first handwriting information in a handwriting queue is read by first interactive intelligent equipment, wherein the handwriting information in the handwriting queue is generated by second interactive intelligent equipment according to a received handwriting event, and the handwriting information at least comprises the following steps: the position information of the writing event, the type of the writing event and a timestamp corresponding to the writing event; the first interactive intelligent device determines processing time corresponding to the first handwriting information, wherein the processing time of the handwriting information is determined according to a timestamp in the handwriting information and preset buffering time; when the processing time is up, the first interactive intelligent device processes the first handwriting information to obtain handwriting corresponding to the handwriting information; the first interactive intelligent device displays handwriting corresponding to the handwriting information; before the first interactive intelligent device reads the first handwriting information in the handwriting queue, the first interactive intelligent device receives the handwriting information sequentially sent by the second interactive intelligent device; and the first interactive intelligent equipment stores the received handwriting information to the tail part of the handwriting queue.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811131653.8A CN109324776B (en) | 2018-09-27 | 2018-09-27 | Handwriting synchronization method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811131653.8A CN109324776B (en) | 2018-09-27 | 2018-09-27 | Handwriting synchronization method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109324776A CN109324776A (en) | 2019-02-12 |
| CN109324776B true CN109324776B (en) | 2021-06-15 |
Family
ID=65266031
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811131653.8A Active CN109324776B (en) | 2018-09-27 | 2018-09-27 | Handwriting synchronization method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109324776B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110392063B (en) * | 2019-08-27 | 2022-04-01 | 深圳市威屏科技有限公司 | Electronic whiteboard data synchronization method, device, equipment and medium |
| CN113034959B (en) * | 2021-03-03 | 2023-01-31 | 重庆赛迪奇智人工智能科技有限公司 | Driving route display method and device and electronic equipment |
| CN113312017B (en) * | 2021-05-25 | 2023-02-21 | 广州市奥威亚电子科技有限公司 | Terminal handwriting synchronization method, system, equipment and storage medium |
| CN115328382A (en) * | 2022-08-16 | 2022-11-11 | 北京有竹居网络技术有限公司 | Method, apparatus, device and medium for managing writing content |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104199566A (en) * | 2014-08-21 | 2014-12-10 | 三星电子（中国）研发中心 | Handwriting synchronizing device and method |
| CN107196956A (en) * | 2017-06-15 | 2017-09-22 | 广州视源电子科技股份有限公司 | Handwriting data synchronous method and apparatus, storage medium and terminal device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160154769A1 (en) * | 2014-11-28 | 2016-06-02 | Kabushiki Kaisha Toshiba | Electronic device and method for handwriting |
| US20160321025A1 (en) * | 2015-04-30 | 2016-11-03 | Kabushiki Kaisha Toshiba | Electronic apparatus and method |
| JP6251214B2 (en) * | 2015-05-14 | 2017-12-20 | 株式会社東芝 | Electronic device, method and program |
-
2018
- 2018-09-27 CN CN201811131653.8A patent/CN109324776B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104199566A (en) * | 2014-08-21 | 2014-12-10 | 三星电子（中国）研发中心 | Handwriting synchronizing device and method |
| CN107196956A (en) * | 2017-06-15 | 2017-09-22 | 广州视源电子科技股份有限公司 | Handwriting data synchronous method and apparatus, storage medium and terminal device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109324776A (en) | 2019-02-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109324776B (en) | Handwriting synchronization method, device and system | |
| CN112154669B (en) | Correlation of video stream frame timestamps based on system clock | |
| EP3447631B1 (en) | Writing trajectory synchronization method and system for multiple clients | |
| WO2022166927A1 (en) | Cursor display method and apparatus based on remote desktop, medium, and electronic device | |
| CN109286836B (en) | Multimedia data processing method and device, intelligent terminal and storage medium | |
| CN104822077B (en) | The operation method and client of client | |
| CN105828146A (en) | Video image interception method, terminal and server | |
| CN108776917B (en) | Synchronous processing method and device for virtual three-dimensional space | |
| CN108762628B (en) | Page element mobile display method and device, terminal equipment and storage medium | |
| CN106469183A (en) | Page rendering method and device, page data processing method and client | |
| CN109587031A (en) | Data processing method | |
| CN108156509A (en) | Video broadcasting method, device and user terminal | |
| EP4224338A1 (en) | Data labeling method, apparatus, and system, device, and storage medium | |
| CN110290413A (en) | A kind of multi-medium data method for recording, playback method and record share system | |
| US10019087B2 (en) | Touch input method and apparatus | |
| US9323367B2 (en) | Automatic annotation de-emphasis | |
| CN105468206B (en) | Interactive demonstration method and equipment | |
| CN111182338A (en) | Video processing method and device, storage medium and electronic equipment | |
| CN111277896A (en) | Method and device for splicing network video stream images | |
| CN109658514B (en) | Data processing method and device and computer storage medium | |
| CN108109106B (en) | Picture generation method and device and computer equipment | |
| CN113346973B (en) | Event prompting method and device, electronic equipment and computer readable storage medium | |
| CN105677362B (en) | A kind of image drawing method and its system | |
| CN112651801B (en) | Method and device for displaying house source information | |
| CN102314235B (en) | Method for realizing synchronization of electronic whiteboards |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |