WO2017101440A1

WO2017101440A1 - Remote annotation synchronization method and system

Info

Publication number: WO2017101440A1
Application number: PCT/CN2016/090746
Authority: WO
Inventors: 杨利侠
Original assignee: 广州视睿电子科技有限公司
Priority date: 2015-12-16
Filing date: 2016-07-20
Publication date: 2017-06-22
Also published as: CN105446689B; CN105446689A; CN109388329A

Abstract

A remote annotation synchronization method and system. The method comprises the following steps: monitoring a screen annotation event (S210); obtaining a coordinate set of a current screen image drawn and stored on a drawing canvas when a screen annotation event is monitored (S220), wherein the current screen image comprises handwritten annotation obtained according to the screen annotation event; performing coordinate transformation on the coordinate set to obtain a transformed coordinate set (S230); and transmitting the transformed coordinate set to an interactive intelligent tablet, wherein the interactive intelligent tablet parses the transformed coordinate set and displays corresponding handwritten annotation according to the parsed coordinate set (S240). Using a mobile device for remotely manipulating an interactive intelligent tablet to perform annotation synchronization can ensure that the annotation displayed on the mobile device is consistent with that displayed on the interactive intelligent tablet, and that a user can implement a relevant operation on content on the screen away from the interactive intelligent tablet and interact with audiences.

Description

Remote annotation synchronization method and system

Technical field

The present invention relates to the field of interactive smart tablet technologies, and in particular, to a method and system for remote annotation synchronization. Background technique

Interactive smart tablet (Windows device), with annotation, painting, multimedia entertainment and other functions, incorporating human-computer interaction, flat panel display, multimedia information processing and network transmission, etc. It is the interaction of office, teaching and graphic in the information age. The preferred solution for the demonstration.

In the implementation process, the inventor found that at least the following problems exist in the conventional technology: using an interactive smart tablet in a classroom or a conference scene, when annotating the content on the screen, the traditional technology requires the user to implement the screen on the interactive smart tablet. The related operations (annotations) of the content, the user can not interact with the audience from the interactive smart tablet. Summary of the invention

Based on this, it is necessary to provide a remote annotation synchronization method and system for remote control interactive smart tablet synchronization display screen annotation.

In order to achieve the above object, an embodiment of the technical solution of the present invention is:

In one aspect, a method of remote annotation synchronization is provided, comprising the steps of:

Monitor screen annotation events;

When the screen annotation event is monitored, the coordinate set of the current screen image drawn and stored on the drawing canvas is acquired; the current screen image includes the annotation handwriting obtained according to the screen annotation event;

Perform coordinate transformation on the coordinate set to obtain the converted coordinate set;

The converted coordinate set is sent to the interactive smart tablet; the converted coordinate set is parsed by the interactive smart tablet, and the corresponding annotation handwriting is displayed according to the parsed coordinate set.

In one aspect, a method of remote annotation synchronization is also provided, including the following steps:

Sending a screen image to the mobile terminal in real time, and intercepting the screen image by the mobile terminal to obtain a screen capture image; Receiving the converted coordinate set sent by the mobile terminal, parsing the converted coordinate set, and displaying the corresponding annotation handwriting according to the parsed coordinate set; the converted coordinate set is the mobile terminal acquiring the drawing according to the screen annotation event of the monitoring And storing the coordinate set of the current screen image on the drawing canvas, and performing coordinate conversion on the coordinate set; the current screen image includes a screen capture image and an annotation handwriting obtained according to the screen annotation event.

In another aspect, a remote annotation synchronization system is provided, including:

a monitor screen unit for monitoring a screen annotation event; and, when the screen annotation event is monitored, acquiring a coordinate set of the current screen image drawn and stored on the drawing canvas; the current screen image includes an annotation handwriting obtained according to the screen annotation event;

The conversion unit is configured to perform coordinate transformation on the coordinate set to obtain the converted coordinate set; the mobile sending unit is configured to send the converted coordinate set to the interactive smart tablet; and the transformed smart set analyzes the converted coordinate set And display the corresponding annotation handwriting based on the parsed coordinate set.

In addition, a remote annotation synchronization system is provided, including:

An interactive smart tablet sending unit is configured to send a screen image to the mobile terminal in real time, and the screen image is captured by the mobile terminal to obtain a screen capture image;

An interactive smart tablet receiving unit, configured to receive a converted coordinate set sent by the mobile terminal; and an analyzing unit, configured to parse the converted coordinate set;

a display unit, configured to display a corresponding annotation handwriting according to the parsed coordinate set;

The converted coordinate set is obtained by the mobile terminal according to the screen annotation event of the monitor, obtaining the coordinate set of the current screen image drawn and stored on the drawing canvas, and performing coordinate conversion on the coordinate set; the current screen image includes the screen capture image and Annotated handwriting obtained from the screen annotation event.

The above technical solution has the following beneficial effects:

The method and system for remote annotation synchronization of the present invention, because the mobile device remotely controls the interactive smart tablet for annotation synchronization, ensuring that the annotations displayed on the mobile device and the interactive smart tablet are consistent; the mobile device continuously receives and intercepts the image sent by the interactive smart tablet. At the same time, the related data of the annotation coordinate set information and the like are sent to the interactive smart tablet, and the interactive smart tablet performs corresponding operations according to the relevant data, so that the annotation on the mobile device is consistent with the annotation displayed on the interactive smart tablet. This ensures that the user can perform related operations (annotations) on the screen content from the interactive smart tablet and interact with the viewer. DRAWINGS

The above and other objects, features and advantages of the present invention will become more apparent from the <RTIgt; The same reference numerals are used throughout the drawings to refer to the same parts, and the drawings are not intended to be scaled to the actual size. The emphasis is on the subject matter of the present invention.

1 is a schematic diagram of an application scenario of a remote annotation synchronization method and system according to the present invention; FIG. 2 is a schematic flowchart of Embodiment 1 of a remote annotation synchronization method implemented by a mobile terminal from the perspective of a mobile terminal;

FIG. 3 is a schematic flowchart of Embodiment 1 of a method for remote annotation synchronization implemented by an interactive smart tablet according to the present invention;

4 is a schematic structural diagram of Embodiment 1 of a system for remote annotation synchronization implemented from a mobile terminal perspective;

FIG. 5 is a schematic structural diagram of Embodiment 1 of a system for remote annotation synchronization implemented from the perspective of an interactive smart tablet. detailed description

In order to facilitate the understanding of the present invention, the present invention will be described more fully hereinafter with reference to the accompanying drawings. Preferred embodiments of the invention are given in the drawings. However, the invention can be embodied in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided for the purpose of making the disclosure of the present invention more comprehensive.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning meaning meaning The terminology used in the description of the present invention is for the purpose of describing particular embodiments and is not intended to limit the invention. The term "and I or" as used herein includes any and all combinations of one or more of the associated listed items. An application scenario of the method and system for remote annotation synchronization of the present invention:

FIG. 1 is a schematic diagram of an application scenario of a remote annotation synchronization method and system according to the present invention; as shown in FIG. 1 , an interactive smart tablet is used in a classroom or a conference scene, and when an annotation is performed on the content on the screen, the user needs to interact. On the smart tablet, related operations (annotations) on the screen content are implemented, and the user cannot interact with the viewer from the interactive smart tablet. The remote annotation synchronization method and system of the present invention can remotely control the interactive smart tablet for annotation, ensuring that the annotations displayed on the mobile device (mobile terminal) and the interactive smart tablet are consistent, thereby ensuring that the user can implement the screen content from the interactive smart tablet. Related operations (annotations) and interaction with the audience. Method 1 of remote annotation synchronization implemented by the present invention from the perspective of a mobile terminal:

The present invention provides a method for remote annotation synchronization implemented from the perspective of a mobile terminal, and a method for remote annotation synchronization implemented from the perspective of a mobile terminal according to the present invention. The schematic diagram of the process of Embodiment 1, as shown in FIG. 2, may include the following steps:

Step S210: Monitor a screen annotation event;

Step S220: Acquire a coordinate set of a current screen image drawn and stored on the drawing canvas when the screen annotation event is monitored; the current screen image includes an annotation stroke obtained according to the screen annotation event;

Step S230: performing coordinate conversion on the coordinate set to obtain a converted coordinate set;

Step S240: Send the converted coordinate set to the interactive smart tablet; parse the converted coordinate set by the interactive smart tablet, and display the corresponding annotation handwriting according to the parsed coordinate set.

In a specific example, step S230 performs coordinate transformation on the coordinate set, and the step of obtaining the converted coordinate set may include:

Take the corner point of the coordinate set as the coordinate origin;

According to the resolution of the current monitoring screen, the coordinates of all the pixel coordinates in the coordinate set are coordinate-converted with respect to the origin of the coordinate, and the converted coordinate set is obtained.

In a specific example, the annotation handwriting obtained according to the screen annotation event in step S220 Create a drawing canvas; take the operating system of the mobile terminal as an Android system, the canvas can be an Android drawing canvas, and the Android drawing canvas is created by Canvas, and accordingly the operating system of the mobile terminal is IOS (the mobile operation developed by Apple) In the case of the system, the drawing canvas can also be an IOS drawing board or a drawing drawing canvas. In the case where the operating system of the interactive intelligent terminal is another type of operating system, the canvas can also have a drawing canvas function for other types of operating systems. Drawing canvas created by the control;

Monitors the screen annotation event, draws and stores the annotation handwriting on the above drawing canvas according to the movement of the current annotation touch point. The purpose of drawing an annotation on the drawing canvas is to make the mobile device match the image displayed on the interactive smart tablet.

In a specific embodiment, taking the mobile device of the Android system as an example, Embodiment 1 of the method for remote annotation synchronization implemented by the mobile terminal from the perspective of the mobile terminal may include the following steps:

(1) The mobile device (mobile terminal) draws an annotation so that the mobile terminal is consistent with the image displayed by the interactive smart tablet; the mobile terminal acquires the annotation point coordinate set of the annotation event.

1) Create an Android drawing canvas (Canvas), and any image or handwriting can be drawn on the drawing canvas by means of the set brush (Paint class); the annotation operations in the embodiment of the present invention are all performed on the drawing canvas.

2) When the mobile device (mobile terminal) listens to the Android screen annotation event, draws the annotation handwriting according to the movement of the finger, that is, the drawing curve method (canvas drawPath) of the Android drawing canvas is drawn in the onDraw method of the control. And recording the currently drawn handwriting, and obtaining the coordinate set of the handwriting; and since the moving end will continuously encode the image drawn on the canvas to the interactive smart tablet, the interactive smart tablet can display the screen image after decoding, and therefore will annotate The handwriting is drawn on the drawing canvas to ensure that the annotations displayed on the mobile end are consistent with the interactive smart tablet.

The screen annotation event is an operation different from the screen touch event. Specifically, the annotation toolbar or the annotation button for triggering the annotation function can be set on the mobile terminal, and when the user triggers the annotation function, the mobile terminal enters the listening Android screen annotation event state. The screen touch event does not need to set a toolbar or button that triggers the touch function on the screen, and the user can trigger the screen touch event by touching the screen with the finger; in addition, different time can be set according to the time or the intensity of the touch of the screen by the human hand. Gestures to trigger screen annotations or screen touches. (2) The mobile end performs coordinate conversion on the annotation point coordinate set of the annotation event, obtains the converted coordinate set, and transmits the converted coordinate set to the interactive smart tablet device:

In a specific embodiment, the upper left corner of the coordinate set is the coordinate origin, and the converted coordinate set (Α, Β) is: the pixel coordinate (xl, yl) of each point in the annotation point set relative to the upper left corner. Converted to (65535*xl/Xm, 65535*yl/Ym), where Xm is the horizontal resolution of the mobile screen and Ym is the vertical resolution of the mobile screen. The converted coordinate set (Α, Β) is transmitted to the interactive smart tablet device, and the converted coordinate set is parsed by the interactive smart tablet, and the resolved coordinate set is (Χη*Α/65535, Υη*Β/65535), Where Χη, Υη is the screen resolution of the smart tablet (large screen) end, and the interactive smart tablet displays the corresponding annotation handwriting according to the parsed coordinate set.

In a specific embodiment, the mobile terminal can also send the converted coordinate set (Xn*xl/Xm,

Yn*xl/Ym) , which is directly received by the interactive smart tablet and uses the converted coordinate set to display the annotation pen.

In a specific embodiment, the mobile terminal can also directly transmit the coordinate set (xl, yl), which is parsed by the interactive smart tablet and interpreted as (Xn*xl/Xm, Yn*xl/Ym).

Embodiment 1 of the method for remote annotation synchronization implemented by the mobile terminal from the mobile terminal perspective, because the mobile device remotely controls the interactive smart tablet for annotation synchronization, ensuring that the annotations displayed on the mobile device and the interactive smart tablet are consistent; the mobile device continuously receives and The image sent by the interactive smart tablet is intercepted, and the related data of the annotation coordinate set information and the like are sent to the interactive smart tablet, and the interactive smart tablet performs corresponding operations according to the relevant data, so that the annotation on the mobile device and the interactive smart tablet are displayed. The annotations are consistent, thus ensuring that the user can perform related operations (annotations) on the screen content from the interactive smart tablet and interact with the viewer. Method 1 of remote annotation synchronization implemented by the present invention from the perspective of interactive smart tablet:

In order to realize the purpose of remotely controlling the interactive smart tablet by the mobile device and synchronously displaying the annotation, the present invention provides a method 1 for remote annotation synchronization implemented from the perspective of an interactive smart tablet; FIG. 3 is a remote annotation synchronization implemented from the perspective of an interactive smart tablet. A schematic diagram of the process of the method embodiment 1, as shown in FIG. 3, taking the mobile device of the Android system as an example, may include the following steps:

Step S310: Sending a screen image to the mobile terminal in real time, and intercepting the screen image by the mobile terminal, Have a screen shot image;

Step S320: Receive a converted coordinate set sent by the mobile terminal, parse the converted coordinate set, and display a corresponding annotation handwriting according to the parsed coordinate set; the converted coordinate set is a mobile terminal annotating event according to the monitoring screen. Obtaining a coordinate set of the current screen image drawn and stored on the drawing canvas, and performing coordinate conversion on the coordinate set; the current screen image includes a screen capture image and an annotation handwriting obtained according to the screen annotation event;

In a specific embodiment, the step of the interactive smart tablet parsing the converted coordinate set may include:

According to the resolution of the current screen, the converted coordinate set is parsed to obtain the parsed set of coordinates.

In a specific embodiment, taking the mobile device of the Android system as an example, Embodiment 1 of the method for remote annotation synchronization implemented by the present invention from the perspective of an interactive smart tablet may include the following steps:

1) The interactive smart tablet sends the screen image to the mobile device in real time, and is intercepted by the mobile device, and saved as a screen after the screen capture;

2) An Android drawing canvas (Canvas) is created by the mobile device, and any image or handwriting can be drawn on the drawing canvas by using the set brush (Paint class); the annotation operations in the embodiment of the present invention are all performed on the Android drawing canvas. .

3) The screen image is drawn on the drawing canvas by the mobile device, and the drawing method of the Android drawing canvas (canvas. drawBitmap) is drawn in the control's drawing (onDraw) method, and the currently drawn image is recorded. Drawing the screenshot on the drawing canvas as a background image ensures that the display on the mobile side is consistent with the interactive smart tablet.

4) When the mobile terminal listens to the Android screen annotation event, draws the annotation handwriting according to the movement of the finger, that is, draws the curve of the draw drawing method of the Android drawing canvas in the onDraw method of the control, and records The currently drawn handwriting. The screen annotation event is an operation different from the screen touch event. Specifically, an annotation toolbar or an annotation button for triggering the annotation function can be set on the mobile terminal, and when the user triggers the annotation function, the mobile terminal enters the monitoring.

The Android screen annotation event status; while the screen touch event does not need to set a toolbar or button that triggers the touch function on the screen, the user can trigger the screen touch event by touching the screen with the finger; The screen annotation function or the screen touch function may be triggered by setting different gesture operations in advance according to different time or strength of the human hand touching the screen.

5) coordinate conversion of the annotation point coordinate set of the annotation event by the mobile terminal to obtain the converted coordinate set; the interactive smart tablet device receives the converted coordinate set, and parses the converted coordinate set:

In a specific embodiment, the upper left corner of the coordinate set is the coordinate origin, and the converted coordinate set (Α, Β) is: the pixel coordinate of each point in the annotation point set relative to the upper left corner (xl, Yl is converted to (65535*xl/Xm, 65535*yl/Ym), where Xm is the horizontal resolution of the mobile screen and Ym is the vertical resolution of the mobile screen.

The interactive smart tablet device receives the converted coordinate set (A, B), and parses the converted coordinate set, and the resolved coordinate set is (Xn*A/65535, Yn*B/65535), where Xn, Yn are The screen resolution of the smart tablet (large screen) side, the interactive smart tablet displays the corresponding annotation handwriting according to the parsed coordinate set.

In a specific embodiment, the interactive smart tablet can receive the coordinate set (Xn*xl/Xm, Yn*xl/Ym) converted by the mobile terminal, and use the coordinate set to display the annotation handwriting.

In a specific embodiment, the interactive smart tablet can receive the coordinate set (xl, yl ) directly sent by the mobile terminal, and parse it into (Xn*xl/Xm, Yn*xl/Ym) and then perform the annotation handwriting. Show no.

The method for remote annotation synchronization implemented by the invention from the perspective of the interactive smart tablet is as follows, because the mobile device remotely controls the interactive smart tablet for annotation synchronization, ensuring that the annotations displayed on the mobile device and the interactive smart tablet are consistent; the mobile device continuously receives and The image sent by the interactive smart tablet is intercepted, and the related data of the annotation coordinate set information and the like are sent to the interactive smart tablet, and the interactive smart tablet performs corresponding operations according to the relevant data, so that the annotation on the mobile device and the interactive smart tablet are displayed. The annotations are consistent, thus ensuring that the user can perform related operations (annotations) on the screen content from the interactive smart tablet and interact with the viewer. Based on the same idea as the method of remote annotation synchronization described above, in order to realize the purpose of remotely controlling the interactive smart tablet by the mobile device and simultaneously displaying the annotation, the embodiment of the present invention also provides a corner from the mobile terminal. The system embodiment 1 of the remote annotation synchronization is implemented. FIG. 4 is a schematic structural diagram of the system embodiment 1 of the remote annotation synchronization implemented by the mobile terminal from the perspective of the mobile terminal. As shown in FIG. 4, the method may include:

The monitor screen unit 10 is configured to monitor a screen annotation event; and, when the screen annotation event is monitored, acquire a coordinate set of a current screen image drawn and stored on the drawing canvas; the current screen image includes an annotation handwriting obtained according to the screen annotation event;

The converting unit 20 is configured to perform coordinate conversion on the coordinate set to obtain the converted coordinate set; the mobile transmitting unit 30 is configured to send the converted coordinate set to the interactive smart tablet; and the transformed smart set is converted by the interactive smart tablet Parsing, and displaying the corresponding annotation handwriting according to the parsed coordinate set.

In a specific embodiment, the system embodiment 1 of the remote annotation synchronization implemented by the present invention from the perspective of the mobile terminal further includes:

The mobile terminal receiving unit 40 is configured to receive a screen image sent by the interactive smart tablet in real time; the intercepting screen unit 50 is configured to intercept the screen image sent in real time to obtain a screen capture image; and the current screen image further includes a screen capture image;

The drawing unit 60 is configured to create a drawing canvas; and through the screen annotation event, draw and store the annotation handwriting on the drawing canvas according to the movement of the current annotation touch point; and use the drawing screen image to be drawn and stored on the drawing canvas.

In a specific embodiment, taking the mobile device of the Android system as an example, the specific working process of the system embodiment 1 of the remote annotation synchronization implemented by the mobile terminal from the perspective of the mobile terminal may be as follows: The mobile terminal receiving unit 40 receives the interaction. The screen image currently being displayed by the smart tablet in real time; the intercepting screen unit 50 intercepts the current screen image;

The drawing unit 60 creates an Android drawing canvas (Canvas), and any image or handwriting can be drawn on the drawing canvas by using the set brush (Paint class); all the annotations and synchronous scaling operations in the embodiment of the present invention are in Android. Drawing on the canvas.

The drawing unit 60 draws the image after the screen capture on the drawing canvas, calls the drawing image method of the Android drawing canvas (canvas. drawBitmap) in the drawing (onDraw) method, and records the currently drawn image. Drawing the screenshot on the drawing canvas as the background image ensures that the display on the mobile side is consistent with the interactive smart tablet. The listening screen unit 10 listens to the Android screen annotation event, and the drawing unit 60 draws the annotation handwriting according to the movement of the finger, that is, in the drawing drawing (onDraw) method of the control, the drawing drawing method (canvas drawPath) of the Android drawing canvas is used to draw the curve, and the recording is performed. The currently drawn handwriting. The screen annotation event is an operation different from the screen touch event. Specifically, an annotation toolbar or an annotation button for triggering the annotation function can be set on the mobile screen, and when the user triggers the annotation function, the mobile terminal enters the listening Android screen annotation. The event status; while the screen touch event does not need to set a toolbar or button that triggers the touch function on the screen, the user can trigger the screen touch event by touching the screen with the finger; in addition, the time can be preset according to the time or the intensity of the touch of the screen by the human hand. Different gestures are used to trigger the screen annotation function or the screen touch function.

The converting unit 20 performs coordinate transformation on the annotation point coordinate set of the annotation event to obtain the converted coordinate set, and the mobile terminal transmitting unit 30 transmits the converted coordinate set to the interactive smart tablet device: In a specific embodiment, the conversion unit 20 takes the upper left corner of the coordinate set as the coordinate origin, and the converted coordinate set (Α, Β) is: converts the pixel coordinate (xl, yl ) of each point in the annotation point set from the upper left corner to (65535*xl/ Xm, 65535*yl/Ym), where Xm is the horizontal resolution of the mobile screen and Ym is the vertical resolution of the mobile screen. The converted coordinate set (Α, Β) is transmitted to the interactive smart tablet device, and the converted coordinate set is parsed by the interactive smart tablet, and the resolved coordinate set is (Xn*A/65535, Yn*B/65535). Xn, Yn is the screen resolution of the smart tablet (large screen), and the interactive smart tablet displays the corresponding annotation handwriting according to the parsed coordinate set.

In a specific embodiment, the mobile terminal may also send the converted coordinate set (Xn*xl/Xm, Yn*xl/Ym), which is directly received by the interactive smart tablet and uses the converted coordinate set to perform the annotation handwriting. display.

Embodiment 1 of the system for remote annotation synchronization implemented from the perspective of the mobile terminal, because the mobile device remotely controls the interactive smart tablet for annotation synchronization, ensuring that the annotations displayed on the mobile device and the interactive smart tablet are consistent; the mobile device continuously receives and The image sent by the interactive smart tablet is intercepted, and the related data of the annotation coordinate set information and the like are sent to the interactive smart tablet, and the interactive smart tablet performs corresponding operations according to the relevant data, so that the annotation and the interactive intelligent flat on the mobile device are ensured. The annotations displayed on the board are consistent, thus ensuring that the user can perform related operations (annotations) on the screen content from the interactive smart tablet and interact with the viewer. The system embodiment 1 of the remote annotation synchronization implemented by the present invention from the perspective of an interactive smart tablet:

Based on the same idea as the remote annotation synchronization method described above, in order to achieve the purpose of remotely controlling the interactive smart tablet and synchronously displaying the annotations, the embodiment of the present invention further provides a system embodiment 1 for remote annotation synchronization implemented from the perspective of an interactive smart tablet. 5 is a schematic structural diagram of Embodiment 1 of a system for remote annotation synchronization implemented from the perspective of an interactive smart tablet; as shown in FIG. 5, it may include:

The interactive smart tablet sending unit 510 is configured to send a screen image to the mobile terminal in real time, and the screen image is intercepted by the mobile terminal to obtain a screen capture image;

The interactive smart panel receiving unit 520 is configured to receive the converted coordinate set sent by the mobile terminal, and the parsing unit 530 is configured to parse the converted coordinate set.

a display unit 540, configured to display a corresponding annotation handwriting according to the parsed coordinate set;

In a specific embodiment, taking the mobile device (mobile terminal) of the Android system as an example, the specific working process of the embodiment 1 of the remote annotation synchronization system implemented from the perspective of the interactive smart tablet may be as follows:

1) The interactive smart tablet sending unit 510 sends the screen image to the mobile device in real time, and is intercepted by the mobile device, and saved as a screen after the screen capture;

3) The screen image is drawn on the drawing canvas by the mobile device, and the image drawing method of the Android drawing canvas (canvas. drawBitmap) is drawn in the drawing of the control (onDraw) method, and the currently drawn image is recorded. And draw the screenshot on the drawing canvas as a background image It can ensure that the display of the mobile terminal is consistent with the interactive smart tablet.

The Android screen annotation event status; while the screen touch event does not need to set a toolbar or button that triggers the touch function on the screen, the user can trigger the screen touch event by touching the screen with the finger; in addition, the time or the intensity of the touch screen may be different according to the human hand. , preset different gesture operations to trigger the screen annotation function or the screen touch function.

5) coordinate conversion of the annotation point coordinate set of the annotation event by the mobile terminal to obtain the converted coordinate set; the interactive smart panel receiving unit 520 receives the converted coordinate set, and the parsing unit 530 parses and converts the converted coordinate set. Unit 540 displays the corresponding annotation handwriting based on the parsed coordinate set:

The interactive smart panel receiving unit 520 receives the converted coordinate set (A, B), and the parsing unit 530 parses the converted coordinate set, and the parsed coordinate set is (Xn*A/65535, Yn*B/65535), wherein Xn, Yn is the screen resolution of the smart tablet (large screen), and the interactive smart tablet displays the corresponding annotation handwriting according to the parsed coordinate set.

The system embodiment 1 of remote annotation synchronization implemented from the perspective of an interactive smart tablet, because Remotely control the interactive smart tablet with the mobile device to perform annotation synchronization to ensure that the annotations displayed on the mobile device and the interactive smart tablet are consistent; the mobile device continuously receives and intercepts the image sent by the interactive smart tablet, and simultaneously sends related data of the annotation coordinate set information and the like. The interactive smart tablet is operated by the interactive smart tablet according to the relevant data, so that the annotation on the mobile device is consistent with the annotation displayed on the interactive smart tablet, thereby ensuring that the user can disconnect the interactive smart tablet from the screen content. Operate (annotate) and interact with the audience. The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.

The above-mentioned embodiments are merely illustrative of several embodiments of the invention, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that various modifications and improvements can be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims

Claim

A method for remote annotation synchronization, characterized in that it comprises the following steps:

Monitor screen annotation events;

Obtaining a coordinate set of a current screen image drawn and stored on the drawing canvas when the screen annotation event is monitored; the current screen image includes an annotation handwriting acquired according to the screen annotation event;

Performing coordinate transformation on the coordinate set to obtain a converted coordinate set;

Transmitting the converted coordinate set to the interactive smart tablet; parsing the converted coordinate set by the interactive smart tablet, and displaying a corresponding annotation handwriting according to the parsed coordinate set.

2. The method of remote annotation synchronization according to claim 1, wherein before the step of monitoring the screen annotation event, the method further comprises the steps of:

Create the drawing canvas.

The remote annotation synchronization method according to claim 1, wherein the current screen image further comprises a screen capture image; the screen capture image is obtained by the following steps:

The screen image sent by the interactive smart tablet in real time is intercepted, and the screen capture image is obtained.

The remote annotation synchronization method according to any one of claims 1 to 3, wherein the step of performing coordinate transformation on the coordinate set to obtain the converted coordinate set comprises: taking the coordinate set The corner point is the coordinate origin;

According to the resolution of the current monitoring screen, the coordinates of all the pixel points in the coordinate set are coordinate-converted with respect to the coordinate origin to obtain a converted coordinate set.

5. A method for remote annotation synchronization, characterized in that it comprises the following steps:

Transmitting a screen image to the mobile terminal in real time, and intercepting the screen image by the mobile terminal to obtain a screen image;

Receiving the converted coordinate set sent by the mobile terminal, parsing the converted coordinate set, and displaying a corresponding annotation handwriting according to the parsed coordinate set; the converted coordinate set is the moving Obtaining, according to the screen annotation event of the monitor, the coordinate set of the current screen image drawn and stored on the drawing canvas, and performing coordinate transformation on the coordinate set; the current screen The screen image includes the screen shot image and an annotation handwriting acquired according to the screen annotation event.

The remote annotation synchronization method according to claim 5, wherein the step of parsing the converted coordinate set comprises:

The converted coordinate set is parsed according to the resolution of the current screen, and the parsed coordinate set is obtained.

7. A remote annotation synchronization system, comprising:

a monitor screen unit for monitoring a screen annotation event; and, when listening to the screen annotation event, acquiring a coordinate set of a current screen image drawn and stored on the drawing canvas; the current screen image includes an annotation event according to the screen Acquired handwriting;

a conversion unit, configured to perform coordinate transformation on the coordinate set to obtain a converted coordinate set; a mobile terminal sending unit, configured to send the converted coordinate set to an interactive smart tablet; The converted coordinate set is parsed, and the corresponding annotation handwriting is displayed according to the parsed coordinate set.

The remote annotation synchronization system according to claim 7, further comprising: a mobile terminal receiving unit, configured to receive a screen image sent by the interactive smart tablet in real time; and a screen capture unit, configured to intercept the a screen image sent in real time, obtaining a screen capture image; the current screen image further including the screen capture image;

a drawing unit, configured to create a drawing canvas, and through the screen annotation event, draw and store the annotation handwriting on the drawing canvas according to movement of a current annotation touch point; and to draw and store the screenshot image in The drawing is on the canvas.

The remote annotation synchronization system according to claim 7 or 8, wherein the conversion unit is specifically configured to:

Taking a corner point of the coordinate set as a coordinate origin;

10. A remote annotation synchronization system, comprising:

An interactive smart tablet sending unit, configured to send a screen image to the mobile terminal in real time, and the screen image is intercepted by the mobile terminal to obtain a screen capture image; An interactive smart panel receiving unit, configured to receive the converted coordinate set sent by the mobile terminal; and an analyzing unit, configured to parse the converted coordinate set;

a display unit, configured to display a corresponding annotation handwriting according to the parsed coordinate set; the converted coordinate set is that the mobile terminal acquires a current screen image drawn and stored on the drawing canvas according to the monitored screen annotation event a coordinate set obtained by performing coordinate transformation on the coordinate set; the current screen image includes the screenshot image and an annotation handwriting acquired according to the screen annotation event.