WO2019015095A1

WO2019015095A1 - Dual-system based handwriting writing and display method and system, and storage medium and device

Info

Publication number: WO2019015095A1
Application number: PCT/CN2017/103425
Authority: WO
Inventors: 向淘
Original assignee: 广州视源电子科技股份有限公司; 广州视臻信息科技有限公司
Priority date: 2017-07-21
Filing date: 2017-09-26
Publication date: 2019-01-24
Also published as: CN107422974B; CN107422974A

Abstract

A dual-system based handwriting writing and display method and system, and a storage medium and a device. The method comprises the following steps: when a touch event is detected, executing a handwriting drawing operation on a transparent writing layer of a first system, and on a writing interface of writing software of a second system respectively (S1); reading a current display image of the first system from a display cache area, drawing the current display image on an original image layer established in advance, performing colour mixing and superposition of the handwriting on the transparent writing layer and the current display image on the original image layer, updating content to the display cache area of the first system after said colour mixing and superposition, and taking same as a display picture of the first system (S2); and displaying the display picture in the first system, and simultaneously displaying the handwriting on the writing interface in the second system (S3).

Description

Handwriting writing display method and system based on dual system, storage medium and device

Technical field

The present invention relates to the field of touch screen technologies, and in particular, to a dual-system based handwriting writing display method and system, a storage medium and a device.

Background technique

A dual system display device is an electronic device that includes two complete operating systems. For example, the operating system of the dual system display device may be composed of a main Android system plus other Android systems, or a main Android system plus a Windows system. Generally, the main Android system is referred to as a first system, and the other system is referred to as a second system. .

At present, in the dual system display device, when the signal of the second system is displayed, the display signal of the second system needs to be physically connected to the first system through the HDMI (High Definition Multimedia Interface) line for display. Output, after receiving the signal of the second system, the first system performs HDMI decoding and displays, and the picture of one frame of the second system needs to be HMDI encoded, transmitted, and HDMI decoded before being presented to the user.

In order to reduce the transmission delay, there is a way to create a transparent writing layer in the first system and write simultaneously in the first system and the second system. However, in this arrangement, the handwriting of the first system easily slashes the windows and buttons of the non-writing application on the transparent writing layer of the first system, as shown in FIG.

In summary, the traditional two-system based writing method has a poor writing effect.

Summary of the invention

Based on this, it is necessary to solve the problem that the traditional two-system based writing method has poor writing effect, and provides a dual-system based handwriting writing display method and system, storage medium and device.

A dual-system based handwriting display method includes the following steps:

After detecting the touch event, performing a handwriting drawing operation on the transparent writing layer of the first system and the writing interface of the writing software of the second system, respectively;

Reading a current display image of the first system from a display buffer area, and drawing the current display image on a pre-established original image layer, the handwriting on the transparent writing layer and the original image layer The current display image is subjected to color fusion superposition, and the color fusion superimposed content is updated into the display buffer of the first system as a display screen of the first system;

The display screen is displayed in the first system, and the handwriting on the writing interface is synchronously displayed in the second system.

A dual-system handwriting writing display system comprising:

a first drawing module, configured to perform a handwriting drawing operation on the transparent writing layer of the first system and the writing interface of the writing software of the second system respectively after detecting the touch event;

a second drawing module, configured to read a current display image of the first system from a display buffer area, and draw the current display image on a pre-established original image layer, and write the handwriting on the transparent writing layer Performing color fusion superposition on the current display image on the original image layer, and updating the color fusion superimposed content to the display buffer of the first system as a display screen of the first system;

And a display module, configured to display the display screen in the first system, and simultaneously display the handwriting on the writing interface in the second system.

A computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements a dual system based handwriting display method.

A computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor executing the program to implement a dual system based handwriting display method.

The above-described dual-system-based handwriting writing display method and system, storage medium and device, by creating a transparent writing layer and an original image layer in the first system, drawing a handwriting on the transparent writing layer, and simultaneously displaying the current display image on the transparent writing layer It is drawn on the original image layer, and then the handwriting on the transparent writing layer and the current display image on the original image layer are color-fused and superimposed as the display screen of the first system, and finally displayed synchronously in the two systems, thereby avoiding the handwriting. Sharpen the windows and buttons in the displayed image to improve the display.

DRAWINGS

1 is a schematic view of a window and a button of a non-writing application in which a handwriting is broken;

2 is a flow chart of a dual system based handwriting writing display method according to an embodiment;

3 is a schematic diagram showing content displayed by a first system of an embodiment;

4 is a schematic diagram showing contents displayed by a second system of an embodiment;

FIG. 5 is a schematic diagram of the first system display content of one embodiment and the final display content after the second system display content is superimposed; FIG.

6 is a schematic diagram showing the result of handwriting drawing of the second system of one embodiment;

7 is a schematic view showing a handwriting drawing result of a transparent layer writing layer of one embodiment;

8 is a schematic diagram showing the display content of the first system and the second layer of the first layer and the second layer to form a first system;

FIG. 9 is a schematic diagram showing display contents after superimposed display of the first system and the second system of an embodiment; FIG.

FIG. 10 is a schematic structural diagram of a dual system based handwriting writing display system according to an embodiment of an embodiment.

Detailed ways

The technical solution of the present invention will be described below with reference to the accompanying drawings.

Here is a description of the principle of handwriting based on dual systems. In order to reduce the transmission delay, there is a way to create a transparent writing layer in the first system and write simultaneously in the first system and the second system. In this solution, when the writing software of the second system is started, a startup command is sent to the first system by the second system, and the transparent writing layer is activated in the first system according to the startup instruction; according to the detected touch event on the transparent writing layer Performing a handwriting drawing operation to obtain a first handwriting, and displaying the first handwriting on the transparent writing layer; performing a handwriting drawing operation on the writing interface of the writing software according to the touch event, obtaining a second handwriting, and displaying the second handwriting in the first On the writing layer of the second system; after detecting the end of the touch event, if the handwriting drawing operation on the writing software is completed, the first handwriting is erased.

In one embodiment, the first system may be an operating system such as an Android system, an IOS system, or a Windows system, and the second system may also be one of the above systems. In a typical embodiment, the first system Both the system and the second system can be Android systems. The writing software of the second system is the writing software installed in the second system. When the handwriting is drawn by the writing software of the second system, the handwriting display process needs to be displayed after HMDI encoding, transmission, and HDMI decoding. In order to speed up the handwriting display, when the writing software of the second system is started, a startup command can be sent to the first system through the second system, and a transparent writing layer is activated in the first system. Since the writing software of the second system is activated first, the transparent writing layer is activated, so that the transparent writing layer will overwrite the writing software of the second system. Moreover, since the first system starts the transparent writing layer, that is, the background thereof is transparent, it is impossible for the user to perceive the existence of the transparent writing layer of the first system, and the startup process is not perceived.

There is a problem in the above scheme that the handwriting of the first system easily breaks the window and button of the non-writing application on the transparent writing layer of the first system, as shown in Fig. 1, the white thin line in the figure is a handwriting, and it can be seen that The first part of the number "00" where "0" and "05" intersect the handwriting line are incomplete. In order to solve the above problems, the present invention provides a dual-system based handwriting writing display method, as shown in FIG. 2, which may include the following steps:

S1, after detecting the touch event, performing a handwriting drawing operation on the transparent writing layer of the first system and the writing interface of the writing software of the second system, respectively;

In one embodiment, one or more icons may be present on the transparent writing layer of the first system, such as a timer icon, as shown in Figure 3. In another embodiment, the writing interface of the writing software of the second system is as shown in FIG. 4, and includes a writing area. The writing interface may also be provided with a plurality of icons for performing related non-writing operations, and the icons are implemented. Features include, but are not limited to, one or more of interoperating with menus, toolbars, and/or palettes, undoing handwriting operations, canceling undo operations, and screenshot operations. The final display content after the first system display content and the second system display content superimposed corresponding to the above two embodiments are as shown in FIG. 5.

In this step, a touch event start command issued by the system may be detected, and if detected, a touch event is determined to occur. Taking the Android system as an example, when the ACTION_DOWN command issued by the system is detected, it can be determined that a touch event occurs, and then the handwriting drawing operation is performed in the first system and the second system, respectively.

S2, reading a current display image of the first system from a display buffer area, and displaying the current display The image is drawn on the pre-established original image layer, and the handwriting on the transparent writing layer and the current display image on the original image layer are color-fused and superimposed, and the color-fused superimposed content is updated to the first system. Display buffer as the display screen of the first system;

When drawing a handwriting in the first system, in order to avoid scratching the buttons and windows of other applications, a layered drawing method may be employed in the first system: wherein the first layer is the original image layer, and the buttons for drawing other applications are used. And the window displays a current display image in the buffer area, and the current display image may include an image of the icon and the window on the transparent layer of the first system. The second layer is a transparent writing layer for drawing handwriting. In one embodiment, when the writing software of the second system is started, a software startup command may be sent to the first system by the second system; the writing software of the first system may be started in response to the software startup command; writing by the first system The software creates a new original image layer and a transparent writing layer in the first system.

Each time drawing, the current display image in the display buffer area is first read as the first layer, and the currently drawn handwriting is used as the second layer; after the current display image of the first layer and the second layer of the handwriting are color-fused and superimposed The obtained content is updated into the display buffer of the first system, and collectively serves as the display content of the first system.

S3, displaying the handwriting on the transparent writing layer and the current display image on the transparent writing layer, and displaying the handwriting on the writing interface on the writing interface.

In one embodiment, the size of the display buffer area is the system display resolution size, and the display refresh rate of the device can be displayed, and the display screen is directly read from the display buffer area according to the display refresh rate, and is in the first system pair. This display screen is displayed.

Further, in an embodiment, before the display, the handwriting color setting instruction may be sent to the first system by the second system, where the current color of the second system handwriting may be carried in the handwriting color setting instruction, and the first system may be The handwriting color setting instructs the handwriting color on the transparent writing layer. Further, the first system may further render the handwriting on the transparent writing layer according to the current display color; and perform color fusion on the rendered handwriting and the current display image on the original image layer as the The display content on the transparent writing layer. The process of setting the handwriting color may also be performed when the second system writing software is started, that is, when the second system writing software is detected to be activated, the handwriting color setting instruction is transmitted to the first system through the second system. In this way, the first system and the second system can be made The system keeps the handwriting color synchronized.

Further, in another embodiment, before the display, the handwriting line setting instruction may be sent to the first system by the second system, where the handwriting line setting instruction can carry the current display line type of the second system handwriting, including but It is not limited to one or more of line thickness, line line type (solid or dashed line), line end point (no end point, end point of line or end point of line end, and/or endpoint type, etc.). Further, the first system may set a line type of the handwriting on the transparent writing layer according to the current display line type; and perform color fusion on the set handwriting and the current display image on the original image layer as a The display content on the transparent writing layer. The process of setting the handwriting line can also be performed when the second system writing software is started, that is, when the second system writing software is detected to be activated, the handwriting line setting instruction is sent to the first system through the second system. In this way, the first system and the second system can be synchronized to maintain the stroke line type.

For ease of understanding, refer to Figures 6-9. Figure 6 is a schematic view of the handwriting on the writing interface of the second system. The second system may, after detecting the writing software startup command, send a startup command to the first system to activate the transparent writing layer of the first system. When the second system begins to draw, the first system performs simultaneous rendering on the transparent writing layer, as shown in FIG. At the same time, the first system can read the current display image on the transparent writing layer from the display buffer area, and draw on the original image layer, and the first layer and the second layer are color-fused and superimposed to form the display content of the first system. As shown in Figure 8. Finally, the result of superimposing the display content of the first system (Fig. 8) and the display content of the second system (Fig. 6) is as shown in Fig. 9. It can be seen that by adopting the layered drawing in the first system, the handwriting of the first system is under the display content of the icon and the window, and the situation that the icon and the window are scratched does not occur.

In a further embodiment, when the second system ends the handwriting drawing, the handwriting drawing termination command is sent to the first system by the second system; and the handwriting drawing operation of the first system is stopped in response to the handwriting drawing termination command, and is cleared. a handwriting on the transparent writing layer. In practical applications, it can be determined whether the touch event is over by detecting a touch event end instruction. When the touch event end instruction is detected, it may be determined that the touch event ends, and then the handwriting drawing termination command is sent to the first system; otherwise, it is determined that the touch event is not ended. Taking the Android system as an example, the ACTION_UP event can be detected. If detected, the touch event can be determined to end, otherwise, the touch event is not ended.

In a further embodiment, when the second system stops exiting the whiteboard writing software, the second system can send an exit command to the first system; in response to the exit command, the original image layer of the first system is closed.

The above-described dual-system-based handwriting writing display method, by creating a transparent writing layer and an original image layer in the first system, drawing a handwriting on the transparent writing layer, and simultaneously drawing the current display image on the transparent writing layer on the original image layer, Finally, the handwriting on the transparent writing layer and the current display image are displayed on the transparent writing layer, and the handwriting on the writing interface is displayed on the writing interface, thereby preventing the handwriting from scratching the window and the button in the display image. Improve the display.

As shown in FIG. 10, the present invention further provides a dual-system handwriting writing display system, which may include:

a first drawing module 10, configured to perform a handwriting drawing operation on the transparent writing layer of the first system and the writing interface of the writing software of the second system respectively after detecting the touch event;

In one embodiment, the transparent writing layer of the first system is transparent except for the side buttons, and one or more icons may still be present on the transparent writing layer of the first system, for example, a timer icon, The display hierarchy screen is shown in Figure 3. In another embodiment, the writing interface of the writing software of the second system is as shown in FIG. 4, and includes a writing area. The writing interface may also be provided with a plurality of icons for performing related non-writing operations, and the icons are implemented. Features include, but are not limited to, one or more of interoperating with menus, toolbars, and/or palettes, undoing handwriting operations, canceling undo operations, and screenshot operations. The final display content after the first system display content and the second system display content superimposed corresponding to the above two embodiments are as shown in FIG. 5.

In this module, the touch event start command issued by the system can be detected, and if detected, the touch event is determined to occur. Taking the Android system as an example, when the ACTION_DOWN command issued by the system is detected, it can be determined that a touch event occurs, and then the handwriting drawing operation is performed in the first system and the second system, respectively.

a second drawing module 20, configured to read a current display image of the first system from a display buffer area, and draw the current display image on a pre-established original image layer, and write a handwriting on the transparent writing layer Performing color fusion superposition with the current display image on the original image layer, and updating the color fusion superimposed content to the display buffer of the first system as a display screen of the first system;

The display module 30 is configured to display the handwriting on the transparent writing layer and the current display image on the transparent writing layer, and display the handwriting on the writing interface on the writing interface.

Further, in an embodiment, before the display, the handwriting color setting instruction may be sent to the first system by the second system, where the current color of the second system handwriting may be carried in the handwriting color setting instruction, and the first system may be The handwriting color setting instructs the handwriting color on the transparent writing layer. Further, the first system may further render the handwriting on the transparent writing layer according to the current display color; and perform color fusion on the rendered handwriting and the current display image on the original image layer as the The display content on the transparent writing layer. The process of setting the handwriting color may also be performed when the second system writing software is started, that is, when the second system writing software is detected to be activated, the handwriting color setting instruction is transmitted to the first system through the second system. In this way, the first system and the second system can be kept in sync with the handwriting color.

Further, in another embodiment, before the display, the handwriting line setting instruction may be sent to the first system by the second system, where the handwriting line setting instruction may carry the current of the second system handwriting Display line type, including but not limited to line thickness, line line type (solid or dashed), one of the line endpoints (no endpoints, endpoints at the beginning of the line, end points at the end of the line, and/or endpoint types, etc.) More. Further, the first system may set a line type of the handwriting on the transparent writing layer according to the current display line type; and perform color fusion on the set handwriting and the current display image on the original image layer as a The display content on the transparent writing layer. The process of setting the handwriting line can also be performed when the second system writing software is started, that is, when the second system writing software is detected to be activated, the handwriting line setting instruction is sent to the first system through the second system. In this way, the first system and the second system can be synchronized to maintain the stroke line type.

The above-described dual-system based handwriting writing display system, by establishing a transparent writing layer in the first system and The original image layer, the handwriting is drawn on the transparent writing layer, while the current display image on the transparent writing layer is drawn on the original image layer, and finally the handwriting on the transparent writing layer and the current display image are displayed on the transparent writing On the layer, the handwriting on the writing interface is displayed on the writing interface, thereby preventing the handwriting from scratching the window and the button in the display image, thereby improving the display effect.

The dual-system-based handwriting writing display system of the present invention has a one-to-one correspondence with the dual-system-based handwriting writing display method of the present invention, and the technical features and the beneficial effects thereof described in the embodiment of the above-described dual-system-based handwriting writing display method are applicable. In the embodiment of the dual system based handwriting writing display system, it is hereby declared.

Further, the present invention further provides a computer readable storage medium having stored thereon a computer program, which when executed by a processor, implements the dual system based handwriting writing display method in any of the above embodiments.

The embodiment of the method performed by the above computer readable storage medium is the same as the other embodiments of the above-described dual system based handwriting writing display method, and details are not described herein again.

Further, the present invention also provides a computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor executing the program to implement the basis in any of the above embodiments Dual system handwriting display method.

The embodiment of the method performed by the processor of the above computer device is the same as the other embodiments of the above-described dual-system based handwriting writing display method, and details are not described herein again.

The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or apparatus, or in conjunction with such an instruction execution system, apparatus, or apparatus.

More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections (electronic devices) having one or more wires, portable computer disk cartridges (magnetic devices), random access memory Memory (RAM), read only memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.

It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: having logic gates for implementing logic functions on data signals. Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms does not necessarily mean the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples.

The technical features of the above-described embodiments may be arbitrarily combined. For the sake of brevity of description, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction between the combinations of these technical features, All should be considered as the scope of this manual.

The above-described embodiments are merely illustrative of several embodiments of the present invention, and the description thereof is more specific and detailed, but is not to be construed as limiting the scope of the invention. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be determined by the appended claims.

Claims

A dual-system handwriting writing display method, comprising the following steps:

After detecting the touch event, performing a handwriting drawing operation on the transparent writing layer of the first system and the writing interface of the writing software of the second system, respectively;

Reading a current display image of the first system from a display buffer area, and drawing the current display image on a pre-established original image layer, the handwriting on the transparent writing layer and the original image layer The current display image is subjected to color fusion superposition, and the color fusion superimposed content is updated into the display buffer of the first system as a display screen of the first system;

The display screen is displayed in the first system, and the handwriting on the writing interface is synchronously displayed in the second system.
The dual-system-based handwriting writing display method according to claim 1, wherein the displaying of the display screen by the first system comprises:

Obtaining the display refresh rate of the display device;

Reading the display screen from the display buffer according to the display refresh rate;

The display screen is displayed in the first system.
The dual-system-based handwriting writing display method according to claim 1, further comprising the following steps:

When the second system ends the handwriting drawing, the handwriting drawing termination command is sent to the first system by the second system;

The handwriting drawing operation of the first system is stopped in response to the handwriting drawing termination command, and the handwriting on the transparent writing layer is cleared.
The dual-system-based handwriting writing display method according to claim 1, further comprising the following steps:

When the second system stops exiting the whiteboard writing software, the second system sends an exit command to the first system;

The original image layer of the first system is turned off in response to the exit command.
The dual system based handwriting writing display method according to claim 1, wherein It also includes the following steps:

Sending a software startup command to the first system by the second system when the writing software of the second system is started;

Initiating the writing software of the first system in response to the software startup command;

The original image layer and the transparent writing layer are newly created in the first system by the writing software of the first system.
The dual-system-based handwriting writing display method according to any one of claims 1 to 5, characterized in that the handwriting on the transparent writing layer and the current display image on the original image layer are color-fused and superimposed The steps include:

Sending, by the second system, a handwriting color setting instruction to the first system, where the handwriting color setting instruction carries a current display color of the handwriting on the writing interface;

Rendering a handwriting on the transparent writing layer according to the current display color;

The rendered handwriting is color-fused and superimposed with the current displayed image on the original image layer.
The dual-system-based handwriting writing display method according to claim 6, wherein the step of color-mixing the handwriting on the transparent writing layer and the current display image on the original image layer further comprises:

Sending, by the second system, a handwriting line setting instruction to the first system, where the handwriting line setting instruction carries a current display line type of the handwriting on the writing interface;

Setting a line type of the handwriting on the transparent writing layer according to the current display line type;

The set handwriting is color-fused and superimposed with the current display image on the original image layer.
A dual-system handwriting writing display system, comprising:

a first drawing module, configured to perform a handwriting drawing operation on the transparent writing layer of the first system and the writing interface of the writing software of the second system respectively after detecting the touch event;

a second drawing module, configured to read a current display image of the first system from a display buffer area, and draw the current display image on a pre-established original image layer, and write the handwriting on the transparent writing layer Performing color fusion superposition on the current display image on the original image layer, and updating the color fusion superimposed content to the display buffer of the first system as a display screen of the first system;

a display module, configured to display the display screen in the first system, and in the second system The handwriting on the writing interface is displayed synchronously.
A computer readable storage medium having stored thereon a computer program, wherein the program is executed by a processor to implement the dual system based handwriting writing display method according to any one of claims 1 to 7.
A computer apparatus comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the program to implement any one of claims 1 to A two-system based handwriting display method.