CN114217730A - Writing display method, device, equipment, system and storage medium - Google Patents
Writing display method, device, equipment, system and storage medium Download PDFInfo
- Publication number
- CN114217730A CN114217730A CN202111619922.7A CN202111619922A CN114217730A CN 114217730 A CN114217730 A CN 114217730A CN 202111619922 A CN202111619922 A CN 202111619922A CN 114217730 A CN114217730 A CN 114217730A
- Authority
- CN
- China
- Prior art keywords
- writing
- display
- handwriting
- application
- signal period
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
- G06F3/03545—Pens or stylus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
Abstract
The application provides a writing display method, a device, equipment, a system and a storage medium, wherein the method comprises the following steps: after the writing application finishes the writing handwriting rendering processing in the current synchronous signal period, starting the writing handwriting rendering processing of the writing application in the current synchronous signal period to obtain a writing handwriting synthesis result; and displaying the obtained handwriting synthesis result. The method can obviously reduce the time delay of the display device for displaying the handwriting and improve the pen following effect of the handwriting display.
Description
Technical Field
The present application relates to the field of human-computer interaction technologies, and in particular, to a writing display method, apparatus, device, system, and storage medium.
Background
The display process of the writing of the user by the display equipment mainly comprises the steps of collecting writing touch position information by a system, drawing and rendering the writing according to the writing touch position information by a writing application, synthesizing a writing rendering result by a display subsystem, displaying a writing synthesis result on a screen, and the like.
The system synchronization signal of the display device is used for realizing the synchronous control of the display process, and under the display process synchronization mechanism, the writing application executes writing drawing and rendering operation, the display subsystem carries out synthesis operation on the writing rendering result, and screen display refreshing are triggered when the system synchronization signal is received, so that all processes are kept synchronous. The display flow synchronization mechanism can eliminate the jamming and improve the visual representation of the graph.
However, when the handwriting of the user is actually displayed, the display delay of the handwriting is high, the handwriting cannot be written synchronously with the user, the situation that the handwriting does not follow the pen is caused, and the writing experience of the user is influenced.
Disclosure of Invention
Based on the technical current situation, the application provides a writing display method, a writing display device, writing display equipment, a writing display system and a storage medium, so that the time delay of displaying the writing handwriting by the display equipment can be obviously reduced, and the pen following effect of displaying the writing handwriting is improved.
A writing display method, comprising:
after the writing application finishes the writing handwriting rendering processing in the current synchronous signal period, starting the writing handwriting rendering processing of the writing application in the current synchronous signal period to obtain a writing handwriting synthesis result;
and displaying the obtained handwriting synthesis result.
Optionally, the method further includes:
when receiving a writing event trigger signal, sending a synchronous trigger signal to a system so that the system sends a system synchronous signal after receiving the synchronous trigger signal;
wherein the writing event trigger signal is sent by the input subsystem when a writing input event is sensed; and the writing application starts to execute writing handwriting drawing and rendering processing when receiving a system synchronization signal sent by the system.
Optionally, the current synchronization signal period takes the time of receiving the system synchronization signal sent by the system as the starting time;
and when the system synchronization signal sent by the system is received, monitoring writing handwriting drawing and rendering processing of the writing application.
Optionally, the method further includes:
when a writing event trigger signal is detected, starting a writing display working mode; in the writing display working mode, when the writing application finishes the writing handwriting rendering processing in the current synchronous signal period, starting the writing handwriting rendering processing in the current synchronous signal period to obtain a writing handwriting combining result; putting the obtained handwriting synthesis result into a display screen for displaying;
when a writing event ending signal is detected, the writing display working mode is exited;
wherein the writing event trigger signal is sent by the input subsystem upon sensing the occurrence of a writing input event, and the writing event end signal is sent by the input subsystem upon sensing the end of the writing input event.
Optionally, the method further includes:
when the writing handwriting rendering result of the writing application in the current synchronization signal period is synthesized, judging whether the completion time exceeds the end time of the current synchronization signal period;
if the completion time exceeds the end time of the current synchronization signal period, judging whether the completion time exceeds the time length of the end time of the current synchronization period or not;
and if the preset time length is exceeded, canceling the synthesis processing of the handwriting rendering result of the writing application in the next synchronous signal period of the current synchronous signal period.
A writing display system comprising:
the display subsystem is used for starting the synthesis processing of the writing rendering result of the writing application in the current synchronous signal period after the writing application completes the writing rendering processing in the current synchronous signal period to obtain a writing synthesis result;
and displaying the obtained handwriting synthesis result.
Optionally, the method further includes:
the input subsystem is used for sending a writing event trigger signal to the display subsystem when a writing input event is sensed to occur, and sending the collected touch position information to the writing application;
the display subsystem is further used for sending a synchronous trigger signal to the system when the writing event trigger signal sent by the input subsystem is detected, so that the system sends a system synchronous signal after receiving the synchronous trigger signal; and when receiving a system synchronization signal sent by the system, the writing application executes writing drawing and rendering processing according to the touch position information.
A writing display device comprising:
the handwriting synthesis unit is used for starting the synthesis processing of the handwriting rendering result of the writing application in the current synchronous signal period after the writing application completes the handwriting rendering processing in the current synchronous signal period to obtain a handwriting synthesis result;
and the handwriting display unit is used for displaying the obtained handwriting synthesis result.
A writing display device comprising:
a memory and a processor;
the memory is connected with the processor and used for storing programs;
the processor is used for realizing the writing display method by running the program in the memory.
A storage medium having stored thereon a computer program which, when executed by a processor, implements the above-described writing display method.
In the writing display method, the starting of the synthesis processing of the display subsystem of the display device is not controlled by a system synchronization signal, but the synthesis of the writing rendering result is started immediately after the writing rendering of the writing is completed by the writing device, and the writing synthesis result is displayed. The writing display method enables the whole writing display processing flow to be more compact, enables the display subsystem to start writing synthesis processing earlier, and enables the writing synthesis result to be refreshed to the display screen to be displayed earlier, namely enables the writing of a user to be displayed on the display screen of the display device faster, and therefore time delay of writing display can be reduced.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic processing flow diagram of handwriting display provided by an embodiment of the present application;
fig. 2 is a schematic diagram of a synchronous display flow of a display device provided in an embodiment of the present application;
FIG. 3 is a diagram illustrating a handwriting display process provided by an embodiment of the present application;
FIG. 4 is a flow chart of a writing display method provided by an embodiment of the present application;
FIG. 5 is a schematic diagram of a handwriting display process in the writing display method provided by the embodiment of the application;
FIG. 6 is a schematic structural diagram of a writing display system provided in an embodiment of the present application;
FIG. 7 is a schematic structural diagram of a writing display device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a writing display device provided in an embodiment of the present application.
Detailed Description
The technical scheme of the embodiment of the application is suitable for the application scene that the display device displays the user writing, and by adopting the technical scheme of the embodiment of the application, the time delay of the display device for displaying the user writing can be reduced, so that the writing effect of the writing display is better, and the writing experience of the user is favorably improved.
The display device is usually equipped with an operating system such as Android, IOS, or Windows, as a native operating system of the display device. On the basis of the method, a user can develop or load a third-party application program on a native operating system of the display device, for example, a writing application can be installed for drawing user writing.
Referring to fig. 1, in a conventional writing scene, when a user writes on an input device of a display device, the input device collects touch position information of the user during writing, sends the collected touch position information to a writing application through an input subsystem of the display device system, the writing application draws and renders writing handwriting based on the obtained touch position information, then sends a writing handwriting rendering result to a display subsystem of the display device, the display subsystem performs display content synthesis processing according to the received writing handwriting rendering result to obtain a writing handwriting synthesis result, and finally, the writing handwriting synthesis result is delivered to a display screen of the display device for display.
The input device of the display device is a device supporting the user to input handwriting, and may be a part of the display device or an independent input device connected to the display device. For example, when the display screen of the display device is a touch display screen, the touch display screen has a function of collecting user writing track information, that is, the touch display screen can be used as an input device of the display device for collecting touch position information when the user writes. Alternatively, the input device of the display device may be an input function component such as a tablet mounted on the display device, or may be a device allowing a user to input handwriting, such as a tablet communicatively connected to the display device via a data line.
Therefore, the display process of displaying the handwriting of the user by the display device mainly comprises the following steps: the input subsystem collects and sends touch position information to the writing application, the writing application performs writing handwriting drawing and rendering, the display subsystem performs display content synthesis on rendering results of the writing application, and the display subsystem puts the synthesis results on a display screen for display.
Besides, the native operating system of the display device also realizes synchronous control of the display flow through a system synchronization signal (VSYNC). The display flow synchronization mechanism of the display device enables the image rendering, the rendered image to be subjected to display content synthesis and screen display refreshing to be triggered when a system synchronization signal is received, so that all processes are kept synchronous.
Taking the synchronous display flow in the Android operating system shown in fig. 2 as an example, when a system synchronization signal arrives, the screen refreshes and displays the display content of the nth frame, meanwhile, the display subsystem starts to synthesize the display content of the (N + 1) th frame, and the writing application starts to render the display content of the (N + 2) th frame; when the next system synchronization signal arrives, the screen refreshes and displays the display content of the (N + 1) th frame, meanwhile, the display subsystem starts to synthesize the display content of the (N + 2) th frame, and the writing application starts to render the display content of the (N + 3) th frame, and so on.
Therefore, based on the above display flow synchronization mechanism, image rendering, display content synthesis and screen refreshing processing are respectively performed on different image frames in one synchronization signal period. The display flow synchronization mechanism realizes strict synchronization of each process in the display flow, can effectively eliminate blockage in practical application, and improves the graphic visual representation.
The display flow synchronization mechanism is also used for synchronously controlling the handwriting display flow. Under the display flow synchronization mechanism, handwriting drawn and rendered in the current synchronization signal period by the writing application needs to be synthesized by the display subsystem in the next synchronization signal period, and is refreshed to the display screen for display in the next synchronization signal period.
However, in practical application, it is found that the display delay of the display device to the user writing note is high, the display of the writing trace cannot be synchronously written along with the user, the situation that the writing trace does not follow the pen is caused, and the writing experience of the user is influenced.
The inventor of the present application finds, through a large number of tests, that in a display device, a process of drawing and rendering a writing script by a writing application according to touch position information written by a user usually consumes about 8ms, a processing time of a display subsystem for synthesizing a rendering result of the writing application is usually about 5ms, a speed of refreshing the synthesized result of the display subsystem to a display screen is faster, and the consumed time can be almost ignored. That is, the actual time consumed for the writing drawing and rendering, writing composition, and writing refresh to the display screen is about 13 ms.
However, under the display flow synchronization mechanism of the native operating system of the display device, the time consumption of the process is longer. Taking the screen refresh rate of the Android operating system of 60Hz as an example, as shown in fig. 3, for a frame of handwriting display image, the rendering is performed when the system synchronization signal arrives at time T, the composition is performed when the system synchronization signal arrives at time T + 1, and the screen is refreshed to be displayed when the system synchronization signal arrives at time T + 2. As can be seen, under the display flow synchronization mechanism, the writing handwriting is rendered and synthesized, and the total time is 21.7ms (16.7ms +5 ms). If the final display of the handwriting is considered again, at least two periods of time of the synchronous signal are needed from the rendering of the handwriting to the final refreshing to the display on the display screen, namely 33.4ms is needed, which is obviously more than the actual time-consuming 13ms, and therefore, obvious handwriting display time delay is formed.
In view of the above problems, the inventor of the technical scheme of the application has conducted intensive research, and provides a technical scheme capable of reducing the time delay of displaying the handwriting of the user on the display device.
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
An embodiment of the present application provides a writing display method, as shown in fig. 4, the method includes:
s401, when the input subsystem senses that a writing input event occurs, a writing event trigger signal is sent to the display subsystem, and touch position information collected from the writing input event is sent to the writing application.
Specifically, an input subsystem in the display device system is connected to an input device of the display device for monitoring writing events occurring on the input device. The input subsystem can sense the occurrence of a touch event when a user begins writing on the input device, such as when a capacitive pen is pressed down on the input device.
When the input subsystem senses that a writing input event occurs, the current input scene is determined to be the writing input scene, the input subsystem receives touch position information from input equipment and sends the touch position information to writing application, meanwhile, the input subsystem sends a writing event trigger signal to a display subsystem in a display equipment system, the writing event trigger signal is used for informing the display subsystem, and the current input scene is the user writing input scene.
S402, the display subsystem receives the writing event trigger signal sent by the input subsystem.
And S403, the display subsystem sends a synchronous trigger signal to the system and starts a writing display working mode.
Specifically, after the display subsystem detects a writing event trigger signal sent by the input subsystem, for example, receiving writing event trigger information sent by the input subsystem, or actively detecting that the input subsystem sends the writing event trigger signal, the content to be displayed subsequently can be specified, and handwriting can be written for the user. At this time, the display subsystem starts a writing display working mode, and in the writing display working mode, the work of the display subsystem is no longer constrained by a display flow synchronization mechanism of the display equipment system, specifically, the start of the display content synthesis work of the display subsystem is not controlled by a system synchronization signal of the display equipment system, but is started timely along with the service progress.
And the display subsystem sends a synchronous trigger signal to the display equipment system, wherein the synchronous trigger signal is used for triggering the bottom layer of the display equipment system to send out a system synchronous signal. The period of the system synchronization signal is used to control the synchronization of the various subsystems or applications above the system bottom layer of the display device. The period of the system synchronization signal sent out by the bottom layer of the display device system is set according to the display device system, for example, for the display device system with a screen refresh rate of 60Hz, the system synchronization signal period is about 16.7 ms.
And S404, when the display equipment system receives the synchronization trigger signal, sending out a system synchronization signal.
Specifically, the system synchronization signal sent by the display device system is sent to the writing application and the display subsystem simultaneously.
And S405, when the writing application receives the system synchronization signal, starting to execute writing handwriting drawing and rendering processing.
Specifically, as shown in fig. 3, when receiving a system synchronization signal, the writing application starts to perform writing trace drawing and rendering processing in a current synchronization signal period according to the touch position information sent by the input subsystem, specifically, drawing the writing trace according to the touch position information, and then rendering the drawn writing trace to obtain a writing trace rendering result.
The current synchronization signal period takes the time of receiving the system synchronization signal as the starting time and the time of receiving the next system synchronization signal as the ending time. When the next system synchronization signal is received, the next synchronization signal period is entered.
It should be noted that in a display process of a conventional display device, usually, when an input subsystem senses a writing event, a signal is sent to a writing application, the writing application sends a system synchronization signal to a bottom layer of a display device system, and then the writing application can receive the system synchronization signal to start writing handwriting drawing and rendering processing.
In the embodiment of the application, the input subsystem directly sends a writing event trigger signal to the display subsystem, and the display subsystem sends a synchronous trigger signal to the display equipment system after receiving the writing event trigger signal, so that the bottom layer of the display equipment system sends a system synchronous signal, and the writing application can receive the system synchronous signal. The system synchronization signal triggering process is completely carried out in the display device system and is not subjected to writing application.
Because the writing application is a third-party application or an independent application loaded in the display equipment system, compared with the method that the writing application triggers the bottom layer of the display equipment system to send out a system synchronization signal, the system synchronization signal is directly triggered through the display equipment system, the system synchronization signal can be triggered more timely, the writing application receives the system synchronization signal earlier, and therefore writing handwriting drawing and rendering processing are started.
Therefore, compared with the conventional display device display process, the processing of the steps S401 to S405 in the embodiment of the present application can enable the writing application to start writing drawing and rendering work faster, thereby facilitating displaying the writing of the user in a more timely manner, i.e., facilitating reducing the writing display time delay.
And S406, when the display subsystem receives the system synchronization signal, starting to monitor writing handwriting drawing and rendering processing of the writing application.
Specifically, when the display subsystem receives the system synchronization signal, that is, when the writing application starts to execute the writing trace drawing and rendering processing in the current synchronization period, the display subsystem starts to monitor the writing trace drawing and rendering processing of the writing application, specifically, the processing progress of the writing application is monitored, so that whether the writing application completes the writing trace rendering processing in the current synchronization period can be determined.
And when the writing application finishes the writing rendering processing in the current synchronous signal period, the display subsystem executes the step S407, and starts the writing rendering processing of the writing application in the current synchronous signal period to obtain a writing composition result.
Specifically, it was discussed above that, in the conventional display flow of the display device, the initiation of the composition process of the display subsystem is controlled by the system synchronization signal of the display device, and the display subsystem starts to execute the display content composition process only when the system synchronization signal arrives. Thus, a process flow as shown in fig. 3 is formed.
However, in the embodiment of the present application, the operation of the display subsystem is set, when a user starts writing, the display subsystem enters a writing display operation mode through interaction between the display subsystem and the input subsystem, and in the writing display operation mode, the start of the display content synthesis operation of the display subsystem is not controlled by a system synchronization signal of the display device system, but is started at a proper time along with the service progress.
Referring to fig. 5, in the current synchronization signal period, the display subsystem monitors the writing trace drawing and rendering processing of the writing application in the current synchronization signal period, and after the writing application completes the writing trace rendering processing in the current synchronization signal period, the display subsystem obtains the writing trace rendering result output by the writing application. At this time, the display subsystem does not wait for the system synchronization signal any more, but immediately starts the synthesis processing of the writing rendering result applied in the current synchronization signal period to obtain the writing synthesis result.
As is known from the above description, the total time for drawing, rendering and composition of the handwriting of the user is usually 13ms, so that in general, the writing drawing, rendering and composition process can be completed completely within one synchronization signal period (for example, 16.7 ms).
S408, the display subsystem judges whether the time of completing the synthesis processing of the handwriting rendering result of the writing application in the current synchronization signal period exceeds the end time of the current synchronization signal period.
If the completion time does not exceed the end time of the current synchronization signal period, the subsequent step S411 is performed.
If the completion time exceeds the end time of the current synchronization signal period, the display subsystem further executes the step S409 to judge whether the completion time exceeds the time length of the end time of the current synchronization period and exceeds the set time length;
and if the preset time length is exceeded, the display subsystem executes the step S410 and cancels the synthesis processing of the writing handwriting rendering result of the writing application in the next synchronous signal period of the current synchronous signal period.
Specifically, under some extreme conditions, for example, when too many writing traces are rendered by the writing application, or the CPU occupancy of the display device is too high, the rendering duration of the writing traces may be too long, and at this time, in the current synchronization signal period, the composition of the rendering result of the writing traces applied in the current synchronization signal period cannot be completed, which may affect the rendering and the composition of the writing traces in the next synchronization signal period. In order to avoid this, the embodiment of the present application sets a frame loss mechanism.
Specifically, if the time when the display subsystem completes the writing synthesis processing in the current synchronization signal period exceeds the end time of the current synchronization signal period, it is determined whether the exceeding time length exceeds the set time length. The set duration is the offset of the system synchronization signal set in the embodiment of the present application, and the specific value thereof may be set according to the actual situation.
When the exceeding time length does not exceed the set time length, the completion time of writing composition in the current synchronous signal period is in the system synchronous signal offset range, and at the moment, the writing rendering and composition in the next synchronous signal period are not influenced, so that the processing is not needed.
However, when the exceeding time length exceeds the set time length, it indicates that the completion time of the writing composition in the current synchronization signal period exceeds the system synchronization signal offset range, and enters the next synchronization signal period, which may affect the writing rendering and composition in the next synchronization signal period. In the embodiment of the application, frame dropping processing is executed under the condition, namely writing handwriting display in the next synchronous signal period is dropped, correspondingly, in order to save processing resources, the display subsystem cancels the synthesis processing of the writing handwriting rendering result applied in the next synchronous signal period of the current synchronous signal period, and waits for the next synchronous signal period to execute handwriting synthesis processing.
For example, in the processing flow shown in fig. 5, when the rendered content is too much or the system CPU occupancy is too high at that time, the condition that the rendering time is longer than 11.7ms is occasionally presented, and the total rendering and combining time exceeds 16.7ms by adding the combining time of 5ms, that is, the processing time exceeds the time of the current synchronization signal period, and then the frame loss phenomenon occurs. In order to prevent the frame loss phenomenon, the embodiment of the present application adjusts the offset of the system synchronization signal to be 2ms, the 2ms offset can increase the frame loss length to 18.7ms, and the frame loss processing is performed only when the total rendering and composition duration exceeds 18.7ms (that is, when the rendering and composition duration in the preamble period exceeds the duration of the current synchronization signal period by more than 2 ms). For example, in the case of system rendering time anomaly or extreme CPU occupation, the rendering time is greater than 13.7ms, and the total time of the rendering time exceeds 5m, which will affect the rendering and composition of the next frame, so as to avoid this phenomenon, active frame dropping processing is performed, that is, in this extreme case, the composition operation is not performed on the next frame, but the composition processing of the frame is directly skipped.
The frame loss scheme can avoid continuous influence on handwriting rendering and synthesis in the subsequent synchronous signal period due to long processing time of the current synchronous signal period.
And S411, the display subsystem displays the obtained handwriting synthesis result.
Specifically, after the writing synthesis processing is completed, the display subsystem immediately puts the writing synthesis result on a display screen of the display device or a screen of the display subsystem for display, namely, when the writing synthesis processing is completed, the display screen of the display device or the display refreshing of the screen of the display subsystem is triggered, so that the writing synthesis result is immediately displayed on the display screen.
The display subsystem puts in the handwriting synthetic result, and breaks the limitation of the screen refreshing period of the display device. The writing composition result of the display subsystem is not refreshed on the display screen for displaying when the system synchronization signal arrives, but the display subsystem completes the composition of the writing, and the refreshing of the display screen is directly triggered after the writing composition result is obtained, so that the writing composition result is displayed on the display screen.
As can be seen from the introduction of the foregoing steps S405 to S411, the writing display method provided in the embodiment of the present application can break through the synchronous control of the display flow synchronization mechanism of the display device on rendering, synthesizing, and refreshing of the writing, that is, for the start of the rendering, synthesizing, and refreshing of the writing, only the rendering of the writing is controlled by the synchronization signal, and the subsequent synthesis of the rendering result of the writing and the display refreshing of the synthesis result of the writing are started by the display subsystem at the right time according to the processing progress, that is, when the current sequence repair is completed, the subsequent processing is started immediately. The writing display scheme enables the whole writing display processing flow to be more compact, enables the display subsystem to start writing synthesis earlier, and refreshes the writing synthesis result to the display screen to display earlier, namely enables the writing of a user to be displayed on the display screen of the display device faster, so that the time delay of writing display can be reduced.
And S412, when the input subsystem senses that the writing input event is ended, sending a writing event ending signal to the display subsystem.
And when the display subsystem receives the writing event ending signal sent by the input subsystem, executing the step S413 and exiting the writing display working mode.
In particular, when a user completes writing on the input device, such as when the capacitive pen is lifted from the input device, the input subsystem can sense the end of the touch event, i.e., the end of the written input event.
When the input subsystem senses that the writing input event is ended, a writing event ending signal is sent to a display subsystem in the display equipment system, the writing event ending signal is used for informing the display subsystem, and the user needs to switch to a conventional display scene when the writing input scene is ended.
When the display subsystem detects a writing event end signal sent by the input subsystem, the writing end of a user is confirmed, at the moment, the display subsystem exits a writing display working mode, at the moment, the starting of the display content synthesis work of the display subsystem is controlled by a system synchronization signal of the display equipment, namely, when the display subsystem receives the system synchronization signal, the display content synthesis processing is started.
The display subsystem timely quits the writing display working mode, and the problems that the display device is jammed and the graphic effect is poor due to the fact that the work of the display subsystem does not obey the display flow synchronization mechanism of the display device when the user finishes writing can be avoided.
To sum up, the embodiment of the present application provides a writing display method, including: after the writing application finishes the writing handwriting rendering processing in the current synchronous signal period, starting the writing handwriting rendering processing of the writing application in the current synchronous signal period to obtain a writing handwriting synthesis result; and displaying the obtained handwriting synthesis result.
In the writing display method, the starting of the synthesis processing of the display subsystem of the display device is not controlled by a system synchronization signal, but the synthesis of the writing rendering result is started immediately after the writing rendering of the writing is completed by the writing device, and the writing synthesis result is put on a display screen for displaying. The writing display method enables the whole writing display processing flow to be more compact, enables the display subsystem to start writing synthesis processing earlier, and enables the writing synthesis result to be refreshed to the display screen to be displayed earlier, namely enables the writing of a user to be displayed on the display screen of the display device faster, and therefore time delay of writing display can be reduced.
Corresponding to the above writing display method, an embodiment of the present application further provides a writing display system, where the writing display system includes: the display subsystem is used for starting the synthesis processing of the writing rendering result of the writing application in the current synchronous signal period after the writing application completes the writing rendering processing in the current synchronous signal period to obtain a writing synthesis result; and displaying the obtained handwriting synthesis result.
More specifically, referring to fig. 6, the writing display system specifically includes:
an input subsystem 1, and a display subsystem 2.
The input subsystem 1 is used for sending a writing event trigger signal to the display subsystem 2 when a writing input event is sensed to occur, and sending the acquired touch position information to the writing application;
the display subsystem 2 is used for starting the synthesis processing of the writing handwriting rendering result of the writing application in the current synchronous signal period after the writing application completes the writing handwriting rendering processing in the current synchronous signal period, so as to obtain a writing handwriting synthesis result; and the obtained handwriting synthesis result is put on a display screen for displaying, and the system is also used for sending a synchronous trigger signal to the system when receiving the writing event trigger signal sent by the input subsystem 1, so that the system sends a system synchronous signal after receiving the synchronous trigger signal.
And when receiving a system synchronization signal sent by the system, the writing application executes writing drawing and rendering processing according to the touch position information.
Optionally, the current synchronization signal period takes the time of receiving the system synchronization signal sent by the system as the starting time;
the display subsystem 2 is further configured to: and when the system synchronization signal sent by the system is received, monitoring writing handwriting drawing and rendering processing of the writing application.
Optionally, the display subsystem 2 is further configured to:
when a writing event trigger signal is detected, starting a writing display working mode; in the writing display working mode, when the writing application finishes the writing handwriting rendering processing in the current synchronous signal period, starting the writing handwriting rendering processing in the current synchronous signal period to obtain a writing handwriting combining result; putting the obtained handwriting synthesis result into a display screen for displaying;
when a writing event ending signal is detected, the writing display working mode is exited;
wherein the writing event triggering signal is sent by the input subsystem 1 when the writing input event is sensed to occur, and the writing event ending signal is sent by the input subsystem 1 when the writing input event ending is sensed to end.
Optionally, the display subsystem 2 is further configured to:
when the writing handwriting rendering result of the writing application in the current synchronization signal period is synthesized, judging whether the completion time exceeds the end time of the current synchronization signal period;
if the completion time exceeds the end time of the current synchronization signal period, judging whether the completion time exceeds the time length of the end time of the current synchronization period or not;
and if the preset time length is exceeded, canceling the synthesis processing of the handwriting rendering result of the writing application in the next synchronous signal period of the current synchronous signal period.
Specifically, the detailed working contents of the various parts of the writing display system are described with reference to the above embodiment of the writing display method, and are not repeated here.
An embodiment of the present application further provides a writing display device, as shown in fig. 7, the writing display device including:
the handwriting synthesizing unit 100 is configured to, after the writing application completes writing handwriting rendering processing in the current synchronization signal period, start synthesizing processing of a writing handwriting rendering result of the writing application in the current synchronization signal period to obtain a writing handwriting synthesizing result;
and a handwriting display unit 110, configured to display the obtained handwriting synthesis result.
As an alternative embodiment, the writing display device further includes:
the display synchronization unit is used for sending a synchronization trigger signal to the system when receiving the writing event trigger signal so that the system sends a system synchronization signal after receiving the synchronization trigger signal;
wherein the writing event trigger signal is sent by the input subsystem when a writing input event is sensed; and the writing application starts to execute writing handwriting drawing and rendering processing when receiving a system synchronization signal sent by the system.
As an optional implementation manner, the current synchronization signal period takes a time when the system synchronization signal sent by the system is received as a starting time;
the handwriting synthesis unit 100 is further configured to: and when the system synchronization signal sent by the system is received, monitoring writing handwriting drawing and rendering processing of the writing application.
As an alternative embodiment, the writing display device further includes:
the working mode setting unit is used for starting a writing display working mode when a writing event trigger signal is detected; when a writing event ending signal is detected, the writing display working mode is exited;
in the writing display working mode, when the writing application finishes the writing handwriting rendering processing in the current synchronous signal period, starting the writing handwriting rendering processing in the current synchronous signal period to obtain a writing handwriting combining result; putting the obtained handwriting synthesis result into a display screen for displaying;
wherein the writing event trigger signal is sent by the input subsystem upon sensing the occurrence of a writing input event, and the writing event end signal is sent by the input subsystem upon sensing the end of the writing input event.
As an alternative embodiment, the handwriting synthesis unit 100 is further configured to:
when the writing handwriting rendering result of the writing application in the current synchronization signal period is synthesized, judging whether the completion time exceeds the end time of the current synchronization signal period;
if the completion time exceeds the end time of the current synchronization signal period, judging whether the completion time exceeds the time length of the end time of the current synchronization period or not;
and if the preset time length is exceeded, canceling the synthesis processing of the handwriting rendering result of the writing application in the next synchronous signal period of the current synchronous signal period.
Specifically, please refer to the description of the corresponding processing steps of the above method embodiments for the specific working contents of each unit of the writing display device, which is not described herein again.
Another embodiment of the present application also provides a writing display apparatus, as shown in fig. 8, including:
a memory 200 and a processor 210;
wherein, the memory 200 is connected to the processor 210 for storing programs;
the processor 210 is configured to implement the writing display method disclosed in any of the above embodiments by running the program stored in the memory 200.
Specifically, the writing display device may further include: a bus, a communication interface 220, an input device 230, and an output device 240.
The processor 210, the memory 200, the communication interface 220, the input device 230, and the output device 240 are connected to each other through a bus. Wherein:
a bus may include a path that transfers information between components of a computer system.
The processor 210 may be a general-purpose processor, such as a general-purpose Central Processing Unit (CPU), microprocessor, etc., an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs in accordance with the present invention. But may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components.
The processor 210 may include a main processor and may also include a baseband chip, modem, and the like.
The memory 200 stores programs for executing the technical solution of the present invention, and may also store an operating system and other key services. In particular, the program may include program code including computer operating instructions. More specifically, memory 200 may include a read-only memory (ROM), other types of static storage devices that may store static information and instructions, a Random Access Memory (RAM), other types of dynamic storage devices that may store information and instructions, a disk storage, a flash, and so forth.
The input device 230 may include a means for receiving data and information input by a user, such as a keyboard, mouse, camera, scanner, light pen, voice input device, touch screen, pedometer, or gravity sensor, among others.
The processor 210 executes the program stored in the memory 200 and invokes other devices, which can be used to implement the steps of any one of the writing display methods provided by the above embodiments of the present application.
Another embodiment of the present application further provides a storage medium, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the computer program implements the steps of any one of the writing display methods provided in the above embodiments of the present application.
Specifically, the specific working contents of each part of the writing display device and the specific processing contents of the computer program on the storage medium when being executed by the processor can refer to the contents of each embodiment of the writing display method, which are not described herein again.
While, for purposes of simplicity of explanation, the foregoing method embodiments have been described as a series of acts or combination of acts, it will be appreciated by those skilled in the art that the present application is not limited by the order of acts or acts described, as some steps may occur in other orders or concurrently with other steps in accordance with the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
It should be noted that, in the present specification, the embodiments are all described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments may be referred to each other. For the device-like embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The steps in the method of each embodiment of the present application may be sequentially adjusted, combined, and deleted according to actual needs, and technical features described in each embodiment may be replaced or combined.
The modules and sub-modules in the device and the terminal in the embodiments of the application can be combined, divided and deleted according to actual needs.
In the several embodiments provided in the present application, it should be understood that the disclosed terminal, apparatus and method may be implemented in other manners. For example, the above-described terminal embodiments are merely illustrative, and for example, the division of a module or a sub-module is only one logical division, and there may be other divisions when the terminal is actually implemented, for example, a plurality of sub-modules or modules may be combined or integrated into another module, or some features may be omitted or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
The modules or sub-modules described as separate parts may or may not be physically separate, and parts that are modules or sub-modules may or may not be physical modules or sub-modules, may be located in one place, or may be distributed over a plurality of network modules or sub-modules. Some or all of the modules or sub-modules can be selected according to actual needs to achieve the purpose of the solution of the present embodiment.
In addition, each functional module or sub-module in the embodiments of the present application may be integrated into one processing module, or each module or sub-module may exist alone physically, or two or more modules or sub-modules may be integrated into one module. The integrated modules or sub-modules may be implemented in the form of hardware, or may be implemented in the form of software functional modules or sub-modules.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software unit executed by a processor, or in a combination of the two. The software cells may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A writing display method, comprising:
after the writing application finishes the writing handwriting rendering processing in the current synchronous signal period, starting the writing handwriting rendering processing of the writing application in the current synchronous signal period to obtain a writing handwriting synthesis result;
and displaying the obtained handwriting synthesis result.
2. The method of claim 1, further comprising:
when receiving a writing event trigger signal, sending a synchronous trigger signal to a system so that the system sends a system synchronous signal after receiving the synchronous trigger signal;
wherein the writing event trigger signal is sent by the input subsystem when a writing input event is sensed; and the writing application starts to execute writing handwriting drawing and rendering processing when receiving a system synchronization signal sent by the system.
3. The method of claim 2, wherein the current synchronization signal period starts from a time when the system synchronization signal sent by a system is received;
and when the system synchronization signal sent by the system is received, monitoring writing handwriting drawing and rendering processing of the writing application.
4. The method of claim 1, further comprising:
when a writing event trigger signal is detected, starting a writing display working mode; in the writing display working mode, when the writing application finishes the writing handwriting rendering processing in the current synchronous signal period, starting the writing handwriting rendering processing in the current synchronous signal period to obtain a writing handwriting combining result; putting the obtained handwriting synthesis result into a display screen for displaying;
when a writing event ending signal is detected, the writing display working mode is exited;
wherein the writing event trigger signal is sent by the input subsystem upon sensing the occurrence of a writing input event, and the writing event end signal is sent by the input subsystem upon sensing the end of the writing input event.
5. The method of claim 1, further comprising:
when the writing handwriting rendering result of the writing application in the current synchronization signal period is synthesized, judging whether the completion time exceeds the end time of the current synchronization signal period;
if the completion time exceeds the end time of the current synchronization signal period, judging whether the completion time exceeds the time length of the end time of the current synchronization period or not;
and if the preset time length is exceeded, canceling the synthesis processing of the handwriting rendering result of the writing application in the next synchronous signal period of the current synchronous signal period.
6. A writing display system, comprising:
the display subsystem is used for starting the synthesis processing of the writing rendering result of the writing application in the current synchronous signal period after the writing application completes the writing rendering processing in the current synchronous signal period to obtain a writing synthesis result;
and displaying the obtained handwriting synthesis result.
7. The system of claim 6, further comprising:
the input subsystem is used for sending a writing event trigger signal to the display subsystem when a writing input event is sensed to occur, and sending the collected touch position information to the writing application;
the display subsystem is further used for sending a synchronous trigger signal to the system when the writing event trigger signal sent by the input subsystem is detected, so that the system sends a system synchronous signal after receiving the synchronous trigger signal; and when receiving a system synchronization signal sent by the system, the writing application executes writing drawing and rendering processing according to the touch position information.
8. A writing display device, comprising:
the handwriting synthesis unit is used for starting the synthesis processing of the handwriting rendering result of the writing application in the current synchronous signal period after the writing application completes the handwriting rendering processing in the current synchronous signal period to obtain a handwriting synthesis result;
and the handwriting display unit is used for displaying the obtained handwriting synthesis result.
9. A writing display device, comprising:
a memory and a processor;
the memory is connected with the processor and used for storing programs;
the processor is configured to implement the writing display method according to any one of claims 1 to 5 by executing the program in the memory.
10. A storage medium having stored thereon a computer program which, when executed by a processor, implements the writing display method according to any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619922.7A CN114217730A (en) | 2021-12-27 | 2021-12-27 | Writing display method, device, equipment, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111619922.7A CN114217730A (en) | 2021-12-27 | 2021-12-27 | Writing display method, device, equipment, system and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114217730A true CN114217730A (en) | 2022-03-22 |
Family
ID=80706396
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111619922.7A Pending CN114217730A (en) | 2021-12-27 | 2021-12-27 | Writing display method, device, equipment, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114217730A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114675775A (en) * | 2022-04-24 | 2022-06-28 | 广州文石信息科技有限公司 | Writing display method and device of electronic ink screen, terminal equipment and storage medium |
| CN117215426A (en) * | 2023-01-28 | 2023-12-12 | 荣耀终端有限公司 | Display method and electronic equipment |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109992232A (en) * | 2019-04-09 | 2019-07-09 | Oppo广东移动通信有限公司 | Image updating method, device, terminal and storage medium |
| CN110018874A (en) * | 2019-04-09 | 2019-07-16 | Oppo广东移动通信有限公司 | Vertical synchronization method, apparatus, terminal and storage medium |
| CN110503708A (en) * | 2019-07-03 | 2019-11-26 | 华为技术有限公司 | A kind of image processing method and electronic equipment based on vertical synchronizing signal |
-
2021
- 2021-12-27 CN CN202111619922.7A patent/CN114217730A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109992232A (en) * | 2019-04-09 | 2019-07-09 | Oppo广东移动通信有限公司 | Image updating method, device, terminal and storage medium |
| CN110018874A (en) * | 2019-04-09 | 2019-07-16 | Oppo广东移动通信有限公司 | Vertical synchronization method, apparatus, terminal and storage medium |
| CN110503708A (en) * | 2019-07-03 | 2019-11-26 | 华为技术有限公司 | A kind of image processing method and electronic equipment based on vertical synchronizing signal |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114675775A (en) * | 2022-04-24 | 2022-06-28 | 广州文石信息科技有限公司 | Writing display method and device of electronic ink screen, terminal equipment and storage medium |
| CN114675775B (en) * | 2022-04-24 | 2022-11-18 | 广州文石信息科技有限公司 | Writing display method and device of electronic ink screen, terminal equipment and storage medium |
| CN117215426A (en) * | 2023-01-28 | 2023-12-12 | 荣耀终端有限公司 | Display method and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114217730A (en) | Writing display method, device, equipment, system and storage medium | |
| CN107102936B (en) | Fluency evaluation method, mobile terminal and storage medium | |
| US11442747B2 (en) | Method for establishing applications-to-be preloaded prediction model based on preorder usage sequence of foreground application, storage medium, and terminal | |
| CN102508573B (en) | Method and equipment for realizing rapid positioning through swiping | |
| CN107533450B (en) | Display method and terminal equipment | |
| US8555156B2 (en) | Inferring that a message has been read | |
| US11442600B2 (en) | Screen display method and terminal | |
| CN109976655A (en) | Long screenshotss method, apparatus, terminal and storage medium | |
| CN104050172B (en) | Web page picture loading method and system | |
| CN106814989A (en) | A kind of method and terminal of the page displayed on the terminals | |
| CN112506413B (en) | Touch point prediction method and device, terminal equipment and computer readable storage medium | |
| CN107995440B (en) | Video subtitle map generating method and device, computer readable storage medium and terminal equipment | |
| WO2019085598A1 (en) | Method and apparatus for calculating above-the-fold rendering duration of page, and electronic device | |
| CN111367434B (en) | Touch delay detection method and device, electronic equipment and storage medium | |
| CN108885775A (en) | A kind of display methods and terminal | |
| CN107526499B (en) | Message processing method and device | |
| US20140028701A1 (en) | Modifying transition sequences in a user interface depending on frequency of use | |
| CN108021416B (en) | Media resource loading method and terminal | |
| JP5635672B1 (en) | Image processing apparatus and image processing program | |
| CN107992262A (en) | Split screen display available interface control method, mobile terminal and computer-readable recording medium | |
| CN111327768A (en) | Display control method and device | |
| CN107291339A (en) | A kind of display control method, computer-readable medium and electronic equipment | |
| CN113778430A (en) | Data rendering method, device and equipment of small program and storage medium | |
| CN113986107A (en) | Touch processing method and device based on graphic display system, electronic equipment and storage medium | |
| US8922491B2 (en) | Method and apparatus enabling keystroke acceleration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |