CN116048339A - Note playback method, device, medium, electronic ink screen equipment and product - Google Patents
Note playback method, device, medium, electronic ink screen equipment and product Download PDFInfo
- Publication number
- CN116048339A CN116048339A CN202310085765.9A CN202310085765A CN116048339A CN 116048339 A CN116048339 A CN 116048339A CN 202310085765 A CN202310085765 A CN 202310085765A CN 116048339 A CN116048339 A CN 116048339A
- Authority
- CN
- China
- Prior art keywords
- area
- refreshing
- current
- writing
- note
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides a note playback method, a device, a medium, electronic ink screen equipment and a product, wherein the method is applied to the electronic ink screen equipment, and a display area of the electronic ink screen is divided into a plurality of area blocks; the method comprises the following steps: acquiring position information of writing points of all strokes corresponding to a current refreshing period in a target note; determining a current area block where a first writing point of a current refreshing period is located, and taking the current area block as a refreshing area; and under the condition that any writing point of all writing points of strokes corresponding to the current refreshing period reaches the boundary of the current area block, locally expanding the refreshing area to update the refreshing area, and further refreshing the refreshing area. According to the method and the device for optimizing the note playback process in the software level, each note can be accurately displayed, the full screen refreshing frequency is reduced, and therefore user experience is improved.
Description
Technical Field
The invention relates to the technical field of information, in particular to a note playback method, a device, a medium, electronic ink screen equipment and a product.
Background
At present, devices such as mobile phones, tablet computers and the like often reach a refresh rate of 100-200 HZ, but the refresh rate of an electronic ink screen is difficult to reach more than 40HZ, so that the electronic ink screen has extremely poor effect on dynamic display, the problems of blocking, black and white flickering, ghost shadows and the like are caused, and the electronic ink screen is difficult to reach a satisfactory display effect of a user due to the technical limitation of the refresh rate, so that the user experience is poor.
The refresh rate that can be recognized by the human eye is generally considered to be around 60HZ, and in comparison, the refresh rate of the electronic ink screen is also slower. In practice, the time period from the display instruction to the screen to the completion of the display is generally about half a second, and the response speed of 1ms is very slow for the high-end liquid crystal screen. Taking note playback as an example, if the refresh rate is very high, the screen redrawing can be triggered every 0.1 second when the note is played back, so that the strokes of the note can be clearly and smoothly displayed on a mobile phone or a tablet computer of a user.
However, such high frequency refreshing is not achievable on electronic ink screen devices because if a refresh is triggered every 0.1 seconds, then the refresh will complete the display after about 0.5 seconds, and three to four refresh commands accumulate during this process, and more refresh commands accumulate, resulting in the thread of the refresh rendering being stuck. Even if the refresh command is reduced to more than half a second, the screen will flash due to the full screen refresh, which is equivalent to the frequency of flashing the entire screen once every half a second, and the user experience will be very poor.
Disclosure of Invention
Aiming at the problems, the invention provides a note playback method, a device, a medium, electronic ink screen equipment and a product.
In a first aspect, an embodiment of the present invention provides a note playback method, which is applied to an electronic ink screen device, where a display area of the electronic ink screen is divided into a plurality of area blocks; the note playback method includes:
acquiring position information of writing points of all strokes corresponding to a current refreshing period in a target note;
determining a current area block where a first writing point of a current refreshing period is located based on the position information, and taking the current area block as a refreshing area;
under the condition that any writing point of all strokes corresponding to the current refreshing period reaches the boundary of the current area block, locally expanding the refreshing area to update the refreshing area;
and carrying out refreshing operation on the refreshing area.
In some implementations, the shape of the area block is a polygon, and when any writing point of writing points of all strokes corresponding to the current refresh period reaches the boundary of the current area block, locally expanding the refresh area to update the refresh area includes:
and under the condition that any writing point of writing points of all strokes in the current refreshing period reaches any side of the current area block, expanding at least one area block in the direction of the other area block to which the side belongs, and obtaining the locally expanded refreshing area.
In some implementations, the shape of the area block is a polygon, and when any writing point of writing points of all strokes corresponding to the current refresh period reaches the boundary of the current area block, locally expanding the refresh area to update the refresh area includes:
and under the condition that any writing point of writing points of all strokes in the current refreshing period reaches any vertex of the current area block, expanding at least one area block in the direction of at least one area block in other area blocks to which the vertex belongs, and obtaining the locally expanded refreshing area.
In some implementations, the location information of the writing point includes coordinates of the writing point and a writing time; the determining, based on the location information, a current area block in which a first writing point of a current refresh cycle is located, and taking the current area block as a refresh area includes:
determining a first writing point of the current refresh period based on the writing time in the position information and a time period corresponding to the current refresh period;
and determining a current area block where the first writing point is located, and taking the current area block as a refreshing area.
In some implementations, after performing the refresh operation on the refresh area, the method further includes:
detecting whether the note playback is stopped;
and when the playback of the note is not stopped, entering the next refreshing period, and continuing to execute the step of acquiring the position information of the writing points of all strokes corresponding to the current refreshing period in the target note.
In some implementations, the target note includes a recorded note, and the location information of the writing point includes coordinates of the writing point and a writing time;
the method further comprises the steps of:
acquiring recording information corresponding to a current refreshing period in a target note, wherein the recording information comprises recording content and recording time;
associating the recording time with the writing time;
and playing back the content of the corresponding recording moment matched with the writing time of each writing point in the refreshing area while carrying out refreshing operation on the refreshing area.
In a second aspect, an embodiment of the present invention provides a note playback apparatus, which is applied to an electronic ink screen device, where a display area of the electronic ink screen is divided into a plurality of area blocks; the device comprises:
the acquisition module is used for acquiring the position information of the writing points of all strokes corresponding to the current refreshing period in the target note;
the determining module is used for determining a current area block where a first writing point of a current refreshing period is located based on the position information, and taking the current area block as a refreshing area;
the expansion module is used for locally expanding the refreshing area to update the refreshing area under the condition that any writing point of all writing points of strokes corresponding to the current refreshing period reaches the boundary of the current area block;
and the refreshing module is used for carrying out refreshing operation on the refreshing area.
In a third aspect, an embodiment of the present invention provides a computer readable storage medium, wherein the computer readable storage medium has stored thereon a computer program which, when executed by one or more processors, implements a method as described in the first aspect.
In a fourth aspect, an embodiment of the present invention provides an electronic ink screen device, including a memory and one or more processors, where the memory stores a computer program, and where the computer program is executed by the one or more processors to implement the method according to the first aspect.
In a fifth aspect, embodiments of the present invention provide a computer program product which, when run on a processor, performs the method according to the first aspect.
One or more embodiments of the present invention provide at least the following benefits:
the invention is applied to electronic ink screen equipment, and the display area of the electronic ink screen is divided into a plurality of area blocks; acquiring position information of writing points of all strokes corresponding to a current refreshing period in a target note, determining a current area block where a first writing point of the current refreshing period is located, and taking the current area block as a refreshing area; and under the condition that any writing point of all writing points of strokes corresponding to the current refreshing period reaches the boundary of the current area block, locally expanding the refreshing area to update the refreshing area, and further refreshing the refreshing area. According to the method and the device for optimizing the note playback process in the software level, each note can be accurately displayed, the full screen refreshing frequency is reduced, and therefore user experience is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate certain embodiments of the present invention and therefore should not be considered as limiting the scope.
FIG. 1 is a canvas diagram;
FIG. 2 is a storage schematic;
FIG. 3 is a schematic view of a partial expansion of a refresh zone provided by an embodiment of the present invention;
FIG. 4 is an example of a note playback flow provided by an embodiment of the present invention;
FIG. 5 is a flowchart of a note playback method provided by an embodiment of the present invention;
fig. 6 is a block diagram of a note playback apparatus provided by an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. The components of the embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the invention, as presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be made by a person skilled in the art without making any inventive effort, are intended to be within the scope of the present invention.
The canvas of a handwritten note may be regarded as a matrix, as shown in fig. 1, with the coordinates of the upper left corner being (0, 0) and the coordinates of the lower right corner being (w, h), where w is the width of the canvas area and h is the height of the canvas area. By default, the written point on the canvas is represented as 1, while the unwritten blank point is represented as 0. Thus, if a fully blank canvas is used, it can be represented by a matrix of all 0's, and if all points are darkened (written), it can be represented by a matrix of all 1's. Generally, a note has fewer written locations than unwritten locations, so the set of written points is taken to represent what the canvas is to show.
Although the points written on the canvas can represent a drawing or writing result, for convenience of storage and use for other functions, the strokes are stored as units, as shown in fig. 2, the points from the position P (x 1, y 1) where the handwriting electromagnetic pen (or finger) contacts the canvas to the point Q (x 2, y 2) where the electromagnetic pen lifts up and all the way points of the process are stored as one stroke, and the trigger time of the point P and the point Q is recorded for use for functions such as inquiry. The written content of each page in the note may be considered as a collection of a series of strokes. If the P point and the Q point are coincident and there are no other points between the P point and the Q point, the current stroke is represented as a point, and if the P point and the Q point are coincident and there are other points between the P point and the Q point, the current stroke is represented as a closed graph.
In the related art, there are two general ways to realize note playback and recording synchronization: the method is realized by recording the display content of a screen and peripheral sound, has the advantages of better synchronization of note playback and recording, has the defects of larger memory space occupied by recorded video and useless details in recording, such as the operations of adjusting the shape and the color of a pen and even switching to other applications, can be recorded, and is most critical that the method can not relate notes to the recording, and can not realize the requirement of directly jumping to the corresponding recording position to play if a user wants to realize clicking a handwriting; another method is to associate each stroke and even each point with the current time when drawing, then associate the recording with the current time, so that when selecting the stroke, the corresponding time can be found, and then jump the recording to the corresponding position to realize synchronous playing. In the two methods, the first method cannot realize the jump requirement of the user. The second approach, while cumbersome, can fulfill user needs.
The electronic ink screen consists of two substrates, on which an electronic ink consisting of countless tiny transparent particles is coated, the particles are formed by sealing a plurality of black and white particles with positive and negative electricity in an internal liquid microcapsule, and the charged particles with different colors can move in different directions due to different applied electric fields, so that the effect of black or white is presented on the surface of the display screen. Thus, the surface of the electronic paper can display black and white patterns and characters like printing, and the electronic paper looks very similar to paper, and has no reflection phenomenon of traditional liquid crystal display in sunlight. Meanwhile, only when the color of the pixel changes (for example, black to white), the power is consumed, and the picture on the display screen can still be reserved after the power is turned off, so that the power is saved very much. The power saving and the eye protection are two great advantages of the electronic ink screen. However, today, devices such as mobile phones and tablet computers often reach a refresh rate of 100HZ to 200HZ, but the refresh rate of the electronic ink screen is difficult to reach above 40HZ, so the electronic ink screen has very poor effect on dynamic display, and has the problems of blocking, black and white flickering, ghost shadows and the like, and the electronic ink screen is difficult to reach a satisfactory display effect of a user due to the technical limitation of the refresh rate, so that the user experience is poor.
If the method is implemented on common terminal equipment (mobile phone, tablet personal computer and the like) with high refresh rate, note playback can be realized, but on electronic ink screen equipment, the screen refresh rate of the equipment such as the mobile phone and the like cannot be reached due to the technical limit of the refresh rate of the electronic ink screen, so the following embodiments of the application provide a note playback method, a device, a medium, the electronic ink screen equipment and a product, and the local refresh replaces global refresh, so that the display effect of the electronic ink screen in the note playback process can be obviously improved.
Applicant analysis finds that note playback is the process of restoring the writing of a user, and no matter how fast or slow a recording is played, only one stroke can be in a playback state at the same time, and other strokes on the whole note do not need to be processed, so that the previous state can be maintained. Therefore, the writing area of the whole drawing board is not required to be refreshed at extremely short time intervals, and the flickering of other note contents caused by refreshing can be eliminated.
Example 1
The embodiment provides a note playback method which is applied to electronic ink screen equipment, such as an electronic ink screen electronic paper book, wherein a display area of an electronic ink screen is divided into a plurality of area blocks; as shown in fig. 5, the note playback method includes:
step S101, position information of writing points of all strokes corresponding to a current refreshing period in a target note is obtained.
In practical application, the function of block refreshing and the area blocks of the block refreshing are determined by a system layer. The display area of the electronic ink screen is divided into a plurality of area blocks, which may be polygons, which may refer to quadrilaterals, such as rectangles, squares, and the like, in some cases. In other cases, polygons may also refer to triangles, pentagons, hexagons, etc., such as regular triangles, regular pentagons, regular hexagons, etc., in a variety of shapes. In a specific implementation, the shape and size of the area block may be set according to the requirement, and the set shape may be one or a combination of two or more of the foregoing shapes.
For example, the display area of an electronic ink screen is divided into a plurality of square area blocks of the same size. The boundary information of each region block is determined, and as shown in fig. 3, the upper left corner of the canvas is taken as an origin o, the direction of the origin pointing to the right is taken as a positive half axis of the x axis, and the direction of the origin pointing to the lower is taken as a positive half axis of the y axis. In one example, where the polygon is a quadrilateral, the boundaries of each region block may be determined at an upper left corner and a lower right corner, such as the boundary of region block A1: (x) s ，y s )，(x s+1 ，y s+1 ) Wherein (x) s ，y s ) Representing the upper left angular position, x s And y s Respectively representing the minimum value of the x coordinate and the minimum value of the y coordinate of the area block A1, (x) s+1 ，y s+1 ) Indicating the lower right angular position, x s+1 And y s+1 The x-coordinate maximum value and the y-coordinate maximum value of the region block A1 are respectively indicated.
In some cases, the option of note playback can be preconfigured in the menu option, and the corresponding interface is called by clicking the option by a user, so that the execution of the method is triggered to realize the block refreshing of the note playback process. Further, the refreshing area corresponding to each refreshing period is obtained efficiently and accurately through the subsequent steps, so that smooth display of the note playback process is achieved, and flickering of the electronic ink screen device during global refreshing is avoided.
The position information of the writing points comprises coordinates of the writing points and writing time, the writing sequence/playback sequence of each writing point in the current refreshing period can be determined in the subsequent step based on the writing time, and the synchronous smooth playback of the recording content of the electronic ink screen device and the writing points can be realized under the condition of being associated with the recording time of the corresponding recording content.
In some cases, the refresh period may be tens of milliseconds, for example 20 milliseconds. Because of the consistency of strokes, there may not be multiple strokes, typically for a very short period of time corresponding to one refresh cycle.
Step S102, determining a current area block where a first writing point of a current refresh period is located based on the position information, and taking the current area block as a refresh area.
In some implementations, determining, based on the location information, a current region block in which a first writing point of a current refresh cycle is located, and taking the current region block as a refresh region, further includes:
step S102a, determining a first writing point of the current refresh cycle based on the writing time in the position information and a time period corresponding to the current refresh cycle.
Step S102b, determining a current area block where the first writing point is located, and taking the current area block as a refreshing area.
In the process of handwriting notes, the position information of the writing points is stored in a database in the form of a data structure of P (x, y, t), so that in the process of note playback, only a time period [ t ] corresponding to a configured refresh period is needed 0 ，t 1 ) Extracting t from a database 0 ，t 1 ) The location information of the writing points of all strokes for this period of time. Then, the first writing point P0 (x 0 ，y 0 ，t 0 ) And the current area block where the first writing point is located is positioned according to the boundary of each area block. According to the coordinate relationship, if there is x s ≤x 0 <x s+1 ,y s ≤y 0 <y s+1 It indicates that the first writing point P0 belongs to the area block A1.
Step S103, when any writing point of all strokes corresponding to the current refreshing period reaches the boundary of the current area block, the refreshing area is locally enlarged to update the refreshing area.
Because of the consistency of strokes, it is not possible to have a t 0 To t 1 There are many strokes in this short period of time, so it is not necessary to compare each writing point with the boundary of the region block, only the case where the writing point reaches the boundary of the region block needs to be considered. If a writing point is found to reach the region block boundary, its next writing point is likely to cross the boundary in that direction, thus requiring expansion of the refresh region.
In some implementations, locally expanding the refresh area to update the refresh area if any one of the writing points of all strokes corresponding to the current refresh period reaches the current area block boundary may include:
and under the condition that any writing point of writing points of all strokes in the current refreshing period reaches any side of the current area block, expanding at least one area block in the direction of the other area block to which the side belongs, and obtaining the locally expanded refreshing area.
In this embodiment, for the case of reaching any edge of the area block, at least one area block is enlarged in the direction of the edge, and the refresh area is updated, so as to implement local refresh.
In practical application, since the time of one refresh period is extremely short, one area block can be extended to the direction of another area block to which the side belongs without extending the area of more than one area block under the condition that any writing point reaches any side of the current area block.
In one specific example, assume a write point Pn (x n ，y n ，t n ) If x n ＝x s And y is n If 0, it is considered that the subsequent points to the writing point are likely to be smaller than x s The original refresh zone can be extended to the left zone block to obtain a new refresh zone including zone block A0 and zone block A1 on the left side, the boundary of zone block A1 being defined by the upper left corner coordinates (x s-1 ，y s ) And lower right angular position (x s ，y s+1 ) The boundary of the area block A0 is determined by its upper left corner coordinates (x s ，y s ) And lower right angular position (x s+1 ，y s+1 ) And (5) determining.
In a specific example, as shown in fig. 3, the area block is a quadrilateral area, the first writing point of the current refresh cycle is used as a starting point, the area block where the first writing point is located is determined, a certain writing point in a stroke written from the starting point reaches the right side of the area block, and an area block is expanded in the direction of another area block where the right side belongs to, so that a locally expanded refresh area, namely, a dotted line area in fig. 3, is obtained.
In other implementations, when any writing point of all strokes corresponding to the current refresh period reaches the boundary of the current area block, locally expanding the refresh area to update the refresh area includes:
and under the condition that any writing point of writing points of all strokes in the current refreshing period reaches any vertex of the current area block, expanding at least one area block in the direction of at least one area block in other area blocks to which the vertex belongs, and obtaining the locally expanded refreshing area.
In a specific example, as shown in fig. 3, the area block is a quadrilateral area, the first writing point of the current refresh cycle is used as a starting point, the area block where the first writing point is located is determined, a certain writing point in a stroke written from the starting point reaches the right side of the area block, and an area block is expanded in the direction of another area block where the right side belongs to, so that a locally expanded refresh area, namely, a dotted line area in fig. 3, is obtained.
For example, the writing point Pn (x n ，y n ，t n ) Exactly the vertex (x) s ，y s ) The position x of (2) n ＝x s And y is n ＝y s The refresh zone is enlarged in the lateral and longitudinal directions, respectively. Specifically, the vertex (x s ，y s ) The vertex is located at the upper left corner of the block a, and the vertex also belongs to three area blocks of the upper left corner and the upper left corner of the area block a, and at this time, one area block can be expanded towards at least one direction of the upper left corner and the upper left corner of the area block a so as to expand the refresh area. For example, one area block is extended to one of the directions, or both directions are extended to expand the refresh area in both the lateral and longitudinal directions, (as in FIG. 3)Section line area) so that the range of partial refresh can completely cover the possible next writing point, and the effect of note playback is improved.
Step S104, carrying out refreshing operation on the refreshing area.
According to the method and the device, through optimization of a software layer, local refreshing is adopted to replace global refreshing in the process of note playback, and on the premise that note display accuracy is guaranteed, played note content is displayed more rapidly and smoothly, screen flickering and blocking are reduced, and finally a user can obtain better experience when using a note playback function.
Fig. 4 shows an example of a note playback flow. In the note playback process, under the condition that the area where the starting point P0 is located is found, whether points reaching the boundaries of the upper, lower, left and right sides exist in the writing points in the current refreshing area is further judged, if so, the range of the refreshing area is expanded towards the corresponding direction, the aim of local refreshing of the electronic ink screen is achieved, and a better display effect is achieved on the electronic ink screen.
In some implementations, after performing the refresh operation on the refresh area, the method further includes:
detecting whether the note playback is stopped;
and when the note playback is not stopped, entering the next refresh period, and continuing to execute the step of acquiring the position information of the writing points of all strokes corresponding to the current refresh period in the target note.
In practical applications, the case where the note playback is stopped includes the end of the note playback and the pause of the note playback. If the note playback is not stopped, continuing the note playback of the next refresh period in the note playback process, and executing the method circularly until the note playback is finished.
In some implementations, the target note includes a recorded note that contains both written note content and synchronized recorded content, the method further comprising:
acquiring recording information corresponding to a current refreshing period in a target note, wherein the recording information comprises recording content and recording time;
associating the recording time with the writing time; and
and playing back the content of the corresponding recording moment matched with the writing time of each writing point in the refreshing area while carrying out refreshing operation on the refreshing area.
According to the embodiment, the writing time of each writing point in each refreshing period is associated with the recording time corresponding to the recording content, so that synchronous playback of the recording can be realized while the writing points are refreshed, and the playback function of the recording notes on the electronic ink screen is realized. The method has the advantages that the flash can be avoided through partial refreshing when writing contents of the recording notes are refreshed, corresponding recording can be synchronously played back, the playback process of the whole recording notes is clear and smooth, and user experience is greatly improved.
Example two
The embodiment provides a note playback device which is applied to electronic ink screen equipment, wherein a display area of an electronic ink screen is divided into a plurality of area blocks; as shown in fig. 6, the apparatus includes:
an obtaining module 201, configured to obtain position information of writing points of all strokes corresponding to a current refresh period in a target note;
a determining module 202, configured to determine, based on the location information, a current area block in which a first writing point of a current refresh period is located, and use the current area block as a refresh area;
the expansion module 203 is configured to locally expand the refresh area to update the refresh area when any one of writing points of all strokes corresponding to the current refresh period reaches a boundary of the current area block;
and a refresh module 204, configured to perform a refresh operation on the refresh area.
In practical application, the function of block refreshing and the area blocks of the block refreshing are determined by a system layer. The display area of the electronic ink screen is divided into a plurality of area blocks, which may be polygons, which may refer to quadrilaterals, such as rectangles, squares, and the like, in some cases. In other cases, polygons may also refer to triangles, pentagons, hexagons, etc., such as regular triangles, regular pentagons, regular hexagons, etc., in a variety of shapes. In a specific implementation, the shape and size of the area block may be set according to the requirement, and the set shape may be one or a combination of two or more of the foregoing shapes.
For example, the display area of an electronic ink screen is divided into a plurality of square area blocks of the same size. The boundary information of each region block is determined, and as shown in fig. 3, the upper left corner of the canvas is taken as an origin o, the direction of the origin pointing to the right is taken as a positive half axis of the x axis, and the direction of the origin pointing to the lower is taken as a positive half axis of the y axis. In one example, where the polygon is a quadrilateral, the boundaries of each region block may be determined at an upper left corner and a lower right corner, such as the boundary of region block A1: (x) s ，y s )，(x s+1 ，y s+1 ) Wherein (x) s ，y s ) Representing the upper left angular position, x s And y s Respectively representing the minimum value of the x coordinate and the minimum value of the y coordinate of the area block A1, (x) s+1 ，y s+1 ) Indicating the lower right angular position, x s+1 And y s+1 The x-coordinate maximum value and the y-coordinate maximum value of the region block A1 are respectively indicated.
The position information of the writing points comprises coordinates of the writing points and writing time, the writing sequence/playback sequence of each writing point in the current refreshing period can be determined based on the writing time, and the synchronous smooth playback of the recording content and the writing points of the electronic ink screen equipment can be realized under the condition of being associated with the recording time of the corresponding recording content.
In some cases, the refresh period may be tens of milliseconds, for example 20 milliseconds. Because of the consistency of strokes, there may not be multiple strokes, typically for a very short period of time corresponding to one refresh cycle.
In some implementations, determining, based on the location information, a current region block in which a first writing point of a current refresh cycle is located, and taking the current region block as a refresh region, further includes:
determining a first writing point of a current refresh period based on the writing time in the position information and a time period corresponding to the current refresh period; and determining a current area block where the first writing point is located, and taking the current area block as a refreshing area.
In the process of handwriting notes, the position information of the writing points is stored in a database in the form of a data structure of P (x, y, t), so that in the process of note playback, only a time period [ t ] corresponding to a configured refresh period is needed 0 ，t 1 ) Extracting t from a database 0 ，t 1 ) The location information of the writing points of all strokes for this period of time. Then, the first writing point P0 (x 0 ，y 0 ，t 0 ) And the current area block where the first writing point is located is positioned according to the boundary of each area block. According to the coordinate relationship, if there is x s ≤x 0 <x s+1 ,y s ≤y 0 <y s+1 It indicates that the first writing point P0 belongs to the area block A1.
Because of the consistency of strokes, it is not possible to have a t 0 To t 1 There are many strokes in this short period of time, so it is not necessary to compare each writing point with the boundary of the region block, only the case where the writing point reaches the boundary of the region block needs to be considered. If a writing point is found to reach the region block boundary, its next writing point is likely to cross the boundary in that direction, thus requiring expansion of the refresh region.
In some implementations, locally expanding the refresh area to update the refresh area if any one of the writing points of all strokes corresponding to the current refresh period reaches the current area block boundary may include: and under the condition that any writing point of writing points of all strokes in the current refreshing period reaches any side of the current area block, expanding at least one area block in the direction of the other area block to which the side belongs, and obtaining the locally expanded refreshing area.
In this embodiment, for the case of reaching any edge of the area block, at least one area block is enlarged in the direction of the edge, and the refresh area is updated, so as to implement local refresh.
In practical application, since the time of one refresh period is extremely short, one area block can be extended to the direction of another area block to which the side belongs without extending the area of more than one area block under the condition that any writing point reaches any side of the current area block.
In other implementations, when any writing point of all strokes corresponding to the current refresh period reaches the boundary of the current area block, locally expanding the refresh area to update the refresh area includes: and under the condition that any writing point of writing points of all strokes in the current refreshing period reaches any vertex of the current area block, expanding at least one area block in the direction of at least one area block in other area blocks to which the vertex belongs, and obtaining the locally expanded refreshing area.
According to the method and the device, through optimization of a software layer, local refreshing is adopted to replace global refreshing in the process of note playback, and on the premise that note display accuracy is guaranteed, played note content is displayed more rapidly and smoothly, screen flickering and blocking are reduced, and finally a user can obtain better experience when using a note playback function.
In some implementations, after performing the refresh operation on the refresh area, the apparatus further includes: the detection module is used for:
detecting whether the note playback is stopped; and entering the next refreshing period under the condition that the note playback is not stopped, and continuously acquiring the position information of writing points of all strokes corresponding to the current refreshing period in the target note.
In practical applications, the case where the note playback is stopped includes the end of the note playback and the pause of the note playback. If the note playback is not stopped, continuing the note playback of the next refresh period in the note playback process until the note playback is ended.
In some implementations, the target note includes a recording note that contains both written note content and synchronized recording content, and a recording synchronization module to:
acquiring recording information corresponding to a current refreshing period in a target note, wherein the recording information comprises recording content and recording time; associating the recording time with the writing time; and playing back the content of the corresponding recording moment matched with the writing time of each writing point in the refreshing area while carrying out refreshing operation on the refreshing area.
According to the embodiment, the writing time of each writing point in each refreshing period is associated with the recording time corresponding to the recording content, so that synchronous playback of the recording can be realized while the writing points are refreshed, and the playback function of the recording notes on the electronic ink screen is realized. The method has the advantages that the flash can be avoided through partial refreshing when writing contents of the recording notes are refreshed, corresponding recording can be synchronously played back, the playback process of the whole recording notes is clear and smooth, and user experience is greatly improved.
It should be appreciated that the device of this embodiment provides at least all of the benefits of embodiment one.
Example III
The present embodiment provides a computer-readable storage medium having a computer program stored thereon, which when executed by one or more processors, implements the method of the first embodiment.
The computer readable storage medium may be implemented by any type or combination of volatile or nonvolatile Memory devices, such as static random access Memory (Static Random Access Memory, SRAM for short), electrically erasable programmable Read-Only Memory (Electrically Erasable Programmable Read-Only Memory, EPROM for short), programmable Read-Only Memory (Programmable Read-Only Memory, PROM for short), read-Only Memory (ROM for short), magnetic Memory, flash Memory, magnetic disk, or optical disk.
Example IV
The present embodiment provides an electronic ink screen device including a memory and one or more processors, the memory having stored thereon a computer program that when executed by the one or more processors performs the method of embodiment one.
The electronic ink screen device is, for example, an electronic ink screen electronic paper book or the like. The computer program may be implemented as a note playback application running in an electronic ink screen device.
The processor may be an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), digital signal processor (Digital Signal Processor, DSP), digital signal processing device (Digital Signal Processing Device, DSPD), programmable logic device (Programmable Logic Device, PLD), field programmable gate array (Field Programmable Gate Array, FPGA), controller, microcontroller (Microcontroller Unit, MCU), microprocessor or other electronic component implementation for performing the methods of the above embodiments.
Example five
The present embodiment provides a computer program product which, when run on a processor, performs the method of embodiment one.
In actual practice, the computer program product may be implemented as a note playback application running on an electronic ink screen device. The system of the electronic ink screen device may be an Android system or other operating systems, which is not limited in this embodiment.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. The apparatus and method embodiments described above are merely illustrative.
It should be noted that, in this document, the terms "first," "second," and the like in the description and the claims of the present application and the above drawings are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Although the embodiments of the present invention are described above, the embodiments are only used for facilitating understanding of the present invention, and are not intended to limit the present invention. Any person skilled in the art can make any modification and variation in form and detail without departing from the spirit and scope of the present disclosure, but the scope of the present disclosure is still subject to the scope of the appended claims.
Claims (10)
1. A note playback method is characterized by being applied to electronic ink screen equipment, wherein the display area of an electronic ink screen is divided into a plurality of area blocks; the note playback method includes:
acquiring position information of writing points of all strokes corresponding to a current refreshing period in a target note;
determining a current area block where a first writing point of a current refreshing period is located based on the position information, and taking the current area block as a refreshing area;
under the condition that any writing point of all strokes corresponding to the current refreshing period reaches the boundary of the current area block, locally expanding the refreshing area to update the refreshing area;
and carrying out refreshing operation on the refreshing area.
2. The method according to claim 1, wherein the area block is polygonal in shape, and the locally expanding the refresh area to update the refresh area when any one of writing points of all strokes corresponding to the current refresh period reaches a boundary of the current area block includes:
and under the condition that any writing point of writing points of all strokes in the current refreshing period reaches any side of the current area block, expanding at least one area block in the direction of the other area block to which the side belongs, and obtaining the locally expanded refreshing area.
3. The method according to claim 1, wherein the area block is polygonal in shape, and the locally expanding the refresh area to update the refresh area when any one of writing points of all strokes corresponding to the current refresh period reaches a boundary of the current area block includes:
and under the condition that any writing point of writing points of all strokes in the current refreshing period reaches any vertex of the current area block, expanding at least one area block in the direction of at least one area block in other area blocks to which the vertex belongs, and obtaining the locally expanded refreshing area.
4. The note playback method according to claim 1, wherein the position information of the writing point includes coordinates of the writing point and writing time; the determining, based on the location information, a current area block in which a first writing point of a current refresh cycle is located, and taking the current area block as a refresh area includes:
determining a first writing point of the current refresh period based on the writing time in the position information and a time period corresponding to the current refresh period;
and determining a current area block where the first writing point is located, and taking the current area block as a refreshing area.
5. The note playback method of claim 1, wherein after the refresh operation is performed on the refresh area, the method further comprises:
detecting whether the note playback is stopped;
and when the playback of the note is not stopped, entering the next refreshing period, and continuing to execute the step of acquiring the position information of the writing points of all strokes corresponding to the current refreshing period in the target note.
6. The note playback method of claim 1, wherein the target note includes a recording note, and the position information of the writing point includes coordinates of the writing point and writing time;
the method further comprises the steps of:
acquiring recording information corresponding to a current refreshing period in a target note, wherein the recording information comprises recording content and recording time;
associating the recording time with the writing time;
and playing back the content of the corresponding recording moment matched with the writing time of each writing point in the refreshing area while carrying out refreshing operation on the refreshing area.
7. The note playback device is characterized by being applied to electronic ink screen equipment, wherein the display area of an electronic ink screen is divided into a plurality of area blocks; the device comprises:
the acquisition module is used for acquiring the position information of the writing points of all strokes corresponding to the current refreshing period in the target note;
the determining module is used for determining a current area block where a first writing point of a current refreshing period is located based on the position information, and taking the current area block as a refreshing area;
the expansion module is used for locally expanding the refreshing area to update the refreshing area under the condition that any writing point of all writing points of strokes corresponding to the current refreshing period reaches the boundary of the current area block;
and the refreshing module is used for carrying out refreshing operation on the refreshing area.
8. A computer readable storage medium, having stored thereon a computer program which, when executed by one or more processors, implements the method of any of claims 1 to 6.
9. An electronic ink screen device comprising a memory and one or more processors, the memory having stored thereon a computer program which, when executed by the one or more processors, implements the method of any of claims 1 to 6.
10. A computer program product, characterized in that it performs the method according to any of claims 1 to 6 when run on a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310085765.9A CN116048339A (en) | 2023-01-18 | 2023-01-18 | Note playback method, device, medium, electronic ink screen equipment and product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310085765.9A CN116048339A (en) | 2023-01-18 | 2023-01-18 | Note playback method, device, medium, electronic ink screen equipment and product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116048339A true CN116048339A (en) | 2023-05-02 |
Family
ID=86119904
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310085765.9A Pending CN116048339A (en) | 2023-01-18 | 2023-01-18 | Note playback method, device, medium, electronic ink screen equipment and product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116048339A (en) |
-
2023
- 2023-01-18 CN CN202310085765.9A patent/CN116048339A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110716680B (en) | Control method and device of intelligent interactive panel | |
| US11079929B2 (en) | Devices, methods, and graphical user interfaces for navigating between user interfaces, displaying a dock, and displaying system user interface elements | |
| CN108334229B (en) | Method, device and equipment for adjusting writing track and readable storage medium | |
| CN109739372B (en) | Graph drawing method for handwriting input equipment and handwriting reading equipment | |
| US9354775B2 (en) | Interaction method for dynamic wallpaper and desktop component | |
| US11455460B2 (en) | Method for displaying handwritten note in electronic book, electronic device and computer storage medium | |
| CN110928459B (en) | Writing operation method, device, equipment and storage medium of intelligent interactive tablet | |
| US20210312679A1 (en) | Method for generating identification pattern and terminal device | |
| CN103500066A (en) | Screenshot device and method suitable for touch screen devices | |
| US20190096100A1 (en) | Ink space coordinate system for a digital ink stroke | |
| CN103257735A (en) | Stroke presentation method for handwriting input and electronic device | |
| CN110928475A (en) | Page interaction method, device, equipment and storage medium of intelligent interaction panel | |
| CN111984151B (en) | Whiteboard canvas size and position roaming control method for improving processing efficiency | |
| CN116048339A (en) | Note playback method, device, medium, electronic ink screen equipment and product | |
| US9483171B1 (en) | Low latency touch input rendering | |
| JP4886570B2 (en) | Information processing apparatus, information processing method, and program | |
| CN109104627B (en) | Focus background generation method, storage medium, device and system of android television | |
| CN112861042A (en) | Information display method, device, equipment and readable medium | |
| CN113485590A (en) | Touch operation method and device | |
| CN106933486B (en) | Touch implementation method and device for android system | |
| CN114356205B (en) | Note processing method, electronic device, and computer storage medium | |
| CN115147856B (en) | Table information extraction method and electronic equipment | |
| JPH11306369A (en) | Picture data editor | |
| WO2021244124A1 (en) | Wearable device interaction method and apparatus, wearable device, and storage medium | |
| WO2024109193A1 (en) | Photo editing method, electronic device and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |