WO2020048026A1 - 批注显示方法、装置、设备和存储介质 - Google Patents

批注显示方法、装置、设备和存储介质 Download PDF

Info

Publication number
WO2020048026A1
WO2020048026A1 PCT/CN2018/118481 CN2018118481W WO2020048026A1 WO 2020048026 A1 WO2020048026 A1 WO 2020048026A1 CN 2018118481 W CN2018118481 W CN 2018118481W WO 2020048026 A1 WO2020048026 A1 WO 2020048026A1
Authority
WO
WIPO (PCT)
Prior art keywords
annotation
layer
handwriting
touch
touch data
Prior art date
Application number
PCT/CN2018/118481
Other languages
English (en)
French (fr)
Inventor
姜雷
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Priority to ES18932432T priority Critical patent/ES2968469T3/es
Priority to EP18932432.0A priority patent/EP3805908B1/en
Publication of WO2020048026A1 publication Critical patent/WO2020048026A1/zh
Priority to US17/157,028 priority patent/US11269512B2/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/169—Annotation, e.g. comment data or footnotes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/166—Editing, e.g. inserting or deleting
    • G06F40/171—Editing, e.g. inserting or deleting by use of digital ink

Definitions

  • the present invention relates to the technical field of interactive smart tablets, and in particular, to a method, a device, a device, and a storage medium for displaying annotations on an interactive smart tablet.
  • the annotation function as one of the more and more important functions of interactive smart tablets, has been widely used in people's work and learning, greatly improving people's work and learning results.
  • the user can annotate the content displayed on the current interactive smart tablet, so that other participants can see the annotated content while watching the display content through the interactive smart tablet, so that the participants can participate in the meeting efficiently and make decisions.
  • the annotation function can be implemented by the annotation application.
  • the Android system of the interactive smart tablet After the Android system of the interactive smart tablet detects a touch screen event, it will send coordinate points to the annotation application to assemble the annotation handwriting that the user wants.
  • an annotation handwriting consists of a series of points.
  • Android view refresh is relatively slow, can not meet the needs of writing immediately displayed, need writing acceleration, generally use framebuffer to achieve writing acceleration.
  • a comment display method including:
  • the touch data is data of a touch point caused by an annotation event occurring on a touch screen of an interactive smart tablet
  • Annotation handwriting is displayed through an interactive smart tablet, the annotation handwriting is obtained according to the touch data, and the annotation handwriting is drawn on a mouse layer;
  • the mouse layer is a transparent layer and is located above the system view layer.
  • it further includes:
  • the received touch data is written into a mouse layer to draw the annotation handwriting through the mouse layer.
  • it further includes:
  • the annotation application is started, and it is prohibited to create the system view layer corresponding to the annotation application.
  • it further includes:
  • the mouse layer is initialized.
  • the receiving the touch data further includes:
  • the wake-up operation instruction being an instruction for waking the annotation application
  • it further includes:
  • the method further includes:
  • Annotation handwriting drawn on the system view layer is displayed through an interactive smart tablet.
  • the system is an Android system.
  • the receiving touch data includes receiving touch data sent by an Android system.
  • it further includes:
  • an annotation display device including:
  • a data receiving module configured to receive touch data, where the touch data is data of a touch point caused by an annotation event occurring on a touch screen of the interactive smart tablet;
  • a display module configured to display an annotation handwriting through an interactive smart tablet, the annotation handwriting is obtained according to the touch data, and the annotation handwriting is drawn on a mouse layer;
  • the mouse layer is a transparent layer and is located above the system view layer.
  • it further includes:
  • a first drawing module is configured to write the received touch data into a mouse layer in a case of determining writing acceleration, so as to draw the annotation handwriting through the mouse layer.
  • it further includes:
  • the application startup module is used to start the annotation application at the end of system startup and create a system view layer corresponding to the annotation application.
  • it further includes:
  • the mouse layer startup module is used to initialize the mouse layer at the end of the annotation application startup.
  • it further includes:
  • a wake-up instruction module configured to receive a wake-up operation instruction, where the wake-up operation instruction is an instruction to wake up the annotation application;
  • the application wake-up module is used to switch the annotation application from running in the background to running in the foreground.
  • it further includes:
  • the acceleration exit module is used to receive an instruction to exit writing acceleration and exit writing acceleration
  • a second drawing module is configured to write the received touch data to the system view layer in the case of determining to exit the writing acceleration, so as to draw the annotation handwriting through the system view layer.
  • an annotation display device including: a memory, a display screen with a touch function, and one or more processors;
  • the memory is used to store one or more programs
  • Each processor implements the steps of the annotation display method of any of the foregoing embodiments.
  • a computer storage medium having stored thereon a computer program that, when executed by a processor, implements the steps of the annotation display method as in any of the above embodiments.
  • the annotation handwriting corresponding to the touch data can be drawn through the mouse layer, and the interactive smart tablet Display the annotation handwriting drawn on the mouse layer; because the mouse layer is a transparent layer and is located above the system view layer, it can achieve the effect of writing and displaying, improve the display efficiency of annotation handwriting, and does not affect the normal refresh of the system view layer and Display, taking into account writing acceleration and normal view refresh, further meet the user's annotation needs.
  • annotation handwriting is drawn based on the mouse layer, and the interactive smart tablet system only needs to start the annotation application once during the entire period from startup to shutdown, and the annotation application is started at startup, but the system view layer corresponding to the annotation application is not created, which is beneficial
  • the startup efficiency of the annotation application is improved, and the problem that the interactive smart tablet annotation application starts slowly is solved.
  • FIG. 1 is a schematic flowchart of an annotation display method according to an embodiment
  • FIG. 2 is a schematic effect diagram of a mouse layer and a system view layer according to an embodiment
  • FIG. 3 is an effect diagram of an annotation handwriting seen by a user according to an embodiment
  • FIG. 4 is a schematic flowchart of a method for displaying annotations according to another embodiment
  • FIG. 5 is a schematic structural diagram of an annotation display device according to an embodiment
  • FIG. 6 is a schematic structural diagram of an annotation display device according to another embodiment
  • FIG. 7 is an internal structure diagram of the annotation display device in one embodiment.
  • an embodiment herein means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application.
  • the appearances of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are they independent or alternative embodiments that are mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
  • the annotation display method provided in the embodiment of the present application may be executed by an annotation display device.
  • the annotation display device may be implemented by software and / or hardware.
  • the annotation display device may be composed of two or more physical entities, or may be A physical entity.
  • the annotation display device may be a computer, a mobile phone, a tablet, a projector, or an interactive smart tablet.
  • the interactive smart tablet is used as an example for annotating a display device.
  • the interactive smart tablet may be an integrated device that uses touch technology to control the content displayed on the display tablet and implement human-computer interactive operations. It integrates one or more functions such as a projector, an electronic whiteboard, a curtain, a stereo, a television, and a video conference terminal.
  • the interactive smart flat-panel display is a touch screen
  • the touch screen includes a capacitive screen, an electromagnetic screen, or an infrared screen.
  • the touch screen can receive a touch operation input by a user through a finger or an input device.
  • the input device includes, but is not limited to, a capacitive pen, an electromagnetic pen, and / or an infrared pen.
  • the main controller of the interactive smart tablet runs the Android system.
  • the computing module in communication with the main controller may also run a PC system, such as a Windows system, that is, the user interface displayed through the mutual smart tablet may be either
  • the user interface of the Android system can also be the user interface of the Windows system. The user can switch the interface display as required.
  • an annotation application software is installed in the interactive smart tablet, and the annotation application software may be pre-installed in the interactive smart tablet, or may be downloaded and installed from a third-party device or server after the interactive smart tablet is started.
  • the third-party device is not limited in the embodiment.
  • the annotation application software is used to implement the function of annotating the content displayed by the interactive smart tablet. For example, the function of annotating the screen content displayed by the interactive smart tablet.
  • a method for displaying an annotation which specifically includes the following steps:
  • S110 Receive touch data, where the touch data is data of a touch point caused by an annotation event occurring on a touch screen of the interactive smart tablet.
  • the annotation event is used to instruct the interactive smart tablet to further display the annotation handwriting event on the currently displayed content.
  • the specific form of the annotation event can be set according to the actual situation.
  • the interactive smart tablet can detect the wake-up of the annotation application.
  • the touch operation is determined as an annotation event; for another example, a trigger button is set, and the trigger button can be a physical button or a virtual button, which can be located on an interactive smart tablet or an interactive intelligent tablet.
  • the tablet wirelessly connects the terminal device; when an annotation is needed, the user can operate the trigger button.
  • the interactive smart tablet detects that the trigger button is clicked, double-clicked, or long-pressed, the operation event is determined as an annotation event.
  • the touch point caused by the annotation event is generally multiple points.
  • the user annotates a piece of text or annotates a graphic.
  • the paragraph of text or graphics is composed of multiple points, and therefore corresponds to multiple touch points.
  • the data of the touch point includes coordinate information of the touch point on the display interface, and may further include information such as the size of the touch point and the touch intensity.
  • this step can be understood as: the annotation application receives touch data sent by the interactive smart tablet main system.
  • the interactive intelligent tablet main system can detect the touch data corresponding to the event. If the annotation application is in the awake state (which can be understood as the foreground operating state), the acquired touch data will be obtained. Handover to annotating application for processing.
  • Annotation handwriting is displayed through an interactive smart tablet, the annotation handwriting is obtained according to the touch data, and the annotation handwriting is drawn on a mouse layer; wherein the mouse layer is a transparent layer and is located on a system view layer.
  • the annotation handwriting can be drawn through the system's drawing interface.
  • the Canvas, Path and other interfaces of the Android system can be used to draw the annotation handwriting.
  • the annotation handwriting displayed through step S120 that is, the handwriting written by the user on the touch screen of the interactive smart tablet, can be referred to FIG. 2.
  • the annotation handwriting is drawn on the mouse layer, and the mouse layer is a transparent layer, which is independent of the system view. Layer and above the system view layer.
  • Interactive smart tablets generally support mouse control.
  • the traditional way of writing is accelerated, and the way of drawing the annotation handwriting is to use FrameBuffer to directly operate on the display buffer.
  • the FrameBuffer device is abstracted for user processes to implement direct screen writing operations.
  • the Framebuffer mechanism mimics the functions of a graphics card, abstracting the hardware structure of the graphics card, and can directly operate the video memory by reading and writing Framebuffer.
  • Framebuffer can be regarded as an image of display memory. After mapping it to the process address space, read and write operations can be performed directly, and write operations can be immediately reflected on the screen. This operation is abstract and unified.
  • Annotation handwriting can be displayed immediately through Framebuffer.
  • the Android system is also writing data to the Framebuffer, the picture may be chaotic. For example, the user ’s previous annotation content may be overwritten. Therefore, when using writing acceleration, you must use the Android system view layer. Refresh is disabled, which means freezing the screen. Therefore, the refresh of the Android system view layer does not work when writing is accelerated.
  • the screen can not be frozen when writing acceleration is started, so the user can immediately display the annotation handwriting when annotating, and the tablet system view layer is also It can be refreshed normally, and the screen will not be disordered, that is, the problem that the annotation handwriting written by the user is refreshed and cleared.
  • the annotation application when a user wishes to write an annotation on the interactive smart tablet, after receiving the touch data corresponding to the annotation, the annotation application can draw the annotation handwriting corresponding to the touch data through the mouse layer, and display the mouse layer through the interactive smart tablet.
  • the annotation handwriting drawn on the screen because the mouse layer is a transparent layer and is located above the system view layer, it can achieve the effect of writing and displaying, improve the annotation handwriting display efficiency, and does not affect the normal refresh and display of the system view layer, taking into account It speeds up writing and normal view refresh, which further meets the user's annotation needs.
  • FIG. 4 provides an annotation display method according to another embodiment.
  • an Android system is used as an example for description.
  • the method specifically includes steps:
  • the implementation of this step may include: receiving a second operation instruction, where the second operation instruction is an instruction for starting the system; and starting the system.
  • the second operation instruction is an instruction for starting the system.
  • reference may be made to a system startup process of an existing interactive smart tablet.
  • the specific form of the second operation instruction may be set according to actual conditions.
  • the second operation instruction may be set when the interactive smart tablet is turned off or in a sleep state, when a touch operation on the touch screen is detected, and the touch operation is recognized as the set touch operation.
  • a specific touch gesture is detected, it is determined that the second operation instruction is received when the touch operation is detected; for another example, a system start button is set, and the system start button can be a physical button or a virtual button, which can be located at
  • the interactive smart tablet can also be located on a terminal device that is wirelessly connected to the interactive smart tablet.
  • the user can operate the system startup button.
  • the interactive smart tablet detects that the system startup button is clicked, double-clicked, or long-pressed, etc. During operation, it is confirmed that a second operation instruction is received.
  • the annotation application is started, and it is prohibited to create a system view layer corresponding to the annotation application.
  • the system view layer corresponding to the annotation application is automatically created.
  • the view layer is the part that carries the handwriting or content and is used to draw the final display content.
  • the Android system will commission the application during the startup process. Creating a corresponding view will consume a certain amount of time and cause the application to take a long time to start. Specifically, for annotating an application, starting an annotation application in the traditional way takes a long time and the user needs to wait.
  • the mouse layer is initialized at the end of starting the annotation application.
  • the mouse layer is the view layer corresponding to the mouse icon. It is independent of the system view layer and is located above the system view layer.
  • the mouse layer is a transparent layer. Through the mouse layer, you can see the view layer below it. It should be noted that the mouse layer may be a 100% transparent layer, that is, a completely transparent layer, or a transparent layer to another extent, such as an 80% transparent layer.
  • the annotation application is started at startup, and the interactive smart tablet system only needs to start the annotation application during the entire period from startup to shutdown.
  • the user needs to make annotations, he only needs to wake up the annotation application, which further saves restart Time-consuming to annotate applications.
  • the specific implementation of this step may be: receiving a third operation instruction, the third operation instruction is an instruction for awakening the annotation application; and switching the annotation application from running in the background to running in the foreground.
  • the process of switching an annotation application from running in the background to running in the foreground that is, the process of annotating the application to wake up.
  • the specific form of the third operation instruction may be set according to actual conditions.
  • the third operation instruction may be an interactive smart tablet annotation application running in the background, when a touch operation on the touch screen is detected, and it is recognized that the touch operation is set.
  • a touch operation for example, a specific touch gesture (which is different from the touch gesture for activating the interactive smart tablet system described above), when the touch operation is detected, it is determined to receive a third operation instruction; for another example, setting a wake-up button
  • the wake-up button can be a physical button or a virtual button, which can be located on the interactive smart tablet or a terminal device wirelessly connected to the interactive smart tablet.
  • the wake-up annotation application is needed, the user can operate the wake-up button and the interactive smart
  • the tablet detects that the wake-up button is clicked, double-clicked, or long-pressed, it confirms that it receives a third operation instruction.
  • the annotation application receives touch data sent by the Android system, and the touch data includes data of multiple touch points.
  • step S406 whether to enable writing acceleration, and if yes, perform step S407; if not, perform step S408.
  • the user can select whether writing acceleration is required, and if necessary, can choose to enable the writing acceleration function, for example: receiving a first operation instruction, the first operation instruction is an instruction for starting writing acceleration; The obtained touch data is written into the mouse layer to draw the annotation handwriting through the mouse layer, that is, the next step is performed.
  • the specific form of the first operation instruction may be set according to actual conditions.
  • the first operation instruction may be set when the interactive smart tablet detects a touch operation on the touch screen after waking the annotation application, and recognizes that the touch operation is a set touch operation.
  • this touch gesture is different from the above-mentioned touch gesture for starting the interactive smart tablet system, and also different from the above-mentioned gesture for starting the annotation application
  • it is determined that the first operation is received when the touch operation is detected Instructions for example, setting a start button, which can be a physical button or a virtual button, which can be located on the interactive smart tablet or a terminal device wirelessly connected to the interactive smart tablet; when writing acceleration is needed, the user
  • the start button can be operated.
  • the interactive smart tablet detects that the start button is clicked, double-clicked, or long-pressed, it confirms that the first operation instruction is received.
  • the mouse layer is used to replace the framebuffer under traditional writing acceleration to draw annotation handwriting. Because the Android system view layer refresh does not affect the drawing of the mouse layer, it can achieve non-freezing screen operation while writing is accelerated. The problem that Android system view layer refresh is not allowed when writing is accelerated. Therefore, while the annotation handwriting is displayed through the interactive smart tablet, the refreshed content of the system view layer can also be displayed at the same time.
  • S408 Write the received touch data to the system view layer to draw annotation handwriting through the system view layer. Then, the annotation handwriting drawn on the view layer of the system is displayed through an interactive smart tablet.
  • the specific implementation method for drawing annotation handwriting by touch data may use the 2D drawing interface built in Android system, such as Canvas, Path, etc. Different), and then displayed through the Android hardware layer synthesis.
  • the implementation process may include receiving a fourth operation instruction, where Instructions to exit writing acceleration; write the received touch data to the system view layer to draw annotation handwriting through the system view layer.
  • the specific form of the fourth operation instruction may be set according to actual conditions.
  • the fourth operation instruction may be set when the writing of the interactive smart tablet is accelerated, and when a touch operation on the touch screen is detected, and the touch operation is identified as being set.
  • a touch operation such as a specific touch gesture, is determined to receive a fourth operation instruction when the touch operation is detected; for another example, setting an exit quick button, which can be a physical button or a virtual button. It can be located on the interactive smart tablet, or it can be located on the terminal device wirelessly connected to the interactive smart tablet. When it is necessary to exit the writing fast, the user can operate the exit quick button.
  • the interactive smart tablet detects that the exit quick button is clicked, double-clicked, or When you press and hold for a while, you confirm that you have received the fourth operation instruction.
  • the user can choose whether to accelerate writing when annotating on the interactive smart tablet. If it is, then draw the written annotation handwriting through the mouse layer to achieve the effect of writing and displaying. If acceleration is not required, follow the normal system Annotation drawing method, drawing through the corresponding system view layer, to meet the needs of annotation in different scenarios.
  • the steps in the flowchart are sequentially displayed according to the directions of the arrows, these steps are not necessarily performed in the order indicated by the arrows. Unless explicitly stated in this document, the execution of these steps is not strictly limited, and these steps can be performed in other orders. Moreover, at least a part of the steps in the flowchart of the method embodiment may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily performed at the same time, but may be performed at different times. These sub-steps Or the order of execution of the stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.
  • an annotation display device is also provided herein.
  • the annotation display device of this embodiment includes a data receiving module 501 and a display module 502, and each module is detailed as follows:
  • a data receiving module 501 configured to receive touch data, where the touch data is data of a touch point caused by an annotation event occurring on a touch screen of an interactive smart tablet;
  • a display module 502 is configured to display an annotation handwriting through an interactive smart tablet.
  • the annotation handwriting is obtained according to the touch data, and the annotation handwriting is drawn on a mouse layer.
  • the mouse layer is a transparent layer and is located in a system view layer. on.
  • the data receiving module 510 is specifically configured to receive touch data sent by the Android system.
  • the above-mentioned annotation display device further includes:
  • the first drawing module 503 is configured to write the received touch data into a mouse layer in a case of determining writing acceleration, so as to draw the annotation handwriting through the mouse layer.
  • annotation display device may further include:
  • a first instruction module configured to receive a first operation instruction, where the first operation instruction is an instruction for starting writing acceleration
  • the first startup module is used to start writing acceleration.
  • annotation display device further includes:
  • the application startup module is used to start the annotation application at the end of the interactive smart tablet system startup and create a system view layer corresponding to the annotation application.
  • annotation display device may further include a system startup module for starting the interactive intelligent tablet system.
  • the above-mentioned annotation display device further includes: a second instruction module for receiving a second operation instruction, where the second operation instruction is an instruction for starting the interactive smart tablet system.
  • the above-mentioned annotation display device further includes: a mouse layer starting module, configured to initialize the mouse layer when the annotation application startup ends.
  • annotation display device further includes:
  • a wake-up instruction module configured to receive a wake-up operation instruction, where the wake-up operation instruction is an instruction to wake up the annotation application;
  • the application wake-up module is used to switch the annotation application from running in the background to running in the foreground.
  • the above-mentioned annotation display device further includes:
  • the acceleration exit module 504 is configured to receive an instruction to exit writing acceleration and exit writing acceleration
  • the second drawing module 505 is configured to write the received touch data to the system view layer in a case where it is determined to quit writing acceleration, so as to draw the annotation handwriting through the system view layer.
  • annotation display device further includes:
  • the display module 502 is further configured to display the annotation handwriting drawn on the system view layer through an interactive smart tablet.
  • the system is an Android system.
  • Each module in the above-mentioned annotation display device may be implemented in whole or in part by software, hardware, and a combination thereof.
  • Each of the above modules may be embedded in the processor in the form of hardware or independent of the processor in the device, or may be stored in the memory of the device in the form of software to facilitate the processor to call and execute the operations corresponding to the above modules.
  • each program module is only an example.
  • the above functions may be used according to the needs of the configuration of the corresponding hardware or the convenience of software
  • the allocation is performed by different program modules, that is, the internal structure of the annotation display device is divided into different program modules to complete all or part of the functions described above.
  • an annotation display device is provided, and its internal structure diagram can be as shown in FIG. 7.
  • the device includes a processor, memory, network interface, display screen, and input devices connected via a system bus.
  • the processor is used to provide computing and control capabilities.
  • the memory includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system and a computer program.
  • the internal memory is a non-volatile storage medium.
  • the operating system and the computer program provide an environment for running; the network interface is used to communicate with external terminals through a network connection; the computer program is executed by the processor to implement an annotation display method; the display screen can be a liquid crystal display or electronic ink display
  • the input device may be a touch layer covered on a display screen, or a button, a trackball, or a touchpad provided on a device casing, or an external keyboard, a touchpad, or a mouse.
  • FIG. 7 is only a block diagram of a part of the structure related to the scheme of the present application, and does not constitute a limitation on the annotation display device to which the scheme of the present application is applied.
  • the device may include more or fewer components than shown in the figure, or some components may be combined, or have different component arrangements.
  • an annotation display device including: a memory, a display screen with a touch function, and one or more processors;
  • the memory is used to store one or more programs
  • the touch data is data of a touch point caused by an annotation event occurring on a touch screen of an interactive smart tablet
  • Annotation handwriting is displayed through an interactive smart tablet, the annotation handwriting is obtained according to the touch data, and the annotation handwriting is drawn on a mouse layer;
  • the mouse layer is a transparent layer and is located above the system view layer.
  • the processor when the computer program is executed by the processor, the processor is further caused to implement the steps of the annotation display method in the other embodiments described above.
  • a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the following steps are implemented:
  • the touch data is data of a touch point caused by an annotation event occurring on a touch screen of an interactive smart tablet
  • Annotation handwriting is displayed through an interactive smart tablet, the annotation handwriting is obtained according to the touch data, and the annotation handwriting is drawn on a mouse layer;
  • the mouse layer is a transparent layer and is located above the system view layer.
  • the steps of the annotation display method in other embodiments described above are also implemented.
  • Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory can include random access memory (RAM) or external cache memory.
  • RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Synchlink DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
  • SRAM static RAM
  • DRAM dynamic RAM
  • SDRAM synchronous DRAM
  • DDRSDRAM dual data rate SDRAM
  • ESDRAM enhanced SDRAM
  • SLDRAM synchronous chain Synchlink DRAM
  • Rambus direct RAM
  • DRAM direct memory bus dynamic RAM
  • RDRAM memory bus dynamic RAM
  • the "plurality” mentioned in the examples means two or more.
  • “And / or” describes the related relationship of related objects and indicates that there can be three types of relationships. For example, A and / or B can indicate that there are three cases where A exists alone, A and B exist simultaneously, and B exists alone.
  • the character "/" generally indicates that the related objects are an "or" relationship.
  • first ⁇ second mentioned in the embodiment is only a difference between similar objects, and does not represent a specific ordering of objects. Understandably, “first ⁇ second” can be interchanged with specific ones if allowed. Sequential or sequential. It should be understood that the objects of the "first ⁇ second" distinction are interchangeable where appropriate, so that the embodiments described herein can be implemented in an order other than those illustrated or described herein.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种批注显示方法、装置、设备和存储介质，应用于交互智能平板技术领域。所述方法包括：接收触摸数据，所述触摸数据为发生在交互智能平板触摸屏上的批注事件引起的触摸点的数据（S110）；通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层（S120）。解决了书写加速时无法刷新系统视图的问题，同时实现了快速显示批注笔迹的目的。

Description

批注显示方法、装置、设备和存储介质 技术领域
本发明涉及交互智能平板技术领域，特别是涉及交互智能平板上的批注显示方法、装置、设备和存储介质。
背景技术
在交互智能平板领域，批注功能作为交互智能平板越来越重要的功能之一，已经广泛的应用于在人们的工作和学习之中，极大的提高了人们的工作及学习效果。例如，在会议场景下，用户可以对当前交互智能平板上显示的内容进行批注，使其他与会人员通过交互智能平板观看展示内容的同时能够看到批注内容，使得与会人员高效的与会及决策。
批注功能可以由批注应用实现，交互智能平板的Android系统检测到触摸屏事件之后，会给批注应用发送坐标点，用来组装成用户想要的批注笔迹，通常一条批注笔迹由一系列的点组成。Android视图刷新相对而言比较慢，不能够满足书写立马显示的需要，需要书写加速，一般是利用framebuffer来实现书写加速。
在实现本发明的过程中，发明人发现现有技术中存在如下问题，批注应用使用framebuffer的时候，Android也会使用framebuffer，因此可能会出现画面混乱的情况，为了避免该问题，通常的做法是在批注应用使用framebuffer的时候，禁止掉android的操作(也就是冻屏)，但是在冻屏情况下，在书写批注笔迹时Android视图的刷新将不起作用，无法满足正常的视图刷新的需求。
发明内容
基于此，有必要针对现有方式在书写加速情况下无法满足正常的视图刷新需求的问题，提供一种批注显示方法、装置、设备和存储介质。
根据本发明的第一方面，提供一种批注显示方法，包括：
接收触摸数据，所述触摸数据为发生在交互智能平板触摸屏上的批注事件 引起的触摸点的数据；
通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层；
其中，所述鼠标层为透明层，且位于系统视图层之上。
在其中一个实施例中，还包括：
在确定书写加速的情况下，将接收到的触摸数据写入鼠标层，以通过鼠标层绘制所述批注笔迹。
在其中一个实施例中，还包括：
启动交互智能平板系统；
在系统启动结束时，启动批注应用，禁止创建批注应用对应的系统视图层。
在其中一个实施例中，还包括：
在批注应用启动结束时，初始化鼠标层。
在其中一个实施例中，所述接收触摸数据，之前还包括：
接收唤醒操作指令，所述唤醒操作指令为用于唤醒批注应用的指令；
将批注应用从后台运行切换至前台运行。
在其中一个实施例中，还包括：
接收退出书写加速操作指令，退出书写加速。
在其中一个实施例中，所述接收触摸数据，之后还包括：
在确定退出书写加速的情况下，将接收到的触摸数据写入系统视图层，以通过系统视图层绘制批注笔迹；
通过交互智能平板显示绘制在系统视图层的批注笔迹。
在其中一个实施例中，所述系统Android系统。
在其中一个实施例中，所述接收触摸数据，包括：接收Android系统发送的触摸数据。
在其中一个实施例中，还包括：
在通过交互智能平板显示批注笔迹的同时，显示系统视图层刷新的内容。
根据本发明的第二方面，提供一种批注显示装置，包括：
数据接收模块，用于接收触摸数据，所述触摸数据为发生在交互智能平板 触摸屏上的批注事件引起的触摸点的数据；
显示模块，用于通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层；
其中，所述鼠标层为透明层，且位于系统视图层之上。
在其中一个实施例中，还包括：
第一绘制模块，用于在确定书写加速的情况下，将接收到的触摸数据写入鼠标层，以通过鼠标层绘制所述批注笔迹。
在其中一个实施例中，还包括：
应用启动模块，用于在系统启动结束时，启动批注应用，创建批注应用对应的系统视图层。
在其中一个实施例中，还包括：
鼠标层启动模块，用于在批注应用启动结束时，初始化鼠标层。
在其中一个实施例中，还包括：
唤醒指令模块，用于接收唤醒操作指令，所述唤醒操作指令为用于唤醒批注应用的指令；
应用唤醒模块，用于将批注应用从后台运行切换至前台运行。
在其中一个实施例中，还包括：
加速退出模块，用于接收退出书写加速操作指令，退出书写加速；
和/或，第二绘制模块，用于在确定退出书写加速的情况下，将接收到的触摸数据写入系统视图层，以通过系统视图层绘制批注笔迹。
根据本发明的第三方面，提供一种批注显示设备，包括：存储器、具有触摸功能的显示屏以及一个或多个处理器；
所述存储器，用于存储一个或多个程序；
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多
个处理器实现上述任一实施例的批注显示方法的步骤。
根据本发明的第四方面，提供一种计算机存储介质，其上存储有计算机程序，该程序被处理器执行时实现如上述任一实施例的批注显示方法的步骤。
实施本发明提供的实施例，当用户希望在交互智能平板上书写批注时，批 注应用接收到批注对应的触摸数据之后，可以通过鼠标层绘制所述触摸数据对应的批注笔迹，并通过交互智能平板显示鼠标层上绘制的批注笔迹；由于鼠标层为透明层，且位于系统视图层之上，因此既能够实现书写即显示的效果，提高批注笔迹显示效率，同时不影响系统视图层的正常刷新及显示，兼顾了书写加速以及正常的视图刷新，进一步满足了用户的批注需求。
进一步地，基于鼠标层绘制批注笔迹，实现交互智能平板的系统从启动到关闭整个期间只需启动一次批注应用，并且在开机时候启动批注应用，但不创建批注应用对应的系统视图层，有利于提高批注应用的启动效率，解决了交互智能平板批注应用启动慢的问题。
附图说明
图1为一实施例的批注显示方法的示意性流程图；
图2为一实施例的鼠标层与系统视图层的示意性效果图；
图3为一实施例的用户看到的批注笔迹的效果图；
图4为另一实施例的批注显示方法的示意性流程图；
图5为一实施例的批注显示装置的示意性结构图；
图6为另一实施例的批注显示装置的示意性结构图；
图7为一个实施例中批注显示设备的内部结构图。
具体实施方式
为了使本发明的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
在本文中提及“实施例”意味着，结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例，也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是，本文所描述的实施例可以与其它实施例相结合。
本申请实施例提供的批注显示方法，可以由批注显示设备执行，该批注显示设备可以通过软件和/或硬件的方式实现，该批注显示设备可以是两个或多个物理实体构成，也可以是一个物理实体构成。该批注显示设备可以是电脑，手机，平板，投影仪或交互智能平板等。在实施例中，以交互智能平板为批注显示设备为例进行描述，其中，交互智能平板可以是通过触控技术对显示在显示平板上的内容进行操控和实现人机交互操作的一体化设备，其集成了投影机、电子白板、幕布、音响、电视机以及视频会议终端等一种或多种功能。
在实施例中，交互智能平板显示屏为触摸屏，该触摸屏包括电容屏、电磁屏或红外屏等。该触摸屏可以接收用户通过手指或者输入设备输入的触摸操作。其中，输入设备包括但不限定于：电容笔、电磁笔和/或红外笔等。
在实施例中，交互智能平板的主控制器运行Android系统，此外，与主控制器通信连接的计算模块还可以运行PC系统，例如Windows系统，即通过互智能平板显示的用户界面，既可以是Android系统的用户界面，也可以是Windows系统的用户界面。用户可以根据需要进行界面显示的切换。
可选的，交互智能平板中安装有批注应用软件，该批注应用软件可以预先安装在上述交互智能平板中，也可以是在交互智能平板启动之后，从第三方设备或服务器进行下载并安装使用。其中，第三方设备在实施例中不作限定。具体地，批注应用软件用于实现对交互智能平板展示的内容进行批注的功能。例如，对交互智能平板展示的投屏内容进行批注的功能。
在一个实施例中，如图1所示，提供了一种批注显示方法，具体包括以下步骤：
S110，接收触摸数据，所述触摸数据为发生在交互智能平板触摸屏上的批注事件引起的触摸点的数据。
其中，批注事件用于指示交互智能平板在当前展示的内容上进一步显示批注笔迹的事件，批注事件的具体形式可以根据实际情况设定，例如，可以是交互智能平板在唤醒批注应用之后，检测到触摸屏上的触摸操作时，将该触摸操作确定为批注事件；又如，设定触发按键，该触发按键可以是实体按键也可以是虚拟按键，其可以位于交互智能平板，也可以位于与交互智能平板无线连接 的终端设备；当需要进行批注时，用户可以操作该触发按键，交互智能平板检测到触发按键被点击、被双击或者被长按等操作时，将该操作事件确定为批注事件。
其中，批注事件引起的触摸点一般是多个点，例如用户批注一段文字，或者批注一个图形，该段文字或者图形由多个点组成，因此对应多个触摸点。触摸点的数据包括触摸点在显示界面上的坐标信息，此外，还可以包括触摸点的尺寸、触摸强度等信息。
在实施例中，本步骤可以理解为：批注应用接收交互智能平板主系统发送的触摸数据。在交互智能平板触摸屏上发生批注事件时，交互智能平板主系统可以检测到该事件对应的触摸数据，若此时批注应用为唤醒状态(可以理解为前台运行状态)，则将获取到的触摸数据移交给批注应用进行处理。
S120，通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层；其中，所述鼠标层为透明层，且位于系统视图层之上。
其中，批注笔迹可以通过系统的画图接口实现绘制，例如Android系统的Canvas、Path等接口实现批注笔迹的绘制。通过步骤S120显示的批注笔迹，即用户在交互智能平板触摸屏上书写的笔迹，可以参考图2所示，本实施例中，批注笔迹绘制在鼠标层，鼠标层为透明层，其独立于系统视图层，并且位于系统视图层之上。交互智能平板一般都支持鼠标控制，为了实现使交互智能平板搭配鼠标的时候不会因为平板系统的卡顿导致鼠标的卡顿，通常会为鼠标做了专门的优化，使得鼠标图标与平板系统视图通过两个不同的显示层进行绘制，最终显示时候从硬件层面把两个显示层的内容混合，例如用户当前的批注操作是对内容“你好”画圈批注，对应的鼠标层和系统视图层的内容图2所示，经过硬件层面把两个显示层的内容混合之后，从用户角度看到的显示效果如图3所示。
传统方式的书写加速，其批注笔迹的绘制方式为：利用FrameBuffer来实现直接对显示缓冲区操作。基于Linux内核抽象出FrameBuffer设备是供用户进程实现直接写屏操作的。Framebuffer机制模仿显卡的功能，将显卡硬件结构抽象掉，可以通过Framebuffer的读写直接对显存进行操作。可以将Framebuffer看 成是显示内存的一个映像，将其映射到进程地址空间之后，就可以直接进行读写操作，而写操作可以立即反应在屏幕上。这种操作是抽象的，统一的。批注笔迹可以通过Framebuffer实现书写立马显示。不过由于Android系统也在向Framebuffer写入数据，因此可能会出现画面混乱的情况，例如可能出现用户之前的批注内容被覆盖掉的情况，因此需要在使用书写加速的时候必须把Android系统视图层的刷新禁用掉，也就是冻屏。因此在书写加速的时候Android系统视图层的刷新是不起作用的。
在上述实施例中，由于平板系统视图层的刷新不会影响鼠标层的绘制，因此可以在启动书写加速的时候不冻屏，因此用户进行批注时能够立马显示批注笔迹，同时平板系统视图层也可以正常刷新，并且不会出现画面错乱，即不会出现用户书写的批注笔迹被刷新清掉的问题。
通过上述实施例，当用户希望在交互智能平板上书写批注时，批注应用接收到批注对应的触摸数据之后，可以通过鼠标层绘制所述触摸数据对应的批注笔迹，并通过交互智能平板显示鼠标层上绘制的批注笔迹；由于鼠标层为透明层，且位于系统视图层之上，因此既能够实现书写即显示的效果，提高批注笔迹显示效率，同时不影响系统视图层的正常刷新及显示，兼顾了书写加速以及正常的视图刷新，进一步满足了用户的批注需求。
进一步地，图4提供了另一实施例的批注显示方法，在本实施例中，以Android系统为例进行说明，该方法具体包括步骤：
S401，启动交互智能平板系统。
在一些实施例中，该步骤的实现方式可以包括：接收第二操作指令，所述第二操作指令为用于启动系统的指令；启动系统。具体的，可以参照现有的交互智能平板的系统启动过程。
其中，第二操作指令的具体形式可以根据实际情况设定，例如，可以是交互智能平板关机或者休眠状态下，检测到触摸屏上的触摸操作时，且识别出该触摸操作为设定的触摸操作，例如特定触摸手势等，则在检测到该触摸操作时，确定为收到第二操作指令；又如，设置系统启动按键，该系统启动按键可以是实体按键也可以是虚拟按键，其可以位于交互智能平板，也可以位于与交互智 能平板无线连接的终端设备；当需要启动系统时，用户可以操作该系统启动按键，交互智能平板检测到该系统启动按键被点击、被双击或者被长按等操作时，则确认收到第二操作指令。
S402，启动批注应用，禁止创建批注应用对应的系统视图层。
本实施例中，在系统启动结束时，启动批注应用，禁止创建批注应用对应的系统视图层。通常情况下，在启动批注应用过程中，会自动创建批注应用对应的系统视图层，视图层是承载笔迹或者内容的部分，是用来绘制最终的显示内容，Android系统启动应用过程中会委应用创建相应的视图，这会消耗一定的时间，导致启动应用耗时较长，具体到批注应用，按照传统方式启动批注应用，耗时较长，用户需要等待。
本实施例中，启动批注应用时无需创建对应的系统视图层，可以实现批注应用的快速启动。
S403，初始化鼠标层。
本实施例中，在批注应用启动结束时，即初始化鼠标层。
鼠标层为绘制鼠标图标对应的视图层，其独立于系统视图层，并且位于系统视图层之上，鼠标层为透明层，透过鼠标层可以看到位于其下的视图层。需要说明的是，鼠标层可以是100％透明层，即完全透明的图层，也可以是其他程度的透明层，例如80％的透明层。
S404，唤醒批注应用。
本实施例中，在开机时候启动批注应用，并且交互智能平板的系统从启动到关闭整个期间只需启动一次批注应用，用户需要进行批注时，只需唤醒批注应用即可，进一步节省了重新启动批注应用的耗时。
在一实施例中，该步骤的具体实现方式可为：接收第三操作指令，所述第三操作指令为用于唤醒批注应用的指令；将批注应用从后台运行切换至前台运行。批注应用从后台运行切换至前台运行的过程，即批注应用唤醒的过程。
其中，第三操作指令的具体形式可以根据实际情况设定，例如，可以是交互智能平板的批注应用后台运行情况下，检测到触摸屏上的触摸操作时，且识别出该触摸操作为设定的触摸操作，例如特定触摸手势(该触摸手势不同于上 述的启动交互智能平板系统的触摸手势)，则在检测到该触摸操作时，确定为收到第三操作指令；又如，设定唤醒按键，该唤醒按键可以是实体按键也可以是虚拟按键，其可以位于交互智能平板，也可以位于与交互智能平板无线连接的终端设备；当需要唤醒批注应用时，用户可以操作该唤醒按键，交互智能平板检测到该唤醒按键被点击、被双击或者被长按等操作时，则确认收到第三操作指令。
S405，接收触摸数据。
以Android系统为例，本步骤即批注应用接收Android系统发送的触摸数据，该触摸数据中包含多个触摸点的数据。
S406，是否启动书写加速，若是，执行步骤S407，若否，执行步骤S408。
在一实施例中，用户可以选择是否需要书写加速，若需要，则可以选择启动书写加速功能，例如：接收第一操作指令，所述第一操作指令为用于启动书写加速的指令；将接收到的触摸数据写入鼠标层，以通过鼠标层绘制所述批注笔迹，即执行下一步骤。
其中，第一操作指令的具体形式可以根据实际情况设定，例如，可以是交互智能平板在唤醒批注应用之后，检测到触摸屏上的触摸操作时，且识别出该触摸操作为设定的触摸操作，例如特定触摸手势(该触摸手势不同于上述的启动交互智能平板系统的触摸手势，也不同于上述的启动批注应用的手势)，则在检测到该触摸操作时，确定为收到第一操作指令；又如，设定启动按键，该启动按键可以是实体按键也可以是虚拟按键，其可以位于交互智能平板，也可以位于与交互智能平板无线连接的终端设备；当需要书写加速时，用户可以操作该启动按键，交互智能平板检测到该启动按键被点击、被双击或者被长按等操作时，则确认收到第一操作指令。
S407，将接收到的触摸数据写入鼠标层，以通过鼠标层绘制所述批注笔迹；然后，通过交互智能平板显示鼠标层上绘制的批注笔迹；结束。
通过鼠标层代替传统书写加速状态下的framebuffer绘制批注笔迹，由于Android系统视图层刷新不会影响鼠标层的绘制，因此可以在书写加速的同时实现不冻屏的操作，解决了传统方式下，在书写加速时不允许Android系统视图层 刷新的问题。因此，在通过交互智能平板显示批注笔迹的同时，还可以同时显示系统视图层刷新的内容。
S408，将接收到的触摸数据写入系统视图层，以通过系统视图层绘制批注笔迹。然后，通过交互智能平板显示系统视图层上绘制的批注笔迹。
在实施例中，通过触摸数据绘制批注笔迹的具体实现方式，可以采用Android系统自带的2D画图接口，例如Canvas、Path等，通过加速或者正常的方式绘制批注笔迹(加速或者正常绘制的图层不同)，然后通过Android硬件层合成显示出来。
此外，在选择书写加速之后，用户还可以选择退出书写加速，退出书写加速之后，将按照Android系统的正常流程显示批注笔迹，实现过程可以包括：接收第四操作指令，所述第四操作指令为用于退出书写加速的指令；将接收到的触摸数据写入系统视图层，以通过系统视图层绘制批注笔迹。
其中，第四操作指令的具体形式可以根据实际情况设定，例如，可以是交互智能平板的书写加速启动的情况下，检测到触摸屏上的触摸操作时，且识别出该触摸操作为设定的触摸操作，例如特定触摸手势，则在检测到该触摸操作时，确定为收到第四操作指令；又如，设定退出快速按键，该退出快速按键可以是实体按键也可以是虚拟按键，其可以位于交互智能平板，也可以位于与交互智能平板无线连接的终端设备；当需要退出书写快速时，用户可以操作该退出快速按键，交互智能平板检测到该退出快速按键被点击、被双击或者被长按等操作时，则确认收到第四操作指令。
基于此，用户需要在交互智能平板上批注时，可以选择是否书写加速，若是，则通过鼠标层绘制书写的批注笔迹，以实现书写即显示的效果，若不需要书写加速，则按照系统正常的批注绘制方式，通过对应的系统视图层进行绘制，满足不同场景的批注需求。
应该理解的是，对于前述的各方法实施例，虽然流程图中的各个步骤按照箭头的指示依次显示，但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明，这些步骤的执行并没有严格的顺序限制，这些步骤可以以其它的顺序执行。而且，方法实施例的流程图中的至少一部分步骤可以 包括多个子步骤或者多个阶段，这些子步骤或者阶段并不必然是在同一时刻执行完成，而是可以在不同的时刻执行，这些子步骤或者阶段的执行顺序也不必然是依次进行，而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。
基于与上述实施例中的批注显示方法相同的思想，本文还提供批注显示装置。
在一个实施例中，如图5所示，本实施例的批注显示装置包括：数据接收模块501、显示模块502，各模块详述如下：
数据接收模块501，用于接收触摸数据，所述触摸数据为发生在交互智能平板触摸屏上的批注事件引起的触摸点的数据；
显示模块502，用于通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层；其中，所述鼠标层为透明层，且位于系统视图层之上。
在一实施例中，上述批注显示装置中，上述数据接收模块510，具体用于接收Android系统发送的触摸数据。
继续参见图6所示，在一实施例中，上述批注显示装置还包括：
第一绘制模块503，用于在确定书写加速的情况下，将接收到的触摸数据写入鼠标层，以通过鼠标层绘制所述批注笔迹。
此外，上述批注显示装置还可以包括：
第一指令模块，用于接收第一操作指令，所述第一操作指令为用于启动书写加速的指令；
第一启动模块，用于启动书写加速。
在一实施例中，上述批注显示装置还包括：
应用启动模块，用于在交互智能平板系统启动结束时，启动批注应用，创建批注应用对应的系统视图层。
此外，上述批注显示装置还可以包括：系统启动模块，用于启动交互智能平板系统。
进一步地，在其他一些实施例中，上述批注显示装置还包括：第二指令模 块，用于接收第二操作指令，所述第二操作指令为用于启动交互智能平板系统的指令。
在一实施例中，上述批注显示装置还包括：鼠标层启动模块，用于在批注应用启动结束时，初始化鼠标层。
在一实施例中，上述批注显示装置还包括：
唤醒指令模块，用于接收唤醒操作指令，所述唤醒操作指令为用于唤醒批注应用的指令；
应用唤醒模块，用于将批注应用从后台运行切换至前台运行。
继续参见图6所示，在一实施例中，上述批注显示装置还包括：
加速退出模块504，用于接收退出书写加速操作指令，退出书写加速；
和/或，
第二绘制模块505，用于在确定退出书写加速的情况下，将接收到的触摸数据写入系统视图层，以通过系统视图层绘制批注笔迹。
在一实施例中，上述批注显示装置还包括：
上述显示模块502，还用于通过交互智能平板显示绘制在系统视图层的批注笔迹。
在一实施例中，所述系统Android系统。
关于批注显示装置的具体限定可以参见上文中对于批注显示方法的限定，在此不再赘述。上述批注显示装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于设备中的处理器中，也可以以软件形式存储于设备中的存储器中，以便于处理器调用执行以上各个模块对应的操作。
此外，上述示例的批注显示装置的实施方式中，各程序模块的逻辑划分仅是举例说明，实际应用中可以根据需要，例如出于相应硬件的配置要求或者软件的实现的便利考虑，将上述功能分配由不同的程序模块完成，即将所述批注显示装置的内部结构划分成不同的程序模块，以完成以上描述的全部或者部分功能。
在一个实施例中，提供了一种批注显示设备，其内部结构图可以如图7所 示。该设备包括通过系统总线连接的处理器、存储器、网络接口、显示屏和输入装置。其中，处理器用于提供计算和控制能力；存储器包括非易失性存储介质、内存储器，该非易失性存储介质存储有操作系统和计算机程序，该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境；网络接口用于与外部的终端通过网络连接通信；该计算机程序被处理器执行时以实现一种批注显示方法；显示屏可以是液晶显示屏或者电子墨水显示屏；输入装置可以是显示屏上覆盖的触摸层，也可以是设备外壳上设置的按键、轨迹球或触控板，还可以是外接的键盘、触控板或鼠标等。
本领域技术人员可以理解，图7中示出的结构，仅仅是与本申请方案相关的部分结构的框图，并不构成对本申请方案所应用于其上的批注显示设备的限定，具体的批注显示设备可以包括比图中所示更多或更少的部件，或者组合某些部件，或者具有不同的部件布置。
在一个实施例中，提供了一种批注显示设备，包括：存储器、具有触摸功能的显示屏以及一个或多个处理器；
所述存储器，用于存储一个或多个程序；
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多
个处理器实现以下步骤：
接收触摸数据，所述触摸数据为发生在交互智能平板触摸屏上的批注事件引起的触摸点的数据；
通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层；
其中，所述鼠标层为透明层，且位于系统视图层之上。
在一些实施例中，当所述计算机程序被所述处理器执行时，还使得所述处理器实现上述其他实施例中批注显示方法的步骤。
在一个实施例中，提供了一种计算机可读存储介质，其上存储有计算机程序，计算机程序被处理器执行时实现以下步骤：
接收触摸数据，所述触摸数据为发生在交互智能平板触摸屏上的批注事件引起的触摸点的数据；
通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层；
其中，所述鼠标层为透明层，且位于系统视图层之上。
在一些实施例中，该计算机程序被处理器执行时还实现上述其他实施例中批注显示方法的步骤。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的计算机程序可存储于一非易失性计算机可读取存储介质中，该计算机程序在执行时，可包括如上述各方法的实施例的流程。其中，本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用，均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限，RAM以多种形式可得，诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。
以上实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。上述各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其它实施例的相关描述。
实施例中的术语“包括”和“具有”以及它们任何变形，意图在于覆盖不排他的包含。例如包含了一系列步骤或(模块)单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元，而是可选地还包括没有列出的步骤或单元，或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。
实施例中提及的“多个”是指两个或两个以上。“和/或”，描述关联对象的关 联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
实施例中提及的“第一\第二”仅仅是是区别类似的对象，不代表针对对象的特定排序，可以理解地，“第一\第二”在允许的情况下可以互换特定的顺序或先后次序。应该理解“第一\第二”区分的对象在适当情况下可以互换，以使这里描述的实施例能够以除了在这里图示或描述的那些以外的顺序实施。
以上实施例仅表达了本发明的几种实施方式，但并不能因此而理解为对发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本申请构思的前提下，还可以做出若干变形和改进，这些都属于本申请的保护范围。因此，本申请专利的保护范围应以所附权利要求为准。

Claims (18)

  1. 一种批注显示方法，其特征在于，包括：
    接收触摸数据，所述触摸数据为发生在交互智能平板触摸屏上的批注事件引起的触摸点的数据；
    通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层；
    其中，所述鼠标层为透明层，且位于系统视图层之上。
  2. 根据权利要求1所述的方法，其特征在于，还包括：
    在确定书写加速的情况下，将接收到的触摸数据写入鼠标层，以通过鼠标层绘制所述批注笔迹。
  3. 根据权利要求1或2所述的方法，其特征在于，还包括：
    在交互智能平板系统启动结束时，启动批注应用，禁止创建批注应用对应的系统视图层。
  4. 根据权利要求3所述的方法，其特征在于，还包括：
    在批注应用启动结束时，初始化鼠标层。
  5. 根据权利要求3所述的方法，其特征在于，所述接收触摸数据，之前还包括：
    接收唤醒操作指令，所述唤醒操作指令为用于唤醒批注应用的指令；
    将批注应用从后台运行切换至前台运行。
  6. 根据权利要求2所述的方法，其特征在于，还包括：
    接收退出书写加速操作指令，退出书写加速。
  7. 根据权利要求6所述的方法，其特征在于，所述接收触摸数据，之后还包括：
    在确定退出书写加速的情况下，将接收到的触摸数据写入系统视图层，以通过系统视图层绘制批注笔迹；
    通过交互智能平板显示绘制在系统视图层的批注笔迹。
  8. 根据权利要求1或2所述的方法，其特征在于，所述系统Android系统。
  9. 根据权利要求8所述的方法，其特征在于，
    所述接收触摸数据，包括：接收Android系统发送的触摸数据。
  10. 根据权利要求8所述的方法，其特征在于，还包括：
    在通过交互智能平板显示批注笔迹的同时，显示系统视图层刷新的内容。
  11. 一种批注显示装置，其特征在于，包括：
    数据接收模块，用于接收触摸数据，所述触摸数据为发生在交互智能平板触摸屏上的批注事件引起的触摸点的数据；
    显示模块，用于通过交互智能平板显示批注笔迹，所述批注笔迹根据所述触摸数据得到，所述批注笔迹绘制在鼠标层；
    其中，所述鼠标层为透明层，且位于系统视图层之上。
  12. 根据权利要求11所述的装置，其特征在于，还包括：
    第一绘制模块，用于在确定书写加速的情况下，将接收到的触摸数据写入鼠标层，以通过鼠标层绘制所述批注笔迹。
  13. 根据权利要求11所述的装置，其特征在于，还包括：
    应用启动模块，用于在交互智能平板系统启动结束时，启动批注应用，创建批注应用对应的系统视图层。
  14. 根据权利要求13所述的装置，其特征在于，还包括：
    鼠标层启动模块，用于在批注应用启动结束时，初始化鼠标层。
  15. 根据权利要求13所述的装置，其特征在于，还包括：
    唤醒指令模块，用于接收唤醒操作指令，所述唤醒操作指令为用于唤醒批注应用的指令；
    应用唤醒模块，用于将批注应用从后台运行切换至前台运行。
  16. 根据权利要求12所述的装置，其特征在于，还包括：
    加速退出模块，用于接收退出书写加速操作指令，退出书写加速；
    和/或，第二绘制模块，用于在确定退出书写加速的情况下，将接收到的触摸数据写入系统视图层，以通过系统视图层绘制批注笔迹。
  17. 一种批注显示设备，其特征在于，包括：存储器、具有触摸功能的显示屏以及一个或多个处理器；
    所述存储器，用于存储一个或多个程序；
    当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现权利要求1至10任一所述方法的步骤。
  18. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，当所述计算机程序被所述处理器执行时，使得所述处理器实现权利要求1至10任一所述方法的步骤。
PCT/CN2018/118481 2018-09-04 2018-11-30 批注显示方法、装置、设备和存储介质 WO2020048026A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
ES18932432T ES2968469T3 (es) 2018-09-04 2018-11-30 Método de visualización de anotaciones, dispositivo, aparato y medio de almacenamiento
EP18932432.0A EP3805908B1 (en) 2018-09-04 2018-11-30 Annotation display method, device and apparatus, and storage medium
US17/157,028 US11269512B2 (en) 2018-09-04 2021-01-25 Annotation display method, device, apparatus and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811024700 2018-09-04
CN201811024700.9 2018-09-04

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/157,028 Continuation US11269512B2 (en) 2018-09-04 2021-01-25 Annotation display method, device, apparatus and storage medium

Publications (1)

Publication Number Publication Date
WO2020048026A1 true WO2020048026A1 (zh) 2020-03-12

Family

ID=66001870

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/118481 WO2020048026A1 (zh) 2018-09-04 2018-11-30 批注显示方法、装置、设备和存储介质

Country Status (5)

Country Link
US (1) US11269512B2 (zh)
EP (1) EP3805908B1 (zh)
CN (1) CN109614178A (zh)
ES (1) ES2968469T3 (zh)
WO (1) WO2020048026A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112015394A (zh) * 2020-08-27 2020-12-01 北京百度网讯科技有限公司 安卓功能模块开发方法和装置、计算机系统和存储介质

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115185444A (zh) * 2019-04-17 2022-10-14 华为技术有限公司 一种添加批注的方法及电子设备
CN113961157B (zh) * 2020-07-21 2023-04-07 华为技术有限公司 显示交互系统、显示方法及设备
CN112347744A (zh) * 2020-11-04 2021-02-09 广州朗国电子科技有限公司 触摸设备自动触发批注模式的方法、设备及存储介质
CN112559541B (zh) * 2020-12-10 2021-09-28 广州市昊链信息科技股份有限公司 一种单证的审核方法、装置、设备及存储介质
CN113316011B (zh) * 2021-05-25 2022-07-29 广州市奥威亚电子科技有限公司 电子白板系统的控制方法、系统、设备及存储介质
CN116483244A (zh) * 2021-11-08 2023-07-25 荣耀终端有限公司 一种文本编辑方法及相关设备
CN113821146B (zh) * 2021-11-22 2022-02-18 广州文石信息科技有限公司 一种全局批注方法、装置、终端设备及存储介质
CN114610188B (zh) * 2022-02-09 2024-02-13 广东能龙教育股份有限公司 一种界面笔迹书写方法及系统、控制装置、存储介质
CN114546173A (zh) * 2022-02-28 2022-05-27 长沙朗源电子科技有限公司 电子白板及其书写加速方法、系统和存储介质
CN114721563A (zh) * 2022-03-30 2022-07-08 海信视像科技股份有限公司 显示设备、批注方法及存储介质
CN115167801B (zh) * 2022-09-07 2022-12-02 深圳市方成教学设备有限公司 基于会议记忆一体机的信息展示方法以及会议记忆一体机

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103207731A (zh) * 2013-04-07 2013-07-17 广州视睿电子科技有限公司 一体机多通道显示的批注方法及装置
CN104731443A (zh) * 2013-12-23 2015-06-24 鸿合科技有限公司 一种批注实现方法及装置
CN107613203A (zh) * 2017-09-22 2018-01-19 维沃移动通信有限公司 一种图像处理方法及移动终端
CN107743193A (zh) * 2017-09-26 2018-02-27 深圳市金立通信设备有限公司 图片编辑方式的选择方法、终端及计算机可读存储介质

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060033724A1 (en) 2004-07-30 2006-02-16 Apple Computer, Inc. Virtual input device placement on a touch screen user interface
US6342906B1 (en) * 1999-02-02 2002-01-29 International Business Machines Corporation Annotation layer for synchronous collaboration
US20040100498A1 (en) * 2002-11-21 2004-05-27 International Business Machines Corporation Annotating received world wide web/internet document pages without changing the hypertext markup language content of the pages
WO2012075565A1 (en) * 2010-12-06 2012-06-14 Smart Technologies Ulc Annotation method and system for conferencing
CN102419743A (zh) * 2011-07-06 2012-04-18 北京汇冠新技术股份有限公司 一种批注方法及系统
KR101395480B1 (ko) * 2012-06-01 2014-05-14 주식회사 팬택 필기 입력에 기초하여 어플리케이션을 실행하는 방법 및 그 단말
WO2014192125A1 (ja) * 2013-05-30 2014-12-04 株式会社 東芝 電子機器および処理方法
US20150016336A1 (en) * 2013-07-12 2015-01-15 Vonage Network, Llc Method and apparatus for voip communication completion to a mobile device
US9830167B2 (en) * 2014-08-12 2017-11-28 Linkedin Corporation Enhancing a multitasking user interface of an operating system
KR102411868B1 (ko) * 2014-11-28 2022-06-23 삼성전자주식회사 전자장치 및 그래픽 오브젝트 표시 방법
CN104778008A (zh) 2015-04-15 2015-07-15 浙江工业大学 基于屏幕管控的虚拟书写系统
CN106681624B (zh) * 2016-10-31 2019-12-03 广州视源电子科技股份有限公司 基于触摸显示屏的批注显示方法和装置
CN106598928B (zh) * 2016-12-01 2019-09-17 广州视源电子科技股份有限公司 一种在显示屏上进行批注的方法及其系统
CN108235100A (zh) * 2016-12-14 2018-06-29 杭州海康威视数字技术股份有限公司 多屏显示方法、装置及系统
CN106776514B (zh) * 2016-12-15 2020-08-07 广州视源电子科技股份有限公司 一种批注方法及装置
KR102360492B1 (ko) * 2017-03-24 2022-02-09 삼성전자주식회사 플렉시블 디스플레이 및 이를 포함하는 전자 장치
CN107193794B (zh) * 2017-06-28 2021-05-18 广州视源电子科技股份有限公司 显示内容的批注方法和装置
CN107797971A (zh) * 2017-10-11 2018-03-13 广州视源电子科技股份有限公司 文档批注方法、装置和电子设备
CN108459836B (zh) * 2018-01-19 2019-05-31 广州视源电子科技股份有限公司 批注显示方法、装置、设备及存储介质
CN108628650B (zh) * 2018-03-20 2020-03-17 广州视源电子科技股份有限公司 触摸事件的处理方法、装置和智能交互设备

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103207731A (zh) * 2013-04-07 2013-07-17 广州视睿电子科技有限公司 一体机多通道显示的批注方法及装置
CN104731443A (zh) * 2013-12-23 2015-06-24 鸿合科技有限公司 一种批注实现方法及装置
CN107613203A (zh) * 2017-09-22 2018-01-19 维沃移动通信有限公司 一种图像处理方法及移动终端
CN107743193A (zh) * 2017-09-26 2018-02-27 深圳市金立通信设备有限公司 图片编辑方式的选择方法、终端及计算机可读存储介质

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112015394A (zh) * 2020-08-27 2020-12-01 北京百度网讯科技有限公司 安卓功能模块开发方法和装置、计算机系统和存储介质
CN112015394B (zh) * 2020-08-27 2024-02-27 北京百度网讯科技有限公司 安卓功能模块开发方法和装置、计算机系统和存储介质

Also Published As

Publication number Publication date
US11269512B2 (en) 2022-03-08
CN109614178A (zh) 2019-04-12
US20210141527A1 (en) 2021-05-13
ES2968469T3 (es) 2024-05-09
EP3805908A4 (en) 2021-08-18
EP3805908A1 (en) 2021-04-14
EP3805908B1 (en) 2023-10-18

Similar Documents

Publication Publication Date Title
WO2020048026A1 (zh) 批注显示方法、装置、设备和存储介质
US11650716B2 (en) Operation methods of a smart interactive tablet, storage medium and related equipment
WO2020147666A1 (zh) 用户界面显示方法、装置、终端及存储介质
WO2019114828A1 (zh) 用户界面显示方法、装置、设备及存储介质
WO2020019616A1 (zh) 触控数据处理的方法、装置、智能设备和存储介质
WO2020024495A1 (zh) 白板操作方法、装置、系统、白板设备和介质
US9454254B2 (en) Wet ink texture engine for reduced lag digital inking
US20210096806A1 (en) Dual-system device and writing method and apparatus thereof, and interactive intelligent tablet
CN105786424B (zh) 嵌入式系统的单屏幕快速分屏显示解决的方法
US10459737B2 (en) Waking and sleeping a display among a plurality of displays using gestures
CN110377220B (zh) 一种指令响应方法、装置、存储介质及电子设备
CN107341015B (zh) 终端间数据同步方法、装置、终端及存储介质
WO2020015704A1 (zh) 触摸控制方法及装置、存储介质、终端设备
WO2022242515A1 (zh) 界面显示方法及装置
WO2019019901A1 (zh) 黑屏手势的响应方法、装置、存储介质及移动终端
WO2016173307A1 (zh) 一种消息复制方法和装置、以及智能终端
WO2019019899A1 (zh) 改善黑屏手势响应的方法、装置、存储介质及移动终端
TWI485616B (zh) 記錄軌跡的方法及電子裝置
TW201407352A (zh) 雙作業系統之運作方法及具有雙作業系統之觸控電子裝置與電腦可讀儲存媒體
US20140019894A1 (en) Augmenting user interface elements
WO2021042910A1 (zh) 一种用户交互方法及电子设备
WO2020211029A1 (zh) 一种笔记重绘方法、书写设备和存储介质
WO2023174328A1 (zh) 屏幕控制方法、装置、电子设备及存储介质
TW201543363A (zh) 切換作業系統的方法及電子裝置
US9582158B2 (en) Efficient usage of screen real estate on an electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18932432

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2018932432

Country of ref document: EP

Effective date: 20210108

NENP Non-entry into the national phase

Ref country code: DE