WO2022001762A1 - 一种桌面处理方法、装置和存储介质 - Google Patents

一种桌面处理方法、装置和存储介质 Download PDF

Info

Publication number
WO2022001762A1
WO2022001762A1 PCT/CN2021/101649 CN2021101649W WO2022001762A1 WO 2022001762 A1 WO2022001762 A1 WO 2022001762A1 CN 2021101649 W CN2021101649 W CN 2021101649W WO 2022001762 A1 WO2022001762 A1 WO 2022001762A1
Authority
WO
WIPO (PCT)
Prior art keywords
desktop
local
transparent
layer
attribute
Prior art date
Application number
PCT/CN2021/101649
Other languages
English (en)
French (fr)
Inventor
宋晨
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2022001762A1 publication Critical patent/WO2022001762A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04801—Cursor retrieval aid, i.e. visual aspect modification, blinking, colour changes, enlargement or other visual cues, for helping user do find the cursor in graphical user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04804—Transparency, e.g. transparent or translucent windows

Definitions

  • the embodiments of the present application relate to the field of data conferences, and in particular, to a desktop processing method, device, and storage medium.
  • Method 1 Use a transparent window that cannot be penetrated by the mouse to cover the desktop, and the mouse event falls on the transparent window to draw strokes to realize desktop annotation. This method cannot switch between stroke drawing and desktop operation. If you want to operate on the desktop, you need to close the transparent window, and the drawn strokes cannot be seen at this time.
  • Method 2 Use a transparent window that is completely penetrated by the mouse to cover the desktop, and capture mouse events globally. This method needs to distinguish all mouse events and judge user behavior (drawing strokes or operating the desktop), which consumes performance and is inaccurate in judging user behavior.
  • the main purpose of the embodiments of the present application is at least to provide a desktop processing method, apparatus, storage medium and electronic device, aiming to realize switching between desktop labeling and desktop operation.
  • the embodiment of the present application provides a desktop processing method, the method includes: sequentially creating a transparent auxiliary layer with variable penetration properties and a local transparent annotation layer with penetration properties on a local desktop;
  • the operation mode of the desktop determines whether the variable penetration attribute of the transparent auxiliary layer is a non-penetrating attribute or a penetrating attribute;
  • the desktop labeling is performed on the local transparent labeling layer of the transparent auxiliary layer; if the variable penetration attribute of the transparent auxiliary layer is determined as the penetration attribute, the desktop operation is performed on the local desktop.
  • the embodiment of the present application also provides a desktop processing device, the device includes: a creation module, a determination module and a processing module; the creation module is used to sequentially create a transparent auxiliary layer with variable penetration properties and a processing module on the local desktop.
  • the processing module is used to perform desktop labeling on the local transparent labeling layer with the penetrating property if the variable penetrating attribute of the transparent auxiliary layer is determined as a non-penetrating attribute; if the variable penetrating attribute of the transparent auxiliary layer is If the attribute is determined to be a penetration attribute, the desktop operation is performed on the local desktop.
  • An embodiment of the present application provides a storage medium for computer-readable storage, where the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the foregoing The steps of the desktop processing method.
  • An embodiment of the present application provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor , the instructions are executed by the at least one processor to enable the at least one processor to execute the aforementioned desktop processing method.
  • FIG. 1 is a first flowchart of a desktop processing method provided by an embodiment of the present application.
  • FIG. 2 is a second flowchart of a desktop processing method provided by an embodiment of the present application.
  • FIG. 3 is a third flowchart of a desktop processing method provided by an embodiment of the present application.
  • FIG. 4 is a schematic diagram of a labeling mode provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a collaboration mode provided by an embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of a desktop processing apparatus provided by an embodiment of the present application.
  • this embodiment provides a desktop processing method, which may include:
  • Step S100 Create a transparent auxiliary layer with variable penetration properties and a local transparent annotation layer with penetration properties on the local desktop in sequence.
  • the local transparent callout layer with the pass-through property is in a state that does not receive mouse events.
  • the variable penetration properties of the transparent auxiliary layer include non-penetration properties and penetration properties. Under the non-penetrating attribute, the transparent auxiliary layer is in a state that can receive mouse events, and under the penetrating attribute, the transparent auxiliary layer is in a state that cannot receive mouse events.
  • the mouse event refers to an event that occurs when the user interacts with the mouse, which in this application includes, but is not limited to, operating the desktop or marking on the desktop.
  • Step S200 According to the operation mode of the local desktop user on the local desktop, the variable penetration attribute of the transparent auxiliary layer is determined as a non-penetrating attribute or a penetrating attribute.
  • the operation mode of the local desktop user on the local desktop is obtained; if the obtained operation mode of the local desktop user on the local desktop is the marked mode, the variable penetration attribute of the transparent auxiliary layer is determined as a non-penetration attribute , so that the transparent auxiliary layer is in a state that can receive mouse events; if the obtained local desktop user's operation mode for the local desktop is the operating desktop mode, the variable penetration attribute of the transparent auxiliary layer is determined as the penetration attribute, so that the transparent The auxiliary layer is in a state where it cannot receive mouse events.
  • Step S300 if the variable penetration attribute of the transparent auxiliary layer is determined as a non-penetrating attribute, perform desktop annotation on the local transparent labeling layer with the penetration attribute; if the variable penetration attribute of the transparent auxiliary layer is determined as Through the attribute, desktop operations are performed on the local desktop.
  • the transparent auxiliary layer when the transparent auxiliary layer has a non-penetrating property, receives mouse events triggered by the local desktop user who penetrate the local transparent annotation layer, and transmits the mouse events triggered by the local desktop user to the local transparent layer.
  • Annotation layer for desktop annotation such as stroke drawing, on a native transparent annotation layer.
  • the local desktop receives the mouse events triggered by the local desktop user who penetrates the local transparent annotation layer and the transparent auxiliary layer in turn, and performs desktop operations on the local desktop.
  • a transparent auxiliary layer with variable penetrating properties is added under a transparent transparent labeling layer, and the properties of the transparent auxiliary layer are changed to realize desktop labeling and desktop Quick switching of operations.
  • the embodiment of the present application can also implement shared desktop collaborative annotation. Referring to FIG. 2, the steps are as follows:
  • Step S400 Share the local desktop of the local desktop user to other users, so as to create a desktop receiving layer with a non-penetrating attribute and a non-local transparent labeling layer with On the transparent annotation layer, desktop annotation is performed according to mouse events triggered by other users, such as stroke drawing.
  • the desktop receiving layer receives desktops shared by local desktop users, and the desktop receiving layer is located between the shared desktop and the non-local transparent labeling layer.
  • performing desktop annotation on the non-local transparent annotation layer according to mouse events triggered by other users includes: the desktop receiving layer receives mouse events triggered by other users penetrating the non-local transparent annotation layer; Events are passed to the non-native transparent callout layer for desktop callouts on the non-native transparent callout layer.
  • Step S500 Receive mouse events triggered by other users, and perform desktop annotation on the local transparent annotation layer according to the mouse events triggered by other users.
  • the method may further include:
  • Step S600 Delete content marked on the non-local transparent marking layer, such as drawn strokes.
  • the local desktop user will also receive stroke events and draw locally at the same time. And after the other user's drawing is completed, the strokes drawn by other users are cleared, so as to display the strokes shared by the local user.
  • the method of this embodiment shares desktop local annotation and multi-terminal collaborative annotation during a data conference, which can improve the usability and real-time performance of annotation.
  • Step 301 User A shares the local desktop with user B. Create a transparent auxiliary layer and a transparent annotation layer on the desktop of user A from bottom to top. User B receives the shared desktop of user A, and creates a shared desktop receiving window (hereinafter referred to as a desktop receiving layer) and a transparent label layer.
  • the transparent annotation layer is in the state of not receiving mouse events
  • the desktop receiving layer is in the state of receiving mouse events
  • the transparent auxiliary layer is switched between the two states according to business needs.
  • Step 302 When the user A is in the stroke drawing mode (hereinafter referred to as the labeling mode), the transparent auxiliary layer at the end A starts to receive mouse events.
  • the transparent auxiliary layer receives the mouse event, it passes the event to the transparent annotation layer on the A side, and the drawing is completed in the transparent annotation layer, as shown in Figure 4.
  • User B simultaneously watches the strokes written by user A through the shared desktop.
  • Step 303 When the user A switches to the operating desktop mode (hereinafter referred to as the cooperation mode), the transparent auxiliary layer of the A side also does not receive mouse events. Then the mouse event will be transmitted to other application windows on the desktop to implement operations on the desktop, as shown in Figure 5.
  • the cooperation mode the operating desktop mode
  • the transparent auxiliary layer of the A side also does not receive mouse events. Then the mouse event will be transmitted to other application windows on the desktop to implement operations on the desktop, as shown in Figure 5.
  • Step 304 When the user B is in the annotation mode, the desktop receiving layer transmits the received mouse event to the transparent annotation layer on the B side, and completes the drawing on the transparent annotation layer.
  • Step 305 while user B is drawing, user B sends the mouse event of the local end to user A synchronously, and user A draws in the transparent annotation layer of end A at the same time.
  • the desktop sharing receiving end uniformly watches the drawing content of the desktop sharing initiator (user A). Furthermore, no matter how many terminals participate, the drawing content will only be displayed on the originating side of the shared desktop in the end, ensuring that the drawing contents seen by each terminal and the post-joining terminal are consistent.
  • this embodiment provides a desktop processing apparatus for implementing the above-mentioned desktop processing method.
  • the apparatus may include a creation module 10, a determination module 20, and a processing module 30, wherein:
  • the creating module 10 is used to sequentially create a transparent auxiliary layer with variable penetration properties and a local transparent annotation layer with penetration properties on the local desktop.
  • the local transparent annotation layer with the penetrating property is in a state of not receiving mouse events.
  • the variable penetration attributes of the transparent auxiliary layer include non-penetrating attributes and penetrating attributes. Under the non-penetrating attribute, the transparent auxiliary layer is in a state that can receive mouse events. Under the penetrating attribute, the transparent auxiliary layer is in a state that cannot receive mouse events. The status of the event.
  • the determining module 20 is configured to determine whether the variable penetration attribute of the transparent auxiliary layer is a non-penetrating attribute or a penetrating attribute according to the operation mode of the local desktop user on the local desktop. In some cases, the determination module 20 obtains the operation mode of the local desktop user on the local desktop; if the obtained operation mode of the local desktop user on the local desktop is the marked mode, then the variable penetration attribute of the transparent auxiliary layer is determined as not The penetrating attribute makes the transparent auxiliary layer in a state that can receive mouse events; if the obtained local desktop user's operation mode for the local desktop is the operating desktop mode, the variable penetrating attribute of the transparent auxiliary layer is determined as the penetrating attribute , which makes the transparent auxiliary layer in a state where it cannot receive mouse events.
  • the processing module 30 is configured to, if the variable penetration attribute of the transparent auxiliary layer is determined to be a non-penetrating attribute, perform desktop annotation on the local transparent annotation layer with the penetration attribute, such as stroke drawing; If the variable penetration attribute of the parameter is determined as the penetration attribute, the desktop operation is performed on the local desktop.
  • the processing module 30 receives the mouse event triggered by the local desktop user that penetrates the local transparent annotation layer, and transmits the mouse event triggered by the local desktop user. Give the local transparent callout layer for desktop callout on the local transparent callout layer.
  • the transparent auxiliary layer has the penetrating property
  • the local desktop receives mouse events triggered by the local desktop user who penetrates the local transparent annotation layer and the transparent auxiliary layer in turn, and performs desktop operations on the local desktop.
  • a transparent window (or transparent auxiliary layer) is added between the desktop and the transparent window (or transparent label layer), and the attributes of the transparent auxiliary layer are changed to quickly switch between stroke drawing and desktop operation scenarios.
  • the mouse when the content of the stroke is displayed, the mouse can penetrate the transparent label layer to operate the desktop, and at the same time, it is not necessary to capture all mouse events and perform classification analysis, which solves the incompatibility between drawing strokes and operating the desktop, and judging user behavior. inaccurate question.
  • the apparatus in this embodiment of the present application may further include a sharing module 40 and a receiving module 50 to implement shared desktop collaborative annotation.
  • the sharing module 40 is used to share the local desktop of the local desktop user to other users, so as to create a desktop receiving layer with a non-penetrating attribute and a non-local transparent labeling layer with a penetrating attribute during the other users receiving the shared desktop, and On the non-local transparent annotation layer, desktop annotation is performed according to mouse events triggered by other users, such as stroke drawing.
  • the receiving module 50 is configured to receive mouse events triggered by other users, so that the processing module can perform desktop annotation on the local transparent annotation layer, such as stroke drawing, according to the mouse events triggered by other users.
  • the creation module 10 is further configured to create a desktop receiving layer with a non-penetrating property and a non-local transparent labeling layer with a penetrating property during receiving the shared desktop.
  • the processing module 30 is further configured to perform desktop annotation on the non-local transparent annotation layer according to mouse events triggered by other users, in some cases, the desktop receiving layer receives mouse events triggered by other users penetrating the non-local transparent annotation layer; The mouse events triggered by other users described above are passed to the non-local transparent annotation layer, so that desktop annotation, such as stroke drawing, can be performed on the non-local transparent annotation layer.
  • the processing module 30 can also be used to delete the content marked on the non-local transparent marking layer, such as drawn strokes.
  • this embodiment transmits mouse events in an orderly manner among each participant of the data conference through the socketio (socket interface) channel, so that strokes drawn at each end can be displayed on the desktop sharing end, and collaborative annotation is realized.
  • socketio socket interface
  • the functional modules/units in the system and the device can be implemented as software (can be implemented by computer program codes executable by the computing device), firmware, hardware, and their appropriate combination.
  • the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components Components execute cooperatively.
  • Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit .
  • the functional modules/units in all or some of the above devices include a non-transitory machine-readable storage medium that stores logic that can be used, for example, to perform at least a portion of the functions of: a storage module, an acquisition module, a trigger module, and Remove modules, etc.
  • Logic may include instructions, data, and/or code that, if executed by a machine, may cause the machine to perform the methods, processes, and/or operations described herein.
  • the machine may include, for example, any suitable processing platform, computing platform, computing device, processing device, computing system, processing system, computer, processor, etc., and may be implemented using any suitable combination of hardware, software, firmware, etc. .
  • Logic may include or may be implemented as: software, software modules, applications, programs, subroutines, instructions, sets of instructions, computational codes, words, values, symbols, and the like.
  • the instructions may include any suitable type of code, eg, source code, compiled code, interpreted code, executable code, static code, dynamic code, and the like. These instructions may be implemented according to a predetermined computer language, manner or syntax to direct the processor to perform a certain function. These instructions may be implemented using any suitable high-level, low-level, object-oriented, visual, compiled and/or interpreted programming language, eg, C, C++, Java, BASIC, Matlab, Pascal, Visual BASIC, Assembly language, machine code, etc.
  • An embodiment of the present application further provides a computer-readable storage medium, where one or more programs are stored in the computer-readable storage medium, and the one or more programs can be executed by one or more processors to implement the foregoing desktop processing method A step of.
  • An embodiment of the present application provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor , the instructions are executed by the at least one processor to enable the at least one processor to execute the aforementioned desktop processing method.
  • a transparent auxiliary layer with variable penetrating properties is added under the penetrable transparent labeling layer, and the transparent auxiliary layer is added through the transparent
  • the attributes of the auxiliary layer are changed to realize quick switching between desktop labeling and desktop operation.
  • the shared desktop annotation function is realized, which expands the application scenarios.
  • the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components Components execute cooperatively.
  • Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit .
  • Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
  • Computer storage media includes both volatile and nonvolatile implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data flexible, removable and non-removable media.
  • Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices, or may Any other medium used to store desired information and which can be accessed by a computer.
  • communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery media, as is well known to those of ordinary skill in the art .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种桌面处理方法、装置、存储介质、电子设备，属于数据会议领域。该方法包括：在本地桌面上依次创建具有可变穿透属性的透明辅助层和具有穿透属性的本地透明标注层（S100）；根据本地桌面用户对本地桌面的操作模式将将透明辅助层的可变穿透属性确定为非穿透属性还是穿透属性（S200）；若将透明辅助层的可变穿透属性确定为非穿透属性，则在具有穿透属性的本地透明标注层上进行桌面标注；若将透明辅助层的可变穿透属性确定为穿透属性，则在本地桌面上进行桌面操作（S300）。

Description

一种桌面处理方法、装置和存储介质
相关申请的交叉引用
本申请基于申请号为202010605122.9、申请日为2020年6月29日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此以引入方式并入本申请。
技术领域
本申请实施例涉及数据会议领域，尤其涉及一种桌面处理方法、装置和存储介质。
背景技术
在个人电脑(Personal Computer,PC)桌面标注中，目前主要有以下两种实现方式。
方式一、使用鼠标无法穿透的透明窗口覆盖在桌面之上，鼠标事件落在透明窗口上进行笔画绘制，实现桌面标注。该方式无法在笔画绘制和桌面操作间切换。如果要进行桌面操作，需要关闭透明窗口，此时无法看到绘制的笔画。
方式二、使用鼠标完全穿透的透明窗口覆盖在桌面之上，全局捕捉鼠标事件。该方式需要对所有鼠标事件进行区分，判断用户行为(绘制笔画或操作桌面)，消耗性能且对用户行为判断不准确。
发明内容
本申请实施例的主要目的至少在于提出一种桌面处理方法、装置、存储介质和电子设备，旨实现桌面标注和桌面操作的切换。
本申请实施例提供了一种桌面处理方法，所述方法包括：在本地桌面上依次创建具有可变穿透属性的透明辅助层和具有穿透属性的本地透明标注层；根据本地桌面用户对本地桌面的操作模式，将透明辅助层的可变穿透属性确定为非穿透属性还是穿透属性；若将透明辅助层的可变穿透属性确定为非穿透属性，则在具有穿透属性的本地透明标注层上进行桌面标注；若将透明辅助层的可变穿透属性确定为穿透属性，则在本地桌面上进行桌面操作。
本申请实施例还提供了一种桌面处理装置，所述装置包括：创建模块、确定模块和处理模块；所述创建模块用于在本地桌面上依次创建具有可变穿透属性的透明辅助层和具有穿透属性的本地透明标注层；所述确定模块，用于根据本地桌面用户对本地桌面的操作模式，将透明辅助层的可变穿透属性确定为非穿透属性还是穿透属性；所述处理模块，用于若将透明辅助层的可变穿透属性确定为非穿透属性，则在具有穿透属性的本地透明标注层上进行桌面标注；若将透明辅助层的可变穿透属性确定为穿透属性，则在本地桌面上进行桌面操作。
本申请实施例提供了一种存储介质，用于计算机可读存储，所述存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现前述桌面处理方法的步骤。
本申请实施例提供了一种电子设备，包括：至少一个处理器；以及，与所述至少一个处理器通信连接的存储器；其中，所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行前述桌面处理方法。
附图说明
图1是本申请实施例提供的桌面处理方法的第一流程图。
图2是本申请实施例提供的桌面处理方法的第二流程图。
图3是本申请实施例提供的桌面处理方法的第三流程图。
图4是本申请实施例提供的标注模式示意图。
图5是本申请实施例提供的协作模式示意图。
图6是本申请实施例提供的桌面处理装置的结构示意图。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
在后续的描述中，使用用于表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本申请的说明，其本身没有特有的意义。因此，“模块”、“部件”或“单元”可以混合地使用。
如图1所示，本实施例提供了一种桌面处理方法，该方法可以包括：
步骤S100：在本地桌面上依次创建具有可变穿透属性的透明辅助层和具有穿透属性的本地透明标注层。
具有穿透属性的本地透明标注层处于不接收鼠标事件的状态。
透明辅助层的可变穿透属性包括非穿透属性和穿透属性。在非穿透属性下，透明辅助层处于可接收鼠标事件的状态，在穿透属性下，透明辅助层处于不可接收鼠标事件的状态。其中，鼠标事件是指用户与鼠标交互时发生的事件，在本申请包括但不限于操作桌面或桌面标注。
步骤S200：根据本地桌面用户对本地桌面的操作模式，将透明辅助层的可变穿透属性确定为非穿透属性还是穿透属性。
在一些情形中，获取本地桌面用户对本地桌面的操作模式；若已获取的本地桌面用户对本地桌面的操作模式是标注模式，则将透明辅助层的可变穿透属性确定为非穿透属性，使透明辅助层处于可接收鼠标事件的状态；若已获取的本地桌面用户对本地桌面的操作模式是操作桌面模式，则将透明辅助层的可变穿透属性确定为穿透属性，使透明辅助层处于不可接收鼠标事件的状态。
步骤S300：若将透明辅助层的可变穿透属性确定为非穿透属性，则在具有穿透属性的本地透明标注层上进行桌面标注；若将透明辅助层的可变穿透属性确定为穿透属性，则在本地桌面上进行桌面操作。
在一些情形中，当透明辅助层具有非穿透属性时，透明辅助层接收穿透本地透明标注层的本地桌面用户触发的鼠标事件，并将所述本地桌面用户触发的鼠标事件传递给本地透明标注层，以便在本地透明标注层上进行桌面标注，例如进行笔画绘制。当透明辅助层具有穿透 属性时，本地桌面接收依次穿透本地透明标注层和透明辅助层的本地桌面用户触发的鼠标事件，并在本地桌面上进行桌面操作。
本申请实施例提出的一种桌面处理方法，在可穿透的透明标注层之下，加入一层可变穿透属性的透明辅助层，并通过透明辅助层的属性变化，实现桌面标注和桌面操作的快速切换。
由于当前方案关注于本地标注，对于多端协同标注缺乏完整解决方案，本申请实施例还可以实现共享桌面协同标注，参见图2，包括步骤如下：
步骤S400：将本地桌面用户的本地桌面共享给其他用户，以便在其他用户接收共享桌面期间依次创建具有非穿透属性的桌面接收层和具有穿透属性的非本地透明标注层，并在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注，例如进行笔画绘制。
其中，桌面接收层接收本地桌面用户共享的桌面，所述桌面接收层位于共享桌面与非本地透明标注层之间。
其中，所述在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注包括：桌面接收层接收穿透非本地透明标注层的其他用户触发的鼠标事件；将所述其他用户触发的鼠标事件传递给非本地透明标注层，以便在非本地透明标注层上进行桌面标注。
步骤S500：接收其他用户触发的鼠标事件，并依据其他用户触发的鼠标事件，在本地透明标注层上进行桌面标注。
在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注之后，所述方法还可以包括：
步骤S600：删除非本地透明标注层上标注的内容，例如绘制的笔画。
也就是说，其他用户绘制时，本地桌面用户也会收到笔画事件，同时在本地绘制。而在其他用户绘制完成后，清除其他用户绘制的笔画，以便展示本地用户共享的笔画。
本实施例的方法在数据会议时共享桌面本地标注和多端协同标注，能够提高标注易用性和实时性。
下面以数据会议中，用户A共享本地桌面给用户B为例进行详细描述，如图3所示，具体实现的步骤可以包括:
步骤301：用户A共享本地桌面给用户B。在用户A的桌面由底到顶依次创建透明辅助层和透明标注层。用户B收到用户A的共享桌面，创建共享桌面接收窗口(下称桌面接收层)和透明标注层。其中，透明标注层都处于不接收鼠标事件状态，桌面接收层处于接收鼠标事件状态，透明辅助层根据业务需要在两种状态中切换。
步骤302：当用户A处于笔画绘制模式时(下称标注模式)，A端的透明辅助层开始接收鼠标事件。当透明辅助层接收到鼠标事件之后将事件传递给A端的透明标注层，在透明标注层完成绘制，如图4所示。用户B通过共享桌面同步观看到用户A书写的笔画。
步骤303：当用户A切换到操作桌面模式时(下称协作模式)，A端的透明辅助层也不接收鼠标事件。则鼠标事件会传递到桌面的其他应用窗口中，实现对桌面的操作，如图5所示。
步骤304：当用户B处于标注模式时，桌面接收层将接收到的鼠标事件传递给B端的透明标注层，在透明标注层完成绘制。
步骤305：当用户B绘制的同时，用户B将本端的鼠标事件同步发送给用户A，用户A同时在A端的透明标注层中绘制。
为防止两端分辨率不同而导致的笔画重影。当用户B完成绘制后，清除B端透明标注层中的绘制内容。桌面共享接收端统一观看桌面共享发起端(用户A)的绘制内容。进一步说，无论有多少个端参与，绘制内容最终只在共享桌面的发起端上展示，保证各个端以及后加入端所见绘制内容一致。
需要说明的时，当共享桌面的参与者超过2人时，桌面共享的画面和绘制的鼠标事件通过数据会议的服务端转发。
采用本实施例的方法，实现了共享桌面时笔画绘制和桌面操作之间的快速切换，并提供了基于数据会议的共享桌面笔画绘制的多端同步方案，该方案实现了笔画内容无重影，完全一致的同步。
如图6所示，本实施例提供了实现上述桌面处理方法的桌面处理装置，该装置可以包括创建模块10、确定模块20、处理模块30，其中：
创建模块10，用于在本地桌面上依次创建具有可变穿透属性的透明辅助层和具有穿透属性的本地透明标注层。其中，具有穿透属性的本地透明标注层处于不接收鼠标事件的状态。透明辅助层的可变穿透属性包括非穿透属性和穿透属性，在非穿透属性下，透明辅助层处于可接收鼠标事件的状态，在穿透属性下，透明辅助层处于不可接收鼠标事件的状态。
确定模块20，用于根据本地桌面用户对本地桌面的操作模式，将透明辅助层的可变穿透属性确定为非穿透属性还是穿透属性。在一些情形中，确定模块20获取本地桌面用户对本地桌面的操作模式；若已获取的本地桌面用户对本地桌面的操作模式是标注模式，则将透明辅助层的可变穿透属性确定为非穿透属性，使透明辅助层处于可接收鼠标事件的状态；若已获取的本地桌面用户对本地桌面的操作模式是操作桌面模式，则将透明辅助层的可变穿透属性确定为穿透属性，使透明辅助层处于不可接收鼠标事件的状态。
处理模块30，用于若将透明辅助层的可变穿透属性确定为非穿透属性，则在具有穿透属性的本地透明标注层上进行桌面标注，例如进行笔画绘制；若将透明辅助层的可变穿透属性确定为穿透属性，则在本地桌面上进行桌面操作。在一些情形中，处理模块30当透明辅助层具有非穿透属性时，透明辅助层接收穿透本地透明标注层的本地桌面用户触发的鼠标事件，并将所述本地桌面用户触发的鼠标事件传递给本地透明标注层，以便在本地透明标注层上进行桌面标注。当透明辅助层具有穿透属性时，本地桌面接收依次穿透本地透明标注层和透明辅助层的本地桌面用户触发的鼠标事件，并在本地桌面上进行桌面操作。
本实施例在桌面和透明窗口(或称透明标注层)之间新增一个透明窗口(或称透明辅助层)，通过透明辅助层的属性进行变化，快速在笔画绘制和桌面操作场景中切换。本实施例在实现了在显示笔画内容的情况下，鼠标穿透透明标注层来操作桌面，同时无需抓取所有的鼠标事件并进行分类分析，解决了绘制笔画和操作桌面难以兼容，判断用户行为不准确的问题。
由于当前方案关注于本地标注，对于多端协同标注缺乏完整解决方案，本申请实施例的装置还可以包括共享模块40和接收模块50实现共享桌面协同标注。
共享模块40，用于将本地桌面用户的本地桌面共享给其他用户，以便在其他用户接收共享桌面期间创建具有非穿透属性的桌面接收层和具有穿透属性的非本地透明标注层，并在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注，例如进行笔画绘制。
接收模块50，用于接收其他用户触发的鼠标事件，以便所述处理模块依据其他用户触发的鼠标事件，在本地透明标注层上进行桌面标注，例如进行笔画绘制。
应用于其他用户的PC时，创建模块10还用于在接收共享桌面期间创建具有非穿透属性的桌面接收层和具有穿透属性的非本地透明标注层。处理模块30还用于在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注，在一些情形下，桌面接收层接收穿透非本地透明标注层的其他用户触发的鼠标事件；将所述其他用户触发的鼠标事件传递给非本地透明标注层，以便在非本地透明标注层上进行桌面标注，例如进行笔画绘制。处理模块30还可以用于删除非本地透明标注层上标注的内容，例如绘制的笔画。
本实施例基于数据会议系统，通过socketio(套接字接口)通道将鼠标事件在数据会议各个参与者中有序传递，实现各个端的笔画绘制都能在桌面共享端上展示，实现协同标注。
本领域的技术人员应该明白，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件(可以用计算装置可执行的计算机程序代码来实现)、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。
上文中的全部或某些装置中的功能模块/单元包括储存逻辑非暂态机器可读存储介质，该逻辑可用于例如执行如下各项的功能的至少一部分：存储模块、获取模块、触发模块和删除模块等。逻辑可包括指令、数据和/或代码，如果这些指令、数据和/或代码被机器执行，则可以使得机器执行本文所述的方法、处理和/或操作。该机器可包括：例如，任意适当的处理平台、计算平台、计算装置、处理装置、计算系统、处理系统、计算机、处理器等，并且可使用硬件、软件、固件等的任意适当的组合来实施。逻辑可包括或可被实施为：软件、软件模块、应用、程序、子程序、指令、指令集、计算代码、词、值、符号等。这些指令可包括任意合适类型的代码，例如，源代码、编译代码、解译代码、可执行代码、静态代码、动态代码等。这些指令可根据预定的计算机语言、方式或语法来实现，以指导处理器执行某一功能。这些指令可使用任意合适的高级、低级、面向对象的、可视的、编译的和/或解译的编程语言来实现，例如，C、C++、Java、BASIC、Matlab、Pascal、Visual BASIC、汇编语言、机器代码等等。
本申请实施例还提出一种计算机可读存储介质，该计算机可读存储介质存储有一个或者多个程序，该一个或者多个程序可被一个或者多个处理器执行，以实现前述桌面处理方法的步骤。
本申请实施例提供了一种电子设备，包括：至少一个处理器；以及，与所述至少一个处理器通信连接的存储器；其中，所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行前述桌面处理方法。
综上，本申请实施例提出的一种桌面处理方法、装置、存储介质和电子设备，在可穿透的透明标注层之下，加入一层可变穿透属性的透明辅助层，并通过透明辅助层的属性变化，实现桌面标注和桌面操作的快速切换。另外，通过同步鼠标事件，实现了共享桌面标注功能，拓展了应用场景。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、设备中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。
在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
以上参照附图说明了本申请的实施例，并非因此局限本申请的权利范围。本领域技术人员不脱离本申请的范围和实质内所作的任何修改、等同替换和改进，均应在本申请的权利范围之内。

Claims (12)

  1. 一种桌面处理方法，其中，所述方法包括：
    在本地桌面上依次创建具有可变穿透属性的透明辅助层和具有穿透属性的本地透明标注层；
    根据本地桌面用户对本地桌面的操作模式，将透明辅助层的可变穿透属性确定为非穿透属性还是穿透属性；
    若将透明辅助层的可变穿透属性确定为非穿透属性，则在具有穿透属性的本地透明标注层上进行桌面标注；
    若将透明辅助层的可变穿透属性确定为穿透属性，则在本地桌面上进行桌面操作。
  2. 根据权利要求1所述的方法，其中，所述根据本地桌面用户对本地桌面的操作模式，将透明辅助层的可变穿透属性确定为非穿透属性或穿透属性包括：
    获取本地桌面用户对本地桌面的操作模式；
    若已获取的本地桌面用户对本地桌面的操作模式是标注模式，则将透明辅助层的可变穿透属性确定为非穿透属性，使透明辅助层处于可接收鼠标事件的状态；
    若已获取的本地桌面用户对本地桌面的操作模式是操作桌面模式，则将透明辅助层的可变穿透属性确定为穿透属性，使透明辅助层处于不可接收鼠标事件的状态。
  3. 根据权利要求1或2所述的方法，其中，所述若将透明辅助层的可变穿透属性确定为非穿透属性，则在具有穿透属性的本地透明标注层上进行桌面标注包括：
    当透明辅助层具有非穿透属性时，透明辅助层接收穿透本地透明标注层的本地桌面用户触发的鼠标事件；
    将所述本地桌面用户触发的鼠标事件传递给本地透明标注层，以便在本地透明标注层上进行桌面标注。
  4. 根据权利要求1或2所述的方法，其中，所述若将透明辅助层的可变穿透属性确定为穿透属性，则在本地桌面上进行桌面操作包括：
    当透明辅助层具有穿透属性时，本地桌面接收依次穿透本地透明标注层和透明辅助层的本地桌面用户触发的鼠标事件，并在本地桌面上进行桌面操作。
  5. 根据权利要求1-4任意一项所述的方法，其中，所述方法还包括：
    将本地桌面用户的本地桌面共享给其他用户，以便在其他用户接收共享桌面期间创建具有非穿透属性的桌面接收层和具有穿透属性的非本地透明标注层，并在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注；
    接收其他用户触发的鼠标事件，并依据其他用户触发的鼠标事件，在本地透明标注层上进行桌面标注。
  6. 根据权利要求5所述的方法，其中，所述在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注包括：
    桌面接收层接收穿透非本地透明标注层的其他用户触发的鼠标事件；
    将所述其他用户触发的鼠标事件传递给非本地透明标注层，以便在非本地透明标注层上进行桌面标注。
  7. 根据权利要求6所述的方法，其中，所述方法还包括：
    在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注之后，删除非本地透明标注层上标注的内容。
  8. 一种桌面处理装置，其中，所述装置包括：
    创建模块，用于在本地桌面上依次创建具有可变穿透属性的透明辅助层和具有穿透属性的本地透明标注层；
    确定模块，用于根据本地桌面用户对本地桌面的操作模式，将透明辅助层的可变穿透属性确定为非穿透属性还是穿透属性；
    处理模块，用于若将透明辅助层的可变穿透属性确定为非穿透属性，则在具有穿透属性的本地透明标注层上进行桌面标注；若将透明辅助层的可变穿透属性确定为穿透属性，则在本地桌面上进行桌面操作。
  9. 根据权利要求8所述的装置，其中，
    所述装置还包括：
    共享模块，用于将本地桌面用户的本地桌面共享给其他用户，以便在其他用户接收共享桌面期间创建具有非穿透属性的桌面接收层和具有穿透属性的非本地透明标注层，并在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注；
    接收模块，用于接收其他用户触发的鼠标事件；
    所述处理模块，还用于依据其他用户触发的鼠标事件，在本地透明标注层上进行桌面标注。
  10. 根据权利要求9所述的装置，其中，所述处理模块还用于：在非本地透明标注层上依据其他用户触发的鼠标事件进行桌面标注之后，删除非本地透明标注层上标注的内容。
  11. 一种计算机可读存储介质，用于计算机可读存储，其中，所述存储介质存储有一个或者多个程序，所述一个或者多个程序可被一个或者多个处理器执行，以实现权利要求1至8中任一项所述的桌面处理方法的步骤。
  12. 一种电子设备，其特征在于，包括：至少一个处理器；以及，
    与所述至少一个处理器通信连接的存储器；其中，
    所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行根据权利要求1至8中任一项所述的桌面处理方法。
PCT/CN2021/101649 2020-06-29 2021-06-22 一种桌面处理方法、装置和存储介质 WO2022001762A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010605122.9 2020-06-29
CN202010605122.9A CN113934329A (zh) 2020-06-29 2020-06-29 一种桌面处理方法、装置和存储介质

Publications (1)

Publication Number Publication Date
WO2022001762A1 true WO2022001762A1 (zh) 2022-01-06

Family

ID=79273073

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/101649 WO2022001762A1 (zh) 2020-06-29 2021-06-22 一种桌面处理方法、装置和存储介质

Country Status (2)

Country Link
CN (1) CN113934329A (zh)
WO (1) WO2022001762A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609401A (zh) * 2011-12-26 2012-07-25 北京大学 一种网页批注方法
CN103077026A (zh) * 2012-12-28 2013-05-01 锐达互动科技股份有限公司 一种在操作系统的桌面环境下进行书写的方法
CN104571782A (zh) * 2013-10-18 2015-04-29 腾讯科技（深圳）有限公司 远程控制方法、系统、操控终端及被控终端
CN110175065A (zh) * 2019-05-29 2019-08-27 广州视源电子科技股份有限公司 一种用户界面的显示方法、装置、设备和存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102609401A (zh) * 2011-12-26 2012-07-25 北京大学 一种网页批注方法
CN103077026A (zh) * 2012-12-28 2013-05-01 锐达互动科技股份有限公司 一种在操作系统的桌面环境下进行书写的方法
CN104571782A (zh) * 2013-10-18 2015-04-29 腾讯科技（深圳）有限公司 远程控制方法、系统、操控终端及被控终端
CN110175065A (zh) * 2019-05-29 2019-08-27 广州视源电子科技股份有限公司 一种用户界面的显示方法、装置、设备和存储介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ANONYMOUS: "Qt5.11 Methods for Making Transparent Windows and Transparent Cursors", 21 September 2018 (2018-09-21), CN, pages 1 - 2, XP009533342, Retrieved from the Internet <URL:https://blog.csdn.net/lh1136863240/article/details/82799840> *

Also Published As

Publication number Publication date
CN113934329A (zh) 2022-01-14

Similar Documents

Publication Publication Date Title
CN110085224B (zh) 智能终端全程语音操控处理方法、智能终端及存储介质
CA2894332C (en) Geo-location based event gallery
US10135925B2 (en) Non-transitory computer-readable medium, terminal, and method
CN107102786B (zh) 一种信息处理方法及客户端
CN110489312B (zh) 用于控件触发数据采集的数据关联方法和装置
KR20140088768A (ko) 카메라를 실행하기 위한 방법 및 그 전자 장치
CN106791574B (zh) 视频标注方法、装置及视频会议系统
CN111554382B (zh) 医学图像的处理方法及装置、电子设备和存储介质
US11190653B2 (en) Techniques for capturing an image within the context of a document
CN113806054A (zh) 任务处理方法及装置、电子设备和存储介质
US20230336690A1 (en) Masking video feedback loop during screen sharing
US10901582B2 (en) Information processing apparatus, communication system, and image processing method
US20150095805A1 (en) Information processing apparatus and electronic conferencing system
CN116820635A (zh) 一种文档块分享方法、装置、系统及存储介质
WO2022001762A1 (zh) 一种桌面处理方法、装置和存储介质
CN107862035B (zh) 会议记录的网络读取方法、装置、智能平板和存储介质
CN111950397B (zh) 图像的文本标注方法、装置、设备及存储介质
CN111444670B (zh) 文档批注方法、装置、计算机设备及存储介质
CN105812547A (zh) 一种信息处理方法及电子设备
US10979598B2 (en) Conference management apparatus, document registration method, program, and conference system
CN111832455A (zh) 获取内容图像的方法、装置、存储介质和电子设备
CN108924624B (zh) 信息处理方法和装置
US20170041392A1 (en) Method of distributing a file and a computing system employing same
CN111818292A (zh) 控制方法、装置、终端和系统
CN113726584A (zh) 消息发送方法、装置和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21833754

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 19/05/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21833754

Country of ref document: EP

Kind code of ref document: A1