CN117453083A - Method for displaying shortcut function list on virtual desktop and cloud desktop system - Google Patents
Method for displaying shortcut function list on virtual desktop and cloud desktop system Download PDFInfo
- Publication number
- CN117453083A CN117453083A CN202311583403.9A CN202311583403A CN117453083A CN 117453083 A CN117453083 A CN 117453083A CN 202311583403 A CN202311583403 A CN 202311583403A CN 117453083 A CN117453083 A CN 117453083A
- Authority
- CN
- China
- Prior art keywords
- shortcut function
- cloud
- virtual desktop
- instruction
- cloud server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 230000002457 bidirectional effect Effects 0.000 claims abstract description 7
- 230000002093 peripheral effect Effects 0.000 claims description 9
- 238000003708 edge detection Methods 0.000 claims description 2
- 238000013139 quantization Methods 0.000 claims description 2
- 230000002194 synthesizing effect Effects 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 description 4
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000005457 optimization Methods 0.000 description 3
- 108091026890 Coding region Proteins 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000000243 solution Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a display method of a shortcut function list on a virtual desktop, which can be applied to a cloud desktop system. The cloud desktop system comprises a cloud server and a cloud terminal which can be in bidirectional data communication with the cloud server. The method for displaying the shortcut function list on the virtual desktop comprises the following steps: and the cloud server receives the pointer position and the shortcut function calling instruction from the cloud terminal. And obtaining the current display area according to the pointer position and the shortcut function calling instruction. And obtaining an area image capable of being displayed on the cloud terminal through the display area. According to the method and the device for displaying the page of the cloud terminal, the cloud terminal can be guaranteed to normally browse, particularly browse the user attention area, through the cloud terminal to receive the pointer position and the shortcut function calling instruction from the cloud terminal, usability of the cloud terminal for displaying the page is improved, and the user can accurately operate each shortcut operation through the shortcut menu.
Description
Technical Field
The invention relates to the technical field of execution applied to a user interface. The invention relates to a display method of a shortcut function list on a virtual desktop and the cloud desktop system.
Background
The display content on the local desktop is connected with the host through the interface of the display screen, and the host pushes the display picture to the display, so that the image quality is not lost. And the content displayed on the cloud desktop is compressed and decompressed through video coding, so that the image quality is lost. And as the bandwidth of the network transmission changes, the video compression ratio becomes higher and the display quality becomes worse as the bandwidth becomes smaller. Particularly, when a user operates the system, if the invoked operation menu cannot be accurately displayed, the user cannot normally operate the shortcut instruction, and therefore the convenient operation of the user can be affected.
Disclosure of Invention
In order to at least partially solve the technical problems mentioned in the background art, the invention aims to provide a display method of a shortcut function list on a virtual desktop and a cloud desktop system. By utilizing the method disclosed by the invention, the menu display area of the shortcut function list can be formed according to the pointer and the shortcut instruction, so that the display of the shortcut function menu is optimized in real time.
The invention provides a display method of a shortcut function list on a virtual desktop, which can be applied to a cloud desktop system. The cloud desktop system comprises a cloud server and a cloud terminal which can be in bidirectional data communication with the cloud server. The method for displaying the shortcut function list on the virtual desktop comprises the following steps: and the cloud server receives the pointer position and the shortcut function calling instruction from the cloud terminal. And obtaining the current display area according to the pointer position and the shortcut function calling instruction. And obtaining an area image capable of being displayed on the cloud terminal through the display area.
In a second aspect of the present invention, a cloud desktop system is provided, which includes a cloud server and a cloud terminal capable of bidirectional data communication with the cloud server. The cloud server is configured to receive the pointer position and the shortcut function calling instruction from the cloud terminal. And obtaining the current display area according to the pointer position and the shortcut function calling instruction. And obtaining an area image capable of being displayed on the cloud terminal through the display area.
According to the scheme disclosed by the aspects of the disclosure, the cloud server receives the pointer position and the shortcut function calling instruction from the cloud terminal, the current shortcut menu area is obtained as the current display area according to the pointer position and the shortcut function calling instruction, and the area image which can be displayed on the cloud terminal is obtained through the display area, so that when a user browses a page, the shortcut menu injection area is highlighted, and the current display area can be encoded according to video encoding parameters and different resolutions, and the cloud terminal can be guaranteed to normally browse, particularly browse the user attention area, while the network transmission flow is limited, so that the usability of the cloud terminal for displaying the page is improved, the display image quality is guaranteed, the user is guaranteed to pass through the shortcut menu, and the accurate operation of each shortcut operation is realized.
Drawings
Fig. 1 is a flowchart for explaining a method of displaying a list of shortcut functions on a virtual desktop in an embodiment of the present invention.
Fig. 2 is a schematic diagram for explaining the composition of a cloud desktop system in one embodiment of the present invention.
FIG. 3 is a schematic diagram illustrating a pointer on a virtual desktop in one embodiment of the invention.
FIG. 4 is a schematic diagram illustrating a pointer on a virtual desktop in another embodiment of the present invention.
Detailed Description
For a clearer understanding of the technical features, objects and effects of the present invention, embodiments of the present invention will now be described with reference to the drawings, in which like reference numerals refer to identical or structurally similar but functionally identical components throughout the separate views.
In this document, "schematic" means "serving as an example, instance, or illustration," and any illustrations, embodiments described herein as "schematic" should not be construed as a more preferred or advantageous solution. For simplicity of the drawing, only the portions related to the present exemplary embodiment are schematically shown in the drawings, and they do not represent actual structures and actual proportions thereof as products.
In one aspect of the present invention, as shown in fig. 1, a method for displaying a shortcut function list on a virtual desktop is provided, where the method for displaying a shortcut function list can be applied to a cloud desktop system. As shown in fig. 2, the cloud desktop system includes a cloud server 101 and a cloud terminal 201 capable of bidirectional data communication with the cloud server.
The display method of the cloud desktop pointer position comprises the following steps:
step S101, a cloud server receives a pointer position and a shortcut function calling instruction from a cloud terminal.
Step S102, a current display area is obtained according to the pointer position and the shortcut function calling instruction. The shortcut function includes a popup list of instructions, such as a shortcut function of viewing, copying, compressing, refreshing, arranging, etc. The method can also comprise a pop-up window, pop-up content and other shortcuts after clicking the mouse, and the current display area can be the pop-up window and the pop-up content.
Step S103, obtaining an area image capable of being displayed on the cloud terminal through the display area.
The method for displaying the shortcut function list on the virtual desktop is applied to a cloud desktop system, a user terminal is arranged on a cloud terminal 201, display content is generated by a display card at one end of a cloud server 101, and unlike a traditional computer, the display content is not directly transmitted to a client through a display interface. This is because clients tend to be on the other side of the network, transmitting very far away, and transmitting display content directly would take up excessive network bandwidth.
The cloud server encodes the video before transmitting the display content to achieve the aim of compressing the data volume, and transmits the encoded video to the client through the network. After receiving the video, the client decodes the video first and then displays the decoded screen content on a local display screen through a display interface.
When it is determined that the user uses the computer display through the cloud terminal 201, if the pointer stays on the currently operated desktop, the stay position of the pointer of the user and the adjacent region of interest are perceived. According to the invention, the operating system and software of the cloud desktop system can obtain the position coordinates of the pointer in the current screen through the software interface and the hardware interface.
And converting the range information of the pointer sensitive area, namely the image in the current display area, into coding parameters acceptable by a video encoder through a setting algorithm. When the video encoder is invoked, perceptual coding parameters are added in addition to conventional video coding parameters. Therefore, the high-resolution coding of the sensitive area, namely the current display area, is realized, the bandwidth requirement of network transmission is adapted to the maximum extent, and the continuous high-network bandwidth support is not needed while the range resolution for the sensitive area is ensured.
In one embodiment of the invention, the cloud server obtains the bottom layer user application interface information called by the current cloud terminal in the cloud server. The bottom layer user application interface information is interface identification information which is used by a user, is applied to the bottom layer in the cloud server and can be displayed to the user.
For example, the user operating system configured on the cloud server is a Windows10 operating system, a macOS operating system Linux, a Unix or a cloud mobile phone terminal interface application, where the system is equivalent to an underlying user application, and an interface of the Windows10 operating system or the macOS operating system is equivalent to an underlying user application interface. The information of the bottom layer user application interface is equivalent to the system configuration information of the Windows10 operating system or the macOS operating system, so that the cloud server can know what the operating system used by the current user is.
In another embodiment of the present invention, the method for displaying a shortcut function list on a virtual desktop further includes:
and the cloud server receives the pointer position, the shortcut function calling instruction and the bottom layer user application interface information from the cloud terminal. And calling a corresponding bottom layer user application interface according to the bottom layer user application interface information.
And obtaining the current shortcut function menu area information according to the bottom application and the shortcut function calling instruction. For example, clicking the right button of the mouse on the desktop of the Windows10 operating system or the macOS operating system may get the shortcut menu item that matches it. And obtaining the current display area according to the pointer position and the current shortcut function menu area information. Therefore, the user side can clearly see the shortcut menu of the operation, so that the contents of each item in the shortcut menu can be further operated.
And obtaining a shortcut function menu area or a popup content area through a server software preset algorithm or through an image recognition and edge detection method.
In still another embodiment of the present invention, the cloud server obtains upper layer user application interface information invoked by the current cloud terminal in the cloud server. The upper layer user application interface information is interface identification information which is loaded on the bottom layer application in the cloud server and can be displayed for a user to use. The above-mentioned upper layer user application refers to a software application loaded in the Windows10 operating system or the macOS operating system, such as CAD, wps, etc. application software.
In another embodiment of the present invention, the method for displaying a shortcut function list on a virtual desktop further includes:
and the cloud server receives the pointer position, the shortcut function calling instruction and the upper user application interface information from the cloud terminal. And calling a corresponding upper user application interface according to the upper user application interface information.
And obtaining the current shortcut function menu area information according to the upper application and the shortcut function calling instruction. And obtaining the current display area according to the pointer position and the current shortcut function menu area information. Therefore, when the applications are different, the express delivery of the shortcut instructions of various application programs can be conveniently invoked.
In one embodiment of the invention, the cloud server obtains pointer control information according to peripheral equipment arranged at the cloud terminal. And if the pointer stay position with the pointer stay time being larger than the set stay time threshold value is obtained, setting the pointer stay position as the pointer position to be clicked.
The pointer control information includes pointer movement position information in consecutive time periods. And the cloud server generates a shortcut function menu area to be displayed according to the position of the pointer to be clicked and the shortcut function calling instruction. And if the cloud terminal triggers a shortcut function calling instruction, the current display area is obtained according to the shortcut function menu area to be displayed and the pointer position.
When the pointer of the user stays on the screen, the shortcut function menu area to be displayed is generated from the cloud server, so that on one hand, clicking operation of the user can be quickly corresponding, and on the other hand, when the network state is unstable, the blocking display of the user side can be reduced, and the applicability of the program is improved.
The pointer control information comprises pointer coordinate information when the pointer continuously moves, the residence time of the pointer can be calculated according to the generation time of the pointer coordinate information, when the residence time of the pointer is larger than the set residence time, the possibility that a user pays attention to the display content of the current screen is calculated, and then the reading behavior of the user to the region of interest is prestored. Thus, pointer movement position information can be obtained dynamically.
In an embodiment of the present invention, the method for displaying a shortcut function list on a virtual desktop further includes: and the cloud terminal generates a pointer position and a shortcut function calling instruction through the peripheral equipment. The peripheral equipment comprises equipment capable of generating pointer positions and shortcut function calling instructions on a cloud terminal display screen. The peripheral equipment comprises a mouse, a handwriting pen, a keyboard and a notebook computer touch pad.
The shortcut function call instruction comprises a right click instruction, a left click instruction, a right click instruction and a left click instruction of the mouse. The method comprises a pen point single click instruction, a pen point continuous click instruction, a pen side case single click instruction, a set function key single click instruction and a continuous click instruction on a keyboard, a right key single click instruction, a left key single click instruction, a right key continuous click instruction and a left key continuous click instruction on a notebook computer touch pad of a handwriting pen.
In one embodiment of the present invention, the cloud terminal is capable of displaying the virtual desktop image acquired from the cloud server 101.
The method for displaying the shortcut function list on the virtual desktop comprises the following steps:
in step S101, the cloud server 101 transmits the locally generated virtual desktop image to the cloud terminal, and the user generates a pointer position on the cloud terminal display through a connection peripheral device disposed on the cloud terminal. The cloud server 101 receives a pointer position and a shortcut function call instruction that can be displayed on the virtual desktop image from the cloud terminal 201.
Step S102 includes obtaining a current display area according to the pointer position and the shortcut function menu area obtained by the shortcut function calling instruction. As shown in fig. 3, when the pointer 10 is positioned at the position 11 of the screen 20, the setting display area related to the position of the pointer 10 is the setting display area 30 including the pointer 10, and the setting display area 30 is the position of the shortcut function menu. Thus, the set display area can be used as a key display area or a user interest area.
In step S103, the cloud server 101 obtains the region encoding parameters of the current display region at the set resolution. And removing partial codes of the current display area from the virtual desktop image to obtain desktop coding parameters. And synthesizing the virtual desktop image to be displayed into a video stream through the region coding parameters and the desktop coding parameters.
The video decoder of the cloud terminal 201 can recognize the video stream as a virtual desktop image to be displayed. The cloud terminal 201 locally displays a virtual desktop image to be displayed.
In one embodiment of the invention, the method for displaying the shortcut function list on the virtual desktop comprises the steps that the set resolution is larger than the resolution of the cloud terminal display page and smaller than the resolution of the cloud terminal display page. The video coding of the region of interest is thus optimized, either more clearly, more vague, or any other feasible adjustment method. Thereby meeting the requirement of displaying the content for the user.
When the display area is clearer, namely the set resolution is larger than the resolution of the cloud terminal display page, the user is required to clearly view the current selected area. When the resolution is more fuzzy, namely the set resolution is smaller than the resolution of the cloud terminal display page, the fact that the user needs to view the current selected area more fuzzy is indicated, namely the position appointed by the mouse pointer is hoped not to be clearly displayed, the requirement on the code transmission rate is further reduced, and when the network bandwidth is limited, the viewing efficiency of the user can be effectively improved.
In another embodiment of the invention, the cloud desktop service provider can determine whether the perceived coding requirement on the position of the display content after the right click of the mouse exists currently through using the scene or the algorithm of the background system. When the demand is judged to occur, the technical scheme is started.
Let the screen resolution be SW x SH.
The software presets that the right key content sensitive area of the mouse is rectangular, the area is RW x RH, and the position difference between the upper left corner of the rectangular area and the mouse is delta_x and delta_y when the mouse is pressed. delta_x, delta_y may be 0 or may be preset to other valid values.
The method for displaying the shortcut function list on the virtual desktop comprises the following steps:
step S201, a user at a client operates a mouse, and mouse control information is returned to a server through a network;
step S202, the server system software obtains control information and obtains the position information { X1, Y1} of the mouse in the screen when the right button of the mouse is pressed;
step S203, the server-side system software further calculates coordinates { X2, Y2} of the upper left corner of the rectangular region
X2＝X1+delta_x；
Y2＝Y1+delta_y；
In step S204, as shown in fig. 4, the server software calculates the range of the sensitive area based on the mouse position according to the mouse position information. Taking a rectangle as an example: the sensitive area is a rectangle with the vertexes of the four coordinate points:
upper left point coordinates lt= { (X2 > 0)? X2:0, (Y2 > 0)? Y2:0};
the upper right dot coordinates rt= { ((x2+rw) < SW)? X2+rw: SW, (Y2 > 0)? Y2:0};
lower left point coordinates lb= { (X2 > 0)? X2:0, ((y2+rh) < SH)? Y2+rh: SH;
the lower right point coordinates rb= { ((x2+rw) < SW)? X2+rw: SW, ((y2+rh) < SH)? Y2+rh: SH;
in step S205, the software converts the sensitive area range coordinates into perceptually encoded optimized area location information. For a common video encoder, the quantization parameter-aware coding region of either the ROI or QP map is usually in the minimum unit ctu _size of a specific number of pixels, and can generally be 8, 16 or 32.
The unit is used for recalculating to obtain the coordinates of the sensing coding region as follows:
upper left dot coordinates clt=lt/ctu _size;
upper right dot coordinates crl=rt/ctu _size;
lower left dot coordinates clb=lb/ctu _size;
lower right dot coordinates crb=rb/ctu _size;
in step S206, the software converts the perceptual coding optimization region location information into coding parameters and applies the coding parameters to the video encoder.
Taking the optimization method of adjusting QP as an example, if the value of QP is qp_delta.
If the ROI region is displayed, the coding parameters need to be given to the upper left corner and lower right corner of the ROI region. The increase parameter is roi_config= (CLT, CRB, qp_delta);
if the QP map is used, the added encoding parameter is the QP matrix of the whole frame, and for the point in the matrix whose coordinates are within CLT, CRL, CLB, CRB, the QP value is qp+qp_delta, and the other points are unchanged.
Step S207, the video encoder applies the coding parameters to code the desktop content into a video code stream;
step S208, the server transmits the video code stream to the client through the network;
in step S209, the client decodes the video, displays the decoded video on the screen, and obtains an optimization effect on the mouse region of interest.
Step S210, when the user clicks the mouse for the next time, the optimized coding parameters of the current interest area are canceled, and the optimized effect is closed. Therefore, in the desktop video coding application, the invention can automatically form the region of interest according to the right click position of the mouse, and optimize the coding in real time.
In another aspect of the present invention, a cloud desktop system is provided, which includes a cloud server 101 and a cloud terminal 201 capable of bidirectional data communication with the cloud server. The cloud server 101 is configured to receive a pointer position and a shortcut function call instruction from the cloud terminal 201. And obtaining the current display area according to the pointer position and the shortcut function calling instruction. An area image that can be displayed on the cloud terminal 201 is obtained by displaying the area.
In another embodiment of the cloud desktop system of the present invention, the cloud server 101 configures a video encoder and the cloud terminal 201 configures a video decoder.
The cloud terminal 201 is further configured to be able to display a virtual desktop image acquired from the cloud server 101.
The cloud server 101 is further configured to receive a pointer position and a shortcut function call instruction that can be displayed on the virtual desktop image from the cloud terminal. And obtaining the current display area according to the pointer position and the shortcut function menu area obtained by the shortcut function calling instruction.
The video encoder is configured to obtain region encoding parameters for a current display region at a set resolution. And removing partial codes of the current display area from the virtual desktop image to obtain desktop coding parameters.
The cloud server 101 is further configured to synthesize the virtual desktop image to be displayed into a video stream through the region encoding parameter and the desktop encoding parameter. And a video decoder configured to identify the video stream as a virtual desktop image to be displayed.
The cloud terminal 201 is further configured to locally display a virtual desktop image to be displayed.
The video decoder referred to in this disclosure is a specific component that decodes a video bitstream into a visual data stream (YUV or RGB format) according to a specific video compression standard. Video coding may be implemented by software or by a chip. Typically in a chip SOC there is a dedicated video decoder IP.
The video encoder referred to in this disclosure is a specific component that encodes a visual data stream (in YUV or RGB format) into a video bitstream according to a specific video compression standard, and configuration parameters. Video decoding may be implemented by software or by a chip. Typically in a chip SOC, there is a dedicated video encoder IP.
It should be understood that although the present disclosure has been described in terms of various embodiments, not every embodiment is intended to include only a single embodiment, and that such descriptions are provided for clarity only, and that the disclosure is not limited to the embodiments shown and described herein, as such, may be suitably combined in any number of embodiments, as would be apparent to one of ordinary skill in the art.
The above list of detailed descriptions is only specific to practical embodiments of the present invention, and they are not intended to limit the scope of the present invention, and all equivalent embodiments or modifications that do not depart from the spirit of the present invention should be included in the scope of the present invention.
Claims (10)
1. The display method of the shortcut function list on the virtual desktop is characterized by being applicable to a cloud desktop system; the cloud desktop system comprises a cloud server and a cloud terminal which can carry out bidirectional data communication with the cloud server; the method for displaying the shortcut function list on the virtual desktop comprises the following steps:
the cloud server receives a pointer position and a shortcut function calling instruction from the cloud terminal;
obtaining a current display area according to the pointer position and the shortcut function calling instruction;
and obtaining an area image capable of being displayed on the cloud terminal through the display area.
2. The method for displaying a list of shortcut functions on a virtual desktop as set forth in claim 1, further comprising;
the cloud server obtains the information of the bottom layer user application interface called by the current cloud terminal in the cloud server; the bottom layer user application interface information is interface identification information which is used by a user, is applied to the bottom layer in the cloud server and can be displayed to the user;
the method for displaying the shortcut function list on the virtual desktop further comprises the following steps:
the cloud server receives pointer positions, shortcut function calling instructions and the bottom layer user application interface information from the cloud terminal;
calling a corresponding bottom layer user application interface according to the bottom layer user application interface information;
obtaining current shortcut function menu area information according to the bottom layer application and the shortcut function calling instruction;
and obtaining a current display area according to the pointer position and the current shortcut function menu area information.
3. The method for displaying a shortcut function list on a virtual desktop according to claim 2, wherein the cloud server obtains upper user application interface information called by a current cloud terminal in the cloud server; the upper user application interface information is interface identification information which is used by a user, is an application loaded on the bottom layer application and can be displayed for the user in the cloud server;
the method for displaying the shortcut function list on the virtual desktop further comprises the following steps:
the cloud server receives pointer positions, shortcut function calling instructions and upper user application interface information from the cloud terminal;
calling a corresponding upper user application interface according to the upper user application interface information;
obtaining current shortcut function menu area information according to the upper application and the shortcut function calling instruction; and obtaining a current display area according to the pointer position and the current shortcut function menu area information.
4. The method for displaying a list of shortcut functions on a virtual desktop as set forth in claim 1, further comprising:
the cloud server obtains pointer control information according to peripheral equipment arranged at the cloud terminal; if the pointer stay position with the pointer stay time being larger than the set stay time threshold value is obtained, setting the pointer stay position as the pointer position to be clicked; the pointer control information includes pointer movement position information in a continuous period of time;
the cloud server generates a shortcut function menu area to be displayed according to the position of the pointer to be clicked and the shortcut function calling instruction;
and if the cloud terminal triggers the shortcut function calling instruction, obtaining the current display area according to the shortcut function menu area to be displayed and the pointer position.
5. The method for displaying a shortcut function list on a virtual desktop according to claim 1, further comprising generating a pointer position and a shortcut function call instruction by the cloud terminal through a peripheral device;
the peripheral equipment comprises equipment capable of generating a pointer position and the shortcut function calling instruction on the cloud terminal display screen; the peripheral equipment comprises a mouse, a handwriting pen, a keyboard and a notebook computer touch pad.
6. The method for displaying a list of shortcut functions on a virtual desktop according to claim 5, wherein the shortcut function call instruction comprises a right click instruction, a left click instruction, a right click instruction, a left click instruction of the mouse;
the pen point clicking instruction, the pen point continuous clicking instruction, the pen side case clicking instruction, the set function key clicking instruction and the continuous clicking instruction on the keyboard, the right key clicking instruction, the left key clicking instruction, the right key continuous clicking instruction and the left key continuous clicking instruction on the notebook computer touch pad of the handwriting pen.
7. The method for displaying a shortcut function list on a virtual desktop according to claim 1, wherein the method comprises the step of displaying the virtual desktop image acquired from the cloud server on the cloud terminal;
the method for displaying the shortcut function list on the virtual desktop comprises the following steps:
the cloud server receives a pointer position and a shortcut function calling instruction which can be displayed on the virtual desktop image from the cloud terminal;
obtaining a current display area according to the pointer position and the shortcut function menu area obtained by the shortcut function calling instruction; obtaining a shortcut function menu area or a pop-up content area through a server software preset algorithm or through an image identification and edge detection method;
obtaining the region coding parameters of the current display region under the set resolution; removing partial codes of the current display area from the virtual desktop image to obtain desktop coding parameters; synthesizing the virtual desktop image to be displayed into a video stream through the region coding parameters and the desktop coding parameters;
the video decoder of the cloud terminal can identify the video stream as the virtual desktop image to be displayed; and the cloud terminal locally displays the virtual desktop image to be displayed.
8. The method for displaying a shortcut function list on a virtual desktop according to claim 7, wherein the set resolution includes a resolution greater than the cloud terminal display page resolution and a resolution less than the cloud terminal display page resolution; and obtaining the coding parameters of the current display area under the set resolution by using an ROI method or a QP MAP quantization parameter adjustment method.
9. The cloud desktop system is characterized by comprising a cloud server and a cloud terminal which can be in bidirectional data communication with the cloud server;
the cloud server is configured to receive a pointer position and a shortcut function calling instruction from the cloud terminal; obtaining a current display area according to the pointer position and the shortcut function calling instruction; and obtaining an area image capable of being displayed on the cloud terminal through the display area.
10. The cloud desktop system of claim 9, wherein the cloud server configures a video encoder and the cloud terminal configures a video decoder;
the cloud terminal is further configured to be capable of displaying the virtual desktop image acquired from the cloud server;
the cloud server is further configured to receive a pointer position and a shortcut function call instruction which can be displayed on the virtual desktop image from the cloud terminal; obtaining a current display area according to the pointer position and the shortcut function menu area obtained by the shortcut function calling instruction;
the video encoder is configured to obtain a region coding parameter of the current display region under a set resolution; removing partial codes of the current display area from the virtual desktop image to obtain desktop coding parameters;
the cloud server is further configured to synthesize a virtual desktop image to be displayed into a video stream through the region coding parameters and the desktop coding parameters;
the video decoder is configured to identify the video stream as the virtual desktop image to be displayed;
the cloud terminal is further configured to locally display the virtual desktop image to be displayed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311583403.9A CN117453083A (en) | 2023-11-24 | 2023-11-24 | Method for displaying shortcut function list on virtual desktop and cloud desktop system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311583403.9A CN117453083A (en) | 2023-11-24 | 2023-11-24 | Method for displaying shortcut function list on virtual desktop and cloud desktop system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117453083A true CN117453083A (en) | 2024-01-26 |
Family
ID=89590981
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311583403.9A Pending CN117453083A (en) | 2023-11-24 | 2023-11-24 | Method for displaying shortcut function list on virtual desktop and cloud desktop system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117453083A (en) |
-
2023
- 2023-11-24 CN CN202311583403.9A patent/CN117453083A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2012059275A (en) | System and method for digital document processing | |
| US7251774B2 (en) | System for describing markup language for mobile use, and information processing apparatus and program for generating display content | |
| KR101482795B1 (en) | METHOD AND APPARATUS FOR TRANSMITING/RECEIVING LASeR CONTENTS | |
| EP3177024B1 (en) | Apparatus for cloud streaming service | |
| CN102053867B (en) | Method and device for dynamically switching pictures | |
| CN111899175A (en) | Image conversion method and display device | |
| US11960674B2 (en) | Display method and display apparatus for operation prompt information of input control | |
| CN112055256B (en) | Image processing method and display device for panoramic image | |
| WO2021213097A1 (en) | Display apparatus and screen projection method | |
| CN111930233B (en) | Panoramic video image display method and display device | |
| CN117453083A (en) | Method for displaying shortcut function list on virtual desktop and cloud desktop system | |
| CN113015014A (en) | Zoom display method, display terminal and storage medium | |
| CN115757608A (en) | Thermodynamic diagram generation method and device, electronic equipment and storage medium | |
| US20220114695A1 (en) | Display apparatus and image scaling method | |
| CN111913621B (en) | Screen interface interactive display method and display equipment | |
| CN117453082A (en) | Display method of selected area on virtual desktop and cloud desktop system | |
| CN111913622B (en) | Screen interface interactive display method and display equipment | |
| CN113556590B (en) | Method for detecting effective resolution of screen-projected video stream and display equipment | |
| CN112926420A (en) | Display device and menu character recognition method | |
| CN113515244A (en) | Screen-projection-based terminal remote control method, device, equipment and storage medium | |
| CN111897463A (en) | Screen interface interactive display method and display equipment | |
| CN111417007A (en) | Image transmission method, device, terminal and storage medium | |
| CN112419988B (en) | Backlight adjusting method and display device | |
| CN114415864B (en) | Touch area determining method and display device | |
| CN111914511B (en) | Remote file browsing method, intelligent terminal and display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |