CN111459589A

CN111459589A - Redirection processing method, virtual desktop infrastructure and readable storage medium

Info

Publication number: CN111459589A
Application number: CN202010236529.9A
Authority: CN
Inventors: 李健麒; 万齐齐; 陈云
Original assignee: Sangfor Technologies Co Ltd
Current assignee: Sangfor Technologies Co Ltd
Priority date: 2020-03-30
Filing date: 2020-03-30
Publication date: 2020-07-28

Abstract

The invention discloses two redirection processing methods, a virtual desktop infrastructure and a readable storage medium, wherein in the technical scheme disclosed by the invention, a back-end device in the virtual desktop infrastructure maps a local browser to a redirection browser in a client in real time; receiving user operation information sent by a client; and performing response processing on the user operation information. A client in the virtual desktop infrastructure maps and displays a browser of the back-end equipment in a redirection browser in real time; monitoring the operation behavior of the user; and sending the user operation information meeting the specified conditions to the back-end equipment. The client monitors the user operation and sends the user operation information which guides the user operation to meet the conditions to the back-end equipment. The back-end equipment can effectively respond to the user operation, and the user operation information is responded by the back-end equipment, so that the occupation of client resources can be reduced.

Description

Redirection processing method, virtual desktop infrastructure and readable storage medium

Technical Field

The invention relates to the technical field of cloud desktop application, in particular to two redirection processing methods, a virtual desktop infrastructure and a readable storage medium.

Background

Virtual desktop infrastructure: virtual Desktop Infrastructure (VDI), which refers to a Desktop virtualization technology framework, virtualizes a computer into multiple logical computers by virtualization technology, and delivers the display capabilities of the logical computers to a user terminal through a remote Desktop protocol, so that the user can use the resources and display capabilities of the logical computers through the terminal.

However, the current cloud desktop application realized based on web page redirection cannot effectively respond to the operation behavior of the user, and has the conditions of poor user experience and occupation of client resources.

In summary, how to effectively respond to the user control and other problems in the redirection processing is a technical problem that needs to be solved by those skilled in the art.

Disclosure of Invention

The invention aims to provide two redirection processing methods, a virtual desktop infrastructure and a readable storage medium, which can effectively respond to user operation behaviors and can reduce occupation of client resources.

In order to solve the technical problems, the invention provides the following technical scheme:

the invention provides a first redirection processing method, which is applied to back-end equipment in a virtual desktop infrastructure and comprises the following steps:

mapping a local browser to a redirection browser in a client in real time;

receiving user operation information sent by the client and determining a user operation type;

and responding the user operation information according to the processing strategy corresponding to the user operation type.

Preferably, the user operation type is file downloading, the user operation information is user downloading operation information, the user downloading operation information includes uniform resource locators and cookies, and the response processing on the user operation information includes:

updating the cookies in the browser by using the cookies;

and loading the uniform resource locator by using the browser to download the file.

Preferably, the user operation type is file uploading, the user operation information is user uploading operation information, the user operation information includes a uniform resource locator, cookies and a non-redirection flag, and the response processing on the user operation information includes:

updating the cookies in the browser by using the cookies;

loading the uniform resource locator by using the browser, and uploading a file;

pausing execution of the step of mapping the browser to a redirected browser in the client in real time using the no redirection flag.

Preferably, the user operation is a keyboard operation and/or a mouse operation, and the user operation information includes a keyboard and/or mouse message, and the responding processing to the user operation information includes:

responding and processing the keyboard and/or mouse message by using a local desktop system;

and controlling the browser by using the response result.

Preferably, the mapping the local browser to the redirected browser in the client in real time includes:

enumerating pixel point positions, and determining an actual visible area of a transparent window in the client through a window handle returned by a pixel point;

acquiring a visible area of a non-transparent window by using window enumeration;

determining a redirection display area by combining the actual visible area and the visible area;

and feeding back the redirection display area information corresponding to the redirection display area to the client.

Preferably, the transparent window is a start menu, and accordingly, determining a redirection display area by combining the actual visible area and the visible area includes:

acquiring an intersection area of the starting menu and a redirection area;

and determining the redirection display area by using the intersection area.

Preferably, mapping the browser to a redirected browser in the client in real time includes:

feeding back window information to the client one by one;

and after the window level is adjusted, the window information comprises a top setting mark.

The second redirection processing method provided by the invention is applied to a client in a virtual desktop infrastructure, and comprises the following steps:

mapping and displaying a browser of the back-end equipment in real time in the redirection browser;

monitoring the operation behavior of the user;

and sending the user operation information meeting the specified conditions to the back-end equipment.

Preferably, the specified condition is a file downloading operation, and the user downloading operation information includes a uniform resource locator and cookies; the sending the user operation information meeting the specified conditions to the back-end equipment comprises:

if the loaded uniform resource locator comprises downloading information, calling a downloading processing function and stopping the downloading operation of the redirection browser;

and the redirection browser transmits the uniform resource locator and the cookies to the browser.

Preferably, the specified condition is a file uploading operation, the user operation information is user uploading operation information, the user operation information includes a uniform resource locator, cookies and a non-redirection flag, and the sending the user operation information meeting the specified condition to the back-end device includes:

if the user operation causes loading of a target page corresponding to the uniform resource locator, identifying elements in the target page by using the redirection browser;

judging whether the element is an element corresponding to uploading or not;

if so, enabling the redirection browser to stop loading the target page, and sending the cookies, the non-redirection mark and the uniform resource locator to the browser;

and if not, enabling the redirection browser to load the target page.

Preferably, the specified condition is a mouse operation and/or a keyboard operation, and the user operation information includes a keyboard and/or a mouse message, and the sending the user operation information meeting the specified condition to the backend device includes:

monitoring all keyboard and/or mouse messages by using a keyboard and mouse monitor;

screening all the keyboard and/or mouse messages by utilizing the redirection browser;

and sending the keyboard and/or mouse message obtained after screening to the back-end equipment.

Preferably, the browser for mapping and displaying the backend device in the redirect browser in real time includes:

receiving redirection display area information sent by the back-end equipment;

and drawing the display content corresponding to the browser in a redirection display area corresponding to the redirection display area information.

when receiving a window message sent by the back-end equipment, displaying the window message by using the feedback window message and combining with locally maintained window level data processing;

and if the window information comprises a top setting mark, processing the window information and updating the window level data.

Preferably, the method further comprises the following steps:

and in the process of windowing the desktop of the virtual machine, restoring the minimized window level display by using the window level data.

The invention discloses a virtual desktop infrastructure, comprising:

a client and a backend device having a communication connection;

the client comprises a redirection browser and a browser control program, and the client is used for realizing the second redirection processing method;

the back-end equipment comprises a browser tracking program, a browser plug-in and a browser; the client is configured to implement the steps of the first redirection processing method.

A readable storage medium, on which a computer program is stored, which computer program, when being executed by a processor, carries out the steps of the above-mentioned redirection processing method.

By applying the redirection processing method provided by the embodiment of the invention, the back-end equipment in the virtual desktop infrastructure maps the local browser to the redirection browser in the client in real time; receiving user operation information sent by a client, and determining a user operation type; and responding the user operation information according to the processing strategy corresponding to the user operation type. And the back-end equipment maps the local browser to a redirected browser in the client in real time. And when the back-end equipment can receive the user operation information sent by the client, the back-end equipment carries out response processing based on the processing strategy corresponding to the user operation information. Therefore, the user operation can be effectively responded, the user operation information is responded by the back-end equipment, and the occupation of client resources can be reduced.

By applying the redirection processing method provided by the embodiment of the invention, a client in a virtual desktop infrastructure maps and displays a browser of a back-end device in a redirection browser in real time; monitoring the operation behavior of the user; and sending the user operation information meeting the specified conditions to the back-end equipment. In the method, a redirection browser in a client maps and displays a browser of a back-end device in real time. The client monitors the user operation and sends the user operation information meeting the specified conditions to the back-end equipment, so that the back-end equipment responds to the user operation information, the occupation of client resources is reduced, and meanwhile, the user operation can be responded in real time.

Accordingly, embodiments of the present invention further provide a virtual desktop infrastructure and a readable storage medium corresponding to the two redirection processing methods, which have the above technical effects and are not described herein again.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a schematic structural diagram of a virtual desktop infrastructure according to an embodiment of the present invention;

fig. 2 is a flowchart of a first redirection processing method according to an embodiment of the present invention;

fig. 3 is a flowchart of a second redirection processing method according to an embodiment of the present invention;

FIG. 4 is a schematic diagram illustrating a file downloading process according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a file uploading process according to an embodiment of the present invention;

FIG. 6 is a schematic view of a window overlay;

FIG. 7 is a schematic diagram illustrating a keyboard and/or mouse message response principle according to an embodiment of the present invention;

FIG. 8 is a timing diagram illustrating a keyboard and/or mouse message response according to an embodiment of the present invention.

Detailed Description

In order that those skilled in the art will better understand the disclosure, the invention will be described in further detail with reference to the accompanying drawings and specific embodiments. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

For convenience of description, the related terms in the embodiments of the present invention will be explained below.

Virtual desktop infrastructure: virtual Desktop Infrastructure (VDI), which refers to a Desktop virtualization technology framework, virtualizes a computer into multiple logical computers by virtualization technology, and delivers the display capabilities of the logical computers to a user terminal (client) through a remote Desktop protocol, so that a user can use the resources and display capabilities of the logical computers through the client.

Virtual machine: virtual Machine (VM), refers to a complete computer system with complete hardware system functionality, emulated by software, running in a completely isolated environment. The VM needs to run on the virtualization platform.

Host machine: host, in reference to a given virtual machine, refers to the virtualized platform Host on which the Virtual Machine (VM) runs. The host provides software and hardware resources such as calculation, storage, network and the like for the VM operated by the host.

Cloud terminal: cloud Terminals (CT), Terminals for VDI delivery, mainly have thin clients and general software clients.

Redirection: redirect, which refers to redirecting various network requests to other locations through various methods.

Cookies: refers to data (typically encrypted) that the web site stores on the user's local terminal for purposes of identifying the user's identity and performing session tracking.

Webpage redirection: the web redirect (WPR) is a new cloud desktop application technology, the browser page content in the virtual machine is redirected to the browser of the user terminal, and when the user uses the cloud desktop to browse the webpage, the user consumes the resources of the client terminal instead of the resources of the virtual machine, so that the load of the server side can be greatly reduced, and the user experience is enhanced.

The two redirection processing methods provided by the embodiment of the invention can be respectively applied to the back-end device and the client in the virtual desktop infrastructure shown in fig. 1.

The browser 1 refers to various mainstream web browsers running in a backend device (e.g., a virtual machine), such as a chrome, an IE, a firebox, and the like.

The browser plug-in 2 is responsible for monitoring the state of the browser 1, controlling the behavior of the browser 1 such as intercepting the url when the user inputs the url to access the website, enabling the browser at the back end 1 not to load, namely not consuming back-end resources, and transmitting the url to the client for loading.

The browser tracking program 3 is mainly responsible for bidirectional communication forwarding of the plug-in 2 and the client (client), and tracking the position and visible area of the browser 1 in the virtual machine, and informing the client whether and how to display the redirected browser 6.

And a transmission communication layer 4 for providing communication transmission between the front end and the back end. According to the deployment situation, the system can be a network, a virtual machine serial port and the like.

A browser control program 5, which is mainly responsible for receiving data of the back-end device, controlling the behavior of the redirection browser 6 (i.e. the action of the user operating the back-end (virtual machine) browser is mapped to the client (terminal) browser, and feeds back the relevant information to the back-end device)

The redirection browser 6 may generally use an open browser engine kernel such as webkit or libref as a browser for basic special implementation, and is responsible for displaying the content of the redirected web page.

The backend device refers to a Virtual Machine (VM) running on a Host machine (Host), and the client refers to a thin terminal or a piece of client terminal software running on a remote physical machine.

Referring to fig. 2, fig. 2 is a flowchart of a first redirection processing method in an embodiment of the present invention, where the method is applicable to a backend device in a virtual desktop infrastructure, and includes:

s101, mapping the local browser to a redirection browser in the client in real time.

Specifically, a Web Page Redirect (WPR) technique is used to redirect the content of the local browser page of the backend device to the redirect browser of the client.

When the web page redirection technology is used, the window needs to be tracked in real time to avoid display abnormality. At present, with the application of transparent windows, the existing window tracking is difficult to track the effective window condition. Preferably, to solve this problem, different window region determination methods may be used for different window types, and then the redirection display region information may be determined. The specific implementation process comprises the following steps:

enumerating pixel point positions, and determining an actual visible area of a transparent window in a client through a window handle returned by a pixel point;

step two, acquiring a visible area of a non-transparent window by using window enumeration;

thirdly, determining a redirection display area by combining the actual visible area and the visible area;

and step four, feeding back the redirection display area information corresponding to the redirection display area to the client.

That is, when the window displayed by the client includes a transparent window, the actual size of each window is obtained by directly adopting the existing window tracking and utilizing the window enumeration principle to perform rectangular operation, so that the actual visible area of the transparent window is difficult to accurately know, and the window condition cannot be effectively tracked. It is considered that there are no pixels in the transparent portion of the transparent window, and there are pixels in the actual display area. Based on this, in this embodiment, enumeration of pixel point positions is adopted, and the window returned based on the pixel points has an actual visible region for determining the transparent window.

And for the non-transparent window, the visible region can be determined directly through a window enumeration mode.

After the actual visible area and the visible area are obtained, the redirected display area may be determined. And feeding back the redirection display area information corresponding to the redirection display area to the client. So that the client performs display content rendering based on the redirected display area information.

In order to further reduce the calculation amount of window tracking, for part of transparent windows with known positions, the following method can be adopted to narrow the search range of pixel point enumeration. Taking a transparent window as a menu starting example, the window tracking process comprises the following steps:

step one, acquiring an intersection area of a starting menu and a redirection area;

and step two, determining a redirection display area by using the intersection area.

The second step may specifically be to search for the left side and the right side in the intersection region; after the left side and the right side are determined, searching an upper side and a lower side in an intersection region; the reoriented display area is determined using the left, right, top and bottom edges.

Through analysis, if the starting menu and the redirection display area have an intersection, at least two edges are intersected, namely at least one corner is covered, the width and the height of the visible area are certain to be on the edges, and the visible area can be obtained by searching the edges of the redirection area. First, the intersection of the redirection area and the start menu is taken as a search area, and then left (left) and right (right) sides are searched, and top (top) and bottom (bottom) sides are searched. Then, a re-oriented display area is determined based on the left, right, top, and bottom sides.

Preferably, considering that in practical applications, there may be a plurality of windows in the client and there are situations of mutual coverage, in order to avoid display anomalies, the real-time mapping of the browser to the redirected browser in the client includes:

step one, feeding back window information to a client one by one;

and step two, after the window level is adjusted, the window information comprises a top mark.

That is to say, when window information is fed back, the window information is fed back one by one, confusion is avoided, and in addition, after window level adjustment occurs, a client is informed to perform corresponding adjustment through a top setting mark.

S102, receiving user operation information sent by a client, and determining a user operation type.

In the application, the user operation information sent by the client can be accepted, and the user operation information can comprise various types, such as file downloading, file uploading, keyboard operation and/or mouse operation and the like. The user operation type may be determined based on the specific content of the user operation information, or may be determined by reading the type tag of the user operation information.

And S103, responding to the user operation information according to the processing corresponding to the user operation type.

In this embodiment, a corresponding processing policy may be set in advance for the user operation type. After obtaining the user operation information and determining the user operation type, the back-end device may perform response processing on the user operation information based on the corresponding processing policy. Namely, the back-end equipment is used for responding to the user operation, and client resources do not need to be occupied.

Due to the current VDI web page redirection process, there are still a lot of problems and more functions to be provided. Therefore, in the embodiment, the corresponding user operation information can be effectively responded according to different function requirements.

Preferably, an efficient file upload processing function is provided. The user operation information is the operation information uploaded by the user, the user operation information comprises uniform resource locators, cookies and non-redirection marks, and the process of responding and processing the user operation information comprises the following steps:

step one, utilizing cookies to update the cookies in the browser;

loading the uniform resource locator by using a browser, and uploading a file;

and step three, using the non-redirection mark to pause and execute the step of mapping the browser to the redirected browser in the client in real time.

When the back-end equipment receives operation information uploaded by a user, the cookies in the browser are updated firstly, and then the uniform resource locator, namely url, is loaded.

And the mark is not redirected, namely the client informs the back-end equipment, and for the processing operation of the url, the downloading action of the browser is mapped to the redirected browser in the client in a pause manner without redirection. That is, the file download operation is performed only in the backend device.

Preferably, in order to provide an effective file uploading operation, the user operation information is user downloading operation information, and the user downloading operation information includes uniform resource locators and cookies, and the process of performing response processing on the user operation information includes:

step one, utilizing cookies to update the cookies in the browser;

and step two, loading the uniform resource locator by using the browser to download the file.

That is, when the user operates at the client and needs the file, the specific execution action of uploading the file is performed by the browser of the backend device, so as to avoid that the redirected browser cannot find the file to be uploaded locally.

Preferably, after the redirection technology is used, the method for solving the problem that the shortcut key and part of mouse operations of the keyboard are invalid, the user operation is the keyboard operation and/or the mouse operation, the user operation information includes keyboard and/or mouse messages, and the responding and processing to the user operation information includes:

step one, utilizing a local desktop system to perform response processing on keyboard and/or mouse messages;

and step two, controlling the browser by using the response result.

In order to effectively respond to the mouse operation and the keyboard operation of the user, in the embodiment, the client side can send a keyboard and/or mouse message to the back-end equipment. Wherein, keyboard and/or mouse messages include: there is only a single keyboard message, or only a single mouse message, or both a keyboard message and a mouse message. Keyboard and/or mouse operations are referred to herein and are not to be enumerated.

After the back-end device receives the keyboard and/or mouse messages, the back-end device can utilize the local desktop system to respond to the keyboard and/or mouse messages. The responding process referred to herein may specifically be responding to a keyboard shortcut key in the local desktop system, and responding to an operation of a mouse.

The browser is then controlled based on the result of the response. And because the browser and the redirected browser of the client have a real-time mapping relationship, a user can see that the keyboard operation or the mouse operation of the user is responded at the client.

Referring to fig. 3, fig. 3 is a flowchart of a second redirection processing method in an embodiment of the present invention, which can be applied to a client in a virtual desktop infrastructure, and the method can be cross-referenced with the redirection processing method in the backend device in the virtual desktop infrastructure described in the foregoing embodiment. The redirection processing method shown in fig. 3 includes:

s201, mapping and displaying the browser of the back-end equipment in the redirection browser in real time.

The web page display content of the browser of the back-end device can be redirected to a redirection browser of the user side by using a web page redirection technology.

When the web page redirection technology is used, the window needs to be tracked in real time to avoid display abnormality. That is, the real-time mapping of the browser that displays the backend device in the redirection browser specifically includes:

step one, receiving redirection display area information sent by back-end equipment;

and step two, drawing the display content corresponding to the browser in the redirection display area corresponding to the redirection display area information.

The redirection display area information may be obtained in the manner described in the above embodiments, and is not described in detail here.

After receiving the redirection display area information, the client can draw the display content corresponding to the browser in the redirection display area corresponding to the redirection display area information. When the webpage is redirected, when windows of other local applications exist, all or part of contents in the browser are displayed according to specific covering conditions, and display confusion is avoided.

Preferably, to avoid confusion of window display, redirecting a browser in the browser for mapping and displaying the backend device in real time includes:

step one, when receiving window information sent by back-end equipment, processing and displaying the window information by using feedback window information and combining locally maintained window level data;

and step two, if the window information comprises a top setting mark, processing the window information and updating window level data.

Namely, the back-end device processes the window information once every time the back-end device sends one window information, and in order to avoid window hierarchy relation abnormity in the processing process, the back-end device can also process the window hierarchy data by combining with local maintenance. When the window information comprises the top setting mark, the window hierarchical relationship can be shown to be changed once, and at the moment, the window hierarchical data can be synchronously updated when the window information is processed. The window level data can be maintained by a data structure of a stack, and can also be maintained in a linked list mode.

Preferably, in order to effectively restore the window, the minimized window level display is restored by using the window level data in the process of windowing the virtual machine desktop. That is, the window level data can ensure that the original window level display is maintained when the window is restored after minimization.

And S202, monitoring the operation behavior of the user.

The user operation behavior may be specifically an operation performed by the user in the redirection webpage, such as a new webpage loading behavior, and monitoring of a local input device, such as a mouse and a keyboard.

And S203, sending the user operation information meeting the specified conditions to the back-end equipment.

In this embodiment, in order to effectively respond to the user operation, the user operation information meeting the specified condition may be sent to the backend device, so that the backend device performs response processing, so that when the redirection browser is used, the corresponding function can be realized.

Preferably, in order to realize the file downloading function, the specified condition is file downloading operation, and the user downloads operation information which comprises uniform resource locators and cookies; the method for sending the user operation information meeting the specified conditions to the back-end equipment comprises the following steps:

step one, if the loaded uniform resource locator comprises downloading information, calling a downloading processing function and stopping the downloading operation of the redirection browser;

and step two, commanding the redirection browser to transmit the uniform resource locator and the cookies to the browser.

At present, a redirection webpage is used for downloading files, and a user clicks a downloading url in the redirection webpage, so that the following conditions can occur: no response is made, the manufacturer does not realize the downloading function, or the user must click the right button to select the downloading option in the right button menu for downloading. In this embodiment, when the uniform resource locator including the download information needs to be loaded, the download processing function may be invoked to stop the download operation of the redirection server, and instruct the redirection browser to send the uniform resource locator and the cookies to the browser of the backend device. Therefore, the browser of the back-end equipment can download files conveniently, and the occupation of local client resources is reduced. Namely, a file downloading mode which is convenient for user operation and does not need to occupy client resources is provided.

Preferably, a file uploading function is provided, the specified condition is a file uploading operation, the user operation information is user uploading operation information, the user operation information includes a uniform resource locator, cookies and a non-redirection flag, and the user operation information meeting the specified condition is sent to the back-end device, including:

step one, if a target page corresponding to a uniform resource locator is loaded due to user operation, identifying elements in the target page by using a redirection browser;

judging whether the element is an uploading corresponding element;

if so, instructing the redirection browser to stop loading the target page, and sending the cookies, the non-redirection mark and the uniform resource locator to the browser;

and step four, if not, loading the target page by the redirection browser.

That is, the client may determine whether the file upload is required by determining whether the element of the load target page is an element corresponding to the upload (e.g., determining whether html api and js api keywords exist). When the user needs to upload the file, the client can directly feed back the user uploading operation information to the back-end equipment, so that the back-end equipment uploads the file related to the size of the back-end equipment to the page based on the user uploading operation information. Particularly, when the file is uploaded, the redirection browser can be instructed to stop loading the target page, that is, the webpage is not redirected at the moment, so that the file is uploaded successfully.

Preferably, in order to effectively respond to the user operation of the keyboard and the mouse at the client, the specified condition is a mouse operation and/or a keyboard operation, and the user operation information includes a keyboard and/or a mouse message, and the user operation information meeting the specified condition is sent to the backend device, including:

step two, screening all keyboard and/or mouse messages by utilizing a redirection browser;

and step three, sending the keyboard and/or mouse information obtained after screening to the back-end equipment.

Since the keyboard-mouse listener can listen to both the mouse message and the keyboard message no matter which program is focused on, the keyboard-mouse listener can be used to listen to the keyboard and/or the mouse message in this embodiment. Then, the redirection browser is utilized to filter the keyboard and/or mouse messages, if the focus is on the redirection browser, the keyboard and/or mouse messages are delivered to the protocol client, and then the keyboard and/or mouse messages are synchronized to the back-end equipment by the client. Thus, the keyboard operation and the mouse operation of the user are known by the backend device, so that the backend device performs corresponding processing, and the specific processing procedure can participate in the above embodiment.

Corresponding to the above method embodiments, the embodiments of the present invention further provide a virtual desktop infrastructure, and the virtual desktop infrastructure described below and the above two redirection processing methods may be referred to correspondingly.

Referring to fig. 1, the virtual desktop infrastructure includes:

a client 20 and a backend device 10 having a communication connection;

the client comprises a redirection browser 6 and a browser control program 5, and is used for realizing the steps of the corresponding redirection processing method;

the back-end equipment comprises a browser tracking program 3, a browser plug-in 2 and a browser 1; the client is used for realizing the steps of the corresponding redirection processing method.

The client 20 and the backend device 10 are connected in communication through the transport communication layer 4.

It should be noted that the two redirection processing methods provided by the embodiment of the present invention may be simultaneously applied to the virtual desktop infrastructure, and for convenience of understanding, a specific application scenario combining the two redirection processing methods and related prior art are described in detail below.

Specific scenarios regarding file upload and file download:

in the current VDI web page redirection scenario, after the uploaded page is redirected, the user clicks to upload, and two situations occur:

1) and the button is not effective and cannot be uploaded, namely, the manufacturer forbids the uploading capability of the front-end redirection browser for the safety consideration of the front end.

2) And popping up a local file system at the front end, and finding out the file expected to be uploaded in the back end.

The two effects cannot meet the real requirement of uploading by a user.

In the current VDI web page redirection scenario, when a user clicks a download url in a redirection page, the following situation may occur:

1) no response, no download function.

2) And the user needs to click the right button to select the download option in the right button menu for downloading.

By combining the two redirection processing methods provided by the embodiment of the invention, the uploading and downloading pages can be transferred to the VM browser without redirection by judging whether the page to be redirected should be redirected at the terminal, so that the resource consumption requirements of the server side for redirection and unloading of most pages can be met, the requirements of users for uploading and downloading files can also be met, the uploaded files and the downloaded files are generally interacted and depended on the VM system environment, the transparency of the user for redirection of the whole webpage is realized, and the user experience is greatly improved.

Specifically, the redirection browser downloads the file: the download request is contained in the url, the mainstream open source browser engines all have corresponding download processing functions, and the download can be controlled by rewriting the download processing functions. When the loaded url contains the downloading information, the redirection browser kernel calls the function, the function can transmit the url to the back-end equipment instead of performing the downloading operation, and the back-end equipment (such as a virtual machine) really executes the downloading operation.

And (3) uploading of the redirected browser file: in multiple steps and methods (such as opening a system dialog box by a user, reading a file in the system or dragging the file, reading the file), the mainstream open source browser engine does not directly provide a relevant interface and an event indication to indicate that the operation is an uploading operation, so that whether the url is a page containing an uploading function or not needs to be judged by self. A feasible method is to determine whether the script content in the page contains a feature code or a keyword for executing an upload operation, and the current mainstream upload mode is to open a local file system dialog box for a user to select a target file or folder and drag the file or folder to a designated place for automatic upload, where these operations are typical html api (web page programming interface, where api is an interface and html is a web page) and js api (application program interface, js is JavaScript, a programming language) keywords. Whether the page is uploaded can be judged through webpage feature identification, whether the page is redirected is further judged, and the page which is not redirected is subjected to primary operation by a VM browser, namely file uploading operation.

Specifically, please refer to fig. 1 and 4, fig. 5; fig. 4 is a schematic diagram of a file downloading process according to an embodiment of the present invention; fig. 5 is a schematic diagram of a file uploading process in an embodiment of the present invention.

A file download process comprising:

1. when the url is loaded by the redirection browser 6, if the url is a downloaded connection, the redirection browser notifies the user of the registered callback function, and the callback function transmits the cookie state and the downloaded url to the virtual machine browser 1 through a tunnel (via the control program 5- > the transport communication layer 4- > the tracking program 3- > the plug-in 2).

2. And the browser plug-in receives the cookies and the url, firstly updates the cookies of the browser 1, and then informs the browser 1 to load the url.

3. And if the browser loads and downloads the url, the downloading operation is carried out, and if the downloading needs to be authenticated, the authentication can be carried out through the latest cookies.

4. And finally, storing the downloaded file in a configuration directory of the virtual machine browser.

The file uploading process comprises the following steps:

1. the user operates the redirection browser 6 to load a url, during the loading process, the browser downloads page source codes such as html and JS to the local for execution, after the page is downloaded, a page analyzer is added in the browser 6 to analyze whether the code of the page has uploading related feature keywords (for example, input type is 'file', a file 'drop' is dragged to an HTM L/JS keyword such as a guidance area), and if so, the page should not be redirected.

2. The page without redirection is delivered to the virtual machine browser 1 for execution by the terminal through the tunnel (via the control program 5- > transport communication layer 4- > tracker program 3- > plug-in 2).

3. And the browser plug-in receives the cookies and the url, firstly, the browser cookies 1 are updated, and then the browser 1 is informed to load the url.

4. The back-end browser 3 trace program informs the front-end redirection browser 6 to hide according to the no redirection flag.

5. At this time, the user can see the page of the virtual machine, and the operations of opening the local file, such as uploading/dragging, of the user are all performed in the virtual machine.

Therefore, the two redirection processing methods provided by the embodiment of the invention are combined and applied to the VDI cloud desktop and webpage redirection scene, and have the following advantages:

1) the virtual machine browser and the terminal browser cookies are shared, so that multiple times of authentication are avoided;

2) the downloading is autonomous and controllable by rewriting the downloading processing function of the terminal browser, so that the downloading transfer of the terminal browser is supported;

3) and confirming that the target page is not redirected through a page feature identification mode to support the uploading transfer of the terminal browser.

Regarding mouse and keyboard response processing in web page redirection:

referring to fig. 6, in the current VDI web page redirection scenario, the following scenario states occur:

1. when the user focuses on the area 1 of the browser 2, the area is rendered and displayed by the browser redirected by the cloud terminal, and at the moment, if the user presses some browser shortcut keys or system shortcut keys (such as ctrl + mouse middle wheel scaling, ctrl + tab switching task, trl + D browser favorites opening and the like), the virtual machine cannot receive the information, because the information is transmitted to the browser redirected by the cloud terminal, the redirected browser cannot be transmitted to the virtual machine by default, and the natural shortcut key cannot take effect.

2. When the user clicks on area 2 of browser 1 using the mouse, the user expects the entire browser 1 to be set top, above software X and browser 2, but to be unresponsive.

The reason for the phenomenon is that after the webpage is redirected, the webpage redirection area is rendered by the redirection browser, and the program is independent of the remote desktop protocol client of the cloud terminal, so that keyboard and mouse messages on the redirection browser cannot be captured by the protocol client, cannot be delivered to the virtual machine, and cannot be synchronized to the browser of the virtual machine.

After applying to the two redirection processing methods provided by the embodiment of the present invention, please refer to fig. 7, and fig. 7 is a schematic diagram illustrating a principle of a keyboard and/or mouse message response in the embodiment of the present invention. The key idea is that keyboard and mouse messages which cannot be captured by a remote desktop protocol client are captured and filtered by a redirection browser and finally synchronized into a virtual machine.

In addition, no matter L inux, windows, Android, mac and other mainstream operating systems, a mechanism for monitoring keyboard and mouse messages globally exists, so in practical application, the implementation mechanism and the difficulty degree are different according to different systems, and the main body has the following two implementation modes:

one is that the focus of the user is on the remote desktop protocol client, the corresponding keyboard and mouse operations are all captured by the protocol client, other programs are not captured, and the message is transmitted to the virtual machine by the client; when the focus of the user is not in the protocol client, the keyboard and mouse messages of the user are captured by a redirection browser, a monitor or a hook and the like, are transmitted to the remote protocol client after being filtered, and are transmitted to the virtual machine by the client, so that the keyboard and/or mouse messages are synchronized to the browser of the virtual machine.

And the other is that no matter which program focuses on, the keyboard and mouse monitor can monitor the keyboard and/or mouse messages, at the moment, the messages are sent to the redirection browser for filtering processing, if the focus is on the redirection browser, the redirection browser delivers the keyboard and/or mouse messages to the protocol client, and the client synchronizes the keyboard and/or mouse messages to the virtual machine.

Specifically, referring to fig. 8, fig. 8 is a timing diagram illustrating a keyboard and/or mouse message response according to an embodiment of the present invention. The remote desktop protocol server can run in a host machine, and the desktop system naturally runs in a virtual machine.

The keyboard and mouse listener may be an independent program, or may be a module integrated in other programs, such as a redirection browser, a remote desktop protocol client, and the like. The keyboard and mouse message transmission optimization experience is not only suitable for a redirection scene under a VDI cloud desktop, but also suitable for a redirection scene of a general remote desktop protocol, and the server side is not only a virtual machine, but also a physical machine.

Therefore, the two redirection processing methods provided by the embodiment of the invention are applied to a VDI cloud desktop webpage redirection scene, and the keyboard and mouse messages penetrate into a virtual machine to optimize the user experience, and the system is not limited, such as a client and a server L inux, Android, mac and windows are all suitable.

In addition, messages which cannot be captured by the remote desktop protocol client can be supplemented through keyboard and mouse message transmission by other programs, namely the method is not only suitable for webpage redirection, but also suitable for other similar redirection technical scenes, such as video redirection (namely a player or a window of the cloud terminal, which is independent of the desktop protocol client, plays the content which is played by a virtual machine player).

For window tracking:

by applying the redirection processing method provided by the embodiment of the invention, it is considered that the function of the windows front pointer returns the window handle of one pixel point, because other places are transparent and display the window behind, theoretically, the function returns the handle of an opaque window, and the result is indeed obtained by directly writing demo verification. That is, the actual display area of the start menu can be determined by enumerating the positions of the pixel points and then judging the actual visible area by the window handle returned by the pixel points.

Further, it was found that by analysis, if there is an intersection between the start menu and the display area, at least two edges will intersect, i.e. at least one corner will be covered. The time complexity can be reduced based on this.

The specific implementation process comprises the following steps:

cutting area: firstly, the intersection of a client area (redirection area) and a start menu is taken as a search area, so that the problem of transparent windows (such as small windows and small icons) can be solved, and the calculation speed is increased under a specific scene to search left and right: the locations of left and right are obtained by the top and bottom edges; specifically, can

Defining a search boundary pointing to left by a previous backspace, and initializing the search boundary to the left and the right; defining a search boundary for a right back pointing to right, initialized to the left and right; left cannot exceed right; the following steps are then performed:

1, taking pt1(left, top) pt2(left, bottom) top and bottom from left, and fixing the top and the bottom;

2. if neither pt1 nor pt2 indicates that there is no execution 3, if there is any execution 4;

taking the left by the preleft, and jumping backwards by the left (preleft + backshift)/2;

4. the current connecting line of pt1 and pt2 has a visible area for starting the menu, and the backshift is taken as left, and the left jumps forward (preleft + backshift)/2;

5. finding the left position when the difference between the front and the back is one pixel or equal;

right is taken pt3(right, top) pt4(right, bottom) top and bottom are fixed as upper and lower edges;

7. if neither pt3 nor pt4 indicates that there is no execution 8, if there is any execution 9;

8, back takes right, right jumps ahead (right + back)/2;

9. it is illustrated that there is already a visible area for starting the menu on the current connecting line of pt3 and pt4, take right as right, right jumps backward (right + back)/2;

10. when the difference between the front and the back is one pixel or equal, the position of the right is found 11. continue to execute 1;

search top and bottom:

the search top and bottom are consistent with the search left and right, only left and right are fixed, and the values of top and bottom are added or subtracted in two halves, so that the detailed description is omitted.

Thus, the overall time complexity is directly reduced from n x n to log n performance tests.

It can be seen that under systems such as win10, where the conventional window tracking method fails because there are a large number of transparent windows in win10, the above scheme filters out the transparent portions of the window by means of the win10 feature (i.e., if the start menu and the display area intersect, there are at least two edges that intersect, i.e., at least one corner is covered).

And (3) window hierarchical relation maintenance:

by applying the two redirection processing methods provided by the embodiment of the invention, two window level relation maintenance schemes are provided: one of them is: the server side sends all changed redirected browser window positions and visual areas to the client side every time, and informs the hierarchical relation of the window set; the other one is as follows: (precondition fact, there is not only one active window, one set top window, the hierarchical relation of other windows does not change) the server transmits the windows with changing visual area one by one, each message carries the sign of whether the current window is set top (active window), i.e. the server transmits a window message each time, the client processes one, when the window message carries the sign of set top (active window), the client window is set top, the other remain the original hierarchical, only the visual area is cut, without adjusting the hierarchical relation of local browser; on the other hand, the client uses the data structure of the stack to store the top-placed order of the windows for use by the scene that needs to restore the hierarchical relationship later. And the client adjusts the window level stack sequence every time the top window message is received so as to ensure the level to be correct.

Therefore, the virtual machine server and the client can solve the problems of overlapping of multiple directional windows and disordered levels and windowed desktop scenes of the virtual machine and restore the original state after minimization, and the transmission of the hierarchical relation information of the virtual machine window and the maintenance of the redirection window level of the client.

In addition, after the two redirection processing methods provided by the embodiment of the invention are applied, the redirection of any webpage can be realized through a url wildcard or a regular expression which can be configured by a user.

Corresponding to the above method embodiment, an embodiment of the present invention further provides a readable storage medium, and a readable storage medium described below and a redirection processing method described above may be referred to in correspondence.

A readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the redirection processing method of the above-mentioned method embodiment.

The readable storage medium may be a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and various other readable storage media capable of storing program codes.

Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

Claims

1. A redirection processing method is applied to a back-end device in a virtual desktop infrastructure, and comprises the following steps:

mapping a local browser to a redirection browser in a client in real time;

2. The redirection processing method according to claim 1, wherein the user operation type is file downloading, the user operation information is user downloading operation information, the user downloading operation information includes uniform resource locators and cookies, and the response processing for the user operation information includes:

updating the cookies in the browser by using the cookies;

3. The redirection processing method according to claim 1, wherein the user operation type is file upload, the user operation information is user upload operation information, and the user operation information includes uniform resource locators, cookies, and no redirection flag, and the response processing for the user operation information includes:

updating the cookies in the browser by using the cookies;

4. A redirection processing method according to claim 1, wherein the user operation is a keyboard operation and/or a mouse operation, and the user operation information includes a keyboard and/or mouse message, and the responding processing to the user operation information includes:

and controlling the browser by using the response result.

5. The redirection processing method according to claim 1, wherein mapping the local browser to the redirection browser in the client in real time comprises:

6. A redirection processing method according to claim 5, wherein said transparent window is a start menu, and accordingly determining a redirection display area in combination with said actual visible area and said visible area comprises:

acquiring an intersection area of the starting menu and a redirection area;

and determining the redirection display area by using the intersection area.

7. The redirection processing method according to claim 1, wherein mapping the browser to a redirected browser in the client in real time comprises:

feeding back window information to the client one by one;

8. A redirection processing method is applied to a client in a virtual desktop infrastructure, and comprises the following steps:

monitoring the operation behavior of the user;

9. The redirection processing method according to claim 8, wherein the specified condition is a file download operation, and the user download operation information comprises a uniform resource locator and cookies; the sending the user operation information meeting the specified conditions to the back-end equipment comprises:

10. The redirection processing method according to claim 8, wherein the specified condition is a file upload operation, the user operation information is user upload operation information, the user operation information includes a uniform resource locator, cookies and a no redirection flag, and the sending the user operation information meeting the specified condition to the backend device includes:

judging whether the element is an element corresponding to uploading or not;

and if not, enabling the redirection browser to load the target page.

11. The redirection processing method according to claim 8, wherein the specified condition is a mouse operation and/or a keyboard operation, and the user operation information includes a keyboard and/or a mouse message, and the sending the user operation information meeting the specified condition to the backend device comprises:

12. The redirection processing method according to claim 8, wherein said mapping a browser displaying a backend device in a redirection browser in real time comprises:

receiving redirection display area information sent by the back-end equipment;

13. The redirection processing method according to claim 8, wherein said mapping a browser displaying a backend device in a redirection browser in real time comprises:

14. A redirection processing method according to claim 9, further comprising:

15. A virtual desktop infrastructure, comprising:

a client and a backend device having a communication connection;

the client comprises a redirection browser and a browser control program, and is used for realizing the steps of the redirection processing method according to any one of the above 8 to 14;

the back-end equipment comprises a browser tracking program, a browser plug-in and a browser; the client is configured to implement the steps of the redirection processing method according to any one of the above 1 to 7.

16. A readable storage medium, characterized in that the readable storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the redirection processing method according to any of the claims 1 to 14.