KR20180086239A - Synchronization of client-side and server-side keyboard layouts in a virtual session - Google Patents

Abstract

A computer implemented technique processes user input. A computer implemented technique includes creating a virtual session between a client device operated by a user and a server device communicating access to a server based user environment. The technique also includes matching the server keyboard layout of the server device to the client keyboard layout of the client device upon creation of the virtual session. This technique also provides a keystroke input from the user according to the server keyboard layout of the server device, while the server device provides access to the server-based user environment during the virtual session, after the server keyboard layout matches the client keyboard layout Server-based user environment.

Description

Synchronization of client-side and server-side keyboard layouts in a virtual session

The present invention relates to synchronizing a server-side keyboard layout to a client-side keyboard layout in a virtual session.

Desktop or application virtualization enables a user to connect a local client device to a remote server device over a network and then access a virtual desktop or virtual application environment provided by the remote server device. Once a user accesses a virtual desktop or virtual application environment, the user can use the virtual desktop or virtual application environment to perform useful tasks such as editing documents, playing a slide show, checking e-mail, and the like.

To provide text input to a virtual desktop or virtual application environment, a user types on a keyboard of a local client device, and the keystrokes that the user makes are stored in a specific character (e.g., letters, numbers, symbols, etc.) Lt; / RTI > In some situations (e.g., in the context of a desktop computer), the local client device may be equipped with a physical keyboard. In other situations (e.g., in the context of a tablet or smartphone), the local client device is equipped with a touch screen that provides a displayed keyboard.

It is assumed that the touch screen of the local client device initially displays an English (US) touch keyboard that allows the user to enter text input into the desktop or virtual application environment provided by the remote server device. Or the local client device is assumed to be equipped with a physical keyboard. When a user types on a touch keyboard or physical keyboard of a local client device, the keystrokes that the user makes are appropriately converted to specific English characters.

It is also assumed that the local client device is configured to enable the user to switch between different keyboard layouts (e.g., from an English keyboard layout to a French keyboard layout or a German keyboard layout, etc.). If this keyboard switching feature is available to the user, the user may attempt to switch from the English keyboard layout to one of the different keyboard layouts according to personal preference. However, after performing keyboard switching at the local client device, the user may be confused about which keyboard is currently available for the virtual desktop or virtual application environment provided by the remote server device. Also, after a keyboard switch is performed on the local client device, the keystrokes entered by the user may be misinterpreted by the virtual desktop or virtual application environment provided by the remote server device.

The improved technique involves electronically synchronizing a server-side keyboard layout to a client-side keyboard layout during a virtual session. This synchronization eliminates user confusion about which keyboard layouts are currently valid. This synchronization also ensures that client-side text input is not misinterpreted by the server-side environment. Thus, the user experience is greatly improved.

One embodiment relates to a computer implemented method for processing user input. A computer implemented method includes creating a virtual session between a client device operated by a user and a server device communicating access to a server based user environment. The method further includes matching the server keyboard layout of the server device to the client keyboard layout of the client device upon creation of the virtual session. The method further comprises inputting a keystroke input from the user according to the server keyboard layout of the server device while the server device passes access to the server based user environment to the user during the virtual session after the server keyboard layout matches the client keyboard layout To a server-based user environment.

In some arrangements, matching the server keyboard layout with the client keyboard layout includes performing a keyboard binding operation to negotiate an initial client keyboard layout of the client device with an initial server keyboard layout of the server device. This configuration is well suited for client devices equipped with a touch keyboard that allows the user to switch client-side keyboard layout.

In some configurations, performing a keyboard binding operation comprises:

(i) passing a keyboard bind request from a server device to a client device, the keyboard bind request identifying a set of compatible server keyboard layouts;

(ii) communicating a keyboard bind response from the client device to the server device in response to a keyboard bind request, the keyboard bind response causing the client device to use any of the set of compatible server keyboard layouts Identifying whether it is currently configured,

(iii) delivering a keyboard bind-commit message from the server device to the client device in response to the keyboard bind response.

Keyboard Bind - The commit message commits that the client device and the server device support the keyboard layout identified in the keyboard bind response.

In some configurations, creating a virtual session between the client device and the server device includes establishing a virtual channel between the client device and the server device over the computer network. In this configuration, the keyboard bind request, the keyboard bind response, and the keyboard bind-commit message are carried through the established virtual channel.

In some configurations, the keyboard bind response identifies a set of keyboard features (e.g., keyboard type, keyboard layout set, current platform, etc.) configured to be configured and supported by the client device.

In some configurations, the method further comprises matching the server keyboard layout of the server device to another client keyboard layout of the client device after the keystroke input from the user is provided to the server-based user environment for a period of time.

In some arrangements, matching the server keyboard layout of the server device to another client keyboard layout of the client device may include receiving a keyboard layout change command from a user, and responsive to a keyboard layout change command from the user, And setting the new client keyboard layout as a system default keyboard layout to synchronize the server keyboard layout of the server device with the initial client keyboard layout of the client device and the new client keyboard layout of another client device .

In some configurations, the initial client keyboard layout includes a first key arrangement for a first language. In addition, the new client keyboard layout includes a first key arrangement for a first language and a second key arrangement for a second language. In addition, receiving the keyboard layout change command from the user may include selecting a keyboard from the user via a keyboard language indicator for a touch keyboard or an operating system taskbar of a client device operated by the user . The keyboard selection identifies a second key arrangement for a second language instead of a first key arrangement for a first language.

In some configurations, the method may further include, after a keyboard layout change operation is performed, adding additional keystrokes from the user in accordance with the new server keyboard layout of the server device while the server device passes access to the server- And providing input to a server-based user environment.

In some configurations, the method includes broadcasting a set of keyboard change messages to a set of server applications running in a server-based user environment to notify each server application to use a new server keyboard layout instead of an initial server keyboard layout .

Another embodiment is directed to a computer program product having a non-volatile computer readable medium storing a set of instructions for processing user input. A set of instructions, when performed by a computerized circuit,

(A) creating a virtual session between a client device operated by a user and a server device communicating access to a server based user environment;

(B) matching the server keyboard layout of the server device with the client keyboard layout of the client device when creating the virtual session;

(C) inputting a keystroke input from the user according to the server keyboard layout of the server device while the server device transmits access to the server-based user environment during the virtual session to the user after the server keyboard layout matches the client keyboard layout To a server-based user environment.

Yet another embodiment relates to a client device comprising a user interface, a memory, and a control circuit coupled to the user interface and the memory. Wherein when the memory is executed by the control circuit,

(A) creating a virtual session between a client device and a server device that conveys access to a server-based user environment;

(B) matching the server keyboard layout of the server device with the client keyboard layout of the client device when creating the virtual session;

(C) after the server keyboard layout is matched to the client keyboard layout, while the server device passes access to the server-based user environment via the user interface to the user during the virtual session, To provide a keystroke input to the server-based user environment via the user interface.

Still another embodiment relates to a server device including a network interface, a memory, and a control circuit coupled to the network interface and the memory. Wherein when the memory is executed by the control circuit,

(A) creating a virtual session between a client device operated by a user and a server device communicating access to a server based user environment;

(B) matching the server keyboard layout of the server device with the client keyboard layout of the client device when creating the virtual session;

(C) inputting a keystroke input from the user according to the server keyboard layout of the server device while the server device transmits access to the server-based user environment during the virtual session to the user after the server keyboard layout matches the client keyboard layout To the server-based user environment.

It should be understood that at least some of the computerized circuits in the cloud environment are formed by remote computer resources distributed over the network. Such a computerized environment may provide certain benefits, such as hosted services and resources (e.g., software as a service, platform as a service, infrastructure as a service, etc.), improved scalability, and the like.

Other embodiments relate to electronic systems and devices, processing circuits, computer program products, and the like. Some embodiments are directed to various methods, electronic components, and circuitry associated with synchronizing a server-side keyboard layout to a client-side keyboard layout in a virtual session.

BRIEF DESCRIPTION OF THE DRAWINGS The foregoing and other objects, features and advantages will be apparent from the following description of specific embodiments of the present disclosure, as illustrated in the accompanying drawings, wherein like reference numerals in the accompanying drawings indicate like Lt; / RTI > The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the various embodiments of the present disclosure.
1 is a block diagram of a computerized configuration in which a server-side keyboard layout of a server device is synchronized to a client-side keyboard layout of a client device.
2 is a block diagram of an exemplary keyboard layout.
Figure 3 is a sequence diagram of communication during a keyboard binding operation.
4 is a block diagram illustrating specific details of a keyboard layout synchronization operation.
5 is a flow chart of the procedure performed by the computerized configuration of FIG.

The improved technique involves electronically synchronizing a server-side keyboard layout to a client-side keyboard layout during a virtual session. This synchronization eliminates confusion for the user as to which keyboard layout is currently valid. This synchronization also ensures that client-side text input is not misinterpreted by the server-side environment. The user experience is therefore greatly improved.

The specific embodiments, examples, and implementations disclosed herein may be combined in any desired manner having a technical meaning. Moreover, these features are combined in this manner to form all possible combinations, permutations, and variations, except where such combinations, substitutions and / or modifications are expressly excluded or impractical. Support for such combinations, substitutions and modifications is deemed to be present in this document.

Figure 1 shows a computerized configuration 20 suitable for electronically synchronizing a server-side keyboard layout to a client-side keyboard layout during a virtual session. The computerized configuration 20 includes a client device 22, a server device 24, and a communications medium 26.

The client device 22 is configured and arranged to operate as a front end for a virtual session in which a user accesses resources (e.g., applications, content, services, etc.) on the server device 24 via the communication medium 26 . Thus, the user can perform useful work. Suitable client devices include user workstations, desktop computers, laptop computers, tablet devices, smart phones, and the like.

Server device 24 is configured and arranged to provide one or more client devices 22 with access to server-side resources (e.g., applications, content, services, etc.). In some configurations, the server device 24 is a virtualization platform hosting a virtual machine. Suitable server devices 24 include server computers, server farms, server facilities or campuses, distributed circuits, and the like.

The communication medium 26 is configured and arranged to connect the various components of the computerized configuration 20 together so that these components can exchange the electronic signal 28 (e.g., see the double arrow 28) . At least a portion of communication media 26 is shown in the cloud to indicate that communication media 26 may have a variety of different topologies including backbones, hubs and spokes, loops, irregularities, combinations thereof, and the like. Along these lines, communication media 26 may include copper based data communication devices and cabling, fiber optic devices and cabling, wireless devices, combinations thereof, and the like. The communication media 26 may also support LAN based communications, cellular communications, plain old telephone service (POTS) communications, combinations thereof, and the like.

1, the client device 22 includes a communication interface 30, a user interface 32, a memory 34, and a processing circuit 36. The communication interface 30, These client-side components can be electronically interconnected via buses, cables, connectors, circuit boards, and other hardware.

The communication interface 30 is configured and arranged to connect the client device 22 to the communication medium 26. Thus, the communication interface 30 enables the client device 22 to communicate with other components of the computerized configuration 20. Such communication may be circuit based and / or wireless (i.e., IP based, cellular, combinations thereof, etc.).

The user interface 32 is configured and arranged to receive input from a user and provide an output to the user. In the context of a stand alone computer, the user interface 32 may be formed by a standard keyboard, a pointing device (e.g., a mouse), and a display. In the context of a tablet or smartphone, the user interface 32 may be formed by other components such as a touch screen, a miniature keyboard, a webcam, a microphone, a speaker, an accelerometer, and the like.

The memory 34 is intended to represent volatile storage devices (e.g., DRAM, SRAM, etc.) and non-volatile storage devices (e.g., flash memory, magnetic disk drives, etc.). Memory 34 includes a set of virtual client applications and data 44 for establishing and managing virtual sessions with operating system 42 and server device 24 and various software configurations including other applications and data 46. [ (40).

The processing circuitry 36 is configured and arranged to operate in accordance with the various software configurations 40 stored in the memory 34. In particular, the processing circuitry 36 manages the various resources (e.g., memory allocation, processor cycles, hardware compatibility, etc.) of the client device 22 when running the operating system 42.

In addition, processing circuitry 36, operating in accordance with a set of virtualization applications and data 44, forms special control circuitry for creating and maintaining a virtual session with server device 24 on behalf of a user of client device 22 do. During this operation, and as will be described in greater detail below, the processing circuitry 36 synchronizes the server-side keyboard layout 52 to the client-side keyboard layout 50 to avoid confusion and misinterpretation and to improve the user experience. Communication for such synchronization is accomplished through a virtual channel 54 established between the client device 22 and the server device 24 via the communication medium 26 (e.g., see the double arrow 54 in FIG. 1) .

In addition, the processing circuitry 36, which operates in accordance with other applications and data 46, forms other specialized circuits that perform other operations. For example, the processing circuitry 36 allows a user to perform other local user level operations, such as web browsing, video viewing, cellular telephone calling, photographing, and the like. In addition, the processing circuitry 36 allows a user to remotely collaborate with one or more other users through online conferencing, document and other content sharing, work in an online virtual team environment (i.e., an online workspace), and the like.

The above-described processing circuitry 36 may be implemented with discrete components, analog circuitry, other hardware circuitry (not shown), etc., via one or more processors (or cores) executing specialized software, application specific integrated circuits (ASICs), field programmable gate arrays , Combinations of these, and the like. In the context of one or more processors executing software, the computer program product 58 may communicate all or part of the software to the client device 22. [ The computer program product 58 has non-volatile and non-volatile computer-readable storage media for storing a set of instructions for controlling one or more operations of the client device 22. [ Examples of suitable computer-readable storage media include articles of manufacture and apparatus for storing instructions in nonvolatile manner such as CD-ROM, flash memory, disk memory, tape memory, and the like.

As further shown in FIG. 1, the server device 24 includes a network interface 60, a memory 64, and a processing circuit 66. These server-side components can be electronically interconnected via buses, cables, connectors, circuit boards, and other hardware.

The network interface 60 is configured and arranged to connect the server device 24 to the communications medium 26. Thus, the network interface 60 allows the server device 24 to communicate with other components of the computerized configuration 20. [ Such communication may be circuit based and / or wireless (i.e., IP based, cellular, combinations thereof, etc.).

The memory 64 is intended to represent volatile storage devices (e.g., DRAM, SRAM, etc.) and non-volatile storage devices (e.g., flash memory, magnetic disk drives, etc.). Memory 64 includes a set of virtualization applications and data 74 for establishing and managing a virtual session with an operating system 72, client device 22, and various software configurations including other applications and data 76 70).

The processing circuitry 66 is configured and arranged to operate in accordance with the various software configurations 70 stored in the memory 64. In particular, the processing circuitry 66 manages the various resources (e.g., memory allocation, processor cycles, hardware compatibility, etc.) of the server device 24 when executing the operating system 72.

In addition, the processing circuit 66, which operates in accordance with a set of virtualization applications and data 74, forms a special control circuit for creating and maintaining a virtual session with one or more client devices 22. [ During this operation, and as will be described in greater detail below, the processing circuitry 66 is configured to communicate the server-side keyboard layout 52 with the client-side keyboard 54 via the virtual channel 54, to avoid confusion and misinterpretation, To the layout (50).

In addition, the processing circuitry 66, which operates in accordance with other applications and data 76, forms other special circuitry to perform other operations. For example, processing circuitry 66 may include code for services and utilities (e.g., applications and services provided to a user during a virtual session, security, etc.), management tools (e.g., user registration, ), Code for other server-based operations, and so on.

The above-described processing circuitry 66 may include discrete components, analog circuitry, other hardware circuitry, and / or software components, via one or more processors (or cores) executing specialized software, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) A combination of these, and the like. In the context of one or more processors executing software, the computer program product 78 may communicate all or part of the software to the server device 24. [ The computer program product 78 has non-volatile and non-volatile computer-readable storage media for storing a set of instructions for controlling one or more operations of the server device 24. [ Examples of suitable computer-readable storage media include articles of manufacture and apparatus for storing instructions in nonvolatile manner such as CD-ROM, flash memory, disk memory, tape memory, and the like. More details will now be provided with reference to FIG.

Figure 2 illustrates an exemplary keyboard layout 100 (i.e., a QWERTY keyboard layout) suitable for a client-side keyboard layout 50 and / or a server-side keyboard layout 52 (see also Figure 1). Other keyboard layouts, for example, QWERTZ, AZERTY, Dvorak, Colemak, Workman, Norman, JCUKEN, Neo, Plover, BEPO, Turkish, Brahmic script, InScript, Khmer, Thai, Sinhalese, Tibetan, Dzongkha, Arabic, Armenian, Cyrillic , Other foreign-language character keyboard layouts, customized and / or personalized keyboard layouts, etc., are also suitable for use.

On the client device 22, the user can view (e.g., display on the touch screen) the client side keyboard layout 50 as well as actuate the keys of the client side keyboard layout 50. On the server device 24, the server-side keyboard layout 52 is internally managed.

As shown in Figure 2, the keyboard layout 100 includes a plurality of characters 112 (1), 112 (2), 112 (3), ... (collectively, (Or keyboard locations 112 collectively) that are mapped to one or more keys 110 (1), 110 (2), 110 (3), ... Alphabetic characters, numbers, symbols, other text-based meta-characters, functions, directions, operations, combinations thereof, and the like.

It is assumed that the exemplary keyboard layout 100 of FIG. 2 is the client-side keyboard layout 50 as well as the current server-side keyboard layout 52. In this example, the keyboard layout 100 includes an English (US) keyboard layout in which locations 110 (1) are mapped to "q", locations 110 (2) are mapped to "w", locations 110 to be. That is, when the user selects position 110 (1) (e.g., via a touch, key press, or other keystroke gesture), the user enters "q". Similarly, when the user selects position 110 (2), the user enters "w" or the like.

In some arrangements, when the user enters a keystroke, a conversion of the specific location 110 to a specific character 112 occurs at the client device 22, and the client device 22 receives an electronic Signal to the server device 24 for processing. In another configuration, when a user enters a keystroke, the client device 22 sends an electronic signal identifying the particular location 110 to the server device 24 and sends the electronic signature to the specific character 112 of the particular location 110 Transformation occurs at the server device 24.

Now, the user can provide another selectable keyboard layout to the user (e.g., by touching the special key 122, activating the input language indicator on the taskbar of the touch screen, clicking the menu / tab, etc.) And activates the menu 120 to display the menu. In this situation, the user can change the current client-side keyboard layout 50 by touching a different keyboard layout selection. For example, as shown in FIG. 2, the user can select a Japanese keyboard layout "J", a German keyboard layout "DEU", a French keyboard layout "FRA", and the like. If the user chooses to switch the current client-side keyboard layout 50 to another client-side keyboard layout 50, the client device 22 electronically communicates this change to the server- In response, the server-side device 24 automatically updates the server-side keyboard layout 52 to synchronize the server-side keyboard layout 52 with the client-side keyboard layout 50. This server-side operation is preferably transparent to the user, thus alleviating the burden of the user performing a manual switchover on the server device 24.

After the user changes the keyboard layout, the touch screen of the client device 22 displays the newly selected keyboard layout (see user interface 32 of FIG. 1). For a newly selected keyboard layout, at least one or more of the keyboard locations 110 are mapped to different characters 112 (e.g., different characters, different numbers, different symbols, etc.) for the previous keyboard layout. Once a keyboard layout transition occurs, when a user selects a key of a newly selected keyboard layout, the user may select different keys for the characters, e.g., different characters due to different locations, , A new function, and the like.

It should be appreciated that client device 22 executes special client software (e.g., see FIG. 1, virtual client application and data 44) to form special client-side circuitry during a virtual session. Likewise, server device 24 executes special server software (e.g., see FIG. 1, virtualization application and data 74) to form special server-side circuitry during a virtual session. Such circuitry may include, for example, encapsulating rich media redirection, supporting Independent Computing Architecture (ICA), supporting COM port, video, graphics, etc., to support virtual session exchange between client device 22 and server device 24. [ To establish a virtual channel 54 (FIG. 1) at the session layer to utilize the smart card function, and the like.

If virtual channel 54 is set between client device 22 and server device 24 then the special circuitry on devices 22 and 24 will synchronize the client side keyboard layout 50 as well as the server side keyboard layout 52 . In particular, client device 22 and server device 24 initially perform keyboard layout binding operations to negotiate keyboard layout sets initially and synchronize client-side keyboard layout 50 to server-side keyboard layout 52 do. After this initial synchronization, the user can operate the client device 22 with the assurance that the client-side keyboard layout 50 matches the server-side keyboard layout 52 on the server device 24. [ In addition, when the user switches from the initial client-side keyboard layout 50 to the new client-side keyboard layout 50, the client device 22 and the server device 24 electronically collaborate to create a new client-side keyboard layout 50 To the server-side keyboard layout 52. Thus, there is no confusion to the user as to which keyboard layout is valid on the server device 24. [ In addition, there is no opportunity to misinterpret text input on the server device 24. More details will now be provided with reference to FIG.

3 illustrates a keyboard binding operation 150 (FIG. 1) performed between the special client-side circuit 152 and the special server-side circuit 154 at the start of a virtual session between the client device 22 and the server device 24 ). ≪ / RTI > Here, a user may initiate a virtual session to access a virtual desktop or virtual application environment (e.g., a remote application, remotely stored content, etc.) provided by the server device 24. [ The keyboard binding operation initially negotiates a set of server side keyboard layout 52 of server device 24 and a set of client side keyboard layout 50 of client device 22. [

The special client side circuitry 152 is formed by the processing circuitry 36 of the client device 22 operating in accordance with the virtual client application and data 44 (Figure 1). In some arrangements, at least a portion of such client-side circuitry 152 may include a dynamic link library (abbreviated as DLL) that is loaded at the start of the virtual session, e.g., when the user requests a virtual desktop or virtual application from the server device 24 ). ≪ / RTI >

Similarly, special client-side circuitry 154 is formed by the processing circuitry 76 of the server device 24 operating in accordance with the virtualization application and data 74 (FIG. 1) (FIG. 1). In some arrangements, at least a portion of such server-side circuitry 154 is formed through a DLL installed on the server device 24. [

During operation, the special circuitry 152, 154 opens (or forms) the virtual channel 54 once a virtual session is created between the client device 22 and the server device 24. It should be appreciated that communication over the virtual channel 54 (e.g., packet) is carried over the communication medium 26 (FIG. 1).

3, after the virtual channel 54 is opened, the special server side circuit 154 sends a keyboard bind request 160 to the special client side circuit 152. The keyboard bind request 160 identifies a set of compatible server-side keyboard layouts 54 supported by the server device 24. For example, the keyboard bind request 160 represents a particular set of server-side keyboard layouts 52 that the server device 24 is currently attempting to support. In addition, the keyboard bind request 160 further identifies any keyboard features (e.g., keyboard type, current platform, etc.) that the particular server side circuitry 154 can support.

In response to the keyboard bind request 160, the special client-side circuit 152 reads a set of compatible server-side keyboard layouts 54 from the keyboard bind request 160 and, And performs a keyboard evaluation operation 162 that determines a compatible server-side keyboard layout configured to support device 22. Such an evaluation may be based on various factors such as the particular operating platform of the client device 22, whether a particular driver is installed, whether a particular software update or upgrade is installed, and so on.

The special client-side circuitry 152 then identifies the server-side keyboard layout configured to be supported by the client device 22 among the set of compatible server-side keyboard layouts 52 as a set of compatible client-side keyboard layouts 50 And sends the keyboard bind response 164 to the special server side circuit 154. The special server side circuit 154 receives the keyboard bind response 164, The keyboard bind response 164 further identifies any keyboard features (e.g., keyboard type, current platform, etc.) that a particular client-side circuit 152 may support.

In response to the keyboard bind response 164, the special server-side circuit 154 performs a keyboard verification operation 166 that verifies that the server device 24 is compatible with the client device 22 in terms of keyboard layout . In addition, the special server-side circuit 154 stores the keyboard features identified by the keyboard bind response 164 for future use.

Next, the special server side circuit 154 generates a keyboard bind-commit message (or command) 168 and sends it to the special client-side circuit 152. The keyboard bind-commit message 168 indicates that the special server-side circuit 154 determines that a particular set of server-side keyboard layout 52 is valid, i.e., that the keyboard layouts are valid for both the server device 24 and the client device 22 To the special client-side circuit 152 that it is supported by the client-side circuitry 152. [

In response to the keyboard bind-commit message 168, the special client-side circuit 152 considers the keyboard bind-commit message 168 as a command to commit to a particular set of server-side keyboard layout 52. Thus, the special client-side circuitry 152 officially stores a set of client-side keyboard layouts 50 that match the set of specific server keyboard layouts 52.

At this point, the client device 22 and the server device 24 have negotiated which keyboard layout is available. In particular, client device 22 and server device 24 agreed on a common set of compatible keyboard layouts.

After the negotiation of the keyboard layout is completed, the special client side circuit 152 transmits the keyboard layout identifier (KLI) message 180 to the special server side circuit 154. The KLI message 180 includes encapsulated keyboard layout information that specifies the current client-side keyboard layout 50 as the keyboard layout identifier that allows the server-side device 24 to synchronize the knowledge of the client- (Or update) it. In particular, the KLI message 180 includes various characteristics such as input locale, keyboard type, keyboard layout name, and the like.

Subsequently, if the user switches the client-side keyboard layout 50 to a new client-side keyboard layout 50, then the special client-side circuitry 152 will allow the new client-side keyboard layout 50 to be within the negotiated keyboard layout 52 Whether the new client-side keyboard layout 50 belongs to a common set of compatible keyboard layouts. If so, the special client-side circuit 152 sends another keyboard layout identifier (KLI) message 180 to the special server-side circuit 154. The KLI message 180 includes encapsulated keyboard layout information that specifies a new client side keyboard layout 50 as a keyboard layout identifier that allows the server side device 24 to synchronize knowledge of the client side keyboard layout 50 Or update). In particular, the KLI message 180 includes various characteristics such as input locale, keyboard type, keyboard layout name, and the like. More details will now be provided with reference to FIG.

Figure 4 illustrates specific details of how the special server side circuit 154 distributes keyboard information received from the special client side circuit 152 to maintain keyboard layout synchronization between the client device 22 and the server device 24. [ Fig. As shown, the server device 24 includes a running operating system 200 and running applications 210 (1), 210 () for a virtual desktop and / or virtual application environment accessed by a user during a virtual session 2), 210 (3), 210 (4), ... (collectively, running applications 210) as well as special server side circuitry 154. In some configurations, / / The virtual application environment is provided through a virtual machine hosted on a virtualization platform.

Upon receiving the KLI message 180 from the special client-side circuitry 152, as shown in FIG. 4, the special server-side circuitry 154 interfaces with the running-in operating system Activates the layout, and sets the default input language based on the selected keyboard layout (see arrow 220). In addition, the special server-side circuitry 154 broadcasts a message 230 to notify the running server-side application 210 of its input language change. Accordingly, all server-side applications that are running will receive user text from the client device 22 in a language (e.g., English, German, French, Japanese, etc.) that matches the selected keyboard layout 50 on the client device 22 You will be notified. Thus, the client device 22 and the server device 24 can maintain rich and robust keyboard layout synchronization and properly interpret user text input.

It should be appreciated that such a keyboard refresh process is repeated each time the user switches the client side keyboard layout 50 (e.g., switch back to the original keyboard layout, switch to the new keyboard layout, etc.). Thus, the client-side keyboard layout 50 and the server-side keyboard layout 52 are continuously synchronized. More details will now be provided with reference to FIG.

5 is a flow diagram of a procedure 300 performed by the circuitry of computerized settings 20 when synchronizing the keyboard layout. At 302, the circuit creates a virtual session between a client device operated by a user and a server device communicating access to a server-based user environment. Such a session may be in response to a user directing the client device 22 to provide access to a virtual desktop or virtual application environment on the server device 24 to perform useful operations (see FIG. 1).

At 304, the circuit matches the server keyboard layout 52 of the server device to the client keyboard layout 50 of the client device. In particular, the circuit performs keyboard binding operations and keyboard layout synchronization operations to synchronize the initial server keyboard layout 52 of the server device to the initial client keyboard layout 50 of the client device (see FIG. 3). Later on, to match the server keyboard layout 52 to the client keyboard layout 50, the client device and the server device perform communication update to perform a keyboard update operation to update the server keyboard layout 52 to the client keyboard layout 50 Lt; / RTI >

At 306, the circuit provides a keystroke input from the user to the server-based user environment in accordance with the server keyboard layout 52 of the server device, while the server device passes access to the server-based user environment during the virtual session to the user . This operation continues until the user terminates the virtual session (for example, by returning to 304) and switches the keyboard layout.

As described above, the improved technique relates to electronically synchronizing the server-side keyboard layout 52 to the client-side keyboard layout 50 during a virtual session. This synchronization eliminates user confusion about which keyboard layouts are currently valid. This synchronization also ensures that client-side text input is not misinterpreted by the server-side environment. The user experience is therefore greatly improved.

It should also be noted that the above described technique is more than merely providing synchronization between a client and a server. Rather, the technique involves performing a coordinated matching operation that matches the server keyboard layout 52 of the server device to the client keyboard layout 50 of the client device during a virtual session. This matching operation provides technical enhancement by eliminating confusion through which keyboard layout is currently valid and preventing misinterpretation by the server side environment. As a result, the above-described techniques improve the user experience when a user accesses a server-based user environment (e.g., a virtual desktop environment) during a virtual session.

While various embodiments of the present disclosure have been particularly shown and described, those skilled in the art will readily appreciate that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. will be.

For example, the various components of the computerized configuration 20 may be implemented in the cloud or moved to the cloud, i. E., To remote computer resources distributed over the network. Here, the various computer resources may be closely distributed (e.g., as in a server farm within a single facility) or distributed over a relatively long distance (e.g., across a campus, other city, coast to coast, etc.) have. In this situation, the network connecting the resources can have various topologies including backbone, hub and spoke, loops, irregularities, combinations thereof, and the like. The network may also include copper based data communication devices and cabling, optical fiber devices and cabling, wireless devices, combinations thereof, and the like. The network may also support LAN based communications, SAN based communications, combinations thereof, and the like.

It should also be appreciated that the example of the keyboard switching provided above dealt with a graphical keyboard provided by the touch screen only by way of example. In some configurations, the above-described enhancements may be made to the keyboard (not shown), which may be selected through an indicator of the screen provided by the operating system 42 (Fig. 1) This applies to situations where a physical keyboard with a layout is used. In some configurations, the foregoing improvements apply to situations in which a user replaces a first physical keyboard with a second physical keyboard. In some configurations, the different physical keyboards are plug-and-play, and certain types of keyboard layouts are detected through auto-discovery on the client device 22. In this configuration, the client device 22 sends a KLI message 180 (FIGS. 3 and 4) to the server device 24 to inform the server device 24 of the change to the new client-side keyboard layout 50 , The server device 24 in response causes the server-side keyboard layout 52 to synchronize to the new client keyboard layout 50. Such variations and modifications are intended to fall within the various embodiments of the disclosure.

Claims (19)

A computer-implemented method for processing user input,
Creating a virtual session between a client device operated by a user and a server device communicating access to a server based user environment,
Matching the server keyboard layout of the server device with the client keyboard layout of the client device upon creation of the virtual session;
Based user environment during the virtual session, after the server keyboard layout is matched to the client keyboard layout, the server keyboard layout is transferred from the user to the server in accordance with the server keyboard layout of the server device Based keystroke input to the server-based user environment
Way.
The method according to claim 1,
Wherein matching the server keyboard layout to the client keyboard layout comprises performing a keyboard binding operation to negotiate a set of initial server keyboard layouts of the server device with a set of initial client keyboard layouts of the client device
Way.
3. The method of claim 2,
The step of performing the keyboard binding operation includes:
Forwarding a keyboard bind request from the server device to the client device, the keyboard bind request identifying a set of compatible server keyboard layouts;
Communicating a keyboard bind response from the client device to the server device in response to the keyboard bind request, wherein the keyboard bind response is a response to the client device response from a client device capable of supporting one of the set of compatible server keyboard layouts, Identified as a set of keyboard layouts,
Communicating a keyboard bind-commit message from the server device to the client device in response to the keyboard bind response, the keyboard bind-commit message being generated by the client device in response to the keyboard bind response, To use a set of < RTI ID = 0.0 >
Way.
The method of claim 3,
Wherein creating a virtual session between the client device and the server device comprises establishing a virtual channel between the client device and the server device via a computer network, wherein the keyboard bind request, the keyboard bind response, The keyboard bind-commit message is passed through the established virtual channel
Way.
The method of claim 3,
Wherein the step of matching the server keyboard layout to the client keyboard layout further comprises the steps of: receiving a keyboard layout display command from the client apparatus; receiving, in response to the keyboard layout display command, Further comprising performing a keyboard layout synchronization operation to synchronize to the client keyboard layout
Way.
The method according to claim 1,
Matching the different server keyboard layout of the server device to another client keyboard layout of the client device different from the client keyboard layout after the keystroke input from the user is provided to the server based user environment for a certain period of time Included
Way.
The method according to claim 6,
Wherein the step of matching the server keyboard layout of the server device to another client keyboard layout of the client device further comprises the steps of: receiving a keyboard layout change command from the user; Performing a keyboard layout change operation to synchronize the server keyboard layout to the other client keyboard layout of the client device
Way.
8. The method of claim 7,
Wherein the client device initially uses a first client keyboard layout including a first key arrangement for a first language as a client keyboard layout,
Wherein the step of receiving the keyboard layout change command from the user comprises: in response to the user switching from the first client keyboard layout to a second client keyboard layout comprising a second key arrangement for a second language, Wherein the keyboard selection indicator instructs the server device to use the second key arrangement for the second language instead of the first key arrangement for the first language
Way.
8. The method of claim 7,
Based on the other server keyboard layout of the server device, while the server device transfers access to the server-based user environment during the virtual session to the user after the keyboard layout changing operation is performed, Providing a stroke input to the server-based user environment
Way.
8. The method of claim 7,
Further comprising broadcasting a set of keyboard change messages to a set of server applications running in the server-based user environment to notify each server application to use the other server keyboard layout instead of the server keyboard layout
Way.
18. A computer program product having a non-transitory computer readable medium storing a set of instructions for processing user input,
The set of instructions, when executed by the computerized circuit, cause the computerized circuit to:
Creating a virtual session between a client device operated by a user and a server device communicating access to a server based user environment,
Matching the server keyboard layout of the server device with the client keyboard layout of the client device upon creation of the virtual session;
Based user environment during the virtual session, after the server keyboard layout is matched to the client keyboard layout, the server keyboard layout is transferred from the user to the server in accordance with the server keyboard layout of the server device Providing a keystroke input of the server-based user environment to the server-based user environment
Computer program products.

12. The method of claim 11,
Wherein matching the server keyboard layout to the client keyboard layout comprises performing a keyboard binding operation to negotiate a set of initial server keyboard layouts of the server device with a set of initial client keyboard layouts of the client device
Computer program products.
13. The method of claim 12,
The method further comprises the step of matching a different server keyboard layout of the server device to another client keyboard layout of the client device after the keystroke input from the user is provided to the server based user environment for a period of time
Computer program products.
As a client device,
A user interface,
A memory,
And a control circuit coupled to the user interface and the memory,
Wherein the memory, when being executed by the control circuit,
To create a virtual session between the client device and a server device that delivers access to the server-based user environment,
When generating the virtual session, causing the server keyboard layout of the server device to match the client keyboard layout of the client device,
Based on the server keyboard layout of the server device, while the server device transmits access to the server-based user environment during the virtual session to the user via the user interface after the server keyboard layout matches the client keyboard layout Providing a keystroke input from the user to the server-based user environment via the user interface
Store instructions
Client device.
15. The method of claim 14,
The control circuit is configured and arranged to perform a keyboard binding operation to synchronize a set of initial server keyboard layouts of the server device to a set of initial client keyboard layouts when matching the server keyboard layout to the client keyboard layout
Client device.
15. The method of claim 14,
The control circuit may further comprise:
Configured and arranged to match another server keyboard layout of the server device to another client keyboard layout of the client device after a keystroke input from the user is provided to the server based user environment for a period of time
Client device.
A server apparatus comprising:
A network interface,
A memory,
And a control circuit coupled to the network interface and the memory,
Wherein the memory, when being executed by the control circuit,
To create a virtual session between a client device operated by a user and the server device communicating access to a server based user environment,
When generating the virtual session, causing the server keyboard layout of the server device to match the client keyboard layout of the client device,
Based user environment during the virtual session, after the server keyboard layout is matched to the client keyboard layout, the server keyboard layout is transferred from the user to the server in accordance with the server keyboard layout of the server device To provide the keystroke input of the server-based user environment
Store instructions
Server device.
18. The method of claim 17,
Wherein the control circuit performs a keyboard binding operation to synchronize a set of initial server keyboard layouts of the server device to a set of initial client keyboard layouts of the client device when matching the server keyboard layout to the client keyboard layout Configured and deployed
Server device.
19. The method of claim 18,
The control circuit may further comprise:
Configured and arranged to match another server keyboard layout of the server device to another client keyboard layout of the client device after a keystroke input from the user is provided to the server based user environment for a period of time
Server device.

Images