WO2017124860A1

WO2017124860A1 - Distributed wireless multi-screen virtual machine service system

Info

Publication number: WO2017124860A1
Application number: PCT/CN2016/109752
Authority: WO
Inventors: 鲁珂; 李晶晶; 刘杰彦
Original assignee: 成都电科致远网络科技有限公司
Priority date: 2016-01-19
Filing date: 2016-12-13
Publication date: 2017-07-27
Also published as: CN105656749A; CN105656749B

Abstract

Disclosed is a distributed wireless multi-screen virtual PC (personal computer) service system, comprising: a virtualization PC server, which is used for virtualizing a set of physical hardware into a plurality of sets of logical hardware, wherein a complete operating system can be installed on each set of logical hardware; a PC service receiver, which is used for receiving a PC service provided by the virtualization PC server; a plurality of screens, which display a PC desktop of the PC service received by the PC service receiver; a network switch, which is arranged between the virtualization PC server and the PC service receiver, and provides a QoS guarantee for a network connection of the virtualization PC server and the PC service receiver; a wireless control terminal, which is used for realizing a human-machine interaction function of the PC service receiver; and a wireless access point, which is used for providing a wireless communication connection for the PC service receiver and the plurality of screens, and providing a wireless communication connection for the PC service receiver and the wireless control terminal. The present invention achieves the advantages of providing a corresponding PC service according to user requirements, reducing the usage costs for a user, and also improving a device utilization rate at the same time.

Description

Distributed wireless multi-screen virtual machine service system

Technical field

The invention belongs to the field of computer technology, and more particularly to a distributed wireless multi-screen virtual machine service system.

Background technique

With the continuous development of smart terminals and mobile Internet technologies, the role of personal computers (PCs) in the family is increasingly marginalized. However, due to limitations of mobile devices in terms of input and output, peripheral expansion capabilities and computing processing capabilities, PCs are still indispensable devices in the general home. If the PC is decomposed according to functions, it can be divided into two parts, namely, a data processing part and an input and output part. Roughly speaking, the data processing part can be regarded as a part of each component of the PC in the chassis, such as CPU, GPU and memory. Accordingly, the input and output sections can be thought of as components located outside the chassis, such as displays, stereos, and keyboard and mouse. Generally, the data processing portion and the input and output portions are closely connected geographically due to the constraint of the cable connection. The wired connection undoubtedly limits the scope of use and usage scenarios of the PC, and makes the components in the PC almost all single functions, and cannot be reused. For example, a display can only be output together with a PC host at a specified time. task. The continuous advancement of network technology, especially wireless network technology, provides a possibility to separate the data processing part of the PC and the data input and output part from the physical connection. Further, the data processing tasks and input and output tasks are shared to multiple On distributed devices. The benefits of separation are: 1) It can improve the utilization rate and scope of use of the equipment, and directly reduce the user's use cost. For example, after separation, a high-definition television can be used as a display for a home PC, and a mobile terminal can be used as a keyboard and mouse for a home PC. 2) Each device component interconnected by wireless technology can move freely, providing users with services that are available anytime, anywhere. On the other hand, the impact of the mobile intelligent terminal on the PC leads to a decrease in the use time of the PC, and the reduction in the use time leads to a relative increase in the use cost per unit time and the increase and upgrade cost. Inspired by cloud computing, is it possible to provide the functionality of a general PC as a service to a user instead of independent hardware and software. Users can directly access general PC services like network broadband without having to purchase separate hosts and operating systems. At the same time, the existing various screens can be used as display devices for PC services for users, and these display devices are connected by wireless. Users are not limited by factors that are insurmountable in traditional ways such as venues.

Traditional PCs in stand-alone mode are obviously not suitable for providing PC services for different users and different needs at the same time. On the one hand, because the functions and performance of a single machine are fixed, it is impossible to provide differentiated on-demand services. On the other hand, because once the wireless multi-screen is implemented, the use of the wireless screen due to the physical properties of the stand-alone PC is subject to many restrictions.

Summary of the invention

The object of the present invention is to overcome the deficiencies of the prior art and provide a distributed wireless multi-screen virtual machine service system, which is implemented to provide PC services according to user requirements, and reduce user usage costs, and at the same time improve device utilization.

To achieve the above object, the distributed wireless multi-screen virtual machine service system of the present invention includes: a virtualized PC server, a PC service receiver, a plurality of wireless screens, a network switch, a wireless control terminal, and a wireless access point;

The virtualized PC server is configured to virtualize a set of physical hardware into multiple sets of logical hardware, and a complete operating system can be installed on each set of logical hardware;

The PC service receiver is configured to connect to the network switch by wire, perform wired communication with the virtualized PC server, receive the PC service provided by the virtualized PC server, and directly or wirelessly access the wireless access point (Access) Point, AP) transits to establish a connection with the wireless control terminal and multiple wireless screens, and cooperate with each other to realize human-computer interaction and transmit customized desktops;

The plurality of wireless screens are connected to the PC service receiver directly or wirelessly by the wireless access point, and are used to display the PC desktop of the PC service received by the PC service receiver according to the customized requirements of the user;

The network switch is disposed between the virtualized PC server and the PC service receiver to provide QoS guarantee for network connection between the virtualized PC server and the PC service receiver;

The wireless control terminal establishes a connection with the PC service receiver directly or wirelessly by the wireless access point to implement the human-computer interaction function of the PC service receiver;

The wireless access point is connected to the network switch by wire, provides a wireless communication connection for the PC service receiver and the plurality of wireless screens, and provides a wireless communication connection for the PC service receiver and the wireless control terminal.

Preferably, the wireless screen includes an optional wireless connection adapter, the wireless adapter A wireless network card is built in. When no one of the plurality of screens has a built-in wireless network card, the service module deployed in the wireless adapter receives the HD encoded stream sent by the PC service receiver, and the wireless connection adapter has no built-in wireless The video input interface of the screen of the network card is connected. After the wireless connection adapter receives the high-definition encoded stream sent by the PC service receiver, the high-definition encoded stream is decoded, and the decoded high-definition encoded stream is input to the screen display.

Preferably, the PC service receiver accesses the virtualized PC server by using an IP address, and establishes a persistent connection with the remote PC service module in the virtualized PC server, and transmits the remote PC service data provided by the virtualized PC server to the PC service through the network. After receiving the desktop data of the remote PC service, the PC service receiver customizes it according to user requirements, compresses and encodes it and sends it to multiple wireless screens, and the wireless screen decodes the received data and displays it.

Preferably, the connection method between the PC service receiver and the plurality of wireless screens comprises: a direct connection mode and a transit connection mode;

The direct connection mode, that is, the point-to-point communication is directly performed between the PC service receiver and the wireless screen by using the Wi-Fi Direct protocol;

The transit connection mode, that is, the PC service receiver and the wireless screen are connected by a wireless access point.

Preferably, when the above-mentioned relay connection mode is used, the PC service receiver runs a screen connection service, and after the screen accesses the network through the wireless access point, the wireless screen automatically initiates a request to the screen connection service, and the screen connection service requests authentication. After that, it is registered as an optional wireless screen on the PC service receiver, and the user selects the required wireless screen through the wireless control terminal, and then the screen connection service transmits the encoded video stream to the wireless screen display selected by the user in real time.

Preferably, the PC service receiver runs control command processing software for receiving and processing control commands from the wireless control terminal, and the control commands are classified into two categories: one is control executed locally at the PC service receiver. Instructions, such as control screen switching projection and peripheral control; and one type of control instructions for remote PC services, such control instructions, converted into corresponding system messages are transmitted to the virtualized PC server.

Preferably, the virtualized PC server runs a PC service and a remote control service, the PC service provides a data flow, and sends various responses of the PC service to the PC service receiver; the remote control service is responsible for receiving the PC The service receiver forwards the control command from the wireless control terminal and according to The received control commands complete remote connection control and common software control.

Preferably, the PC service receiver and the plurality of wireless screens are specifically managed and coordinated by a wireless connection session management module running in the PC service receiver. The wireless connection session management module includes: a user interaction unit, a session control unit, a device discovery unit, and a connection establishment unit;

The user interaction unit is configured to receive an instruction input by the user, and return the call execution result to the user;

The session control unit: implementing input analysis and output response of the user;

The device discovery unit is configured to discover a device that can establish a connection in a current network environment;

The connection establishing unit: periodically sends a broadcast message to the network, indicating that the service is ready to receive the connection;

After the device discovery unit is enabled, the device discovery unit parses out the broadcast message sent by the connection establishment unit, and displays the connectable wireless screen list to the user interaction unit, and the user interaction unit specifies to establish a connection session after establishing a connection with a certain wireless screen. In the life cycle of the connection session, the user interaction unit invokes the session control unit to complete the user's input parsing and output response.

The technical solution of the present invention has the following beneficial effects:

1. Provide a future-oriented PC service system implementation. The system can be used in homes, companies and schools. The system disclosed by the present invention will support the traditional industry of PC to transform the service. After using the system, the user does not need to purchase and upgrade the PC hardware exclusively, and only needs to access the virtual machine service like the access to the broadband network. The same function as the original independent hardware and software system.

2. The system disclosed by the present invention provides new possibilities for payment methods between enterprises and users. Previously, the user had to pay all the hardware and software costs in one time before using the PC. When the PC was accessed by the service, the service provider could pay the fee according to the usage, time of use and other factors.

3. After using the system, the user does not have to be constrained by the cable, and the position of the display screen can be arranged as desired. At the same time, users can conveniently deploy multiple wireless screens for the same PC desktop and display the virtual machine desktop or a specific PC application window on the specified screen.

4. The system disclosed by the present invention fully considers the existing equipment of the user and encourages reuse of the device. Thus, the user's use cost is reduced, and the device utilization rate is improved.

5. Not only the existing hardware devices of the user can be reused, but in the virtual machine, the software can also be reused. A software can be implemented on the virtualized PC server using technologies such as software virtualization and virtual machine sharing. Reduced software usage costs for businesses and homes by multiple users.

DRAWINGS

1 is a simplified system network topology diagram of a distributed wireless multi-screen virtual machine service system according to an embodiment of the present invention;

2 is a logical structural diagram of a distributed wireless multi-screen virtual machine service system according to an embodiment of the present invention;

3 is a schematic diagram of a multi-screen projection mode;

4 is a schematic diagram of a connection between a PC service receiver and a wireless screen;

5 is a schematic diagram of input control in which a wireless control terminal participates;

6 is a schematic diagram of a process for implementing a direct connection method;

7 is a schematic diagram of a process of implementing a relay connection mode technology;

Figure 8 is a diagram of a wireless connection session management module;

Figure 9 is a typical data processing flow diagram for projecting specified content onto a designated screen.

detailed description

The specific embodiments of the present invention are described below in conjunction with the drawings in order to provide a better understanding of the invention. It is to be noted that in the following description, when a detailed description of known functions and designs may dilute the main content of the present invention, these descriptions will be omitted herein.

The distributed wireless multi-screen virtual machine service system disclosed by the present invention is coordinated by a plurality of functional components, as shown in FIG. 1 , which are respectively a virtualized PC server 101 , a PC service receiver 105 , and a plurality of wireless screens 108 . Network switch 103 (house switch) and 104 (user switch), wireless control terminal 106, and access point (AP) 107. If the specific implementation process, the peripherals that need to be extended are generally connected through the wireless control terminal 106, or may be connected through the PC service receiver 105. These devices, according to the owner and the deployment site, as shown in FIG. 1, can be divided into two categories: service provider device 100 and user device 200, wherein the service provider device 100 includes a virtualized PC server 101 and a network switch 103 ( The building switch), 104 (user switch), and the rest are the client device 200. Figure 1 is only an illustrative example of the hardware elements necessary in the system. In an actual system, the user's device can be much richer than that given in Figure 1. For the sake of simplicity of the drawing, only the network device of the user 1 is shown in FIG. 1, and the network devices of other users are not shown.

The virtualized PC server 101 is used to virtualize a set of physical hardware into multiple sets of logical hardware, each set of logic A complete operating system can be installed on the hardware. The logical hardware and operating system together provide users with virtualized PC services. The PC service is transmitted to the PC service receiver 105 of the client device 200 through a network, that is, a network switch 103 (a building switch), 104 (a user switch). Since the focus of the present disclosure is on a future-oriented PC service system, the virtualization technology is not limited by the specific technology, but any technology that can implement a virtualized PC can be implemented in the disclosed solution. For example, the current commercial virtualization technology VMware vSphere, Citrix XenServer, Microsoft Hyper-V and open source virtualization technology Xen, KVM and so on.

The PC service receiver 105 is for receiving a PC service provided by the virtualized PC server 101. The PC service receiving software is deployed on the PC service receiver 105, is responsible for receiving the virtualized PC service, and displays the PC desktop through a plurality of wireless screens 108. The PC service receiver 105 integrates a plurality of wired and wireless network modules, and the wired network module is used to connect to the virtualized PC server 101, and the wireless module is used to project the virtualized PC desktop wirelessly (directly or by the wireless access point 107) To the target wireless screen 108, the wireless control terminal 106 is connected directly or through the wireless access point 107 to implement human-computer interaction with the user. The PC service receiver 105 can also connect the user's local private hard disk through an optional PCI interface and a high-speed USB interface to store the user's personal data. It can also connect external devices such as a USB flash drive and a printer to read and print local files.

A plurality of wireless screens 108 are used to display desktop images received by the PC service receiver 105 in accordance with user customization requirements. The connection between the wireless screen 108 and the PC service receiver 105 can be either a wired connection or a wireless connection. Since the wired connection method is already applied in the conventional PC, and the wired connection method is not the protection point of the present invention, the present invention is mainly directed to the wireless connection method. Here, the wireless screen 108 can be either a dedicated display or an existing device multiplex, such as a television screen, a projector screen, or even a mobile phone screen and a tablet screen. For the built-in wireless network card, and the screen of the application can be installed, the image can be directly placed on the wireless screen 108. For screens without a built-in wireless network card, you need to receive the virtualized PC desktop image through the wireless connection adapter, and then display the desktop image through the video input interface of the connected screen. In particular, the distributed wireless multi-screen virtual machine service system disclosed in this patent supports multiple screens to display the same desktop at the same time, and also supports window interface for displaying a certain PC application on a specified screen according to user customization. Finally, the PC service receiver 105 and the wireless screen 108 can be either in a direct connection mode or a wireless connection point 107. In the case of a direct connection, the Wi-Fi Direct protocol is used between the PC service receiver 105 and the wireless screen 108. Both parties are not required to access additional networks. However, a wireless network card can only be connected to one screen at the same time. To connect multiple screens, multiple network cards are required. If the connection mode is transited through the wireless access point 107, the PC service receiver 105 and the wireless screen 108 are required to access the network. The network can be either a wireless local area network or a wireless ad hoc network.

Network switches 103 (house switches) and 104 (user switches) operate between the virtualized PC server 101 and the PC service receiver 105 to provide QoS guarantees for the network connections of the two. Since the virtualized PC server 101 simultaneously provides virtualized PC services to a plurality of PC service receivers 105, there is a network resource competition between the PC service receivers 105. In order to provide reliable and stable virtualized PC desktop services, it is necessary to provide QoS guarantees for 103 (the building switch) and 104 (the user switch).

The wireless access point 107 has two main purposes. When the PC service receiver 105 is connected to the multi-screen through the wireless access point 107, the PC service receiver 105 and the plurality of wireless screens 108 are connected to the wireless access point 107. Another function is when the mobile device, such as a mobile phone and a tablet computer, is used as the wireless control terminal 106 of the PC service receiver 105, if the PC service receiver 105 and the wireless control terminal 106 are blocked by obstacles or obstacles. It is not possible to communicate directly, and both need to be connected to the wireless access point 107, through which it accesses the local area network, thereby achieving mutual communication.

The wireless connection adapter is used to form the wireless screen 108 as an extended peripheral of the screen when no one of the plurality of screens has a built-in wireless network card and does not support installation of the application. The wireless adapter has a built-in wireless network card in which the deployed service program can receive the HD encoded stream sent by the PC service receiver 105. The wireless connection adapter is connected to the video input interface of the screen, and after receiving the high-definition encoded stream sent by the PC service receiver 105, it is decoded and displayed through the connected screen.

The wireless control terminal 106 is composed of the mobile terminal hardware and operating system software and special control software running thereon. Among them, the mobile terminal hardware can be various mobile phones and tablet computers popular in the market. The PC service receiver 105 is connected to the virtualized PC server 101 using a wired network, so the location is relatively fixed, and the signal of the wireless keyboard mouse is greatly affected by the distance. Therefore, the user in the system disclosed in the present invention passes the mobile wireless control terminal 106. The PC service receiver 105 is controlled to implement the human-computer interaction function with the PC service receiver 105. Specifically, the user can implement analog input of the mouse and keyboard through the simulation software on the wireless control terminal 106, and can also install the Bluetooth module and the transfer program on the wireless control terminal 106 to implement signal access of the external Bluetooth mouse and keyboard. Moreover, the function of the wireless control terminal 106 also includes controlling the program interface running in the virtual machine desktop system to be projected to the specified The wireless screen 108, and the connection/disconnection of the available wireless screen 108, as well as control of commonly used software, such as controlling the video player to play a specified video through the designated wireless screen 108, remotely controlling PPT playback, and the like.

The extended peripheral refers to optional human-computer interaction devices such as a mouse, a keyboard, a remote controller, a joystick, etc., such as the wireless mouse 109, the wireless keyboard 110, the wireless peripheral 111, and the like in FIG. The system supports wireless control terminal 106 (preferred) or PC service receiver 105 to wirelessly access these devices. Although these expansion devices are not necessary for the system, they have a good enhancement and supplement to the functions of the system.

It can be seen from FIG. 1 that compared with the current mainstream PC usage scheme, the system implemented and disclosed by the present invention mainly has the following features:

1. Separate the computing processing functions of the traditional PC. That is, the computational processing functions assumed by a fixed unit in the traditional PC usage mode are shared on a plurality of distributed devices. As can be seen from FIG. 1, these distributed devices include at least a virtualized PC server 101, a PC service receiver 105, and a wireless control terminal 106.

2. Separate the input and output functions of the traditional PC. That is, the input/output device connected by the fixed cable in the conventional PC usage mode becomes a plurality of distributed wireless connection devices that can dynamically schedule freely moveable.

The biggest benefit of the implementation of the above two points is the liberation of users. On the one hand, the operation and maintenance and technical issues are handed over to professionals (service providers), and users only need to use the services provided by professionals to complete their work. On the other hand, if the user wants to use the computer, instead of sitting at the computer desk and facing the display, the user can use all the convenient display screens and use the smart terminal such as a mobile phone to complete the control of the computer. Another advantage brought by the implementation of the present invention is that the demultiplexing between the device and the function can increase the reuse rate of the device, thereby reducing the user's use cost.

Figure 2 shows the logical structure of the system. The solid line in Figure 2 indicates the physical link connection between devices, and the dotted line indicates the logical relationship between devices. Figure 2 is described from the perspective of the user (from right to left) and from the perspective of system implementation (from left to right). First of all, for the user of the system, only concerned about how to input the target instruction and get the output response of the system. In the system disclosed by the present invention, the main input and output devices: the mouse 109, the keyboard 110, and the screen 108 all become wireless connections, even virtual devices, such as the mouse 109 and the keyboard 110 can wirelessly control the App on the terminal 106. achieve. In this way, each component can move independently and freely. It should be particularly noted that the system disclosed in the present invention is compatible with the traditional wired connection manner, but since the conventional wired connection method is not the first choice for system implementation, and is not a protection point of the technical solution, it is not particularly pointed out. Second, the PC service receiver 105 that connects the user and system functions is located in the middle of the system topology, and the PC service receiver 105 forwards the user's instructions to the virtualized PC server 101 while receiving the service output of the virtualized PC server 101. Since the PC service receiver 105 does not assume the user's computing and processing tasks, the PC service receiver 105 can be miniaturized while using the wireless control terminal 106 for basic control. In addition, if the security of the system is considered and the resource management and scheduling are facilitated, the authentication server may be deployed in front of the virtualized PC server 101. The user may first complete the authentication through the authentication server and then access the virtualized PC server 101 according to the assigned address. Finally, the virtual desktop service is provided by the virtualized PC server 101. From the perspective of system implementation, the virtual desktop service is first provided by the virtualized PC server 101, then transmitted to the PC service receiver 105 of the client, and the desktop of the virtual machine 102 or a specific PC application is assisted by the wireless control terminal 106. The window is wirelessly projected onto a screen 108 designated by the user.

The present invention implements the above points by the following methods:

1. Decoupling and distributed deployment of computational processing functions.

Firstly, by utilizing the powerful computing resources and processing capabilities of the virtualized PC server 101, multiple logical hardwares are virtualized on the physical hardware. Each logical hardware is independent of each other, and each logical hardware corresponds to one virtual machine 102 (VM). For virtual implementation of a custom computer system). The virtual machine 102 is logically complete, and a user-selected operating system can be installed thereon, and the remote PC service software is deployed in the operating system. Second, remote PC service receiving software is deployed on the PC service receiver 105. The PC service receiver accesses the virtual machine through the IP address and establishes a persistent connection with the remote PC service software in the virtual machine 102 to transmit remote PC service data over the network. After receiving the remote PC service data, the PC service receiver 105 sends it to the wireless screen 108 for display according to the user's customized requirements. Considering that the PC service receiver 105 and the virtual machine 102 are wired connections, the deployment location will be limited, and the present invention focuses on the mobilization and distributed deployment of the conventional PC device. Therefore, the PC service receiver 105 generally does not. Connect the external I/O device directly with a cable. In order to solve the human-computer interaction problem with the PC service receiver 105, this part of the processing task is handed over to the wireless control terminal 106. The wireless control terminal 106 can be either a mobile phone or a tablet, or other mobile operating system. The terminal device (Android/IOS/Windows Phone, etc.) can complete the control of the PC service receiver 105 by installing the application of the virtualized PC service provider. The control principle is that a control service is run on the PC service receiver 105 for managing virtual machine services, such as accessing/disconnecting PC services, projecting the PC service desktop to a user-specified wireless screen. 108, and projecting the designated PC application window interface to the designated wireless screen 108 and the like. The service listens for commands from the wireless control terminal 106 at the designated port, and the App on the wireless control terminal 106 implements remote control by establishing a network connection forwarding command with it.

2. Distributed output mode deployment.

For the output, the present invention provides two wireless screen projection modes, namely a multi-screen mirroring method and a multi-screen multi-application mode.

As shown in FIG. 3, it is assumed that the picture browsing, PowerPoint, microblog, and movie playing programs are run in the virtualized PC server 105. In the multi-screen mirroring mode, assuming that a full-screen photo viewing program is running in the virtualized PC server 105, the multi-screen mirroring function can project the viewing image interface onto different sizes of the wireless screen 108, and the display image seen by each screen. all the same. In the multi-screen multi-application mode, the multi-screen multi-application function can project the above different applications such as picture browsing, PowerPoint, microblog and movie playing interface onto different wireless screens, and the display images seen on each screen are specific. The interface of the application. It should be particularly noted that in FIG. 3, all display devices are used as the wireless screen 108, and the displayed interfaces are all window interfaces of a PC application running in the virtualized PC server 101. And it is uniformly received and encoded by the PC service receiver 105 and distributed to different devices for display.

3. Implementation of the screen wireless connection.

In the system disclosed by the present invention, the connection between the PC service receiver 105 and the wireless screen 108 is in two ways, namely a direct connection mode and a transit connection mode, and the two connection modes are as shown in FIG. 4 .

The direct connection mode 401 refers to direct peer-to-peer communication (Wi-Fi P2P) between the PC service receiver 105 and the wireless screen 108 using the Wi-Fi Direct protocol, and both devices do not need to connect to an additional network. This connection method is similar to the connection between Bluetooth communication and infrared communication in terms of implementation effect. The advantage of this connection is that it is simple, straightforward, requires no additional device support and has a small transmission delay. The disadvantage is that a wireless network card can only be connected to a wireless screen due to the point-to-point connection. At the same time, the peer-to-peer wireless transmission quality is also affected by the distance between devices, when the PC service receiver 105 and the wireless screen If the distance between 108 is too large, or there is an obstacle between them, the transmission quality will be affected. The transit connection mode 402 can avoid two disadvantages of the direct connection mode, because the relay connection mode 402 needs to be forwarded by the wireless access point 107, so the relative distance between the PC service receiver 105 and the wireless screen 108 does not affect. To the quality of the connection. Moreover, in the case of using the relay connection mode 402, the PC service receiver 105 can also simultaneously connect a plurality of wireless screens 108 without adding a wireless network card. A disadvantage of the transit connection mode 402 is that additional support for the wireless access point 107 is required compared to the direct connection mode 401. At the same time, because of the need for storage and forwarding again, there will be some extra delay.

4. Input implementation centered on the wireless control terminal.

Since the computational processing functions and output functions have been decoupled and distributed, it is no longer possible to require users to use the traditional direct connection wired keyboard and mouse input mechanism. In order to bring an experience consistent with the above output functions, a completely new input method is provided in the disclosed system. This input mode is accomplished by the cooperation of the wireless control terminal 106. Specifically, the wireless mouse 109 and wireless keyboard 110 commands are forwarded by the wireless control terminal 106. Meanwhile, the wireless mouse 109 and the wireless keyboard 110 herein may be either a physical device or a virtual device. The virtual device refers to virtualizing a keyboard and mouse application through the App in the wireless control terminal 106. The user controls the virtualized PC desktop by touching and clicking the screen of the wireless control terminal 106. If it is a physical keyboard mouse, it can be connected to the wireless control terminal 106 by wireless, and then the App in the wireless control terminal 106 forwards the keyboard and mouse commands through the network. The PC service receiver 105 receives mouse and keyboard commands from the wireless control terminal 106 and performs control locally or forwards the received instructions to the virtualized PC server 101 to effect remote control. The implementation mechanism is shown in Figure 5.

5 is a wireless screen 108 and a wireless control terminal 106, a PC service receiver 105, and a virtual machine 102, from right to left. Within the scope of the present invention, the wireless control terminal 106 receives control commands input from a mouse and keyboard. The control commands are mainly divided into two categories: a local control command 501 and a remote control command 502, such as a screen projection control. Control of virtual peripherals, etc., remote control commands 502 such as remote connection control, common software control, and the like.

The PC server receiver 105 runs the PC service receiving software 503 and the control command processing software 504. The PC service receiving software 503 is responsible for receiving the remote PC service. The control command processing software 504 is responsible for receiving and processing the control commands sent by the wireless control terminal 106. Local control command 501 is in this Execution, for remote control instructions 502, is directly passed to remote control service 506 in virtual machine 102.

The PC operating system is installed in the virtual machine 102. The remote PC 102 mainly runs a remote PC service 505 and a remote control service 506. The remote PC service 505 provides a data stream and transmits various responses of the PC to the PC service receiver 105; the remote control service 506 is responsible for receiving the service by the PC. The control command from the wireless control terminal 106 forwarded by the receiver 105 is converted into a corresponding system message, thereby completing remote control, such as remote connection control and common software control.

5. Implementation of wireless multi-screen display.

FIG. 4 illustrates a cooperative working mode between the PC service receiver 105 and the wireless screen 108. The specific implementation principle of the direct connection mode 401 is as shown in FIG. 6. Logically, the screen image and sound of the PC service receiver 105 are directly transmitted to the wireless screen/sound 108 for display/playback by encoding. Actually, the audio and video data is transmitted in the direction indicated by the solid arrow in Fig. 6. The screen image of the PC service receiver 105 is captured by the video capture module 601 and then first encoded by the video encoding module 603. The sound signal is captured by the audio capture module 602 and then encoded by the audio encoding module 604, and then subjected to channel multiplexing by the video and audio multiplexing module 605. And then, through the transport layer 611, the logical link control layer 612, the Wi-Fi link layer 613 and the Wi-Fi physical layer 614 transmit data to the receiving end, and the data received by the receiving end sequentially passes through the Wi-Fi physical layer. 614, the Wi-Fi link layer 613, the logical link control layer 612 and the transport layer 611 arrive at the video and audio demultiplexing module 610, and finally need to pass through the video decoding module 608 and the audio decoding module 609 to be displayed by the video display module 606. The audio play module 607 plays.

The data transmission process of the relay connection mode 402 is similar to the direct connection mode described in FIG. 6, except that the PC service receiver 105 and the wireless screen 108 are no longer in direct communication, but transit through a wireless access point 107. The process is shown in Figure 7. Logically, the audio and video of the PC service receiver 105 is still transmitted directly to the wireless screen 108 display and wireless speaker playback via the wireless network. However, in actual implementation, the wireless access point 107 needs to be forwarded. In order to reduce the computational overhead and implement fast forwarding, the wireless access point 107 does not perform decoding and the like, but only forwards the data received by itself to the receiving end.

6 and 7 show the implementation of the wireless display, and more specifically, the data transfer process after the PC service receiver 105 and the wireless screen/speaker 108 establish a connection. In the wireless display, a more detailed implementation also requires a wireless connection session management module running on the PC service receiver 105. As shown in FIG. 8, the module includes a user interaction unit 801, a device discovery unit 802, and a session control unit 803. And the connection establishing unit 804, through the assistance of these units, completes the connection establishment between the PC service receiver 105 and the wireless screen 108.

The user interaction unit 801 is configured to receive an instruction input by a user, such as opening/closing a device discovery unit, establishing a connection with a specified device, and the like. The function of the user interaction unit 801 is to convert the user's input into a specific function call of other units, and return the call execution result to the user. The device discovery unit 802 is configured to discover which devices in the current network environment are connectable with the current device. The device discovery unit 802 and the connection establishing unit 804 work together to complete the discovery and connection of the device. When the connection establishing unit 804 is working, it periodically sends a broadcast message to the network, indicating that it is in the service ready state and can receive the connection. After the device discovery unit 802 is enabled, the device discovery unit 802 can parse the message sent by the connection establishing unit 804 and display the connectable list to the user interaction unit 801. The user interaction unit 801 specifies to establish a connection session after establishing a connection with a certain device. In the life cycle of the connection session, the session control unit 803 is called by the user interaction unit 801 to complete the user's input parsing and output response. Since the device discovery and connection establishment belong to the control process and the application data is not transmitted, the wireless packet header information is directly used to complete the communication. During the session, application data such as a video stream needs to be transmitted, so the data needs to be further encapsulated into a transport layer and a data link control layer message.

For wireless multi-screen custom display of different PC application windows, in addition to the instructions already given, additional implementation details are required. First, the video capture module 601 no longer has only one working instance, but multiple capture instances simultaneously capture multiple different pictures and hand them to multiple coded instance codes. Secondly, when the network is transmitted, it is no longer that one screen is transmitted to multiple screens, but multiple screens are simultaneously transmitted to multiple screens. Different content of the transmission process can be realized corresponding to different device MAC and IP addresses. However, further explanation is needed for the capture process. Figure 9 shows a simplified typical flow of projecting specified content to a specified wireless screen.

This screen projection process starts from step 901. In step 902, the PC service receiver 105 receives the projection control command of the mobile control terminal 106, and then proceeds to step 903, where step 903 determines the content to be displayed, if it is a video or a picture, etc. If the multimedia file can be directly encoded, the process proceeds to step 904, otherwise, the process proceeds to step 905. In step 904, the image is encoded using video encoding module 603. In step 905, for the content to be displayed that cannot be directly encoded, such as the picture of the Office software and the picture of the browser, if directly captured and encoded under the same desktop, it will affect each other, so it needs to be different in the operating system. The application first creates multiple virtual views (or called Desktop View instances), and then In step 906, the application to be displayed is opened in a virtual view, and the desired application view image is captured in step 907, and then proceeds to step 904 where the image is encoded using video encoding module 603. In step 908, the encoded content is sent to the designated screen display through the local wireless network, thereby achieving independence of the application interface display, and step 909 represents the end of the display process. In this process, creating a virtual view can be done using the operating system desktop management API.

The previous sections of this document have been combined with the drawings to illustrate the components of the system, implementation ideas and specific functional implementation details. Combined with Figure 2, the integration and deployment of the system includes the following points:

1) Virtualization PC server 101 deploys virtualization infrastructure software. A plurality of virtual machines (VMs) 102 are created and maintained on the virtualized PC server 101.

2) The remote PC service and the remote control service are run in the virtual machine 102. Used to send virtualized PC desktop services and receive control commands and control PC applications according to instructions.

3) The PC service receiver 105 deploys PC service receiving software and control command processing software, which are respectively responsible for receiving the remote PC service, and receiving and processing the control commands sent by the wireless control terminal 106. Control instructions are divided into two categories, one is a locally executed control command, such as controlling the switching projection between screens and controlling peripherals. Another type of control is the remote PC service, which is directly passed to the remote control service in the virtual machine 102.

4) The wireless control terminal 106 runs the control App and sends various types of control commands to the PC service receiver 105. Optional control commands include: accessing/deactivating the remote PC service, projecting the specified window/application/file to the specified wireless screen 108, and simulating and transferring the mouse 109/keyboard 110 and other peripherals 111, for commonly used software Control and so on.

5) Deploy wireless connection session management software on the wireless screen 108 or an optional wireless connection adapter. Peer-to-peer wireless connection session management software is also deployed on the PC service receiver 105 and the wireless control terminal 106 that connect to the wireless screen 108.

6) Peripherals connected to the wireless control terminal 106, such as the mouse 109 and the keyboard 110, are connected to the wireless control terminal 106 via a Bluetooth module. The corresponding mouse and keyboard messages are sent by the control app running in the wireless control terminal 106 to the PC service receiver 105, which needs to be interacted with the remote PC server 101, and then forwarded by the PC service receiver 105 to the remote control in the virtual machine 102. service.

7) A peripheral device 111 connected to the PC service receiver 105, such as a Bluetooth speaker, directly establishes a connection with the PC service receiver 105 through the Bluetooth module, and the wireless control terminal 106 controls the establishment of the connection and releases And the connected transmission content.

After accessing the virtual machine service through a micro-receiving device, the technical solution of the present invention can use a high-definition television, a projector and a display as a wireless display device for virtualizing a PC service, thereby realizing device multiplexing, computing, and storage resource multiplexing. At the same time, you can use mobile phones, tablets, wireless keyboard and mouse and voice commands as input controls for virtualized PC services. The system is suitable for residential buildings, corporate offices, government and universities.

While the invention has been described with respect to the preferred embodiments of the present invention, it is understood that the invention These variations are obvious as long as the various changes are within the spirit and scope of the invention as defined and claimed in the appended claims.

Claims

A distributed wireless multi-screen virtual machine service system, comprising: a virtualized PC server, a PC service receiver, a plurality of wireless screens, a network switch, a wireless control terminal, and a wireless access point;

The virtualized PC server is configured to virtualize a set of physical hardware into multiple sets of logical hardware, and a complete operating system can be installed on each set of logical hardware;

The PC service receiver is configured to connect to the network switch by wire, perform wired communication with the virtualized PC server, receive the PC service provided by the virtualized PC server, and directly or wirelessly access the wireless access point (Access) Point, AP) transits to establish a connection with the wireless control terminal and multiple wireless screens, and cooperate with each other to realize human-computer interaction and transmit customized desktops;

The plurality of wireless screens are connected to the PC service receiver directly or wirelessly by the wireless access point, and are used to display the PC desktop of the PC service received by the PC service receiver according to the customized requirements of the user;

The network switch is disposed between the virtualized PC server and the PC service receiver to provide QoS guarantee for network connection between the virtualized PC server and the PC service receiver;

The wireless control terminal establishes a connection with the PC service receiver directly or wirelessly by the wireless access point to implement the human-computer interaction function of the PC service receiver;

The wireless access point is connected to the network switch by wire, provides a wireless communication connection for the PC service receiver and the plurality of wireless screens, and provides a wireless communication connection for the PC service receiver and the wireless control terminal.
The distributed wireless multi-screen virtual PC service system according to claim 1, wherein said wireless screen comprises an optional wireless connection adapter, said wireless adapter having a built-in wireless network card, and having no built-in wireless when any of the plurality of screens a network card, the service module deployed in the wireless adapter receives a high-definition encoded stream sent by the PC service receiver, and the wireless connection adapter is connected to a video input interface of a screen without a built-in wireless network card, when the wireless connection adapter After receiving the HD encoded stream sent by the PC service receiver, the HD encoded stream is decoded, and the decoded HD encoded stream is input to the screen display.
The distributed wireless multi-screen virtual PC service system according to claim 1 or 2, wherein the PC service receiver accesses the virtualized PC server by using an IP address, and the virtualized PC The remote PC service module in the server establishes a persistent connection, and transmits the remote PC service data provided by the virtualized PC server to the PC service receiver through the network. After receiving the desktop data of the remote PC service, the PC service receiver presses the user data according to the user's demand. Customized, and compressed and sent to multiple wireless screens, the wireless screen will decode the received data and display it.
The distributed wireless multi-screen virtual PC service system according to claim 3, wherein the connection method between the PC service receiver and the plurality of screens comprises: a direct connection mode and a transit connection mode;

The direct connection mode, that is, the point-to-point communication is directly performed between the PC service receiver and the screen by using the Wi-Fi Direct protocol;

The transit connection mode, that is, the PC service receiver and the screen are connected by a wireless access point.
The distributed wireless multi-screen virtual PC service system according to claim 4, wherein when the relay connection mode is used, the PC service receiver runs a screen connection service, and the screen accesses the network through the wireless access point. After that, the wireless screen automatically initiates a request to the screen connection service. After the screen connection service requests the authentication, the screen is registered as an optional wireless screen on the PC service receiver, and the user selects the required wireless screen through the wireless control terminal, and then the screen connection service will The encoded video stream is sent in real time to the user selected wireless screen display.
The distributed wireless multi-screen virtual PC service system according to claim 4 or 5, wherein the PC service receiver runs control command processing software for receiving and processing control commands from the wireless control terminal. The control commands are divided into two categories: one is a control instruction executed locally at the PC service receiver; and the other is a control instruction for the remote PC service, and the control command is converted into a corresponding system message to be virtualized. PC server.
The distributed wireless multi-screen virtual PC service system according to claim 6, wherein the virtualized PC server runs a PC service and a remote control service, and the PC service provides a data stream, and each of the PC services The response is sent to the PC service receiver; the remote control service is responsible for receiving control commands from the wireless control terminal forwarded by the PC service receiver, and completing remote connection control and common software control according to the received control commands.
The distributed wireless multi-screen virtual PC service system according to claim 4, wherein the wireless connection between the PC service receiver and the plurality of wireless screens is performed through the PC service receiver The session management module to specifically manage and coordinate the work. The wireless connection session management module includes: a user interaction unit, a session control unit, a device discovery unit, and a connection establishment unit;

The user interaction unit is configured to receive an instruction input by the user, and return the call execution result to the user;

The session control unit: implementing input analysis and output response of the user;

The device discovery unit is configured to discover a device that can establish a connection in a current network environment;

The connection establishing unit: periodically sends a broadcast message to the network, indicating that the service is ready to receive the connection;

After the device discovery unit is enabled, the device discovery unit parses out the broadcast message sent by the connection establishment unit, and displays the connectable wireless screen list to the user interaction unit, and the user interaction unit specifies to establish a connection session after establishing a connection with a certain wireless screen. In the life cycle of the connection session, the user interaction unit invokes the session control unit to complete the user's input parsing and output response.