WO2014029091A1 - Procédé de transmission d'image de fenêtre, procédé d'affichage, terminal, serveur et système - Google Patents

Procédé de transmission d'image de fenêtre, procédé d'affichage, terminal, serveur et système Download PDF

Info

Publication number
WO2014029091A1
WO2014029091A1 PCT/CN2012/080475 CN2012080475W WO2014029091A1 WO 2014029091 A1 WO2014029091 A1 WO 2014029091A1 CN 2012080475 W CN2012080475 W CN 2012080475W WO 2014029091 A1 WO2014029091 A1 WO 2014029091A1
Authority
WO
WIPO (PCT)
Prior art keywords
window
area
display
coordinate
height
Prior art date
Application number
PCT/CN2012/080475
Other languages
English (en)
Chinese (zh)
Inventor
秦晋
狄龙
谢军安
张楚雄
张毅
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2012/080475 priority Critical patent/WO2014029091A1/fr
Priority to CN201280001095.8A priority patent/CN103959246B/zh
Publication of WO2014029091A1 publication Critical patent/WO2014029091A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G06F2009/45595—Network integration; Enabling network access in virtual machine instances

Definitions

  • the embodiments of the present invention relate to the field of communications technologies, and in particular, to a window image transmission method, a display method, a terminal, a server, and a system. Background of the invention
  • the terminal and the server generally interact with each other as follows:
  • the terminal uploads a request for running the application generated by the user operation to the server, and the server calculates and processes the request after the application is run, and obtains the window image and sound of the application running.
  • the data is sent to the terminal, so that the terminal decodes and displays the window image.
  • one server runs multiple virtual machines at the same time, and each virtual machine runs a different application.
  • the server selects a specific virtual machine to run the application requested by the terminal, and then the virtual machine sends the window image of the application running to the terminal in real time.
  • data for multiple applications is displayed on the same terminal's desktop.
  • each application corresponds to a virtual machine, that is, the terminal establishes a connection with multiple virtual machines to obtain images, sounds, and the like that are running on different virtual machines. Therefore, the terminal needs to receive the transmitted data of each virtual machine and decode it on the desktop of the terminal.
  • the terminal displays data of multiple applications
  • the user may only focus on the window image displayed by one or several applications at the forefront of the desktop.
  • the virtual machine sends a window image of multiple application runs to the terminal, it will consume a lot of network bandwidth.
  • the terminal needs to decode the window image of multiple application operations, which increases the processing load of the terminal.
  • An object of the embodiments of the present invention is to provide a method, a display method, a terminal, a server, and a system for transmitting a window image, and displaying a window when a plurality of windows are occluded.
  • a first aspect of the present invention provides a method for transmitting a window image, including: in a process of running an application, a receiving terminal sends window information of a window corresponding to the application, and determining a display area of the window according to the window information. And sending, according to the display area of the window, image data corresponding to the display area information of the window to the terminal, so that the terminal performs display.
  • a second aspect of the present invention provides a server, including: a receiving unit, configured to: when a virtual machine runs an application, receive, by the terminal, window information of a window corresponding to the application;
  • Determining a unit determining, according to the window information, display area information of the window
  • the transmission unit transmits, by the display area information of the window, image data corresponding to the display area information of the window to the terminal, so that the terminal performs display.
  • a third aspect of the present invention provides a method for displaying a window, including: in a process of running an application, sending, by a virtual machine, window information of a window corresponding to the application to a server, so that the virtual machine on the server is according to the window Information, determining display area information of the window; receiving image data corresponding to the display area information of the window sent by the server and displaying the image data.
  • a fourth aspect of the present invention provides a terminal, including: a sending unit, configured to send, by a virtual machine, window information of a window corresponding to the application to a server, in a process of running an application, so that the virtual machine on the server is configured according to the virtual machine The window information, determining display area information of the window;
  • the receiving unit receives and displays the image data corresponding to the display area information of the window sent by the server.
  • a third aspect of the present invention provides a window display system including the above server and the above terminal.
  • the window image transmission method, the display method, the terminal, the server, and the system according to the embodiment of the present invention send image data corresponding to the display area information of the window according to the display area information of the window displayed by the terminal, when the window display area is smaller than the entire window In the area, it is not necessary to send the image data corresponding to the entire window area, thereby reducing the network load and improving the terminal operating efficiency.
  • FIG. 1 is a schematic flow chart of a method for transmitting a window image according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram 1 of a window in a method for transmitting a window image according to an embodiment of the present invention.
  • FIG. 3 is a second schematic diagram of a window in a method for transmitting a window image according to an embodiment of the present invention.
  • FIG. 4 is a third schematic diagram of a window in a method for transmitting a window image according to an embodiment of the present invention.
  • FIG. 5 is a window intent 4 of a method for transmitting a window image according to an embodiment of the present invention.
  • FIG. 6 is a first schematic structural diagram of a server according to an embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram 2 of a server according to an embodiment of the present invention.
  • FIG. 8 is a schematic flowchart 1 of a method for displaying a window according to an embodiment of the present invention.
  • FIG. 9 is a schematic flowchart 1 of a method for displaying a window according to an embodiment of the present invention.
  • FIG. 10 is a first schematic structural diagram of a terminal according to an embodiment of the present invention.
  • FIG. 11 is a second schematic structural diagram of a terminal according to an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of a display system of a window according to an embodiment of the present invention. Mode for carrying out the invention
  • an embodiment of the present invention provides a method for transmitting a window image, including:
  • Step 11 In the process of running the application, the receiving terminal sends the window information of the window corresponding to the application.
  • Step 12 Determine display area information of the window according to the window information
  • Step 13 Send image data corresponding to the display area information of the window to the terminal according to the display area information of the window, so that the terminal performs display.
  • the execution body of the window image transmission method in the embodiment of the present invention may be a server-side virtual machine.
  • the terminal sends a request for running the application carrying the application identifier to the server, and the server selects the application that the virtual machine runs the terminal request according to the identifier, and the virtual machine and the terminal establish the transmission application operation data and the receiving terminal sends the information. connection. Therefore, the terminal sends the window information of the application in the terminal display window or the user's operation for the application to the virtual machine running the application through the connection.
  • the window is the window displayed by the application running on the terminal.
  • the method for transmitting a window image sends image data corresponding to the display area information of the window according to the display area information of the window displayed by the terminal.
  • the window display area is smaller than the entire window area, the entire image does not need to be sent.
  • the image data corresponding to the window area thereby achieving the effect of reducing the network load.
  • the window information sent by the terminal includes: a window display state, a coordinate of any corner point of the cover area of the window, and a width and a height of the cover area.
  • the coordinates include an X coordinate and a Y coordinate
  • the coordinate may adopt a coordinate of a screen coordinate system or a coordinate of a window coordinate system
  • the screen coordinate system refers to a point of the upper left corner of the display screen as a coordinate origin (0, 0)
  • a horizontal direction is an X axis.
  • the vertical direction is the Y axis
  • the window coordinate system refers to the coordinate point origin (0, 0) of the upper left corner of the window, the X axis for the horizontal direction, and the Y axis for the vertical direction; the cover area of the window may be one or more.
  • the window information may further include: a number of cloaking windows.
  • the message type of the terminal sending window information is Updata_Window_infrom, and the message format can be as shown in Table 1 below, so that the virtual machine parses the message to obtain the window information sent by the terminal - Table 1
  • the parameters of the number of cover windows, X coordinate, Y coordinate, width and height are empty.
  • the width refers to the length of the region on the X axis
  • the height is the length of the region on the Y axis.
  • the X coordinate and the Y coordinate may be the coordinates of any corner point of the first cover area, and Table 1 takes the value of the point of the upper left corner, and may also take the coordinates of other corner points.
  • the embodiments of the present invention are not limited herein. The corresponding parameters in other tables refer to the description of this paragraph.
  • the corner of the covering area may be the upper left corner point, the upper right corner point, the lower left corner point or the lower right corner point of the covering area.
  • the upper left corner is preferred.
  • the window information sent by the terminal includes: a window display state, a coordinate of any corner point of the window, a width and a height of the window, and a coordinate of the z-axis sequence larger than the corner of the window and covering the window. And the Z-axis order is larger than the window And cover the window width and height of the window.
  • the coordinates include an X coordinate and a Y coordinate, and the coordinate may adopt a coordinate of a screen coordinate system or a coordinate of a window coordinate system; a window whose z-axis sequence is larger than the window and covers the window may be one or more.
  • the window information may further include: a number of cloaking windows.
  • the message type of the terminal to send the window information is Updata_Window_infrom, and the message format can be as shown in Table 2 below, so that the virtual machine parses the message to obtain the window information sent by the terminal:
  • the width and height of the window larger than the window and covering the window can determine the X coordinate, the Y coordinate, the width and the height of the cover area of any corner of the cover area of the window as shown in Table 1.
  • the corner point can be the upper left corner point, the upper right corner point, the lower left corner point, or the lower right corner point.
  • the upper left corner is preferred.
  • Z-axis sequence Z-axis sequence: When using the operating system, multiple windows are opened, resulting in a heap of overlapping windows. To indicate the position of these stacked windows, each window is labeled using the z-axis sequence, and each window has a unique position in the z-axis sequence. This window stack is along a virtual axis - the "z-axis", extending vertically from the screen. The window at the top of the z-axis sequence covers other windows in the Z-axis sequence. The window at the bottom of the Z-axis sequence is covered by other windows in the Z-axis sequence.
  • the Windows system puts the window just created on top of the Z-axis sequence, and the user can change the Z-axis sequence by activating another window; the Windows system always places the active window on top of the Z-axis sequence, the application can use functions.
  • a single linked list of the system maintains the Z-axis sequence.
  • the user changes the Z-axis sequence during the activation of different windows. For example, by using the GetNextWindow() parameter, you can get the handle of the previous or next window in the Z-axis sequence.
  • the operating system of the terminal can obtain the Z-axis order and window coordinate information of each window, including the coordinates of the top left corner and the width and height of each window.
  • the window information sent by the terminal includes: coordinates of any corner point of the window, width and height of the window, a Z-axis order is greater than coordinates of any corner of the window of the window, and a Z-axis sequence is larger than the window.
  • the coordinate includes the X coordinate and the Y coordinate, and the coordinate may adopt the coordinate of the screen coordinate system or the coordinate of the window coordinate system; the window whose Z axis sequence is larger than the window may be more than one.
  • the window information may further include: a number of cloaking windows.
  • the message type of the terminal sending window information is Updata_Window_infrom, and the message format can be as shown in Table 3 below, so that the virtual machine parses the message to obtain the window information sent by the terminal:
  • Message type string Indicates the message type, set to window display status update message
  • the first z-axis is greater than the X coordinate of any corner of the window of the window
  • the first z-axis order is greater than the Y coordinate of any corner of the window of the window.
  • width int The first z-axis order is greater than the width of the window of the window.
  • Height int The first z-axis order is greater than the width of the window's window int second, third...
  • the z-axis order is greater than the window's (X, Y, width, Height) in Table 3, through the window
  • the X coordinate of the corner point, the Y coordinate, the width and height of the window, and the X coordinate, the Y coordinate, and the z axis sequence of any corner of the window whose z-axis order is larger than the window are larger than the width and height of the window of the window, and can be determined.
  • the X coordinate, the Y coordinate, and the z-axis sequence of any corner point of the window as shown in Table 2 that is larger than the window and covering the window are larger than the window and the width and height of the window covering the window, thereby further determining The X coordinate, the Y coordinate, the width and height of the cover area of any corner point of the cover area of the window shown in Table 1.
  • the corner point can be the upper left corner point, the upper right corner point, the lower left corner point, or the lower right corner point.
  • the upper left corner is preferred.
  • the terminal can send window information in the above three types of message formats, and the terminal and the virtual machine can negotiate in advance which format to use to send window information, so that the virtual machine can parse out the window information.
  • the size of the window is in units of pixels.
  • the window width is 640 and the height is 480
  • the width of the window is 640 pixels and the height is 480 pixels.
  • the two windows of the corresponding application may also be different. This difference can be divided into three categories:
  • the window size is different: If the server's window size is 640*480, the size of the terminal's window is dragged by the user to 480*320.
  • the position of the window is different: For example, the coordinates of the upper left corner of the window of the server are (50, 50), but the coordinates of the upper left corner of the window of the terminal are (40, 70).
  • the terminal window size and the window size of the virtual machine can be obtained through the API (Application Programming Interface) provided by the operating system, and will not be described here.
  • API Application Programming Interface
  • the coordinates of the terminal and the sitting needs of the virtual machine can be converted to each other:
  • the window size of the virtual machine is X1*Y1
  • the size of the terminal window is ⁇ 2* ⁇ 2
  • the coordinates of the upper left corner of the terminal window are (xl, yl)
  • the virtual machine The coordinates of the upper left corner of the window are (x2, y2).
  • the window width is 480
  • the height is 320
  • the coordinates of the upper left corner of the window of the virtual machine are (50, 60)
  • the width of the window is 800
  • the height is 600.
  • the coordinate transformation can be performed on the virtual machine side or at the terminal. If the coordinate transformation is performed at the terminal, the terminal sends a window position request message to the virtual machine to obtain a virtual Machine window size and location information. If the coordinate transformation is performed on the virtual machine side, the window size and location information of the terminal may be included in the message (such as Table 1 - Table 3 format), or the terminal sends a separate window notification message carrying the window size and location information of the terminal to the virtual Machine, in order to facilitate the coordinate conversion of the virtual machine, not to repeat here.
  • the window information of the window sent by the terminal may be represented by a coordinate of a screen coordinate system (the screen coordinate system refers to a coordinate of the upper left corner of the display screen as a coordinate origin (0, 0)), or It is represented by the coordinates of the window coordinate system (the window coordinate system refers to the point in the upper left corner of the window as the coordinate origin (0, 0)).
  • the window information in the format of the table 1 can be represented by the coordinates in the window coordinate system. Since the virtual machine does not need to calculate the cover area according to the window information, the virtual machine can quickly obtain the cover area according to the coordinates in the window coordinate system.
  • the window information in the format of Table 2 and Table 3 can be represented by the coordinates in the screen coordinate system.
  • the terminal when the terminal establishes a window, or the Z-axis sequence of the window changes, or the coordinates of any corner of the window change, or the width or height of the window changes, the terminal
  • the window information of the window needs to be updated to the corresponding virtual machine, so that the corresponding virtual machine receives the window information of the updated window sent by the terminal.
  • step 12 determining the display area information of the window according to the window information of the window, including: mode 1, when the window information is in the format of the table 1:
  • the display area of the window is determined to be 0.
  • the display area of the window is determined to be the entire window except the cover area.
  • the area when there are a plurality of cover areas, determine a joint cover area composed of a plurality of cover areas, thereby determining a display area of the window as a field outside the joint cover area of the entire window.
  • the coordinates of the upper left corner of the window A are (50, 50), and the width is 150, the height is 100; the upper left corner of the window ( (X, ⁇ ) coordinates are (70, 80), the width is 60, the height is 120; the upper left corner of the window C ( ⁇ , ⁇ ) coordinates are (100, 110), width is 140, height is 100; as the upper left corner of window D ( ⁇ , ⁇ ) coordinates are (210, 160), width is 20, and height is 20.
  • the window display state of the window A is partially covered, and the (X, Y) coordinate of the upper left corner of the first cover field of the window A is (70, 80), the first cover The area is 60 wide and 70 high.
  • the second cover area of the window ⁇
  • the (X,Y) coordinate of the upper left corner is (100, 110), the second cover area is 100 wide, and the height is 40.
  • a joint covering area composed of the first covering area and the second covering area is determined, wherein the coordinates are (100, 110), the width is 30, and the height is 40 area is an overlapping area.
  • the display area of the window ⁇ is determined as the area of the entire window A except the joint cover area.
  • the window display state of the window B is partially covered, and the ( ⁇ , ⁇ ) coordinate of the upper left corner of the cover area of the window B is (100, 110), and the cover area width is 30, the height is 40, thereby determining the display area of the window ⁇ to remove the area outside the occlusion area for the entire window.
  • window C the window display state of window C is full display, and the display area of the window is determined to be the entire window C.
  • window D the window display state of the window D is completely covered, and the display area of the window is determined to be 0.
  • the window display state in the window information is completely covered, it is determined that the display area of the window is 0.
  • the window display state in the window information is partially covered, according to the X coordinate, the ⁇ coordinate, the width and the height of any corner of the window in the window information, and any corner of the window whose axis sequence is larger than the window and covers the window.
  • the X coordinate, ⁇ coordinate, width and height of the point determine the X coordinate, ⁇ coordinate, width and height of the occlusion area of any corner of the occlusion field;
  • the display area of the window is an area other than the occlusion area of the entire window, and when the occlusion area is plural, determining a plurality of occlusion areas The joint cover area, thereby determining the display area of the window as the area of the entire window except the joint cover area.
  • the coordinates (X, Y) of the upper left corner of the window ⁇ are (50, 50), The width is 150 and the height is 100; the upper left corner of the window ⁇ ( ⁇ , ⁇ ) has coordinates (70, 80), width 60, and height 120; window C's upper left corner (X, ⁇ ) coordinates are (100) , 110), width is 140, height is 100; as in the upper left corner of window D ( ⁇ , ⁇ ) coordinates are (210, 160), width is 20, height is 20.
  • the window display state of the window A is partially covered, and the coordinates of the ( ⁇ , ⁇ ) point according to the upper left corner of the window A are (50, 50), and the width is 150, high.
  • the (X,Y) coordinates of the upper left corner of the window ⁇ that is larger than the window ⁇ and cover the window ⁇ are (70, 80)
  • the width is 60
  • the height is 120
  • the ⁇ axis order is larger than the window ⁇
  • the (X,Y) coordinates of the upper left corner of the window C of the cover window are (100, 110)
  • the width is 140
  • the height is 100.
  • the ( ⁇ , ⁇ ) coordinates of the upper left corner of the first cover area of the window ⁇ are determined. For (70, 80), the first cover area is 60 wide and 70 high.
  • the ( ⁇ , ⁇ ) coordinates of the upper left corner of the second occlusion area of the window are (100, 110), and the second cover area is 100 wide and 40 high.
  • the display area of the window ⁇ is determined to be the area of the entire window A except the joint occlusion field.
  • the window display state of the window B is partially covered.
  • the coordinates (X, Y) are (70, 80), the width is 60, and the height is 120, and the ( ⁇ , ⁇ ) coordinate of the upper left corner of the window C whose axis sequence is larger than the window ⁇ and covers the window ⁇ is (100, 110), the width is 140, and the height is 100, and the upper left corner of the cover area of the window ⁇ is determined.
  • the coordinates of the point ( ⁇ , ⁇ ) are (100, 110), the width of the occlusion area is 30, and the height is 40, so that the display area of the window ⁇ is determined to be the area outside the occlusion area of the entire window.
  • window C the window display state of window C is full display, and the display area of the window is determined to be the entire window C.
  • window D the window display state of the window D is completely covered, and the display area of the window is determined to be 0.
  • the z-axis order is larger than the Whether the window of the window covers the window, if the window whose z-axis order is larger than the window does not cover the window, the window display state of the window is full display, and the display area of the window is determined to be the entire window;
  • the X coordinate, Y coordinate, the width and the height of any corner of the window in the window information, and the window whose z-axis order is larger than the window and covers the window The X coordinate, Y coordinate, width and height of a corner point, determine the X coordinate, Y coordinate, width and height of the cover area of any corner point of the cover area; According to the X coordinate, the Y coordinate, the width and the height of the corner of the cover area, it is determined whether the cover area completely covers the window. When there are multiple cover areas, it is determined whether the joint cover area composed of the plurality of cover areas is completely covered.
  • the window if the occlusion area or the joint occlusion area completely covers the window, the window display state of the window is full occlusion, thereby determining that the display field of the window is 0, and if the occlusion area or the joint occlusion area does not completely cover the window,
  • the window display state of the window is partially covered, and the display area of the window is determined to be an area of the entire window except the cover area, or the display area of the window is determined to be an area of the entire window except the joint cover area.
  • the coordinates (X, Y) of the upper left corner of the window A are (50, 50), and the width is wide.
  • the height is 100; the upper left corner of the window ( (X, ⁇ ) coordinates are (70, 80), the width is 60, the height is 120; the upper left corner of the window C ( ⁇ , ⁇ ) coordinates are (100, 110), width is 140, height is 100; as in the upper left corner of window D ( ⁇ , ⁇ ) coordinates are (210, 160), width is 20, height is 20.
  • the (X, Y) coordinate of the upper left corner of window A is (50, 50), the width is 150, the height is 100, and the axis sequence is greater than
  • the ( ⁇ , ⁇ ) coordinates of the upper left corner of the window ⁇ window are (70, 80), the width is 60, and the height is 120.
  • the coordinates of the upper left corner of the window ⁇ are determined to be within the window area of the window ⁇ .
  • the coordinates (50, 50), the width 150, and the height of 100 degrees are calculated (X, Y) of the upper right corner of the window ⁇ is (200, 50), and Calculate the coordinates of the lower left corner point (50, 150), determine that the X-axis coordinate 70 of the upper left corner of the window ⁇ is greater than the X-axis coordinate 50 of the upper left corner of the window ,, less than the X-axis coordinate 200 of the upper right corner of the window A, and It is determined that the Y-axis coordinate 80 of the upper left corner of the window B is smaller than the Y-axis coordinate 150 of the lower left corner of the window A, and is greater than the Y-axis coordinate 50 of the upper left corner of the window A, thereby determining that the upper left corner of the window B is located in the window A. Within the window area. Further, the z-axis order of the window B is determined to be larger than the window A and the
  • the (X, Y) coordinates of the upper left corner of the window A are (50, 50), the width is 150, the height is 100, and the top left corner of the window C whose axis sequence is larger than the window ⁇ is
  • the ( ⁇ , ⁇ ) coordinates are (100, 110), the width is 140, and the height is 100. It is determined that the coordinates of the upper left corner of the window C are located in the window area of the window ⁇ .
  • the coordinates (50, 50), the width 150, and the height of 100 degrees are calculated (X, Y) of the upper right corner of the window ⁇ (200, 50), and Calculating the coordinates of the lower left corner point (50, 150), determining that the X-axis coordinate 100 of the upper left corner of the window C is greater than the X-axis coordinate 50 of the upper left corner of the window ,, less than the X-axis coordinate 200 of the upper right corner of the window A, and It is determined that the Y-axis coordinate 110 of the upper left corner of the window C is smaller than the Y-axis coordinate 150 of the lower left corner of the window A, and is greater than the Y-axis coordinate 50 of the upper left corner of the window A, thereby determining that the upper left corner of the window C is located in the window A. Within the window area. Further, the z-axis order of the window C is larger than the window A and the window A is covered
  • the (X, Y) coordinates of the upper left corner of window A are (50, 50), and the window!
  • the coordinates of the upper left corner ( ⁇ , ⁇ ) are (210, 160), the width is 20, and the height is 20.
  • the coordinates of the upper right corner of the calculation window ⁇ ( ⁇ , ⁇ ) are (200, 50), and the lower left corner is calculated.
  • Point coordinates (50, 150) determining that the X-axis coordinate 210 of the upper left corner of the window D is greater than the X-axis coordinate 200 of the upper right corner of the window ,, and the Y-axis coordinate 160 of the upper left corner of the window D is greater than the upper right corner of the window A
  • the Y-axis coordinate of the point is 150, thereby determining that the upper left corner of the window D is outside the window area of the window A. Further determining that window D does not obscure window A.
  • the X-axis coordinate of the upper left corner of the window B is larger than the X-axis coordinate of the upper right corner of the window A, or the Y-axis coordinate of the upper left corner of the window B is larger than the Y-axis coordinate of the lower left corner of the window A, that is, The upper left corner of window B is not located in the window area of window A, then it is determined that window A is not covered by window B; it is assumed that the X-axis coordinate of the upper left corner of window C is larger than the window.
  • the X-axis coordinate of the upper right corner of A, or the Y-axis coordinate of the upper left corner of window C is greater than the Y-axis coordinate of the lower left corner of window A, that is, the upper left corner of window C is not located in the window area of window A, then It is determined that the window A is not covered by the window C; therefore, it is determined that the window A is not covered by the window B, the window (;, the window D, and the window display state of the window A is the full display, and the display area of the window A is determined to be the entire window.
  • the covered area i.e., the first covered area in which the window A is covered by the window B is obtained.
  • the coordinates (X, Y) of the upper right corner of the window A are (200, 50) and the coordinates of the lower left corner (50, 150), and
  • the coordinates (X, Y) of the upper right corner of the window B are calculated as (130, 80) and the coordinates of the lower left corner (70, 200), and the window B is determined.
  • the upper right corner point is located in the area of the window A, and the lower left corner point of the window B is outside the area of the window A, then the width of the first covering area is determined to be the width 60 of the window B, and the height of the first covering area is the window A
  • the Y-axis coordinate 150 of the lower left corner point minus the Y-axis coordinate 80 of the upper left corner of the window B is 70. Therefore, the ( ⁇ , ⁇ ) coordinate of the upper left corner of the first cover area of the window A is (70, 80), and the first cover area is 60 wide and 70 high.
  • the coordinates of the upper right corner of the window ⁇ are located outside the area of the window , that is, the X-axis coordinate of the upper right corner of the window B is greater than the X-axis coordinate of the window A, and the width of the first covering area is the window A.
  • the X-axis coordinate of the upper right corner point is subtracted from the coordinates of the upper left corner of the window B.
  • the height of the first covered area is the height of the window B.
  • the masked area (i.e., the second covered area) in which the window A is covered by the window C is obtained according to the width 140 of the window C and the height 100, and the coordinates of the upper left corner of the window A and the width and height of the window A.
  • the coordinates (X, Y) of the upper right corner of the window A are (200, 50) and the coordinates of the lower left corner (50, 150), and
  • the coordinates ( ⁇ , ⁇ ) of the upper right corner of the window C are calculated as (240, 100) and the coordinates of the lower left corner (100, 210), and the window C is determined.
  • the upper right corner point is outside the area of the window ⁇ and the lower left corner of the window C is outside the area of the window D, then the width of the second covered area is determined as the X-axis coordinate of the upper right corner of the window A 200 minus the window
  • the X-axis coordinate 100 of the upper left corner of C is 100
  • the height of the second masking area is the Y-axis coordinate 150 of the lower left corner of the window A minus the Y-axis coordinate 110 of the upper left corner of the window C is 40. Therefore, the (X,Y) coordinate of the upper left corner of the second cover area of the window A is (100, 110), and the second cover area is 100 wide and 40 high.
  • the width of the second covered area is the width of the window C.
  • the height of the second covered area is the height of the window C.
  • the joint cover area does not completely cover the window A, and the display of the window A is determined.
  • the area is the entire area of the window A except the joint mask area.
  • the joint cover area is less than or equal to the X-axis coordinate of the upper left corner of the window A
  • the Y-axis coordinate of the upper left corner of the joint cover area is less than or equal to the Y-axis coordinate of the upper left corner of the window A
  • the joint cover If the width of the area is greater than or equal to the width of the window A, and the height of the joint cover area is greater than or equal to the height of the window A, it is determined that the joint cover area completely covers the window A, and the display area of the window A is determined to be 0.
  • the coordinates of the upper left corner ( ⁇ , ⁇ ) according to the window ⁇ are (70, 80), the width is 60, the height is 120, and the window whose axis sequence is larger than the window ⁇
  • the ( ⁇ , ⁇ ) coordinates of the upper left corner of C are (100, 110), the width is 140, and the height is 100.
  • the coordinates of the upper left corner of the fixed window C are located in the window area of the window B.
  • the coordinates are (70, 80), the width is 60, and the height is 120.
  • the coordinates of the upper right corner of the calculation window ⁇ ( ⁇ , ⁇ ) are (130, 80).
  • the width is 60
  • the height is 120
  • the upper left corner of the window D (X, ⁇ ) coordinates are (210, 160)
  • the width is 20
  • the height is 20
  • the coordinates of the upper right corner of the calculation window ⁇ ( ⁇ , ⁇ ) are (130, 80)
  • the coordinates of the lower left corner point (70, 200) are calculated
  • the X-axis coordinate 210 of the upper left corner of the window D is determined. It is greater than the X-axis coordinate 130 of the upper right corner of the window ,, thereby determining that the upper left corner of the window D is outside the window area of the window ⁇ . Further confirmation window D does not cover the window ⁇ .
  • the X-axis coordinate of the upper left corner of the window C is larger than the X-axis coordinate of the upper right corner of the window ,, or the ⁇ -axis coordinate of the lower left corner of the window of the upper left corner of the window C, that is, the window
  • the upper left corner of C is not located in the window area of the window , then it is determined that the window ⁇ is not covered by the window (:, window D, the window ⁇ window display state is full display, and the window ⁇ display area is determined to be the entire window.
  • the window ⁇ is covered by the window C according to the width 140 and the height 100 of the window C, and the coordinates of the upper left corner of the window ⁇ and the width and height of the window ⁇ .
  • the coordinates ( ⁇ , ⁇ ) of the upper right corner of the window ⁇ are (130, 80) and the coordinates of the lower left corner (70, 200), and
  • the coordinates (X, ⁇ ) of the upper right corner of the window C are calculated as (240, 100) and the coordinates of the lower left corner (100, 110), and the window C is determined.
  • the upper right corner point is outside the area of the window
  • the lower left corner of the window C is outside the area of the window
  • the width of the occlusion area is determined as the X-axis coordinate 130 of the upper right corner of the window ⁇ minus the upper left corner of the window C
  • the X-axis coordinate 100 is 30, and the height of the cover area is the ⁇ axis coordinate 200 of the window ⁇ lower left corner point minus the ⁇ axis coordinate 110 of the upper left corner of the window C is 90. Therefore, the ( ⁇ , ⁇ ) coordinates of the upper left corner of the window ⁇ cover area are (100, 110), the cover area is 30 wide, and the height is 90.
  • the width of the occlusion area is the width of the window C.
  • the height of the cover area is the height of the window C.
  • the display area of the window ⁇ is determined to be the entire area of the window except the cover area.
  • the X-axis coordinate of the upper left corner of the cover area is smaller than the X-axis coordinate of the upper left corner of the window, and the coordinate of the upper left corner of the cover area is less than or equal to the pivot coordinate of the upper left corner of the window, and the width of the cover area is large.
  • the height of the occlusion area is greater than or equal to the height of the window ⁇ , then it is determined that the occlusion area completely covers the window ⁇ , and the display area of the window ⁇ is determined to be 0.
  • window C the Z-axis order of window C> the Z-axis order of window D> the Z-axis order of window B> the Z-axis order of window A
  • the window information of window C has no window of z-order in window C
  • the coordinates (X, Y) of the upper left corner of the window D are (210, 160), The width is 20 and the height is 20.
  • the coordinates (X, Y) of the upper right corner of the calculation window D are (230, 160), and the coordinates of the lower left corner of the calculation window D (210, 180) are larger than the window D according to the z-axis order.
  • the (X,Y) coordinates of the upper left corner of window C are (100, 110), the width is 140, and the height is 100.
  • the coordinates of the upper right corner of the calculation window C ( ⁇ , ⁇ ) are (240, 100), and Calculate the coordinates of the lower left corner of the window C (100, 210), and determine that the X-axis coordinate 210 of the upper left corner of the window D is greater than the X-axis coordinate 100 of the upper left corner of the window C, and is smaller than the X-axis coordinate of the upper right corner of the window C.
  • 240 and determining that the pivot coordinate 160 of the upper left corner of the window D is smaller than the pivot coordinate 210 of the lower left corner of the window C, is greater than the pivot coordinate 110 of the upper left corner of the window C, thereby determining that the window C covers the window D.
  • the coordinates of the upper right corner of D ( ⁇ , ⁇ ) is (210, 160), the coordinates of the lower left corner of window D (210, 180), and the coordinates of the upper right corner of window C ( ⁇ , ⁇ ) are (240, 100).
  • the coordinates of the lower left corner of the window C (100, 210) are determined to be (210, 160), and the coordinates of the upper right corner of the window D are located at the window C.
  • the width of the cover area is the width 20 of the window D
  • the lower left corner of the window C is located in the area of the window C
  • the height of the cover area is the height 20 of the window D.
  • the width of the cover area is the width 20 of the window D
  • the height of the cover area is the height 20 of the window D
  • the step of: 3 according to the display area information of the window, the image data corresponding to the display area information of the window is sent to the terminal, so that the terminal performs the display, including:
  • the image data of the entire window is acquired and sent to the terminal for display by the terminal.
  • the display area of the window is an area other than the cover area of the entire window
  • image data of the entire window is acquired, and the cover area is filled with a solid color or a colorless, and the filled image data is sent to the terminal, and the terminal displays.
  • the image data of the entire window is the image data of the application running corresponding to the window; the solid color is black or white.
  • the encoded data size of the image is complicated (the color type is large, the color distribution is uneven) is larger than the image is simple (the color type is single, the color distribution is uniform), so the image coding of the solid color is The amount of data is minimal.
  • the video stream that is, encoding a plurality of consecutive images
  • the encoding of the two images before and after only need to encode the changed portion of the second image, so the image to be covered is filled with a solid color and encoded, because the image is not It will change, and no coding will be used to reduce the amount of data in the video stream.
  • the display area of the window is 0, it is not necessary to acquire image data, and the amount of data of the video stream is reduced.
  • the method for transmitting a window image in the embodiment of the present invention may further include:
  • the display image transmission strategy includes: lowering the image of the window or not transmitting the image according to a Z-axis sequence of the window that is smaller than a Z-axis sequence of other windows of the terminal; An image of the window, or according to the ratio of the cover area of the window to the display area being greater than a certain threshold, determining to degrade the image of the window or not to transmit the image of the window;
  • the image of the window is reduced or not transmitted correspondingly.
  • the image of the window is degraded, for example, the HD image is degraded to a standard definition image, etc., to reduce the network load.
  • the terminal may directly set the window display state of the window to be completely covered by the window.
  • the user may only focus on the front end of the desktop (the Z-axis order is the largest).
  • the window corresponding to one or two applications does not focus on the window with a small z-axis order. Therefore, it is possible to reduce the transmission of a window with a small Z-axis sequence or a window with a small z-axis sequence, thereby reducing the network load. Improve terminal operating efficiency and reduce server load.
  • the method for transmitting a window image according to an embodiment of the present invention is applicable to an online application scenario, and the audio and video data of the window is efficiently compressed (for example, by using a video compression technology) and then sent to the terminal, and the terminal first decodes the compressed image after receiving the compressed image. Show.
  • the online application scenario is to transfer the image data of the application window of the server running application to the terminal, and the remote desktop transmits the entire desktop of the server to the terminal, but the terminal is in a window manner. display. Therefore, if the window of the remote desktop displayed by the terminal is partially covered by other windows, the area of the covered remote desktop corresponding to the server may be monochromatically filled and then encoded and transmitted. If the cover is completely covered, the image of the entire desktop is not used. Encoding, without transmission, can also reduce network bandwidth and reduce resource consumption of servers and terminals.
  • the method for transmitting a window image in the embodiment of the present invention is also applicable to a remote desktop application scenario.
  • the embodiment of the present invention provides a server, which includes: a receiving unit 61. In the process of running an application, the receiving terminal sends the application corresponding to the virtual terminal. a window information of the window; a determining unit 62, configured to determine display area information of the window according to the window information;
  • the transmission unit 63 transmits, by the T, image data corresponding to the display area information of the window to the terminal according to the display area information of the window, so that the terminal performs display.
  • the server of the embodiment of the present invention sends image data corresponding to the display area information of the window according to the display area information of the window displayed by the terminal.
  • the window display area is smaller than the entire window area, the image corresponding to the entire window area does not need to be sent. Data to achieve the effect of reducing network load.
  • the terminal before the receiving unit 61 receives the window information of the window corresponding to the application, the terminal sends a request for running the application carrying the application identifier to the server, and the server selects the application requested by the virtual machine running terminal according to the identifier. And the virtual machine and the terminal establish a connection for transmitting the application running data and receiving the information sent by the terminal. Therefore, the terminal transmits the window information of the application in the terminal display window or the user's operation for the application to the virtual machine running the application through the connection.
  • the window is the window displayed by the application running on the terminal.
  • the window information sent by the terminal includes: a window display state, a coordinate of any corner point of the cover area of the window, and a width and a height of the cover area.
  • the coordinates include an X coordinate and a Y coordinate
  • the coordinate may adopt a coordinate of a screen coordinate system or a coordinate of a window coordinate system
  • the screen coordinate system refers to a point of the upper left corner of the display screen as a coordinate origin (0, 0)
  • a horizontal direction is an X axis.
  • the vertical direction is the Y axis
  • the window coordinate system means that the upper left corner of the window is the coordinate origin (0, 0), the horizontal direction is the X axis, and the vertical direction is the Y axis; the window covering area can be one or more.
  • the window information may further include: a number of cloaking windows.
  • the message type of the terminal to send the window information is Updata_Window_infrom, and the message format can be as shown in Table 1, so that the virtual machine parses the message to obtain the window information sent by the terminal.
  • the window information sent by the terminal includes: a window display state, a coordinate of any corner of the window, a width and a height of the window, a coordinate of the z-axis sequence larger than the corner of the window and the window covering the window, and the z-axis The order is larger than the window and covers the window width and height of the window.
  • the coordinates include an X coordinate and a Y coordinate, and the coordinate may adopt a coordinate of a screen coordinate system or a coordinate of a window coordinate system; the window may be one or more of the window and the window covering the window may be one or more.
  • the window information may further include: a number of cloaking windows.
  • the message type of the terminal to send the window information is Updata_Window_infrom, and the message format can be as shown in Table 2 above, so that the virtual machine parses the message to obtain the window information sent by the terminal.
  • the window information sent by the terminal includes: coordinates of any corner point of the window, width and height of the window, a coordinate of the Z axis is greater than a corner of the window of the window, and a Z axis order is greater than a window width of the window and height.
  • the coordinates include an X coordinate and a ⁇ coordinate, and the coordinate may adopt the coordinate of the screen coordinate system or the coordinate of the window coordinate system; the window whose Z axis sequence is larger than the window may be one or more.
  • the window information may further include: a number of cloaking windows.
  • the message type of the terminal to send the window information is Updata_Window_infrom, and the message format can be as shown in Table 3 above, so that the virtual machine parses the message to obtain the window information sent by the terminal.
  • the receiving unit 61 is further configured to receive a window location request message sent by the terminal, where the window location request message is used to obtain the window size and location information of the virtual machine.
  • the server provided by the embodiment of the present invention may further include a sending unit 71, configured to send the window size and location information of the virtual machine to the terminal.
  • the receiving unit 61 receives the window information sent by the terminal, where the window information includes the window size and location information of the terminal, or receives a window notification message sent by the terminal, and the window notifies the message carrying terminal of the window size and location information.
  • the server provided by the embodiment of the present invention may further include a coordinate conversion unit 72, configured to convert the coordinates of the terminal into two according to the window size and location information of the terminal, the window size and the location information of the virtual machine. The corresponding coordinates of the virtual machine.
  • the window size of the virtual machine can be obtained through the API provided by the operating system. Coordinate conversion formula: If the window size of the virtual machine is X1*Y1, the terminal window size is ⁇ 2* ⁇ 2, for example, the coordinates of the upper left corner of the terminal window are (xl, yl), and the coordinates of the upper left corner of the virtual machine window are (x2, y2).
  • the determining unit 62 can be specifically used for:
  • the display area of the window is determined to be 0.
  • the display area of the window is determined to be the entire window except the cover area.
  • the area when there are a plurality of cover areas, determine a joint cover area composed of a plurality of cover areas, thereby determining that the display area of the window is an area of the entire window except the joint cover area.
  • the determining unit 62 can be specifically used to determine the display area of the window as the entire window according to the window display state in the window information.
  • the display area of the window is determined to be 0.
  • the window display state in the window information is partially covered, according to the X coordinate, the Y coordinate, the width and the height of any corner point of the window in the window information, and any corner of the window whose z-axis order is larger than the window and covers the window X coordinate, Y coordinate, width of the point Degree and height, determine the X coordinate, Y coordinate, width and height of the cover area of any corner of the cover field;
  • the display area of the window is an area other than the covering area of the entire window, and when there are a plurality of covering areas, determining a plurality of covering areas
  • the joint occlusion area determines the display field of the window as the area of the entire window except the joint occlusion area.
  • determining unit 62 specifically for:
  • the z-axis order is larger than the Whether the window of the window covers the window, if the window whose z-axis order is larger than the window does not cover the window, the window display state of the window is full display, and the display area of the window is determined to be the entire window;
  • the X coordinate, Y coordinate, the width and the height of any corner of the window in the window information, and the window whose z-axis order is larger than the window and covers the window The X coordinate, Y coordinate, width and height of a corner point, determine the X coordinate, Y coordinate, width and height of the cover area of any corner point of the cover area;
  • the cover area According to the X coordinate, the Y coordinate, the width and the height of the corner of the cover area, it is determined whether the cover area completely covers the window. When there are multiple cover areas, it is determined whether the joint cover area composed of the plurality of cover areas is completely covered.
  • the window if the occlusion area or the joint occlusion area completely covers the window, the window display state of the window is full occlusion, thereby determining that the display field of the window is 0, and if the occlusion area or the joint occlusion area does not completely cover the window,
  • the window display state of the window is partially covered, and the display area of the window is determined to be an area of the entire window except the cover area, or the display area of the window is determined to be an area of the entire window except the joint cover area.
  • the transmission unit 63 can be configured to acquire image data of the entire window when the display area of the window is the entire window, and send the image data to the terminal for display by the terminal.
  • the display area of the window is an area of the entire window except the cover area
  • image data of the entire window is acquired, and the cover area is filled with a solid color or a colorless, and the filled image data is sent to the terminal, and the terminal displays .
  • the solid color is black or white.
  • the server of the embodiment of the present invention is further configured to:
  • the display image transmission strategy includes: lowering the image of the window or not transmitting the image according to a Z-axis sequence of the window that is smaller than a Z-axis sequence of other windows of the terminal; An image of the window, or according to the ratio of the cover area of the window to the display area being greater than a certain threshold, determining to degrade the image of the window or not to transmit the image of the window;
  • the transmission unit 63 is configured to reduce or not transmit the image of the window according to the display image transmission policy.
  • the image of the window is degraded, for example, the HD image is degraded to a standard definition image, etc., to reduce the network load.
  • the terminal determines that the image transmission policy is not to transmit the image of the window, the window display state in the window information sent by the terminal is completely covered by the window, so that the receiving unit 61 receives the window display in the window information sent by the terminal. The status is completely covered by the window.
  • an embodiment of the present invention provides a window display method, including:
  • Step 81 The virtual machine sends window information of the window corresponding to the application to the server, so that the virtual machine on the server determines the display area information of the window according to the window information.
  • Step 82 Receive image data corresponding to the display area information of the window sent by the server and display the image data.
  • the execution body of the display method of the window of the embodiment of the present invention is a terminal.
  • the terminal receives the image data corresponding to the display area information of the window sent by the server, and when the window display area is smaller than the entire window area, the image data corresponding to the entire window area does not need to be received, thereby achieving Reduce the effect of network load and improve terminal operating efficiency.
  • the terminal sends a request for running the application carrying the application identifier to the server, and the server selects the application requested by the virtual machine running terminal according to the identifier, and the transmission application running data and the receiving terminal are established by the virtual machine and the terminal.
  • the window is the window displayed by the application running on the terminal.
  • the window information of the window is determined.
  • the window information of the window is determined, including:
  • Step 91 The terminal acquires the Z-axis sequence of all windows of the terminal, the (X, Y) coordinates of any corner of all the windows, and the width and height of all the windows.
  • the terminal acquires the axis sequence of all windows, such as the axis sequence of window C > the axis sequence of window D > the axis sequence of the window ⁇ the axis sequence of the window ⁇ .
  • the coordinates of the upper left corner (X, Y) of the terminal acquisition window A are (50, 50), the width is 150, and the height is 100.
  • the upper left corner of the window ⁇ ( ⁇ , ⁇ ) The coordinates are (70,80), the width is 60, and the height is 120.
  • the upper left corner of window C ( ⁇ , ⁇ ) has coordinates (100,110), width 140, and height 100; as in the upper left corner of window D ( ⁇ , ⁇ )
  • the coordinates are (210, 160), the width is 20, and the height is 20.
  • Step 92 The terminal determines whether the axis sequence of the window is maximum, and if yes, the window display state is full display, otherwise, the process proceeds to step 93 to determine ( ⁇ , ⁇ ) coordinates and window of any corner of the window of the axis window Width and height.
  • the terminal determines that the Z-axis order of the window C is the largest according to the axis sequence of the window C, the axis sequence of the window D, and the axis sequence of the window ,, that is, the window C is the top of the Z-axis sequence.
  • the window according to the window at the top of the Z-axis sequence, covers other windows in the Z-axis sequence, and determines that the window display state of the window C is full display.
  • step 93 further determines ⁇ axis of order greater than any corner of the window the window points ( ⁇ , ⁇ ) coordinates and the width and height of the window.
  • Step 93 The terminal is greater than ( ⁇ , ⁇ ) coordinates of any corner of the window of the window according to the axis sequence, and the width and height of the window. Determining whether the window is covered by a window whose z-axis order is larger than the window. If not, the window display state of the window is full display, otherwise it is determined that the axis sequence is larger than the window and covers any corner of the window of the window ( ⁇ , ⁇ ) The coordinates and the width and height of the window.
  • the axis sequence of the window C, the axis sequence of the window D, and the axis sequence of the window ⁇ are larger than the axis sequence of the window , and the terminal is based on the horizontal and vertical axes ( ⁇ , ⁇ ) of the upper left corner of the window A and the window.
  • the width and height of the window are confirmed to be larger than the window ⁇ .
  • the upper left corner of the window is located in the window area of window A, and it is determined that window A is covered by window B. Specifically, as shown in FIG.
  • the terminal is based on the Z-axis sequence of window B> the Z-axis order of window A, and the horizontal and vertical axis (X, Y) coordinates of window A are (50, 50), width 150, height 100;
  • the upper left corner of the window ⁇ ( ⁇ , ⁇ ) coordinates are (70, 80), and the coordinates of the upper left corner of the window ⁇ are determined to be within the window area of the window ⁇ .
  • the terminal can calculate the coordinates ( ⁇ , ⁇ ) of the upper right corner of the window ⁇ according to the XY axis ( ⁇ , ⁇ ) coordinates of the window A as (50, 50), the width 150, and the height of 100 degrees (200, 50), And calculating the coordinates of the lower left corner point (50, 150), determining that the X-axis coordinate 70 of the upper left corner of the window ⁇ is greater than the X-axis coordinate 50 of the upper left corner of the window ,, and less than the X-axis coordinate 200 of the upper right corner of the window A, And determining that the Y-axis coordinate 80 of the upper left corner of the window B is smaller than the Y-axis coordinate 150 of the lower left corner of the window A, and larger than the Y-axis coordinate 50 of the upper left corner of the window A, thereby determining that the upper left corner of the window B is located in the window A.
  • the window area Within the window area.
  • the terminal confirms according to the horizontal and vertical axes ( ⁇ , ⁇ ) of the upper left corner of the window A, the width and height of the window, and the coordinates of the upper left corner of the window ⁇ and/or the height of the window ⁇ .
  • 1 axis sequence is larger than the window ⁇ window ⁇ window ⁇ the upper left corner of the point Y axis is sitting on the small D ⁇ window A lower left corner point Y coordinate, or the window B lower left corner point Y coordinate is greater than the window A
  • the Y-axis coordinate of the upper left corner point determines that window A is not covered by window B.
  • the terminal determines the upper left corner of the window ⁇ according to the horizontal and vertical axes ( ⁇ , ⁇ ) of the upper left corner of the window A and the width and height of the window and the coordinates of the upper left corner of the window ⁇ and/or the height of the window ⁇ .
  • the X coordinate of the point is larger than the X-axis coordinate of the upper left corner of the window ,, smaller than the X-axis coordinate of the upper right corner of the window A, and the Y-axis coordinate of the lower left corner of the window B is larger than the Y-axis coordinate of the upper left corner of the window A.
  • the ( ⁇ , ⁇ ) coordinates of the upper left corner of the window A are (50, 50), the width is 150, the height is 100, and the top left corner of the window C whose axis sequence is larger than the window ⁇ is ( ⁇ , ⁇ )
  • the coordinates are (100, 110), the width is 140, and the height is 100. It is determined that the coordinates of the upper left corner of the window C are located in the window area of the window ⁇ .
  • the coordinates (50, 50), the width 150, and the height of 100 degrees are calculated as the coordinates ( ⁇ , ⁇ ) of the upper right corner of the window ⁇ (200, 50), and Calculating the coordinates of the lower left corner point (50, 150), determining that the X-axis coordinate 100 of the upper left corner of the window C is greater than the X-axis coordinate 50 of the upper left corner of the window ,, less than the X-axis coordinate 200 of the upper right corner of the window A, and It is determined that the Y-axis coordinate 110 of the upper left corner of the window C is smaller than the Y-axis coordinate 150 of the lower left corner of the window A, and is greater than the Y-axis coordinate 50 of the upper left corner of the window A, thereby determining that the upper left corner of the window C is located in the window A. Within the window area. Further, the z-axis order of the window C is larger than the window A and the
  • the coordinates of ( ⁇ , ⁇ ) of the upper left corner of window A are (50, 50), and the coordinates of the upper left corner of window D ((, ⁇ ) are (210, 160), and the width is 20 , the height is 20, the coordinates of the upper right corner of the calculation window ( (X, ⁇ ) are (200, 50), and the coordinates of the lower left corner point (50, 150) are calculated, and the X-axis coordinate 210 of the upper left corner of the window D is determined to be greater than
  • the X-axis coordinate 200 of the upper right corner of the window A, the Y-axis coordinate 160 of the upper left corner of the window D is greater than the Y-axis coordinate 150 of the upper right corner of the window A, thereby determining that the upper left corner of the window D is located in the window area of the window A Outside. Further determining that window D does not obscure window A.
  • the X-axis coordinate of the upper left corner of the window B is larger than the X-axis coordinate of the upper right corner of the window A, or the Y-axis coordinate of the upper left corner of the window B is larger than the Y-axis coordinate of the lower left corner of the window A, that is, The top left corner of window B is not located in window A.
  • the window A In the window area, it is determined that the window A is not covered by the window B; it is assumed that the X-axis coordinate of the upper left corner of the window C is larger than the X-axis coordinate of the upper right corner of the window A, or the Y-axis coordinate of the upper left corner of the window C If the Y-axis coordinate of the lower left corner of the window A is larger, that is, the upper left corner of the window C is not located in the window area of the window A, it is determined that the window A is not covered by the window C; therefore, it is determined that the window A is not covered by the window B or the window ( The window D is covered, and the window display state of the window A is full display.
  • the Z-axis order of window C and the Z-axis order of window D are larger than the Z-axis order of window B, and the terminal coordinates (70, 80) according to the upper left corner of window B ( ⁇ , ⁇ ). ), the width is 60, the height is 120, and the "Y" coordinate of the upper left corner of the window C whose axis sequence is larger than the window ⁇ is (100, 110), the width is 140, and the height is 100.
  • the upper left of the window C is determined.
  • the corner coordinates are in the window area of the window ⁇ .
  • the width is 60
  • the height is 120
  • the coordinates of the upper right corner of the window ⁇ ( ⁇ , ⁇ ) are calculated as (130, 80)
  • calculating the coordinates of the lower left corner point (70, 200) determining that the X-axis coordinate 100 of the upper left corner of the window C is greater than the X-axis coordinate 70 of the upper left corner of the window ,, and less than the X-axis coordinate 130 of the upper right corner of the window ⁇
  • the axis coordinate 110 of the upper left corner of the window C is smaller than the pivot coordinate 200 of the lower left corner of the window ,, which is greater than the ⁇ axis coordinate 80 of the upper left corner of the window ,, thereby determining that the upper left corner of the window C is located in the window Inside the window area. Further, it is determined that the axis of the window C is in the window and the window is closed.
  • the coordinates are (70, 80), the width is 60, the height is 120, and the upper left corner of the window D (X, ⁇ ) coordinates are (210, 160), and the width is 20, the height is 20, the coordinates of the upper right corner of the calculation window ⁇ ( ⁇ , ⁇ ) are (130, 80), and the coordinates of the lower left corner point (70, 200) are calculated, and the X-axis coordinate 210 of the upper left corner of the window D is determined. It is greater than the X-axis coordinate 130 of the upper right corner of the window ,, thereby determining that the upper left corner of the window D is outside the window area of the window ⁇ . Further confirmation window D does not cover the window ⁇ .
  • the X-axis coordinate of the upper left corner of the window C is larger than the X-axis coordinate of the upper right corner of the window ,, or the ⁇ coordinate of the upper left corner of the window C is the ⁇ coordinate of the lower left corner of the window ,, that is, the window
  • the window ⁇ is not covered by the window (;, window D, and the window ⁇ window display state is full display.
  • the Z-axis order of the window C is larger than the Z-axis order of the window D
  • the terminal coordinates (X, Y) of the upper left corner of the window D according to the window information of the window D is (210, 160)
  • width is 20
  • height is 20
  • the coordinates (X, Y) of the upper right corner of the calculation window D are (230, 160)
  • the coordinates of the lower left corner of the calculation window D (210, 180), according to the z-axis order
  • the ( ⁇ , ⁇ ) coordinates of the upper left corner of the window C larger than the window D are (100, 110), the width is 140, and the height is 100.
  • the coordinates of the upper right corner of the calculation window C ( ⁇ , ⁇ ) are (240, 100). And calculating the coordinates of the lower left corner of the window C (100, 210), determining that the X-axis coordinate 210 of the upper left corner of the window D is greater than the X-axis coordinate 100 of the upper left corner of the window C, which is smaller than the upper right corner of the window C.
  • the X-axis coordinate 240, and the paraxial coordinate 160 of the upper left corner of the window D is determined to be smaller than the paraxial coordinate 210 of the lower left corner of the window C, and greater than the paraxial coordinate 110 of the upper left corner of the window C, thereby determining the axis of C
  • the sequence is larger than window D and covers window D.
  • Step 94 The terminal is larger than the ( ⁇ , ⁇ ) coordinate of any corner of the window according to the z-axis sequence and covering the window, and the width and height of the window, and the ( ⁇ , ⁇ ) coordinates of any corner of the window and the window. Width and height, determine the ( ⁇ , ⁇ ) coordinates of any corner of the window's covered area and the width and height of the covered area.
  • the occlusion area of the window A covered by the window B is obtained (ie, A covered area).
  • the coordinates of the upper left corner of the terminal window A and the width and height of the window A obtain the coordinates ( ⁇ , ⁇ ) of the upper right corner of the window A as (200, 50)
  • the coordinates of the lower left corner point (50, 150), and the coordinates of the upper right corner of the window B (X, Y) are (130, 80) and the lower left corner according to the coordinates of the upper left corner of the window B and the width and height of the window B.
  • the Y-axis coordinate 150 of the point minus the Y-axis coordinate 80 of the upper left corner of the window B is 70. Therefore, the (X, Y) coordinate of the upper left corner of the first cover area of the window A is (70, 80), the first cover The area is 60 wide and 70 high.
  • the terminal determines that the coordinates of the upper corner of the window ⁇ are outside the area of the window , that is, the X-axis coordinate of the upper right corner of the window B is greater than the X-axis coordinate of the window A, the width of the first covering area is the window.
  • the X-axis coordinate of the upper right corner of A is subtracted from the coordinates of the upper left corner of window B.
  • the height of the first covered area is the height of the window B.
  • the masked area (i.e., the second covered area) in which the window A is covered by the window C is obtained according to the width 140 of the window C and the height 100, and the coordinates of the upper left corner of the window A and the width and height of the window A.
  • the coordinates ( ⁇ , ⁇ ) of the upper right corner of the window A are (200, 50) and the coordinates of the lower left corner (50, 150), and
  • the coordinates (X, ⁇ ) of the upper right corner of the window C are calculated as (240, 100) and the coordinates of the lower left corner (100, 210), and the window C is determined.
  • the upper right corner point is outside the area of the window ⁇ and the lower left corner of the window C is outside the area of the window A, and then the width of the second covered area is determined as the X-axis coordinate 200 of the upper right corner of the window A minus the window C
  • the X-axis coordinate 100 of the upper left corner point is 100
  • the height of the second masking area is the Y-axis coordinate 150 of the lower left corner of the window A minus the Y-axis coordinate 110 of the upper left corner of the window C is 40. Therefore, the (X, Y) coordinate of the upper left corner of the second cover area of the window A is (100, 110), and the second cover area is 100 wide and 40 high.
  • the width of the second mask area is the width of the window C.
  • the height of the second covered area is the height of the window C.
  • the window B is covered by the window C according to the width 140 and the height 100 of the window C, and the coordinates of the upper left corner of the window B and the width and height of the window B.
  • the coordinates (X, Y) of the upper right corner of the window B are (130, 80) and the coordinates of the lower left corner (70, 200), and Calculate the coordinates of the upper right corner of the window C ( ⁇ , ⁇ ) as (240, 100) and the coordinates of the lower left corner (100, 110) according to the coordinates of the upper left corner of the window C and the width and height of the window C, and determine the window C.
  • the upper right corner point is outside the area of the window
  • the lower left corner of the window C is outside the area of the window
  • the width of the occlusion area is determined as the X-axis coordinate 130 of the upper right corner of the window ⁇ minus the upper left corner of the window C
  • the X-axis coordinate 100 is 30, and the height of the cover area is the ⁇ axis coordinate 200 of the window ⁇ lower left corner point minus the ⁇ axis coordinate 110 of the upper left corner of the window C is 90. Therefore, the ( ⁇ , ⁇ ) coordinates of the upper left corner of the window area are (100, 110), the cover area is 30 wide, and the height is 90.
  • the width of the occlusion area is the width of the window C.
  • the height of the cover field is the height of the window C.
  • the coordinates (X, ⁇ ) of the upper right corner of D are (210, 160), the coordinates of the lower left corner of window D (210, 180), and the coordinates of the upper right corner of window C ( ⁇ , ⁇ ) is (240, 100), and the coordinates of the lower left corner of the window C (100, 210), determine the coordinates of the upper left corner of the window D ( ⁇ , ⁇ ) (210, 160), window D
  • the coordinates of the upper right corner point are located in the area of the window C, and the width of the cover area is the width 20 of the window D, and the lower left corner of the window C is located in the area of the window C.
  • the height of the covered area is the height 20 of the window D.
  • Step 95 When the terminal determines that the cover area of the window completely covers the window, determine that the window display state of the window is full cover. When the cover area of the window does not completely cover the window, the window display state of the window is partially covered.
  • the X-axis coordinate of the upper left corner of the joint cover area is less than or equal to the X-axis coordinate of the upper left corner of the window A
  • the Y-axis coordinate of the upper left corner of the joint cover area is smaller than the Y-axis coordinate of the upper left corner of the window A
  • the joint cover The width of the area is greater than or equal to the width of the window A, and the height of the joint cover area is high, and the height of the window A is determined to completely cover the window A, that is, the window display state of the window A is fully covered.
  • the cover area does not completely cover the window B, that is, the window display state of the window B is partially covered.
  • the X-axis coordinate of the upper left corner of the cover area is less than or equal to the X-axis coordinate of the upper left corner of the window B.
  • the Y-axis coordinate of the upper left corner of the cover area is less than or equal to the Y-axis coordinate of the upper left corner of the window B, and the width of the cover area is large.
  • the height of the cover area is greater than or equal to the height of the window B, it is determined that the cover area completely covers the window B, that is, the window display state of the window B is fully covered.
  • the width of the covering area is the width 20 of the window D
  • the height of the covering area is the height 20 of the window D
  • the covering area is completely determined.
  • the window D is covered, that is, the window display state of the window D is fully covered.
  • the window information includes a window size and location information of the terminal, or the terminal sends a window notification message, where the window notifies the message carrying the window size and location information of the terminal, so that the server
  • the window size and location information of the terminal, the window size and location information of the virtual machine convert the coordinates of the terminal into the corresponding coordinates of the virtual machine.
  • the display method of the window of the embodiment of the present invention may further include:
  • the window location request message is used to request the window size and location information of the virtual machine.
  • the coordinates of the terminal are converted into corresponding coordinates of the virtual machine according to the window size and position information of the terminal, the window size and position information of the virtual machine.
  • the window size of the terminal can be obtained through an API provided by the operating system. Coordinate conversion formula: If the window size of the virtual machine is X1*Y1, the terminal window size is ⁇ 2* ⁇ 2, for example, the coordinates of the upper left corner of the terminal window are (xl, yl), and the coordinates of the upper left corner of the virtual machine window are (x2, y2).
  • the display method of the window of the embodiment of the present invention may further include:
  • the determined display image transmission policy is sent to the server.
  • the image of the window is degraded, for example, the HD image is degraded to a standard definition image, etc., to reduce the network load.
  • the terminal determines that the image transmission policy is not to transmit the image of the window, the window display state in the window information sent by the terminal is completely covered by the window.
  • the embodiment of the present invention provides a terminal, including: a sending unit 101, configured to send a window of a window corresponding to the application in a process of running the application by the virtual machine.
  • the information is sent to the server, so that the virtual machine on the server determines the display area information of the window according to the window information.
  • the receiving unit 102 is configured to receive image data corresponding to the display area information of the window sent by the server and display the image data.
  • the terminal of the embodiment of the present invention receives the image data corresponding to the display area information of the window sent by the server. When the window display area is smaller than the entire window area, the image data corresponding to the entire window area does not need to be received, thereby reducing the network load. And improve terminal operating efficiency.
  • the terminal sends a request for running the application carrying the application identifier to the server, and the server selects the application requested by the virtual machine running terminal according to the identifier, and the virtual machine and the terminal establish a connection for transmitting the application running data and transmitting the information by the receiving terminal. Therefore, the terminal transmits the window information of the application in the terminal display window or the user's operation for the application to the virtual machine running the application through the connection.
  • the window is the window displayed by the application running on the terminal.
  • the terminal of the embodiment of the present invention further includes:
  • the determining unit 111 is configured to determine the window information of the window when the terminal establishes a window, or the z-axis sequence of the window changes, or the coordinate of any corner of the window changes, or the width or height of the window changes.
  • the determination unit 11 body includes:
  • the obtaining subunit 1111 is configured to acquire the Z-axis sequence of all windows of the terminal, the ( ⁇ , ⁇ ) coordinates of any corner point of all the windows, and the width and height of all the windows;
  • the first determining sub-unit 1112 is configured to determine whether the axis sequence of the window corresponding to the application is the maximum, and if yes, the window display state of the window corresponding to the application is a full display;
  • a second determining sub-unit 1113 configured to determine, by the first determining sub-unit 1112, that the axis sequence of the window corresponding to the application is not the maximum, according to any one of the corners of the window corresponding to the window corresponding to the application ( ⁇ , ⁇ ).
  • the coordinates and the width and height of the window determine whether the window corresponding to the application is covered by the window whose axis sequence is larger than the window corresponding to the application. If not, the window display state of the corresponding window of the application is full display, otherwise the axis is determined.
  • a third determining subunit 1114 configured to: ( ⁇ , ⁇ ) coordinates of any corner of the window corresponding to the window corresponding to the application and cover the window corresponding to the application, and the width and height of the window, and the application corresponding to the application The ( ⁇ , ⁇ ) coordinates of any corner of the window and the width and height of the window, determine the ( ⁇ , ⁇ ) coordinates of any corner of the covered area of the window corresponding to the application, and the width and height of the occluded area;
  • the fourth determining sub-unit 1115 is configured to determine that the cover area of the window corresponding to the application completely covers the window corresponding to the application, and determine that the window display state of the window corresponding to the application is full coverage, and the cover area of the corresponding window of the application is not When the window corresponding to the application is completely covered, it is determined that the window display state of the window corresponding to the application is partially covered.
  • the window information sent by the sending unit 101 may include the window size and location information of the terminal, or the sending unit 101 sends a window notification message, where the window notifies the message carrying the window size and location information of the terminal, so that the server is configured according to the terminal.
  • the window size and location information, the window size and location information of the virtual machine convert the coordinates of the terminal to the corresponding coordinates of the virtual machine.
  • the sending unit 101 may be further configured to send a window location request message to the server, where the window location request message is used to request to obtain the window size and location information of the virtual machine; at this time, the receiving unit 102 may further be configured to receive The window size and location information of the virtual machine sent by the server; at this time, the terminal of the embodiment of the present invention further includes a coordinate conversion 112, which is used to set the coordinates of the terminal according to the window size and location information of the terminal, the window size and the location information of the virtual machine. Convert to the corresponding coordinates of the virtual machine.
  • the window size of the terminal can be obtained through an API provided by the operating system. Coordinate conversion formula: If the window size of the virtual machine is X1*Y1, the terminal window size is ⁇ 2* ⁇ 2, for example, the coordinates of the upper left corner of the terminal window are (xl, yl), and the coordinates of the upper left corner of the virtual machine window are (x2, y2).
  • the determining unit 111 is further configured to determine, according to the Z-axis sequence of the window that is smaller than the Z-axis sequence of the other windows of the terminal, that the display image transmission policy is to degrade the image of the window or not to transmit the image of the window. Or determining, according to the ratio of the cover area of the window to the display area, that the display image transmission policy is to degrade the image of the window or not to transmit the image of the window;
  • the sending unit 101 is further configured to send the determined display image transmission policy to the server.
  • the first determining subunit 1112 may determine whether the Z-axis order of the window is smaller than the Z-axis order of other windows of the terminal.
  • the fourth determining sub-unit 1115 may determine that the ratio of the covered area of the window to the display area is greater than a certain threshold.
  • the image of the window is degraded, for example, the HD image is degraded to a standard definition image, etc., to reduce the network load.
  • the terminal determines that the image transmission policy is displayed as not transmitting the image of the window, the window display state in the window information sent by the sending unit 101 is full coverage of the window.
  • an application schematic diagram of a display system of a window according to an embodiment of the present invention includes a terminal 121 and a server 122.
  • the terminal 121 includes a determining unit 1211, a coordinate converting unit 1212, an input device unit 1213, a transmitting unit 1214, a receiving unit 1215, and a display unit 1216.
  • the server 122 includes a receiving unit 1221, an application running unit 1222, an image capturing unit 1223, an image filling unit 1224, an image position processing unit 1225, an encoding unit 1226, and a transmitting unit 1226.
  • the determining unit 1211 is configured to determine window information of the window.
  • the coordinate conversion unit 1212 is configured to convert the window coordinates of the terminal into corresponding coordinates of the window on the server-side virtual machine.
  • the input device unit 1213 is configured to generate an input event.
  • the input events operated by the user may specifically refer to keyboard and mouse events (terminals of the PC model), button or touch screen events (mobile phone or PDA type terminals), remote control or gamepad operation events (television type terminals), and the like.
  • the sending unit 1214 is configured to send window information to the receiving unit 1221.
  • the receiving unit 1221 is configured to receive the window information sent by the sending unit 1214, and send the information to the application running unit 1222 and the image.
  • Location processing unit 1225 is configured to receive the window information sent by the sending unit 1214, and send the information to the application running unit 1222 and the image.
  • the application running unit 1222 controls the running of the application on the virtual machine, including starting, suspending, and aborting the application.
  • the processing unit 1225 is configured to determine the window covering area information when the window portion is covered, or calculate the window covering area information according to the window covering position information.
  • the image intercepting unit 1223 is configured to intercept an image of the window according to the running of the application running unit 1222, and send the captured image to the encoding unit 1226 when the window is fully displayed.
  • the image filling unit 1224 is configured to fill a masked area in the image of the cut window with a solid color when the window portion is covered, and send the clipped image with the fill to the encoding unit 726.
  • the encoding unit 1226 is configured to encode the received image and send it to the sending unit 1226.
  • the sending unit 226 is configured to send the encoded image to the receiving unit 1215.
  • the receiving unit 1215 is configured to receive the encoded image from the sending unit 1226.
  • the display unit 1216 is configured to perform decoding display on the encoded image received by the receiving unit 1215.
  • the terminal 121 and the server 122 in the display system of the embodiment of the present invention can be specifically understood by referring to the terminal and the server in the above embodiments, and details are not described herein.
  • a person skilled in the art can understand that all or part of the process of implementing the above embodiment method can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. In execution, the flow of an embodiment of the methods as described above may be included.
  • the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

Abstract

L'invention concerne un procédé de transmission d'image de fenêtre qui comporte : dans un processus de fonctionnement d'une application, la réception, par une machine virtuelle, d'informations de fenêtre (11) envoyées par un terminal et correspondant à l'application ; la détermination d'informations de zone d'affichage (12) concernant la fenêtre selon les informations de fenêtre ; l'envoi, selon les informations de zone d'affichage concernant la fenêtre, des données d'image correspondant aux informations de zone d'affichage concernant la fenêtre au terminal, de manière à ce que le terminal effectue l'affichage (13). En outre, un procédé d'affichage, un terminal, un serveur et un système sont décrits. Selon l'invention, des données d'image correspondant aux informations de zone d'affichage concernant une fenêtre sont envoyées, conformément à des informations de zone d'affichage concernant la fenêtre affichées par une application dans le terminal, et lorsqu'une zone d'affichage de fenêtre est plus petite qu'une zone de fenêtre entière, il n'est pas nécessaire d'envoyer des données d'image correspondant à la fenêtre entière, de manière à obtenir un effet de réduction de la charge de réseau.
PCT/CN2012/080475 2012-08-22 2012-08-22 Procédé de transmission d'image de fenêtre, procédé d'affichage, terminal, serveur et système WO2014029091A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2012/080475 WO2014029091A1 (fr) 2012-08-22 2012-08-22 Procédé de transmission d'image de fenêtre, procédé d'affichage, terminal, serveur et système
CN201280001095.8A CN103959246B (zh) 2012-08-22 2012-08-22 窗口图像的传输方法、显示方法、终端、服务器及系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/080475 WO2014029091A1 (fr) 2012-08-22 2012-08-22 Procédé de transmission d'image de fenêtre, procédé d'affichage, terminal, serveur et système

Publications (1)

Publication Number Publication Date
WO2014029091A1 true WO2014029091A1 (fr) 2014-02-27

Family

ID=50149354

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/080475 WO2014029091A1 (fr) 2012-08-22 2012-08-22 Procédé de transmission d'image de fenêtre, procédé d'affichage, terminal, serveur et système

Country Status (2)

Country Link
CN (1) CN103959246B (fr)
WO (1) WO2014029091A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107508886A (zh) * 2017-08-24 2017-12-22 西安万像电子科技有限公司 应用显示方法及装置

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114217758A (zh) * 2021-12-01 2022-03-22 深圳Tcl新技术有限公司 图像显示方法、装置、电子设备及计算机可读存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020196279A1 (en) * 1995-11-13 2002-12-26 Marc Bloomfield Interacting with software applications displayed in a web page
CN1645320A (zh) * 2005-01-31 2005-07-27 浙江大学 确定图形用户界面中窗口剪切关系的方法
CN102436350A (zh) * 2011-12-06 2012-05-02 北京航空航天大学 远程应用窗口显示方法、服务器及用户终端

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020196279A1 (en) * 1995-11-13 2002-12-26 Marc Bloomfield Interacting with software applications displayed in a web page
CN1645320A (zh) * 2005-01-31 2005-07-27 浙江大学 确定图形用户界面中窗口剪切关系的方法
CN102436350A (zh) * 2011-12-06 2012-05-02 北京航空航天大学 远程应用窗口显示方法、服务器及用户终端

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107508886A (zh) * 2017-08-24 2017-12-22 西安万像电子科技有限公司 应用显示方法及装置

Also Published As

Publication number Publication date
CN103959246B (zh) 2017-03-08
CN103959246A (zh) 2014-07-30

Similar Documents

Publication Publication Date Title
TWI803590B (zh) 藉由所關注區域之制定的異步時間及空間翹曲
EP4095804A1 (fr) Procédé et dispositif de traitement d'image, serveur, et support
WO2021135160A1 (fr) Procédé et dispositif de commande de flux en direct de jeu, support de stockage informatique et appareil électronique
US11303881B2 (en) Method and client for playing back panoramic video
JP6013562B2 (ja) ワイヤレスシンクとワイヤレスソースデバイスとの間で機能をネゴシエートすること
JP6092338B2 (ja) ワイヤレスディスプレイのためのユーザ入力バックチャネル
JP5714726B2 (ja) ワイヤレスディスプレイのためのユーザ入力バックチャネル
JP5826861B2 (ja) ワイヤレスディスプレイのためのユーザ入力バックチャネル
KR101640767B1 (ko) 이종 수행 환경을 위한 네트워크 기반의 실시간 가상 현실 입출력 시스템 및 가상 현실 입출력 방법
JP5826860B2 (ja) ワイヤレスディスプレイのためのユーザ入力バックチャネル
CN107113396B (zh) 视频通话期间在用户终端处实现的方法、用户终端及计算机可读存储介质
WO2021143182A1 (fr) Procédé et appareil de traitement de jeu, dispositif électronique, et support de stockage lisible par ordinateur
CN105704161B (zh) 用于传送和接收远程呈现图形数据的方法和系统
CN102375687A (zh) 在无线显示表面上显示计算机桌面
JP2007274150A (ja) サーバ装置および映像配信方法
TW200948088A (en) System and method for virtual 3D graphics acceleration and streaming multiple different video streams
JP5500513B2 (ja) ２次元（２ｄ）ビデオメッセンジャアプリケーションのための３次元（３ｄ）ビデオ
WO2013135141A1 (fr) Système, terminal et procédé de réglage vidéo dynamique
CN102196033B (zh) 一种传送和接收远程呈现数据的方法和系统
CN111221491A (zh) 交互控制方法及装置、电子设备、存储介质
US20160014193A1 (en) Computer system, distribution control system, distribution control method, and computer-readable storage medium
CN113489805A (zh) 一种云桌面系统的对接方法、装置、设备及存储介质
WO2014029091A1 (fr) Procédé de transmission d'image de fenêtre, procédé d'affichage, terminal, serveur et système
JP5077272B2 (ja) クライアント装置、サーバベース・コンピューティング・システム、およびクライアント制御プログラム
JP5847846B2 (ja) ワイヤレスディスプレイのためのユーザ入力バックチャネル

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12883217

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12883217

Country of ref document: EP

Kind code of ref document: A1