CN108521604A - Redirect the multi-display method and device of video - Google Patents

Redirect the multi-display method and device of video Download PDF

Info

Publication number
CN108521604A
CN108521604A CN201810291613.3A CN201810291613A CN108521604A CN 108521604 A CN108521604 A CN 108521604A CN 201810291613 A CN201810291613 A CN 201810291613A CN 108521604 A CN108521604 A CN 108521604A
Authority
CN
China
Prior art keywords
play position
video
physical display
player
real
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810291613.3A
Other languages
Chinese (zh)
Other versions
CN108521604B (en
Inventor
卢亚广
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
New H3C Cloud Technologies Co Ltd
Original Assignee
New H3C Cloud Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by New H3C Cloud Technologies Co Ltd filed Critical New H3C Cloud Technologies Co Ltd
Priority to CN201810291613.3A priority Critical patent/CN108521604B/en
Publication of CN108521604A publication Critical patent/CN108521604A/en
Application granted granted Critical
Publication of CN108521604B publication Critical patent/CN108521604B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44004Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4437Implementing a Virtual Machine [VM]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438Window management, e.g. event handling following interaction with the user interface
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present embodiments relate to field of cloud computer technology, a kind of multi-display method and device redirecting video is provided, exceed the indication range of the corresponding present physical display of video player in the real-time play position of judgement virtual player, when physical display switching occurs for the window that i.e. video redirects, the first video data in video cache area is first put into temporary buffer, again the video playing frame of client actively restart, to make the video of client redirect the target play position that window switches to rapidly target physical display, the first video data in temporary buffer is first played after the completion of restarting, the problem of so as to avoid audio and video interim card in the prior art, user experience can effectively be promoted.

Description

Redirect the multi-display method and device of video
Technical field
The present embodiments relate to field of cloud computer technology, in particular to a kind of multihead display redirecting video Method and device.
Background technology
Under the historical background of current cloud computing, VDI (Virtual Desktop Infrastructure, virtual desktop Architecture) application scenarios it is increasingly extensive, VDI relies primarily on the virtual machine that Hypervisor on physical server is marked off, And video and image-capable are very expensive in virtual machine, thus it is common to use video redirecting technique will be in virtual machine The original audio, video data of middle decoding process is transmitted to client, and completing decoding in client renders and show.Currently on the market Common video re-direction applications are essentially all to be broadcast come real-time update client according to the location information of virtual machine broadcast window The position of window is put, still, under the application scenarios of multi-screen expansion, display switching can occur for the window that video redirects, this When video playing frame inside exception handling can restart video playing frame, processing procedure is more complicated and exists and waits for Time, therefore the problem of position of broadcast window will appear audio and video interim card is directly updated using existing method, influence user Experience.
Invention content
The embodiment of the present invention is designed to provide a kind of multi-display method and device redirecting video, to solve Video redirects the problem of audio and video interim card when switching between multi-screen.
To achieve the goals above, technical solution used in the embodiment of the present invention is as follows:
In a first aspect, an embodiment of the present invention provides a kind of multi-display method redirecting video, it is applied to client, The client and server-side communicate to connect, configured with virtual machine player and multiple virtual aobvious in the virtual machine of the server-side Show device, the client is configured with video player and multiple physical displays, the multiple virtual monitor and the multiple Physical display be it is one-to-one, the method includes:Obtain the first video data and the void that the server-side is sent The real-time play position of quasi- machine player;First video data is cached in the video cache area of the client;When When judging that the real-time play position exceeds the indication range of the corresponding present physical display of the video player, according to institute The indication range for stating the real-time play position and the present physical display of virtual machine player, determines first video The corresponding target physical display of target play position and target play position of data;By first video data from described The video cache area of client is added to pre-defined temporary buffer;The video for stopping being carrying out in the client is broadcast Affairs are put, and the video playing frame for controlling the client is restarted;Detect that the video playing frame restarts completion, from institute State and take out first video data in temporary buffer, the target physical display target play position to described One video data plays out.
Second aspect, the embodiment of the present invention additionally provide a kind of multi-display apparatus redirecting video, are applied to client End, the client are communicated to connect with server-side, and virtual machine player and multiple void are configured in the virtual machine of the server-side Quasi- display, the client are configured with video player and multiple physical displays, the multiple virtual monitor and described Multiple physical displays are one-to-one, and described device includes acquisition module, cache module, determining module, execution module, again Open module and playing module.Wherein, acquisition module is used to obtain the first video data that the server-side is sent and described virtual The real-time play position of machine player;Cache module is for delaying the video that first video data is cached in the client It deposits in area;Determining module is used to show beyond the corresponding present physical of the video player when the judgement real-time play position When the indication range of device, the display model of real-time play position and the present physical display according to the virtual machine player It encloses, determines the target play position of first video data and the corresponding target physical display of target play position;It holds Row module from the video cache area of the client for being added first video data to pre-defined temporal cache Area;Module is restarted for stopping the video playing affairs being carrying out in the client, and controls the video of the client Playing frame is restarted;Playing module takes for detecting that the video playing frame restarts completion from the temporary buffer Go out first video data, first video data is broadcast in the target play position of the target physical display It puts.
Compared with the prior art, a kind of multi-display method and device redirecting video provided in an embodiment of the present invention, When judging that the real-time play position of virtual player exceeds the indication range of the corresponding present physical display of video player, When being exactly the window generation physical display switching that video redirects, first the first video data in video cache area is put at this time Enter temporary buffer, then stop the video playing affairs being carrying out in client, the video playing frame of client is carried out Actively restart, compared with prior art, the embodiment of the present invention is by the way of actively restarting video playing frame, processing time It is short, moment screen flicker is only will appear during screens switch, the video of client can be made to redirect window and switched rapidly To the target play position of target physical display, meanwhile, after the completion of video playing frame is restarted, first play temporary buffer In the first video data effectively improve production when switching so as to avoid multi-screen in the prior art the problem of audio and video interim card The user experience of product.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment cited below particularly, and coordinate Appended attached drawing, is described in detail below.
Description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this A little attached drawings obtain other relevant attached drawings.
Fig. 1 shows the schematic diagram that server-side provided in an embodiment of the present invention is interacted with client.
Fig. 2 shows the block diagrams of client provided in an embodiment of the present invention.
Fig. 3 shows the multi-display method flow chart for the redirection video that first embodiment of the invention provides.
Fig. 4 shows the block diagram of the multi-display apparatus for the redirection video that second embodiment of the invention provides.
Icon:10- server-sides;20- clients;11- virtual machine players;12- virtual monitors;30- networks;201- is deposited Reservoir;202- storage controls;203- processors;204- Peripheral Interfaces;205- physical displays;300- redirects the more of video Screen display device;301- acquisition modules;302- cache modules;303- coordinate calculation modules;304- judgment modules;305- determines mould Block;306- execution modules;307- restarts module;308- playing modules.
Specific implementation mode
Below in conjunction with attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete Ground describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Usually exist The component of the embodiment of the present invention described and illustrated in attached drawing can be arranged and be designed with a variety of different configurations herein.Cause This, the detailed description of the embodiment of the present invention to providing in the accompanying drawings is not intended to limit claimed invention below Range, but it is merely representative of the selected embodiment of the present invention.Based on the embodiment of the present invention, those skilled in the art are not doing The every other embodiment obtained under the premise of going out creative work, shall fall within the protection scope of the present invention.
It should be noted that:Similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi It is defined, then it further need not be defined and explained in subsequent attached drawing in a attached drawing.Meanwhile the present invention's In description, term " first ", " second " etc. are only used for distinguishing description, are not understood to indicate or imply relative importance.
Fig. 1 is please referred to, Fig. 1 shows that server-side 10 provided in an embodiment of the present invention is handed over at least one client 20 Mutual schematic diagram.Server-side 10 can be communicated by network 30 with client 20, with realize server-side 10 and client 20 it Between data communication or interaction.In the virtual machine of server-side 10 be configured with virtual machine player 11, meanwhile, server-side 10 it is virtual It is also configured with multiple virtual monitors 12 in machine, server-side 10 can be by network 30 by the video data in virtual machine player 11 Video is redirected to client 20 and completes decoding rendering and display.
In embodiments of the present invention, server-side 10 can be media server, and server-side 10 includes at least one virtual machine, Virtual machine player 11 may be, but not limited to, wmp players, VLC players etc..Client 20 may be, but not limited to, Thin-client, PC (personal computer, PC) etc..The operating system of client 20 may be, but not limited to, Windows systems, linux system etc., client 20 are configured with video player, which may be, but not limited to, Media Player, KMPlayer etc., the broadcast window of video player is exactly the window that video redirects in client 20.
Fig. 2 is please referred to, Fig. 2 shows the block diagrams of client 20 provided in an embodiment of the present invention.Client 20 is wrapped Include multi-display apparatus 300, memory 201, storage control 202, processor 203,204 and of Peripheral Interface for redirecting video Multiple physical displays 205.
The memory 201, storage control 202, processor 203, Peripheral Interface 204 and multiple physical displays 205 Each element is directly or indirectly electrically connected between each other, to realize the transmission or interaction of data.For example, these elements mutually it Between can pass through one or more communication bus or signal wire and realize and be electrically connected.The multi-display apparatus for redirecting video 300 can be stored in the memory 201 or be solidificated in institute including at least one in the form of software or firmware (firmware) State the software function module in the operating system (operating system, OS) of client 20.The processor 203 is for holding The executable module stored in line storage 201, such as the software work(that includes of multi-display apparatus 300 for redirecting video It can module or computer program.
Wherein, memory 201 may be, but not limited to, random access memory (Random Access Memory, RAM), read-only memory (Read Only Memory, ROM), programmable read only memory (Programmable Read-Only Memory, PROM), erasable read-only memory (Erasable Programmable Read-Only Memory, EPROM), Electricallyerasable ROM (EEROM) (Electric Erasable Programmable Read-Only Memory, EEPROM) etc.. Wherein, memory 201 is for storing program, and the processor 203 executes described program after receiving and executing instruction.
Processor 203 can be a kind of IC chip, have signal handling capacity.Above-mentioned processor 203 can be with It is general processor, including central processing unit (Central Processing Unit, CPU), network processing unit (Network Processor, NP), speech processor and video processor etc.;Can also be digital signal processor, application-specific integrated circuit, Field programmable gate array either other programmable logic device, discrete gate or transistor logic, discrete hardware components. It may be implemented or execute disclosed each method, step and the logic diagram in the embodiment of the present invention.General processor can be Microprocessor or the processor 203 can also be any conventional processor etc..
The Peripheral Interface 204 is used to couple various input/output devices to processor 203 and memory 201. In some embodiments, Peripheral Interface 204, processor 203 and storage control 202 can be realized in one single chip.At it In his some examples, they can be realized by independent chip respectively.
Physical display 205 is for playing out the video data that server-side 10 is sent to realize that video redirects, clothes It is engaged in multiple virtual monitors 12 at end 10 and multiple physical displays 205 of client 20 is one-to-one, and resolution ratio Unanimously, when virtual monitor 12, which occurs, for virtual machine player 11 switches, that is to say, that when the broadcasting window of virtual machine player 11 When mouth is moved to 2# virtual monitors 12 by 1# virtual monitors 12, the window that video redirects needs progress physics aobvious accordingly Show that device 205 switches, i.e., the window that video redirects is needed accordingly from 1# physical displays corresponding with 1# virtual monitors 12 205 are moved to 2# physical displays corresponding with 2# virtual monitors 12 205.As an implementation, virtual monitor 12 It may each be the high-definition display screen of 1920*1080 with physical display 205.
First embodiment
Fig. 3 is please referred to, Fig. 3 shows the multi-display method flow for the redirection video that first embodiment of the invention provides Figure.The multi-display method for redirecting video includes the following steps:
Step S101 obtains the real-time play position of the first video data and virtual machine player that server-side is sent.
In embodiments of the present invention, the first video data can be that server-side 10 is currently transmitted to client 20, and will The video data that decoding is rendered and shown is completed in client 20 comprising the video requency frame data and audio frame number evidence of separation.Depending on During frequency redirects, server-side 10 can monitor the location information of virtual machine player 11 in real time, and by real-time position information It is transmitted to client 20, so that client 20 determines the play position of the first video data according to the real-time position information, in turn Keep the broadcasting pictures of client 20 consistent with the broadcasting pictures of virtual machine player 11.
The real-time play position of virtual machine player 11 is server-side 10 according to virtual aobvious where virtual machine player 11 Show what the indication range of device 12 was determined, since the resolution ratio of multiple virtual monitors 12 is consistent, therefore can be according to more The position relationship of a virtual monitor 12 defines the indication range of each virtual monitor 12, for example, server-side 10 laterally and It is longitudinal to be respectively configured with 2 virtual monitors 12, it is assumed that the resolution ratio of virtual monitor 12 is 1920*1080, then 4 virtual displays The indication range of device 12 is respectively (0,1920), (0,1080);(1920,3840)、(0,1080);(0,1920)、(1080, 2160) with (1920,3840), (1080,2160), then server-side 10 can be according to the display according to this 4 virtual monitors 12 Range determines the real-time play position i.e. transverse and longitudinal coordinate section of virtual machine player 11 and is sent to client 20.
It is not often to receive a server-side 10 when the video data that client 20 sends server-side 10 is decoded The video data of transmission is just once decoded, and is susceptible to the discontinuous situation of video playing in this way.In order to ensure that video is broadcast The continuity put, it will usually which the video data that will be decoded is cached.
First video data is cached in the video cache area of client by step S102.
In embodiments of the present invention, video cache area can be the one piece of calculator memory pre-defined in client 20, The video data that video cache area is used to be decoded in cache client 20, can treat solution in order to client 20 in this way The video data of code carries out quick reading process, and the continuity of video playing can be effectively ensured.
It in embodiments of the present invention, can be according to real-time after getting the real-time play position of virtual machine player 11 Relationship between the indication range of the center point coordinate of play position present physical display corresponding with video player is sentenced Whether the real-time play position of disconnected virtual machine player 11 exceeds the display model of the corresponding present physical display of video player It encloses, i.e., whether virtual machine player 11 occurs the switching of virtual monitor 12, and therefore, the embodiment of the present invention can also include step S103 and step S104.
Step S103, the abscissa zone according to real-time play position and ordinate section, calculate real-time play position Center point coordinate.
In embodiments of the present invention, the center point coordinate of real-time play position can be according to the horizontal seat of the real-time play position Mark section and ordinate section are solved, that is to say, that central point abscissa, which is the midpoint of abscissa zone, central point is vertical sits Be designated as the midpoint in ordinate section, for example, in real time play position abscissa zone and ordinate section be respectively (2000, 3600) with (200,980), then the center point coordinate of the real-time play position is (2800,590).
Step S104, judges whether center point coordinate exceeds the display model of the corresponding present physical display of video player It encloses, if so, judging that real-time play position exceeds the indication range of the corresponding present physical display of video player.
In embodiments of the present invention, after the center point coordinate for calculating real-time play position, judge the center point coordinate The indication range for whether exceeding 20 present physical display of client, if the center point coordinate has exceeded 20 current object of client The indication range for managing display then analyzes virtual machine player 11 and the switching of virtual monitor 12 has occurred, for example, present physical The abscissa indication range and ordinate indication range of display are respectively (0,1920) and (0,1080), are with 1920 and 1080 Benchmark, it is seen that the central point abscissa of real-time play position is more than 1920, can be determined that the real-time of virtual machine player 11 at this time Whether play position exceeds the indication range of the corresponding present physical display of video player, i.e. virtual machine player 11 occurs Virtual monitor 12 switches.
It should be pointed out that in the present embodiment, the center point coordinate of real-time play position is more than present physical display Maximum indication range or minimum indication range less than present physical display, think that the center point coordinate has exceeded visitor The indication range of 20 present physical display of family end, maximum indication range include lateral maximum value and longitudinal maximum value, and minimum is aobvious Demonstration is enclosed including lateral minimum value and longitudinal minimum value.That is, central point abscissa occur is more than lateral maximum value, center Point ordinate is more than longitudinal maximum value, central point abscissa is less than lateral minimum value, central point ordinate is less than longitudinal minimum value At least one of, think that the center point coordinate has exceeded the display model of the corresponding present physical display of video player Enclose, for example, the abscissa indication range and ordinate indication range of present physical display be respectively (1920,3840) and (1080,2160), wherein 3840 be lateral maximum value, 1920 be lateral minimum value, 2160 be longitudinal maximum value, 1080 be vertical To minimum value, it is less than as long as central point abscissa occur and being more than 2160, central point abscissa more than 3840, central point ordinate 1920, central point ordinate is less than at least one of 1080, thinks that the center point coordinate has exceeded present physical display Indication range.
Step S105, when the real-time play position of judgement exceeds the display model of the corresponding present physical display of video player When enclosing, the indication range of real-time play position and present physical display according to virtual machine player determines the first video The corresponding target physical display of target play position and target play position of data.
In embodiments of the present invention, when virtual monitor 12, which occurs, for virtual machine player 11 switches, it is corresponding right to need Client 20 carries out physical display 205 and switches, while needing to update visitor according to the real-time play position of virtual machine player 11 The current play position at family end 20.That is, when the switching of virtual monitor 12 occurs for virtual machine player 11, it is thus necessary to determine that Go out client 20 to carry out the target physical display after physical display 205 switches and play on target physical display The target play position of first video data.
It in embodiments of the present invention, can be according to the real-time play position of virtual machine player 11 and working as video player Position coordinates difference between preceding play position determines the target play position of the first video data.Specifically, position coordinates Difference includes abscissa difference and ordinate difference, wherein abscissa difference provides waiting for for the current play position of client 20 Mobile abscissa, the ordinate to be moved that ordinate difference provides the current play position of client 20 therefore can be according to this Abscissa difference moves the current play position of client 20 according to abscissa to be moved, while according to Diff N It is different, the current play position of client 20 is moved according to ordinate to be moved, the mesh of the first video data can be obtained Mark play position.For example, the abscissa zone and ordinate section of the real-time play position of virtual machine player 11 are respectively (2000,3600) and (200,980), the abscissa zone and ordinate section of the current play position of client 20 are respectively (1000,2600) and (500,1280), it is seen that abscissa difference is the abscissa of current play position need to deviate 1000 to the left, indulge Coordinate difference, which is the ordinate of current play position, need to offset up 300, therefore, by the abscissa of current play position to left avertence It moves 1000, ordinate and offsets up 300, you can obtain the target play position of the first video data.
In embodiments of the present invention, can according to virtual machine player 11 real-time play position it is corresponding with video player Present physical display indication range, determine the corresponding target physical display of target play position.Specifically, first First, the center point coordinate of real-time play position can be calculated, center point coordinate can be according to the abscissa of the real-time play position Section and ordinate section are solved, that is to say, that central point abscissa is the midpoint of abscissa zone, central point ordinate For the midpoint in ordinate section, for example, the abscissa zone and ordinate section of play position are respectively (200,2120) in real time (0,1080), then the center point coordinate of the real-time play position is (1160,540);Then, corresponding according to video player The indication range of present physical display determines that reference coordinate, reference coordinate can be the indication ranges of present physical display The abscissa and ordinate of middle minimum, for example, it is assumed that 20 landscape configuration of client has multiple physical displays 205, present physical Display is 2# displays, and abscissa indication range and ordinate indication range are respectively (1920,3840) and (0,1080), Then reference coordinate is (1920,0) at this time, that is to say, that it is 1920 to refer to abscissa, is 0 with reference to ordinate;Next, it is judged that The size of center point coordinate and reference coordinate, if center point coordinate be less than reference coordinate, by with present physical display Indication range continuously previous physical display 205 be used as target physical display, for example, center point coordinate be (1160, 540), reference coordinate is (1920,0), and since 1160 are less than 1920, then target physical display is 1# displays, abscissa Indication range and ordinate indication range are respectively (0,1920) and (0,1080);If center point coordinate be more than reference coordinate and Center point coordinate exceed present physical display indication range, then by with the indication range of present physical display it is continuous after One physical display 205 is used as target physical display, for example, center point coordinate is (4000,540), reference coordinate is (1920,0) are more than 1920 and the indication range (1920,3080) beyond present physical display, then target physical due to 4000 Display is 3# displays, and abscissa indication range and ordinate indication range are respectively (3840,5760) and (0,1080).
It should be pointed out that the determination process of above-mentioned target physical display is that have multiple objects with 20 landscape configuration of client It is illustrated for reason display 205, when client 20 is longitudinal configured with multiple physical displays 205 or laterally longitudinal When simultaneously configured with multiple physical displays 205, the determination process of target physical display is similar with the above process, herein no longer It repeats.
Under the application scenarios of multi-screen expansion, when virtual monitor 12, which occurs, for virtual machine player 11 switches, phase is needed That answers carries out the switching of physical display 205 to client 20, the video playing frame of client 20 when physical display 205 switches It needs to reconnect renderer, therefore usually requires to restart the video playing frame of client 20, but restart client 20 Video playing frame means that the video playing position of script in client 20 is changed, so when video cache area in The video data of script just needs to be updated to current video data to be played, that is to say, that the video data of script needs clear Sky, but the Hua Pinghuo nonsynchronous problems of audio and video within a certain period of time can be caused in this way.To solve this problem, it needs to cache Script video data in area is stored, and plays the video data of script in video cache area first after the completion of restarting.
First video data is added from the video cache area of client to pre-defined temporal cache step S106 Area.
In embodiments of the present invention, temporary buffer can be the one piece of calculator memory pre-defined in client 20, The temporary buffer and video cache area are independent two pieces of calculator memories, and the two does not have an impact mutually.Temporary buffer It can be used for when the progress video playing frame of client 20 is restarted, the first video data in buffered video buffer area.
Step S107 stops the video playing affairs being carrying out in client, and controls the video display frame of client Frame is restarted.
In embodiments of the present invention, the first video data is added from the video cache area of client 20 to pre-defined After temporary buffer, the video playing frame of client 20 actively restart.That is, stopping in client 20 just In the video playing affairs of execution, and the video playing frame for controlling client 20 is restarted to empty video cache area, specific next It says, is first shut off original video reproduction program in client 20, then restart the video decoding frame of client 20, and again Transmit the parameter that video decoding needs.Video playing frame may be, but not limited to, Directshow playing frames.
In the prior art, under the application scenarios of multi-screen expansion, when screens switch occurs for the window that video redirects, visitor The video playing frame at family end 20 can also restart, but it is this restart be by the exception handling inside video playing frame into Row processing, processing procedure is more complicated and there are the stand-by period, therefore processing time is longer, therefore will appear audio and video interim card The problem of, influence user experience and product quality.And in such a way that the active introduced in the embodiment of the present invention is restarted, when processing Between it is short, moment screen flicker is only will appear during screens switch, effectively improves the user experience of product.
Step S108 detects that the video playing frame restarts completion, and described first is taken out from temporary buffer and is regarded Frequency evidence is played out in the first video data of target play position pair of target physical display.
In embodiments of the present invention, after the completion of detecting that the video playing frame of client 20 is restarted, from pre-defined The first video data is taken out in temporary buffer, and is played out in the target play position of target physical display.Due to visitor After screens switch occurs for family end 20, restart first to play out the first video data of temporary buffer when playing, this Sample is it is possible to prevente effectively from flower screen or the within a certain period of time nonsynchronous problem of audio and video.
Compared with prior art, the embodiment of the present invention has the advantages that:
First, aobvious beyond the corresponding present physical of video player in the real-time play position of judgement virtual machine player 11 When showing the indication range of device, analyzes virtual machine player 11 and the switching of virtual monitor 12 occurs, video redirects aobvious at this time Show that window needs the corresponding physical display 205 that carries out to switch, actively weight is carried out by the video playing frame to client 20 It opens, the target play position of target physical display is switched to rapidly to make the video of client 20 redirect window, it can be with Effectively solve the problems, such as audio and video interim card when video redirection is moved between multi-screen, the user experience is improved;
Secondly, aobvious beyond the corresponding present physical of video player in the real-time play position of judgement virtual machine player 11 When showing the indication range of device, analyze virtual machine player 11 occur virtual monitor 12 switch when, by the first video data from The video cache area of client 20 is added to pre-defined temporary buffer, and restarts in the video playing frame of client 20 After the completion, the first video data is taken out from temporary buffer to play out in target play position, it is possible to prevente effectively from flower screen Or the nonsynchronous problem of audio and video within a certain period of time.
Second embodiment
Fig. 4 is please referred to, Fig. 4 shows the multi-display apparatus 300 for the redirection video that second embodiment of the invention provides Block diagram.The multi-display apparatus 300 for redirecting video includes acquisition module 301, cache module 302, coordinate calculating Module 303, determining module 305, execution module 306, restarts module 307 and playing module 308 at judgment module 304.
Acquisition module 301, the real-time broadcasting of the first video data and virtual machine player for obtaining server-side transmission Position.
Cache module 302, for the first video data to be cached in the video cache area of client.
Coordinate calculation module 303 is used for the abscissa zone according to real-time play position and ordinate section, calculates real-time The center point coordinate of play position.
Judgment module 304, for judging whether center point coordinate exceeds the corresponding present physical display of video player Indication range, if so, judge real-time play position exceed the corresponding present physical display of video player display model It encloses.
Determining module 305, for exceeding the corresponding present physical display of video player when the real-time play position of judgement Indication range when, according to virtual machine player real-time play position and present physical display indication range, determine The corresponding target physical display of target play position and target play position of first video data.
In embodiments of the present invention, determining module 305 is specifically used for, and obtains the current play position of video player, In, current play position is on the present physical display;Real-time play position according to virtual machine player is broadcast with video The position coordinates difference between the current play position of device is put, determines the target play position of the first video data;According to virtual The indication range of the real-time play position present physical display corresponding with video player of machine player determines that target plays The corresponding target physical display in position.Execution module 306, for adding the first video data from the video cache area of client Enter to pre-defined temporary buffer.
Restart module 307, the video playing affairs for stopping being carrying out in client, and control the video of client Playing frame is restarted.
Playing module 308 takes out for detecting that the video playing frame restarts completion from the temporary buffer First video data is played out in the first video data of target play position pair of target physical display.
The embodiment of the present invention further discloses a kind of computer readable storage medium, is stored thereon with computer program, described The multihead display side for the redirection video that present invention discloses is realized when computer program is executed by processor 203 Method.
In conclusion a kind of multi-display method and device redirecting video provided in an embodiment of the present invention, is applied to Client, client and server-side communicate to connect, configured with virtual machine player and multiple virtual aobvious in the virtual machine of server-side Show that device, client are configured with video player and multiple physical displays, multiple virtual monitors and multiple physical displays are Correspondingly, method includes:Obtain the real-time play position of the first video data and virtual machine player that server-side is sent; First video data is cached in the video cache area of client;When the real-time play position of judgement is corresponded to beyond video player Present physical display indication range when, real-time play position and present physical display according to virtual machine player The current play position of indication range determines the target play position and the corresponding mesh of target play position of the first video data Mark physical display;First video data is added from the video cache area of client to pre-defined temporary buffer;Stop The video playing affairs being only carrying out in client, and the video playing frame for controlling client is restarted;Detect described regard Frequency playing frame restarts completion, and the first video data is taken out from temporary buffer, is played in the target of target physical display The first video data of position pair plays out.Compared with prior art, the real-time of judgement of embodiment of the present invention virtual player is broadcast When putting indication range of the position beyond the corresponding present physical display of video player, the window hair of video redirection is analyzed Raw physical display switching to the video playing frame of client actively restart, to make the video of client redirect Window switches to rapidly the target play position of target physical display, the problem of avoiding audio and video interim card, can effectively carry Rise user experience.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, the flow chart in attached drawing and block diagram Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product, Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code Part, a part for the module, section or code, which includes that one or more is for implementing the specified logical function, to be held Row instruction.It should also be noted that at some as in the realization method replaced, the function of being marked in box can also be to be different from The sequence marked in attached drawing occurs.For example, two continuous boxes can essentially be basically executed in parallel, they are sometimes It can execute in the opposite order, this is depended on the functions involved.It is also noted that every in block diagram and or flow chart The combination of box in a box and block diagram and or flow chart can use function or the dedicated base of action as defined in executing It realizes, or can be realized using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each function module in each embodiment of the present invention can integrate to form an independent portion Point, can also be modules individualism, can also two or more modules be integrated to form an independent part.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module It is stored in a computer read/write memory medium.Based on this understanding, technical scheme of the present invention is substantially in other words The part of the part that contributes to existing technology or the technical solution can be expressed in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention. And storage medium above-mentioned includes:USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic disc or CD.It needs Illustrate, herein, relational terms such as first and second and the like be used merely to by an entity or operation with Another entity or operation distinguish, and without necessarily requiring or implying between these entities or operation, there are any this realities The relationship or sequence on border.Moreover, the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability Contain, so that the process, method, article or equipment including a series of elements includes not only those elements, but also includes Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device. In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element Process, method, article or equipment in there is also other identical elements.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, any made by repair Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.It should be noted that:Similar label and letter exist Similar terms are indicated in following attached drawing, therefore, once being defined in a certain Xiang Yi attached drawing, are then not required in subsequent attached drawing It is further defined and is explained.

Claims (10)

1. a kind of multi-display method redirecting video, which is characterized in that be applied to client, the client and server-side It communicates to connect, virtual machine player and multiple virtual monitors is configured in the virtual machine of the server-side, the client is matched It is equipped with video player and multiple physical displays, the multiple virtual monitor and the multiple physical display are an a pair It answers, the method includes:
Obtain the real-time play position of the first video data and the virtual machine player that the server-side is sent;
First video data is cached in the video cache area of the client;
When judging that the real-time play position exceeds the indication range of the corresponding present physical display of the video player, The indication range of real-time play position and the present physical display according to the virtual machine player determines described The corresponding target physical display of target play position and target play position of one video data;
First video data is added from the video cache area of the client to pre-defined temporary buffer;
Stop the video playing affairs being carrying out in the client, and controls the video playing frame weight of the client It opens;
It detects that the video playing frame restarts completion, first video data is taken out from the temporary buffer, The target play position of the target physical display plays out first video data.
2. the method as described in claim 1, which is characterized in that described when the judgement real-time play position exceeds the video When the indication range of the corresponding present physical display of player, the real-time play position according to the virtual machine player and institute The indication range for stating present physical display determines the target play position and target play position of first video data Before the step of corresponding target physical display, the method further includes:
Abscissa zone according to the real-time play position and ordinate section calculate the central point of the real-time play position Coordinate;
Judge whether the center point coordinate exceeds the indication range of the corresponding present physical display of the video player;
If so, the judgement real-time play position exceeds the display model of the corresponding present physical display of the video player It encloses.
3. the method as described in claim 1, which is characterized in that the real-time play position according to the virtual machine player With the indication range of the present physical display, determine that the target play position of first video data and target play The step of corresponding target physical display in position, including:
Obtain the current play position of the video player, wherein the current play position is shown in the present physical On device;
According to the position between the real-time play position and the current play position of the video player of the virtual machine player Coordinate difference is set, determines the target play position of first video data;
Real-time play position present physical display corresponding with the video player according to the virtual machine player Indication range determines the corresponding target physical display of the target play position.
4. method as claimed in claim 3, which is characterized in that the position coordinates difference includes abscissa difference and ordinate Difference, the abscissa difference provide the abscissa to be moved of the current play position of the video player, the ordinate Difference provides the ordinate to be moved of the current play position of the video player;
The real-time play position according to virtual machine player current play position corresponding with the video player Between position coordinates difference, the step of determining the target play position of first video data, including:
According to the abscissa difference, the current play position of the video player is moved according to abscissa to be moved It is dynamic;
According to the ordinate difference, the current play position of the video player is moved according to ordinate to be moved It is dynamic, obtain the target play position of first video data.
5. method as claimed in claim 3, which is characterized in that the real-time play position according to the virtual machine player The indication range of present physical display corresponding with the video player determines the corresponding target of the target play position The step of physical display, including:
Abscissa zone according to the real-time play position and ordinate section calculate the central point of the real-time play position Coordinate;
According to the indication range of the corresponding present physical display of the video player, reference coordinate is determined;
It, will be continuous with the indication range of the present physical display when the center point coordinate is less than the reference coordinate Previous physical display is as target physical display;
When the center point coordinate is more than the reference coordinate, and the center point coordinate is beyond the present physical display When indication range, using with the continuous the latter physical display of the indication range of the present physical display as target physical Display.
6. a kind of multi-display apparatus redirecting video, which is characterized in that be applied to client, the client and server-side It communicates to connect, virtual machine player and multiple virtual monitors is configured in the virtual machine of the server-side, the client is matched It is equipped with video player and multiple physical displays, the multiple virtual monitor and the multiple physical display are an a pair It answers, described device includes:
Acquisition module, the real-time broadcasting for obtaining the first video data and the virtual machine player that the server-side is sent Position;
Cache module, for first video data to be cached in the video cache area of the client;
Determining module, for exceeding the corresponding present physical display of the video player when the judgement real-time play position Indication range when, the display model of real-time play position and the present physical display according to the virtual machine player It encloses, determines the target play position of first video data and the corresponding target physical display of target play position;
Execution module is faced for being added first video data to pre-defined from the video cache area of the client When buffer area;
Restart module, the video playing affairs for stopping being carrying out in the client, and control regarding for the client Frequency playing frame is restarted;
Playing module takes out described for detecting that the video playing frame restarts completion from the temporary buffer One video data plays out first video data in the target play position of the target physical display.
7. device as claimed in claim 6, which is characterized in that described device further includes:
Coordinate calculation module is used for the abscissa zone according to the real-time play position and ordinate section, calculates the reality When play position center point coordinate;
Judgment module, for judging whether the center point coordinate exceeds the corresponding present physical display of the video player Indication range, if so, the judgement real-time play position exceeds the corresponding present physical display of the video player Indication range.
8. device as claimed in claim 6, which is characterized in that the determining module is specifically used for:
Obtain the current play position of the video player, wherein the current play position is shown in the present physical On device;
According to the position between the real-time play position and the current play position of the video player of the virtual machine player Coordinate difference is set, determines the target play position of first video data;
Real-time play position present physical display corresponding with the video player according to the virtual machine player Indication range determines the corresponding target physical display of the target play position.
9. device as claimed in claim 8, which is characterized in that the position coordinates difference includes abscissa difference and ordinate Difference, the abscissa difference provide the abscissa to be moved of the current play position of the video player, the ordinate Difference provides the ordinate to be moved of the current play position of the video player;
The determining module executes the current of real-time play position according to the virtual machine player and the video player Position coordinates difference between play position determines the mode of the target play position of first video data, including:
According to the abscissa difference, the current play position of the video player is moved according to abscissa to be moved It is dynamic;
According to the ordinate difference, the current play position of the video player is moved according to ordinate to be moved It is dynamic, obtain the target play position of first video data.
10. device as claimed in claim 8, which is characterized in that the determining module is executed according to the virtual machine player Real-time play position present physical display corresponding with the video player indication range, determine that the target plays The mode of the corresponding target physical display in position, including:
Abscissa zone according to the real-time play position and ordinate section calculate the central point of the real-time play position Coordinate;
According to the indication range of the corresponding present physical display of the video player, reference coordinate is determined;
It, will be continuous with the indication range of the present physical display when the center point coordinate is less than the reference coordinate Previous physical display is as target physical display;
When the center point coordinate is more than the reference coordinate, and the center point coordinate is beyond the present physical display When indication range, using with the continuous the latter physical display of the indication range of the present physical display as target physical Display.
CN201810291613.3A 2018-03-30 2018-03-30 Multi-screen display method and device for redirecting video Active CN108521604B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810291613.3A CN108521604B (en) 2018-03-30 2018-03-30 Multi-screen display method and device for redirecting video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810291613.3A CN108521604B (en) 2018-03-30 2018-03-30 Multi-screen display method and device for redirecting video

Publications (2)

Publication Number Publication Date
CN108521604A true CN108521604A (en) 2018-09-11
CN108521604B CN108521604B (en) 2020-12-08

Family

ID=63431135

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810291613.3A Active CN108521604B (en) 2018-03-30 2018-03-30 Multi-screen display method and device for redirecting video

Country Status (1)

Country Link
CN (1) CN108521604B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109522070A (en) * 2018-10-29 2019-03-26 联想(北京)有限公司 Display processing method and system
CN112637681A (en) * 2020-12-22 2021-04-09 新华三大数据技术有限公司 Video redirection method and device
CN112650462A (en) * 2020-12-29 2021-04-13 展讯半导体(南京)有限公司 Image processing method and device, electronic device and storage medium

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105308536A (en) * 2013-01-15 2016-02-03 厉动公司 Dynamic user interactions for display control and customized gesture interpretation
CN105338291A (en) * 2014-07-29 2016-02-17 杭州海康威视数字技术股份有限公司 Method and device for processing virtual tiled screen
CN105574744A (en) * 2016-01-29 2016-05-11 上海云活科技有限公司 Multi-screen interactive video shopping method
CN105611394A (en) * 2015-12-21 2016-05-25 福建时迅信息科技有限公司 Method and system for redirecting video under VDI environment
CN105791892A (en) * 2016-03-02 2016-07-20 汉柏科技有限公司 Video redirecting method based on desktop cloud, cloud server and video redirecting system
CN106210865A (en) * 2016-07-08 2016-12-07 中霆云计算科技(上海)有限公司 A kind of video reorientation method and system presenting agreement based on remote desktop
CN106851282A (en) * 2017-02-15 2017-06-13 福建时迅信息科技有限公司 The method and system of encoding video pictures data volume is reduced in a kind of VDI agreements
CN107018137A (en) * 2017-04-07 2017-08-04 成都长天信息技术有限公司 A kind of Flash reorientation methods and device
CN107077311A (en) * 2014-10-17 2017-08-18 微软技术许可有限责任公司 Input signal is emulated
US9892589B2 (en) * 2011-10-14 2018-02-13 Bally Gaming, Inc. System and method for cross platform persistent gaming sessions using a mobile device
CN107809671A (en) * 2017-11-20 2018-03-16 深圳市青葡萄科技有限公司 Video is redirected to the method and system of server decoding under a kind of virtualized environment

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9892589B2 (en) * 2011-10-14 2018-02-13 Bally Gaming, Inc. System and method for cross platform persistent gaming sessions using a mobile device
CN105308536A (en) * 2013-01-15 2016-02-03 厉动公司 Dynamic user interactions for display control and customized gesture interpretation
CN105338291A (en) * 2014-07-29 2016-02-17 杭州海康威视数字技术股份有限公司 Method and device for processing virtual tiled screen
CN107077311A (en) * 2014-10-17 2017-08-18 微软技术许可有限责任公司 Input signal is emulated
CN105611394A (en) * 2015-12-21 2016-05-25 福建时迅信息科技有限公司 Method and system for redirecting video under VDI environment
CN105574744A (en) * 2016-01-29 2016-05-11 上海云活科技有限公司 Multi-screen interactive video shopping method
CN105791892A (en) * 2016-03-02 2016-07-20 汉柏科技有限公司 Video redirecting method based on desktop cloud, cloud server and video redirecting system
CN106210865A (en) * 2016-07-08 2016-12-07 中霆云计算科技(上海)有限公司 A kind of video reorientation method and system presenting agreement based on remote desktop
CN106851282A (en) * 2017-02-15 2017-06-13 福建时迅信息科技有限公司 The method and system of encoding video pictures data volume is reduced in a kind of VDI agreements
CN107018137A (en) * 2017-04-07 2017-08-04 成都长天信息技术有限公司 A kind of Flash reorientation methods and device
CN107809671A (en) * 2017-11-20 2018-03-16 深圳市青葡萄科技有限公司 Video is redirected to the method and system of server decoding under a kind of virtualized environment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
周毅: "《基于KVM的桌面虚拟化VDI研究以及实现》", 《中国优秀硕士学位论文全文数据库》 *
徐斌: "《都江堰市教育局教育云桌面系统的设计与实现》", 《中国优秀硕士学位论文全文数据库》 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109522070A (en) * 2018-10-29 2019-03-26 联想(北京)有限公司 Display processing method and system
CN109522070B (en) * 2018-10-29 2021-07-16 联想(北京)有限公司 Display processing method and system
CN112637681A (en) * 2020-12-22 2021-04-09 新华三大数据技术有限公司 Video redirection method and device
CN112637681B (en) * 2020-12-22 2022-02-22 新华三大数据技术有限公司 Video redirection method and device
CN112650462A (en) * 2020-12-29 2021-04-13 展讯半导体(南京)有限公司 Image processing method and device, electronic device and storage medium
CN112650462B (en) * 2020-12-29 2022-11-04 展讯半导体(南京)有限公司 Image processing method and device, electronic device and storage medium

Also Published As

Publication number Publication date
CN108521604B (en) 2020-12-08

Similar Documents

Publication Publication Date Title
US11586345B2 (en) Method and apparatus for interaction control of display page
CN112261226B (en) Horizontal screen interaction method and device, electronic equipment and storage medium
US8607158B2 (en) Content presentation in remote monitoring sessions for information technology systems
US9940898B2 (en) Variable refresh rate video capture and playback
CN111277845B (en) Game live broadcast control method and device, computer storage medium and electronic equipment
CN109275011B (en) Processing method and device for switching motion modes of smart television and user equipment
CN108600800B (en) Smart television and starting method thereof
US20160307605A1 (en) Method, device, and system of synchronously playing media file
CN108521604A (en) Redirect the multi-display method and device of video
CN103618959A (en) Method and device for video playing
US9460486B2 (en) Image display system, information processing device, server, and image processing method
CN111901832B (en) Wireless screen projection module and screen projection method of all-in-one machine
US20160269674A1 (en) Dynamic Video Capture Rate Control
WO2017202175A1 (en) Method and device for video compression and electronic device
US20240118794A1 (en) Control display method, apparatus, and device, and medium
WO2021190319A1 (en) Interface access method, display apparatus, and electronic device
US20150045119A1 (en) Server and method for providing a video game
CN110401877B (en) Video playing control method and device, electronic equipment and storage medium
US10110887B2 (en) Display diagnostics for enhancing performance of display devices
US20240143649A1 (en) Multimedia information processing method, apparatus, electronic device, and medium
CN108519900A (en) display window control method, device and server
CN112866809A (en) Video processing method and device, electronic equipment and readable storage medium
CN109600655A (en) Method, applications client and the electronic equipment that barrage is shown in applications client
CN112804410A (en) Multi-display-screen synchronous display method and device, video processing equipment and storage medium
CN108563479A (en) Redirect control method, device, virtual machine and the Redirectional system of window

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant