CN109600623A - The control method and system of VR live video - Google Patents
The control method and system of VR live video Download PDFInfo
- Publication number
- CN109600623A CN109600623A CN201811367241.4A CN201811367241A CN109600623A CN 109600623 A CN109600623 A CN 109600623A CN 201811367241 A CN201811367241 A CN 201811367241A CN 109600623 A CN109600623 A CN 109600623A
- Authority
- CN
- China
- Prior art keywords
- frame
- picture
- video flowing
- regional display
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
Abstract
The invention discloses a kind of control methods of VR live video, and method: server carries out motion detection to video flowing, determines the moving region of moving object；The first picture of any frame is chosen from video flowing, and first area corresponding with moving region is determined in first picture of frame；First area in first picture is sheared, the first picture after definition shearing is background frame；Intercept every the first picture of frame regional display corresponding with moving region；Background frame, regional display are sent to client；Client is directed to every frame regional display, and background frame and regional display are spliced into complete picture, and all complete pictures are formed the first video flowing；First video flowing is rendered and is exported.The invention also discloses a kind of control systems of VR live video.Method and system of the invention greatly reduces the data volume that server is issued to client under the premise of not influencing the clarity of client terminal playing VR live video, alleviates the bandwidth pressure that server issues data.
Description
Technical field
The present invention relates to communication technique field more particularly to a kind of control methods and system of VR live video.
Background technique
Network direct broadcasting is very hot at present, it is stated that the just prosperous live streaming platform of public attention has reached 116.It is emerging with VR
It rises, VR live video also can slowly prevail.This 360 degree of panoramic effects of VR can bring completely new experience to viewer, must
It is well-established greatly by general sieve that a kind of new direct-seeding will be become.
VR live video needs to complete 360 ° of panorama material collection, and for now, the acquisition of VR panoramic video is general
It is acquired by multiple wide-angle lens.Then a complete panoramic video is spliced by computer graphics algorithm.
VR video uses spherical projection mode at present, only watches in a portion picture when being watched by VR terminal
Hold.Therefore under the premise of image sharpness is identical, the resolution ratio of the resolution ratio tradition live video of VR live video is bigger.
Under conditions of i.e. real-time broadcasting pictures clarity same video, VR live video needs bigger network to pass than traditional live video
Defeated bandwidth brings very big pressure to current network bandwidth.
Summary of the invention
It is bigger compared to traditional live video needs it is a primary object of the present invention to solve VR live video in the prior art
Network transmission bandwidth, the technical issues of bringing very big pressure to current network bandwidth.
To achieve the above object, the present invention provides a kind of control method of VR live video, the control of the VR live video
Method processed includes:
Server carries out motion detection to the video flowing received, determines the moving region of moving object in video flowing；
The first picture of any frame is chosen from the video flowing, the determining and moving region pair in first picture of frame
The first area answered；
First area described in first picture is sheared, the first picture after definition shearing is background frame；
Intercept regional display corresponding with the moving region in the first picture of each frame of the video flowing；
The regional display that the background frame and each frame intercept is issued to client；
Client is directed to each frame regional display, and it is complete that the background frame with corresponding regional display is spliced to form a frame
All complete pictures are formed spliced first video flowing by whole picture；
Rendering output is carried out to first video flowing.
Preferably, the server moves the video flowing using optical flow method, frame difference method or background subtraction
Detection, to determine the moving region of moving object in video flowing.
Preferably, the corresponding regional display of first picture of each frame carries corresponding the first picture of frame in the video
Timestamp in stream；
All complete pictures are formed spliced first video flowing and specifically included by the client:
The timestamp that the client is carried according to the corresponding regional display of every frame complete picture, by all complete pictures
Form spliced first video flowing.
In addition, to achieve the above object, the present invention also provides a kind of control system of VR live video, the VR live streaming view
The control system of frequency includes:
Server determines the motor area of moving object in video flowing for carrying out motion detection to the video flowing received
Domain；The first picture of any frame is chosen from the video flowing, determination is corresponding with the moving region in first picture of frame
First area；First area described in first picture is sheared, the first picture after definition shearing is background frame；
Intercept regional display corresponding with the moving region in the first picture of each frame of the video flowing；By the background frame,
And the regional display of each frame interception is issued to client；
Client, for receiving the background frame and the regional display that the server issues；For each frame
The background frame is spliced to form a frame complete picture with corresponding regional display, by all complete pictures by regional display
Form spliced first video flowing；And rendering output is carried out to first video flowing.
Preferably, the server moves the video flowing using optical flow method, frame difference method or background subtraction
Detection, to determine the moving region of moving object in video flowing.
Preferably, the corresponding regional display of first picture of each frame carries corresponding the first picture of frame in the video
Timestamp in stream；
The server will own specifically for the timestamp carried according to the corresponding regional display of every frame complete picture
Complete picture form spliced first video flowing.
The control method and system of VR live video provided by the present invention flow into the video received by server
Row motion detection determines the moving region of moving object in video flowing；The first picture of any frame is chosen from the video flowing,
First area corresponding with the moving region is determined in first picture of frame；To first area described in first picture into
Row shearing, the first picture after definition shearing are background frame；Intercept in the first picture of each frame of the video flowing with it is described
The corresponding regional display in moving region；The regional display that the background frame and each frame intercept is issued to client；Visitor
Family end is directed to each frame regional display, and the background frame is spliced to form a frame complete picture with corresponding regional display, will
All complete pictures form spliced first video flowing；The mode that rendering output is carried out to first video flowing, not
Under the premise of the clarity for influencing client terminal playing VR live video, the data that server is issued to client are greatly reduced
Amount, alleviates the bandwidth pressure that server issues data.
Detailed description of the invention
Fig. 1 is the flow diagram of one embodiment of control method of VR live video of the invention；
Fig. 2 is the structural schematic diagram of one embodiment of control system of VR live video of the invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
Below in conjunction with Figure of description, preferred embodiment of the present invention will be described, it should be understood that described herein
Preferred embodiment only for the purpose of illustrating and explaining the present invention and is not intended to limit the present invention, and in the absence of conflict, this hair
The feature in embodiment and embodiment in bright can be combined with each other.
The present invention provides a kind of control method of VR live video.Referring to Fig.1, Fig. 1 is VR live video of the invention
The flow diagram of one embodiment of control method.In one embodiment, the control method of the VR live video includes:
Step S10: server carries out motion detection to the video flowing received, determines the movement of moving object in video flowing
Region.
Server described in the present embodiment carries out the video flowing using optical flow method, frame difference method or background subtraction
Motion detection, to determine the moving region of moving object in video flowing, it is preferred to use background subtraction.Concrete processing procedure is such as
Under: motion detection is carried out to video flowing, determines the moving object in video flowing；For each frame picture in video flowing, determine
The moving object region (encoding and decoding of video flowing are by the way of rectangle for now), where the moving object
Region is the minimum rectangular area that can accommodate the moving object；4 vertex for calculating the moving object region exist
Coordinate in corresponding frame picture；According to 4 vertex of moving object region described in every frame picture in corresponding frame picture
Coordinate, determine that (the entire every frame picture size of video flowing is consistent, aobvious for the moving region of moving object described in entire video flowing
Display position is consistent in display screen during showing).Wherein the moving region is that can contain movement described in every frame picture
The minimum rectangle moving region of object region.
Step S20: choosing the first picture of any frame from the video flowing, the determining and fortune in first picture of frame
The dynamic corresponding first area in region.
Step S30: shearing first area described in first picture, and the first picture after definition shearing is back
Scape picture.
Step S40: regional display corresponding with the moving region in the first picture of each frame of the video flowing is intercepted.
The corresponding regional display of each the first picture of frame described in the present embodiment carries corresponding the first picture of frame described
Timestamp in video flowing.
Step S50: the regional display that the background frame and each frame intercept is issued to client.
Step S60: the client is directed to each frame regional display, and the background frame is spelled with corresponding regional display
It connects to form a frame complete picture, all complete pictures is formed into spliced first video flowing.
It is first after client described in the present embodiment receives the background frame and the regional display that server issues
First the background frame and the regional display are decoded, then execute the step S60 step again.I.e. above-mentioned client
After to the background frame and regional display decoding, for the regional display after each frame decoding, by decoded institute
It states background frame and is spliced to form a frame complete picture with corresponding decoded regional display, all complete pictures are formed and are spelled
The first video flowing after connecing.
All complete pictures are formed spliced first video flowing and specifically included by client described in the present embodiment: institute
The timestamp that client is carried according to the corresponding regional display of every frame complete picture is stated, all complete pictures are formed into the spelling
The first video flowing after connecing.
Step S70: rendering output is carried out to first video flowing.
The control method of VR live video provided by above-described embodiment carries out the video flowing received by server
Motion detection determines the moving region of moving object in video flowing；The first picture of any frame is chosen from the video flowing, at this
First area corresponding with the moving region is determined in the first picture of frame；First area described in first picture is carried out
Shearing, the first picture after definition shearing are background frame；Intercept in the first picture of each frame of the video flowing with the fortune
The dynamic corresponding regional display in region；The regional display that the background frame and each frame intercept is issued to client；Client
End is directed to each frame regional display, the background frame is spliced to form a frame complete picture with corresponding regional display, by institute
By complete picture form spliced first video flowing；The mode that rendering output is carried out to first video flowing, in not shadow
Under the premise of the clarity for ringing client terminal playing VR live video, the data that server is issued to client are greatly reduced
Amount, alleviates the bandwidth pressure that server issues data.
The present invention further provides a kind of control systems of VR live video.Referring to Fig. 2, Fig. 2 is that VR of the invention is broadcast live
The structural schematic diagram of one embodiment of control system of video.In one embodiment, the control system 100 of the VR live video is wrapped
It includes: server 110 and client 120.Wherein, the server 110, for carrying out motion detection to the video flowing received,
Determine the moving region of moving object in video flowing；The first picture of any frame is chosen from the video flowing, is drawn in the frame first
First area corresponding with the moving region is determined in face；First area described in first picture is sheared, it is fixed
The first picture after justice shearing is background frame；Intercept in the first picture of each frame of the video flowing with the moving region pair
The regional display answered；The regional display that the background frame and each frame intercept is issued to client 120.The client
End 120, for receiving the background frame and the regional display that the server 110 issues；It is drawn for each frame region
The background frame is spliced to form a frame complete picture with corresponding regional display by face, and all complete pictures are formed and are spelled
The first video flowing after connecing；And rendering output is carried out to first video flowing.
Server 110 described in the present embodiment flows into the video using optical flow method, frame difference method or background subtraction
Row motion detection, to determine the moving region of moving object in video flowing.It is preferred that using background subtraction.Concrete processing procedure is such as
Under: the server 110 carries out motion detection to video flowing, determines the moving object in video flowing；For every in video flowing
One frame picture determines the moving object region (encoding and decoding of video flowing are by the way of rectangle for now), institute
Stating moving object region is the minimum rectangular area that can accommodate the moving object；Calculate the moving object location
Coordinate of 4 vertex in domain in corresponding frame picture；Existed according to 4 vertex of moving object region described in every frame picture
Coordinate in corresponding frame picture, determines moving region (the entire every frame picture of video flowing of moving object described in entire video flowing
In the same size, display position is consistent in display screen during display).Wherein the moving region is that can contain every frame to draw
The minimum rectangle moving region of moving object region described in face.
Client 120 described in the present embodiment receives the background frame that server 110 issues and the region is drawn
Behind face, the background frame and the regional display are decoded first, then executed again described for each frame region picture
The background frame is spliced to form a frame complete picture with corresponding regional display by face, and all complete pictures are formed and are spelled
The operation of the first video flowing after connecing.I.e. above-mentioned client 120 is after to the background frame and regional display decoding, needle
To the regional display after each frame decoding, the decoded background frame is spliced into shape with corresponding decoded regional display
At a frame complete picture, all complete pictures are formed into spliced first video flowing.
The corresponding regional display of each the first picture of frame described in the present embodiment carries corresponding the first picture of frame described
Timestamp in video flowing.The server 110, specifically for according to the corresponding regional display of every frame complete picture carry when
Between stab, all complete picture is formed into spliced first video flowing.
The control system 100 of VR live video provided by above-described embodiment, by server 110 to the video received
Stream carries out motion detection, determines the moving region of moving object in video flowing；Any frame first is chosen from the video flowing to draw
Face determines first area corresponding with the moving region in first picture of frame；To first described in first picture
Region is sheared, and the first picture after definition shearing is background frame；It intercepts in the first picture of each frame of the video flowing
Regional display corresponding with the moving region；The regional display that the background frame and each frame intercept is issued to visitor
Family end 120；The client 120 receives the background frame and the regional display that the server 110 issues；For
The background frame is spliced to form a frame complete picture with corresponding regional display by each frame regional display, will be all complete
Whole picture forms spliced first video flowing；The mode that rendering output is carried out to first video flowing, is not influencing client
Under the premise of end plays the clarity of VR live video, greatly reduces the server 110 and issued to the client 120
Data volume, alleviate the bandwidth pressure that the server 110 issues data.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (6)
1. a kind of control method of VR live video, which is characterized in that the control method of the VR live video includes:
Server carries out motion detection to the video flowing received, determines the moving region of moving object in video flowing；
The first picture of any frame is chosen from the video flowing, determination is corresponding with the moving region in first picture of frame
First area；
First area described in first picture is sheared, the first picture after definition shearing is background frame；
Intercept regional display corresponding with the moving region in the first picture of each frame of the video flowing；
The regional display that the background frame and each frame intercept is issued to client；
The client is directed to each frame regional display, and it is complete that the background frame with corresponding regional display is spliced to form a frame
All complete pictures are formed spliced first video flowing by whole picture；
Rendering output is carried out to first video flowing.
2. the control method of VR live video according to claim 1, which is characterized in that the server uses light stream
Method, frame difference method or background subtraction carry out motion detection to the video flowing, to determine the movement of moving object in video flowing
Region.
3. the control method of VR live video according to claim 1, which is characterized in that each first picture pair of frame
The regional display answered carries timestamp of corresponding the first picture of frame in the video flowing；
All complete pictures are formed spliced first video flowing and specifically included by the client:
The timestamp that the client is carried according to the corresponding regional display of every frame complete picture, all complete pictures are formed
Spliced first video flowing.
4. a kind of control system of VR live video, which is characterized in that the control system of the VR live video includes:
Server determines the moving region of moving object in video flowing for carrying out motion detection to the video flowing received；From
The first picture of any frame is chosen in the video flowing, and the firstth area corresponding with the moving region is determined in first picture of frame
Domain；First area described in first picture is sheared, the first picture after definition shearing is background frame；Interception institute
State regional display corresponding with the moving region in the first picture of each frame of video flowing；By the background frame and often
The regional display of one frame interception is issued to client；
The client, for receiving the background frame and the regional display that the server issues；For each frame
The background frame is spliced to form a frame complete picture with corresponding regional display, by all complete pictures by regional display
Form spliced first video flowing；And rendering output is carried out to first video flowing.
5. the control system of VR live video according to claim 4, which is characterized in that the server uses light stream
Method, frame difference method or background subtraction carry out motion detection to the video flowing, to determine the movement of moving object in video flowing
Region.
6. the control system of VR live video according to claim 4, which is characterized in that each first picture pair of frame
The regional display answered carries timestamp of corresponding the first picture of frame in the video flowing；
The server will be all complete specifically for the timestamp carried according to the corresponding regional display of every frame complete picture
Whole picture forms spliced first video flowing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811367241.4A CN109600623A (en) | 2018-11-16 | 2018-11-16 | The control method and system of VR live video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811367241.4A CN109600623A (en) | 2018-11-16 | 2018-11-16 | The control method and system of VR live video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109600623A true CN109600623A (en) | 2019-04-09 |
Family
ID=65957815
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811367241.4A Pending CN109600623A (en) | 2018-11-16 | 2018-11-16 | The control method and system of VR live video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109600623A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111105350A (en) * | 2019-11-25 | 2020-05-05 | 南京大学 | Real-time video splicing method based on self homography transformation under large parallax scene |
-
2018
- 2018-11-16 CN CN201811367241.4A patent/CN109600623A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111105350A (en) * | 2019-11-25 | 2020-05-05 | 南京大学 | Real-time video splicing method based on self homography transformation under large parallax scene |
| CN111105350B (en) * | 2019-11-25 | 2022-03-15 | 南京大学 | Real-time video splicing method based on self homography transformation under large parallax scene |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112585978B (en) | Generating a composite video stream for display in VR | |
| CN107018370B (en) | Display method and system for video wall | |
| CN111447461A (en) | Synchronous switching method, device, equipment and medium for multi-view live video | |
| CN111314720A (en) | Live broadcast and microphone connection control method and device, electronic equipment and computer readable medium | |
| US20080168512A1 (en) | System and Method to Implement Interactive Video Streaming | |
| US20110229106A1 (en) | System for playback of ultra high resolution video using multiple displays | |
| TW201442507A (en) | Method and apparatus for providing interactive augmented reality information corresponding to television programs | |
| CN111970524B (en) | Control method, device, system, equipment and medium for interactive live broadcast and microphone connection | |
| CN105657494A (en) | Virtual cinema and implementation method thereof | |
| CN103795961A (en) | Video conference telepresence system and image processing method thereof | |
| CN111405339A (en) | Split screen display method, electronic equipment and storage medium | |
| CN112911318A (en) | Live broadcast room background replacement method and device, electronic equipment and storage medium | |
| CN106331530A (en) | Synchronous rapid display switching method for television wall and decoding equipment | |
| CN110012336A (en) | Picture configuration method, terminal and the device at interface is broadcast live | |
| CN105100870A (en) | Screenshot method and terminal equipment | |
| CN107231564B (en) | Video live broadcast method, live broadcast system and live broadcast server | |
| CN100384245C (en) | Method for adding Chinese station identification sign of digital TV set | |
| CN109600623A (en) | The control method and system of VR live video | |
| CN110049347A (en) | In method, system, terminal and the device of live streaming interface configurations image | |
| US11120615B2 (en) | Dynamic rendering of low frequency objects in a virtual reality system | |
| CN108401183A (en) | Method and system that VR panoramic videos are shown, VR servers | |
| US10529129B2 (en) | Dynamic selection mechanism for interactive video | |
| CN110198457B (en) | Video playing method and device, system, storage medium, terminal and server thereof | |
| CN115580738B (en) | High-resolution video display method, device and system for on-demand transmission | |
| CN113286149B (en) | Cloud conference self-adaptive multi-layer video coding method, system and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190409 |
|
| WD01 | Invention patent application deemed withdrawn after publication |