CN107395984A - A kind of method and device of transmission of video - Google Patents
A kind of method and device of transmission of video Download PDFInfo
- Publication number
- CN107395984A CN107395984A CN201710742909.8A CN201710742909A CN107395984A CN 107395984 A CN107395984 A CN 107395984A CN 201710742909 A CN201710742909 A CN 201710742909A CN 107395984 A CN107395984 A CN 107395984A
- Authority
- CN
- China
- Prior art keywords
- user
- region
- image quality
- camera
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims abstract description 41
- 230000000007 visual effect Effects 0.000 claims abstract description 27
- 238000010030 laminating Methods 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 description 5
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000036961 partial effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000002860 competitive effect Effects 0.000 description 1
- 239000006185 dispersion Substances 0.000 description 1
- 239000000686 essence Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
- H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computing Systems (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiments of the invention provide a kind of method and device of transmission of video, it is related to technical field of image processing, the requirement to transmission bandwidth can be reduced to a certain extent, reduces the complexity of video split.Wherein, this method includes：Obtain user's angle of visual field；Secondly, according to user's angle of visual field, it is determined that each each self-corresponding user's region-of-interest of user in panoramic video picture；Then, according to user's region-of-interest, obtain with the pending video flowing for specifying image quality definition；So as to which the pending video flowing got is carried out into video split processing.Technical scheme provided by the invention is suitable for server.
Description
【Technical field】
The present invention relates to technical field of image processing, more particularly to a kind of method and device of transmission of video.
【Background technology】
VR (Virtual Reality, virtual reality) technology is shot respectively using the VR video cameras of multiple cameras composition
The picture of different angle, then the picture that these are photographed all is transmitted to image processing services with same image quality definition
Device, the picture group that image processing server photographs these are combined together, and form 360 panoramic videos.VR videos contain 360
The image information spent in angular range, compared with conventional video when transmitting the video of equal picture quality level, transmission VR videos need
The bandwidth wanted is transmit bandwidth needed for conventional video several times, and Image Mosaic processing has certain complexity, it is desirable to is held
The server of row Image Mosaic possesses certain calculation processing power.Because VR transmission of video is to transmission bandwidth requirement and to clothes
The requirement of the arithmetic speed of business device is high, limits the application of VR technologies.
【The content of the invention】
The embodiments of the invention provide a kind of method and device of transmission of video, transmission during VR transmission of video can be reduced
Bandwidth, reduce the computational complexity of Video processing.
In a first aspect, the embodiments of the invention provide a kind of method of transmission of video, suitable for server, methods described bag
Include：
Obtain user's angle of visual field；
According to user's angle of visual field, it is determined that each each self-corresponding user of user pays close attention to area in panoramic video picture
Domain；
According to user's region-of-interest, obtain with the pending video flowing for specifying image quality definition；
The pending video flowing got is subjected to video split processing.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described according to institute
User's region-of-interest is stated, obtaining the pending video flowing with specified image quality definition includes：
It is superimposed each user's region-of-interest；
It is determined that camera corresponding with user's region-of-interest after superposition；
Image quality definition configured information is sent to the camera；
Obtain the pending video flowing for the specified image quality definition that the camera returns.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, when it is determined that superposition
When user's region-of-interest afterwards corresponds to whole cameras of video camera, methods described also includes：
Determine camera corresponding to the hot spot region of user's concern；
Then sending image quality definition configured information to the camera includes：
Camera corresponding to the hot spot region paid close attention to the user sends image quality definition configured information；
Obtaining the pending video flowing for the specified image quality definition that the camera returns includes：
Specified the pending of image quality definition that camera corresponding to obtaining the hot spot region of user's concern returns regards
Frequency flows.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is described according to institute
User's region-of-interest is stated, obtaining the pending video flowing with specified image quality definition also includes：
Determine camera corresponding to the hot spot region of user's concern；
To user pay close attention to hot spot region corresponding to camera send the first image quality definition configured information, and to other
Camera sends the second image quality definition configured information；
Obtain the pending video flowing for the specified image quality definition that the camera returns.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, it is determined that user
Include before the hot spot region of concern：
Determine the overlapping region of each user's region-of-interest；
Obtain the number of users of the overlapping region of each user's region-of-interest；
By the number of users compared with preset value, the hot spot region of user's concern is determined.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, will get
Pending video flowing also include after video split processing：
Video after split is handled is sent to user terminal.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, described obtain are used
Family visual angle includes：
The video request information that user terminal is sent is obtained, the video request information carries user's angle of visual field.
Second aspect, the embodiment of the present invention provides a kind of device of transmission of video, suitable for server, described device bag
Include：
First acquisition unit, for obtaining user's angle of visual field；
Determining unit, user is according to user's angle of visual field, it is determined that each user each corresponds in panoramic video picture
User's region-of-interest；
Second acquisition unit, for according to user's region-of-interest, obtaining with the pending of specified image quality definition
Video flowing；
Split unit, for the pending video flowing got to be carried out into video split processing.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, described second obtains
Unit is taken to include：
Laminating module, for being superimposed each user's region-of-interest；
First determining module, for determine be superimposed after the corresponding camera of user's region-of-interest；
First sending module, for sending image quality definition configured information to the camera；
First acquisition module, the pending video flowing of the specified image quality definition returned for obtaining the camera.
Aspect and any possible implementation as described above, it is further provided a kind of implementation, described second obtains
Unit also includes：
Second determining module, for determining camera corresponding to the hot spot region of user's concern；
Then the first sending module includes：
Sending submodule, the instruction of image quality definition is sent for camera corresponding to the hot spot region paid close attention to the user
Information；
First acquisition module includes：
Acquisition submodule, the specified image quality for obtaining camera return corresponding to the hot spot region of user's concern are clear
The pending video flowing of clear degree.
Aspect and any possible implementation as described above, it is further provided a kind of implementation, described second obtains
Unit also includes：
3rd determining module, for determining camera corresponding to the hot spot region of user's concern；
Second sending module, send the first image quality definition for camera corresponding to the hot spot region paid close attention to user and refer to
Show information, and the second image quality definition configured information is sent to other cameras；
Second acquisition module, the pending video flowing of the specified image quality definition returned for obtaining the camera.
Aspect and any possible implementation as described above, it is further provided a kind of implementation, described second obtains
Unit also includes：
4th determining module, for determining the overlapping region of each user's region-of-interest；
3rd acquiring unit, the number of users of the overlapping region for obtaining each user's region-of-interest；
Comparison module, for the number of users compared with preset value, to be determined to the hot spot region of user's concern.
Aspect and any possible implementation as described above, it is further provided a kind of implementation, described device are also wrapped
Include：
Transmitting element, user terminal is sent to for the video after split is handled.
Aspect as described above and any possible implementation, it is further provided a kind of implementation, described first obtains
Unit is taken to include：
Acquisition module, for obtaining the video request information of user terminal transmission, the video request information carries use
The family angle of visual field.In above-mentioned technical proposal compared with prior art, have the advantages that：
The method and device of transmission of video provided in an embodiment of the present invention, determining that user pays close attention to by user's angle of visual field needs
Ask, the video flowing of image quality definition is specified according to customer requirement retrieval, and the video flowing is subjected to split processing, compared to existing
Technology carries out split processing by all videos stream in same image quality definition transmission panoramic camera to all videos stream,
The device of transmission of video provided in an embodiment of the present invention, the demand paid close attention to according to user transmit specified the regarding for specifying image quality definition
Frequency flows, by the restriction of the pending video flowing to acquisition and the restriction to pending video flowing image quality definition, so as to have
Effect reduces the bandwidth required for VR transmission of video, while reduces video split algorithm complex.
【Brief description of the drawings】
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by embodiment it is required use it is attached
Figure is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for this area
For those of ordinary skill, on the premise of not paying creative work, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is a kind of schematic flow sheet of the method for transmission of video provided in an embodiment of the present invention；
Fig. 2 is the schematic flow sheet of the method for another transmission of video provided in an embodiment of the present invention；
Fig. 3 is the schematic flow sheet of the method for another transmission of video provided in an embodiment of the present invention；
Fig. 4 is the schematic flow sheet of the method for another transmission of video provided in an embodiment of the present invention；
Fig. 5 is the schematic flow sheet of the method for another transmission of video provided in an embodiment of the present invention；
Fig. 6 is the schematic flow sheet of the method for another transmission of video provided in an embodiment of the present invention；
Fig. 7 is the schematic flow sheet of the method for another transmission of video provided in an embodiment of the present invention；
A kind of Fig. 8 structural representations of the device of transmission of video provided in an embodiment of the present invention；
A kind of structural representation of Fig. 9 second acquisition units 43 provided in an embodiment of the present invention；
Another structural representation of Figure 10 second acquisition units 43 provided in an embodiment of the present invention；
Another structural representation of Figure 11 second acquisition units 43 provided in an embodiment of the present invention；
Another structural representation of Figure 12 second acquisition units 43 provided in an embodiment of the present invention；
The structural representation of the device of Figure 13 another transmission of video provided in an embodiment of the present invention；
The structural representation of the device of Figure 14 another transmission of video provided in an embodiment of the present invention.
【Embodiment】
In order to be better understood from technical scheme, the embodiment of the present invention is retouched in detail below in conjunction with the accompanying drawings
State.
It will be appreciated that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.Base
Embodiment in the present invention, those of ordinary skill in the art obtained under the premise of creative work is not made it is all its
Its embodiment, belongs to the scope of protection of the invention.
The term used in embodiments of the present invention is only merely for the purpose of description specific embodiment, and is not intended to be limiting
The present invention." one kind ", " described " and "the" of singulative used in the embodiment of the present invention and appended claims
It is also intended to including most forms, unless context clearly shows that other implications.
In the prior art, the institute that VR (Virtual Reality, virtual reality) video cameras photograph whole cameras
There is video flowing to be transferred to server with same image quality definition, server receives all video flowings, in order to ensure transmission when
Between, it is desirable to there is higher transmission bandwidth, while server is same to what is received between server and the equipment interacted
The all videos stream of one image quality definition carries out split processing, also increases the speed of computing split.And the thought base of the present invention
In the demand of user, VR (VirtualReality, virtual reality) video cameras are according to specified image quality definition to server transport
Partial video stream, and, based on user's request, VR (Virtual Reality, virtual reality) video camera is clear according to specified image quality
The clear video flowing spent to server transport difference image quality definition.
The embodiments of the invention provide a kind of method of transmission of video, suitable for server, as shown in figure 1, methods described
Including：
101st, user's angle of visual field is obtained.
Wherein, above-mentioned user's angle of visual field refers to the angle of user terminal displays device and eyes of user line.The angle of visual field is in VR
Effect in (Virtual Reality, virtual reality) technology is mainly reflected in user's feeling of immersion, in user's angle of visual field with using
Under the premise of the size of family terminal display matches, user's angle of visual field is bigger, what user watched from user terminal displays device
Scenery is more, and user's feeling of immersion is stronger.
102nd, according to user's angle of visual field, it is determined that each each self-corresponding user's concern of user in panoramic video picture
Region.
103rd, according to user's region-of-interest, obtain with the pending video flowing for specifying image quality definition.
Wherein, pending video flowing is the specified camera shooting of VR (Virtual Reality, virtual reality) video camera
The video flowing to server that is transmitted according to specified image quality definition of video.The pending video flowing can be VR
The video of a part of camera shooting in (Virtual Reality, virtual reality) video camera is clear according to the image quality of acquiescence
Degree is transferred to the video flowing of server；Can also be whole shootings in VR (Virtual Reality, virtual reality) video camera
The video of head shooting is transferred to the video flowing of server according to the image quality definition each specified；Pending video flowing can also be
The video of a part of camera shooting in VR (Virtual Reality, virtual reality) video camera is according to the picture each specified
Matter definition is transferred to the video flowing of server.
104th, the pending video flowing got is subjected to video split processing.
The method of transmission of video provided in an embodiment of the present invention, determine that user pays close attention to demand, foundation by user's angle of visual field
Customer requirement retrieval specifies the video flowing of image quality definition, and the video flowing is carried out into split processing, is pressed compared to prior art
All videos stream in same image quality definition transmission panoramic camera, and split processing, the present invention are carried out to all videos stream
The device for the transmission of video that embodiment provides, the demand paid close attention to according to user transmit the specified video stream for specifying image quality definition,
By the restriction of the pending video flowing to acquisition and the restriction to pending video flowing image quality definition, so as to effectively reduce
Bandwidth required for VR transmission of video, while reduce video split algorithm complex.
Further, with reference to foregoing schemes, the embodiments of the invention provide another implementation, it is directed to step 103
According to user's region-of-interest, obtain the realization with the pending video flowing for specifying image quality definition and provide two kinds of realizations
Mode：
The first implementation, part camera in VR (Virtual Reality, virtual reality) video camera is to the clothes
Device of being engaged in sends the video flowing for specifying image quality definition, its method flow diagram as shown in Fig. 2 including：
201st, it is superimposed each user's region-of-interest.
One user's region-of-interest may have identical region-of-interest with other users region-of-interest, it is also possible to other
Identical region-of-interest is all not present in any user region-of-interest, and each user's region-of-interest is obtained respectively after overlap-add procedure
The union refion of individual user's region-of-interest, the union refion include all user's region-of-interests, and the union refion is VR
A part in (Virtual Reality, virtual reality) panoramic video corresponding region.
202nd, camera corresponding with user's region-of-interest after superposition is determined.
The picture in each angular range in VR (Virtual Reality, virtual reality) panoramic video is by VR
Corresponding camera shooting in (Virtual Reality, virtual reality) video camera.
User's region-of-interest after superposition includes several in VR (Virtual Reality, virtual reality) panoramic video
Picture in angular range, the VR included to user's region-of-interest after superposition (Virtual Reality, virtual reality) panorama
Several angular ranges in video are analyzed, so as to converse the related shooting of user's region-of-interest after shooting the superposition
Head, server only interacts to the related camera of user's region-of-interest after superposition, and then realizes that server only obtains use
The video flowing of family region-of-interest, and without obtaining video flowing corresponding to the region beyond user's region-of-interest.
203rd, image quality definition configured information is sent to the camera.
204th, the pending video flowing for the specified image quality definition that the camera returns is obtained.
Further illustrate, when the Regional Dispersion of user's concern, user's region-of-interest after superposition corresponds to VR video cameras
Whole cameras when, the embodiment of the present invention further provides for a kind of implementation, as shown in figure 3, this method also includes：
205th, camera corresponding to the hot spot region of user's concern is determined.
It should be noted that server determines the method for the hot spot region in user's region-of-interest after superposition follow-up real
Apply in example and be discussed in detail, will not be repeated here.
Then step 203 sends image quality definition configured information to the camera and included：
2031st, camera sends image quality definition configured information corresponding to the hot spot region paid close attention to the user.
Then step 204 obtains the pending video flowing of the specified image quality definition that the camera returns and included：
2041st, the specified image quality definition that camera corresponding to obtaining the hot spot region of user's concern returns is waited to locate
Manage video flowing.
Server determines user by the number of users of the concern of the regional in user's region-of-interest after calculating superposition
Camera corresponding to the hot spot region of concern and the hot spot region, so as to server camera corresponding with the hot spot region
Interact, and then realize that server only obtains the part camera in VR (Virtual Reality, virtual reality) video camera
The video flowing of transmission.
It should be noted that above-mentioned implementation is primarily adapted for use in the scene that user only focuses on subregion, for example,
Watch in competitive sports, user only focuses on the picture in stadium, without concern for the picture in other regions beyond stadium
Face, determine to shoot the camera of stadium in VR (Virtual Reality, virtual reality) video camera, server only needs
The video flowing in the camera of shooting stadium is obtained, without obtaining camera corresponding to other regions beyond stadium
In video flowing.
Above-described embodiment is by obtaining the partial video in VR (Virtual Reality, virtual reality) video camera, to obtaining
Partial video stream in VR (Virtual Reality, the virtual reality) video camera got carries out split processing, is meeting user
While experience, the computing overhead of video transmission bandwidth and video split algorithm is effectively reduced.
Second of implementation, camera in VR (Virtual Reality, virtual reality) video camera is as indicated
Image quality definition sends the video flowing of different image quality definition to server, its method flow diagram as shown in figure 4, including：
301st, camera corresponding to the hot spot region of user's concern is determined.
302nd, camera sends the first image quality definition configured information, Yi Jixiang corresponding to the hot spot region paid close attention to user
Other cameras send the second image quality definition configured information.
Wherein, other cameras are except corresponding to hot spot region in VR (Virtual Reality, virtual reality) video camera
Camera beyond camera.
Wherein, image quality levels of sharpness is divided into super clear image quality, high definition image quality, SD image quality.Serviced in the embodiment of the present invention
Device to the image quality definition configured information that camera is sent can be above-mentioned any two kinds of image quality definition, and of the invention real
Apply the first image quality definition in example and be higher than the second image quality definition.
303rd, the pending video flowing for the specified image quality definition that the camera returns is obtained.
It should be noted that the implementation is primarily adapted for use in the scene of user's region-of-interest concentration, for example, at one
In scenic spot, most users pay close attention to the region of fountain, and a few users pay close attention to other regions beyond fountain, in such a scenario,
Server needs to obtain the video data of whole cameras of VR (Virtual Reality, virtual reality) video camera, is ensureing
In the case of user's viewing experience, server is specified camera corresponding to region in the scenic spot where fountain to send high definition and regarded
Frequently, camera corresponding to other regions sends SD video.
The temperature that the implementation is paid close attention to according to designated area user, server obtain phase according to different image quality definition
The video flowing answered, so as to reduce the bandwidth of transmission of video, to the different corresponding video flowings of image quality definition got
Spliced, the computing overhead of video split algorithm can be reduced.
Supplementary notes, according to user's request, above two implementation can also be combined and performed.For above-mentioned two
The order that kind implementation performs does not limit, and server can first be superimposed each user's region-of-interest, obtains each user and closes
The union refion in region is noted, then determines the number of users of each designated area scope concern in union refion, so that it is determined that this is simultaneously
Collect the hot spot region in region, it is then determined that camera corresponding with the union refion, solicited message is sent to video camera, obtaining should
In the video flowing for the first image quality definition that camera corresponding to hot spot region in union refion returns and the union refion
Hot spot region beyond region corresponding to camera return the second image quality definition video flowing.
Further, to realize aforesaid operations, the embodiments of the invention provide another implementation, as shown in figure 5,
Before determining camera corresponding to the hot spot region of user's concern, also need to perform following steps：
401st, the overlapping region of each user's region-of-interest is determined.
Each user's region-of-interest is overlapped, should based on graphical analysis by extracting the feature of user's region-of-interest
Feature includes profile, curve, angle point of user's region-of-interest etc., then with this feature standard, is paid close attention to from each user of superposition
The region matched with this feature is searched in region, and then determines the overlapping region of user's region-of-interest.
It should be noted that the overlapping region method of above-mentioned determination user region-of-interest is only one of which implementation,
The embodiment of the present invention is for determining that the method for the overlapping region of user's region-of-interest does not limit.
402nd, the number of users of the overlapping region of each user's region-of-interest is obtained.
By calculating the number for each user's region-of-interest for forming the overlapping region, the user of the overlapping region is determined
Number.
403rd, by the number of users compared with preset value, the hot spot region of user's concern is determined.
When the number of users of the overlapping region meets preset value, the overlapping region is the hot spot region of user's concern, when this
The number of users of overlapping region is unsatisfactory for preset value, and the overlapping region is the non-hot region of user's concern.
Furthermore, it is understood that in order to allow users to watch VR (Virtual Reality, virtual reality) video, such as Fig. 6
Shown, the embodiment of the present invention additionally provides following steps on the basis of abovementioned steps are combined：
105th, the video after split is handled is sent to user terminal.
Further, to realize aforesaid operations, the embodiments of the invention provide alternatively possible implementation, such as Fig. 7
Shown, the specific implementation operation that step 101 obtains user perspective includes：
1011st, the video request information that user terminal is sent is obtained, the video request information carries user's angle of visual field.
The method of transmission of video based on above-mentioned offer, the embodiments of the invention provide a kind of device of transmission of video, fits
For server, the structural representation of the device is as shown in figure 8, described device includes：
First acquisition unit 41, for obtaining user's angle of visual field.
Determining unit 42, user is according to user's angle of visual field, it is determined that each user is each right in panoramic video picture
The user's region-of-interest answered.
Second acquisition unit 43, for according to user's region-of-interest, obtaining and waiting to locate with specified image quality definition
Manage video flowing.
Split unit 44, for the pending video flowing got to be carried out into video split processing.
Optionally, as shown in figure 9, the second acquisition unit 43 includes：
Laminating module 4311, for being superimposed each user's region-of-interest.
First determining module 4312, for determine be superimposed after the corresponding camera of user's region-of-interest.
First sending module 4313, for sending image quality definition configured information to the camera.
First acquisition module 4314, the pending video of the specified image quality definition returned for obtaining the camera
Stream.
Optionally, as shown in Figure 10, the second acquisition unit 43 also includes：
Second determining module 4315, for determining camera corresponding to the hot spot region of user's concern；
Then the first sending module 4313 includes：
Sending submodule 43131, it is clear to send image quality for camera corresponding to the hot spot region paid close attention to the user
Spend configured information；
First acquisition module 4314 includes：
Acquisition submodule 43141, for obtaining specifying for camera return corresponding to the hot spot region of user's concern
The pending video flowing of image quality definition.
Optionally, as shown in figure 11, the second acquisition unit 43 also includes：
Second determining module 4316, for determining camera corresponding to the hot spot region of user's concern.
Second sending module 4317, it is clear to send the first image quality for camera corresponding to the hot spot region paid close attention to user
Configured information is spent, and the second image quality definition configured information is sent to other cameras.
Second acquisition module 4318, the pending video of the specified image quality definition returned for obtaining the camera
Stream.
Optionally, as shown in figure 12, the second acquisition unit 43 also includes：
3rd determining module 4319, for determining the overlapping region of each user's region-of-interest.
3rd acquisition module 4320, the number of users of the overlapping region for obtaining each user's region-of-interest.
Comparison module 4321, for the number of users compared with preset value, to be determined to the hot spot region of user's concern.It is optional
, as shown in figure 13, the device also includes：
Transmitting element 45, user terminal is sent to for the video after split is handled.
Optionally, as shown in figure 14, the first acquisition unit 41 includes：
Acquisition module 411, for obtaining the video request information of user terminal transmission, the video request information carries
User's angle of visual field.
The device of transmission of video provided in an embodiment of the present invention, determine that user pays close attention to demand, foundation by user's angle of visual field
Customer requirement retrieval specifies the video flowing of image quality definition, and the video flowing is carried out into split processing, is pressed compared to prior art
All videos stream in same image quality definition transmission panoramic camera, and split processing, the present invention are carried out to all videos stream
The device for the transmission of video that embodiment provides, the demand paid close attention to according to user transmit the specified video stream for specifying image quality definition,
By the restriction of the pending video flowing to acquisition and the restriction to pending video flowing image quality definition, so as to effectively reduce
Bandwidth required for VR transmission of video, while reduce video split algorithm complex.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In several embodiments provided by the present invention, it should be understood that disclosed system, apparatus and method can be with
Realize by another way.For example, device embodiment described above is only schematical, for example, the unit
Division, only a kind of division of logic function, can there is other dividing mode, for example, multiple units or group when actually realizing
Part can combine or be desirably integrated into another system, or some features can be ignored, or not perform.It is another, it is shown
Or the mutual coupling discussed or direct-coupling or communication connection can be by some interfaces, device or unit it is indirect
Coupling or communication connection, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list
Member can both be realized in the form of hardware, can also be realized in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit realized in the form of SFU software functional unit, can be stored in one and computer-readable deposit
In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are causing a computer
It is each that device (can be personal computer, server, or network equipment etc.) or processor (Processor) perform the present invention
The part steps of embodiment methods described.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (Read-
Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disc or CD etc. it is various
Can be with the medium of store program codes.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention
God any modification, equivalent substitution and improvements done etc., should be included within the scope of protection of the invention with principle.
Claims (10)
- A kind of 1. method of transmission of video, it is characterised in that suitable for server, methods described includes：Obtain user's angle of visual field；According to user's angle of visual field, it is determined that each each self-corresponding user's region-of-interest of user in panoramic video picture；According to user's region-of-interest, obtain with the pending video flowing for specifying image quality definition；The pending video flowing got is subjected to video split processing.
- 2. according to the method for claim 1, it is characterised in that described according to user's region-of-interest, obtaining has finger Determining the pending video flowing of image quality definition includes：It is superimposed each user's region-of-interest；It is determined that camera corresponding with user's region-of-interest after superposition；Image quality definition configured information is sent to the camera；Obtain the pending video flowing for the specified image quality definition that the camera returns.
- 3. according to the method for claim 2, it is characterised in that user's region-of-interest after it is determined that being superimposed corresponds to video camera Whole cameras when, it is described to the camera send image quality definition configured information before include：Determine camera corresponding to the hot spot region of user's concern；Then sending image quality definition configured information to the camera includes：Camera corresponding to the hot spot region paid close attention to the user sends image quality definition configured information；Obtaining the pending video flowing for the specified image quality definition that the camera returns includes：The pending video flowing for the specified image quality definition that camera corresponding to obtaining the hot spot region of user's concern returns.
- 4. according to the method for claim 1, it is characterised in that described according to user's region-of-interest, obtaining has finger Determining the pending video flowing of image quality definition also includes：Determine camera corresponding to the hot spot region of user's concern；Camera corresponding to the hot spot region paid close attention to user sends the first image quality definition configured information, and is imaged to other Hair send the second image quality definition configured information；Obtain the pending video flowing for the specified image quality definition that the camera returns.
- 5. the method according to claim 3 or 4, it is characterised in that before the hot spot region of the determination user concern Including：Determine the overlapping region of each user's region-of-interest；Obtain the number of users of the overlapping region of each user's region-of-interest；By the number of users compared with preset value, the hot spot region of user's concern is determined.
- 6. according to the method for claim 1, it is characterised in that the pending video flowing got is being subjected to video split Also include after processing：Video after split is handled is sent to user terminal.
- 7. according to the method for claim 1, it is characterised in that the acquisition user perspective includes：The video request information that user terminal is sent is obtained, the video request information carries user's angle of visual field.
- 8. a kind of device of transmission of video, it is characterised in that suitable for server, described device includes：First acquisition unit, for obtaining user's angle of visual field；Determining unit, user is according to user's angle of visual field, it is determined that each each self-corresponding use of user in panoramic video picture Family region-of-interest；Second acquisition unit, for according to user's region-of-interest, obtaining with the pending video for specifying image quality definition Stream；Split unit, for the pending video flowing got to be carried out into video split processing.
- 9. device according to claim 8, it is characterised in that the second acquisition unit includes：Laminating module, for being superimposed each user's region-of-interest；First determining module, for determine be superimposed after the corresponding camera of user's region-of-interest；First sending module, for sending image quality definition configured information to the camera；First acquisition module, the pending video flowing of the specified image quality definition returned for obtaining the camera.
- 10. device according to claim 9, it is characterised in that the second acquisition unit also includes：Second determining module, for determining camera corresponding to the hot spot region of user's concern；Then the first sending module includes：Sending submodule, image quality definition instruction letter is sent for camera corresponding to the hot spot region paid close attention to the user Breath；First acquisition module includes：Acquisition submodule, for obtaining the specified image quality definition of camera return corresponding to the hot spot region of user's concern Pending video flowing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710742909.8A CN107395984A (en) | 2017-08-25 | 2017-08-25 | A kind of method and device of transmission of video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710742909.8A CN107395984A (en) | 2017-08-25 | 2017-08-25 | A kind of method and device of transmission of video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107395984A true CN107395984A (en) | 2017-11-24 |
Family
ID=60345699
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710742909.8A Pending CN107395984A (en) | 2017-08-25 | 2017-08-25 | A kind of method and device of transmission of video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107395984A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108769739A (en) * | 2018-06-27 | 2018-11-06 | 哈尔滨市舍科技有限公司 | The method that picture and short-sighted frequency are obtained from panoramic video |
| WO2019100631A1 (en) * | 2017-11-27 | 2019-05-31 | 中兴通讯股份有限公司 | Video playing method, apparatus and system, and storage medium |
| CN109996069A (en) * | 2018-01-03 | 2019-07-09 | 华为技术有限公司 | Video image encoding and decoding method and equipment |
| WO2020024373A1 (en) * | 2018-08-02 | 2020-02-06 | 华为技术有限公司 | Media data transmission method, client and server |
| CN111147883A (en) * | 2019-12-31 | 2020-05-12 | 歌尔科技有限公司 | Live broadcast method and device, head-mounted display equipment and readable storage medium |
| WO2020093862A1 (en) * | 2018-11-08 | 2020-05-14 | 华为技术有限公司 | Method for processing vr video, and related apparatus |
| CN111601151A (en) * | 2020-04-13 | 2020-08-28 | 北京拙河科技有限公司 | Method, device, medium and equipment for reviewing hundred million-level pixel video |
| WO2021052040A1 (en) * | 2019-09-20 | 2021-03-25 | 华为技术有限公司 | Video image enhancement method, device, apparatus, chip, and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101521745A (en) * | 2009-04-14 | 2009-09-02 | 王广生 | Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method |
| CN102802054A (en) * | 2012-08-14 | 2012-11-28 | 广州盈可视电子科技有限公司 | Control method and device used in multi-stream live video broadcast |
| CN105939482A (en) * | 2015-03-05 | 2016-09-14 | 诺基亚技术有限公司 | Video streaming transmission method |
| CN106454321A (en) * | 2016-10-26 | 2017-02-22 | 深圳市道通智能航空技术有限公司 | Panoramic video processing method, device and system |
| CN106911902A (en) * | 2017-03-15 | 2017-06-30 | 微鲸科技有限公司 | Video image transmission method, method of reseptance and device |
| CN106919248A (en) * | 2015-12-26 | 2017-07-04 | 华为技术有限公司 | It is applied to the content transmission method and equipment of virtual reality |
| CN107040794A (en) * | 2017-04-26 | 2017-08-11 | 盯盯拍（深圳）技术股份有限公司 | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system |
-
2017
- 2017-08-25 CN CN201710742909.8A patent/CN107395984A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101521745A (en) * | 2009-04-14 | 2009-09-02 | 王广生 | Multi-lens optical center superposing type omnibearing shooting device and panoramic shooting and retransmitting method |
| CN102802054A (en) * | 2012-08-14 | 2012-11-28 | 广州盈可视电子科技有限公司 | Control method and device used in multi-stream live video broadcast |
| CN105939482A (en) * | 2015-03-05 | 2016-09-14 | 诺基亚技术有限公司 | Video streaming transmission method |
| CN106919248A (en) * | 2015-12-26 | 2017-07-04 | 华为技术有限公司 | It is applied to the content transmission method and equipment of virtual reality |
| CN106454321A (en) * | 2016-10-26 | 2017-02-22 | 深圳市道通智能航空技术有限公司 | Panoramic video processing method, device and system |
| CN106911902A (en) * | 2017-03-15 | 2017-06-30 | 微鲸科技有限公司 | Video image transmission method, method of reseptance and device |
| CN107040794A (en) * | 2017-04-26 | 2017-08-11 | 盯盯拍（深圳）技术股份有限公司 | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system |
Non-Patent Citations (1)
| Title |
|---|
| 刘海贵: "《新闻传播学通用教材 当代新闻采访 第2版软扫》", 31 July 2003 * |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109842792B (en) * | 2017-11-27 | 2021-05-11 | 中兴通讯股份有限公司 | Video playing method, device, system and storage medium |
| WO2019100631A1 (en) * | 2017-11-27 | 2019-05-31 | 中兴通讯股份有限公司 | Video playing method, apparatus and system, and storage medium |
| CN109842792A (en) * | 2017-11-27 | 2019-06-04 | 中兴通讯股份有限公司 | Video broadcasting method, device, system and storage medium |
| CN109996069A (en) * | 2018-01-03 | 2019-07-09 | 华为技术有限公司 | Video image encoding and decoding method and equipment |
| TWI680673B (en) * | 2018-01-03 | 2019-12-21 | 大陸商華為技術有限公司 | Method and apparatus for video image coding and decoding |
| US11800095B2 (en) | 2018-01-03 | 2023-10-24 | Huawei Technologies Co., Ltd. | Video picture encoding and decoding method and device |
| CN108769739A (en) * | 2018-06-27 | 2018-11-06 | 哈尔滨市舍科技有限公司 | The method that picture and short-sighted frequency are obtained from panoramic video |
| WO2020024373A1 (en) * | 2018-08-02 | 2020-02-06 | 华为技术有限公司 | Media data transmission method, client and server |
| US11368729B2 (en) | 2018-08-02 | 2022-06-21 | Huawei Technologies Co., Ltd. | Media data transmission method, client, and server |
| CN111163306A (en) * | 2018-11-08 | 2020-05-15 | 华为技术有限公司 | VR video processing method and related device |
| CN111163306B (en) * | 2018-11-08 | 2022-04-05 | 华为技术有限公司 | VR video processing method and related device |
| US11341712B2 (en) | 2018-11-08 | 2022-05-24 | Huawei Technologies Co., Ltd. | VR video processing method and related apparatus |
| WO2020093862A1 (en) * | 2018-11-08 | 2020-05-14 | 华为技术有限公司 | Method for processing vr video, and related apparatus |
| WO2021052040A1 (en) * | 2019-09-20 | 2021-03-25 | 华为技术有限公司 | Video image enhancement method, device, apparatus, chip, and storage medium |
| CN111147883A (en) * | 2019-12-31 | 2020-05-12 | 歌尔科技有限公司 | Live broadcast method and device, head-mounted display equipment and readable storage medium |
| CN111601151A (en) * | 2020-04-13 | 2020-08-28 | 北京拙河科技有限公司 | Method, device, medium and equipment for reviewing hundred million-level pixel video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107395984A (en) | A kind of method and device of transmission of video | |
| CN107509037B (en) | The method and terminal taken pictures using different field angle cameras | |
| WO2017071506A1 (en) | Two-dimensional code processing method and apparatus | |
| US10831823B2 (en) | Photo distribution method and terminal | |
| US7565035B2 (en) | Image processing method, image processing apparatus and image processing program | |
| CN107454343B (en) | Photographic method, camera arrangement and terminal | |
| JP2018023158A (en) | Preview image display method and device, and terminal | |
| WO2010028559A1 (en) | Image splicing method and device | |
| US20230137219A1 (en) | Image processing system and method in metaverse environment | |
| CN109086847A (en) | Pick-up processing method and processing device based on recognition of face | |
| TW200406122A (en) | System and method for remote controlled photography | |
| US20090237490A1 (en) | System and method for stereoscopic image creation and transmission | |
| US20150244756A1 (en) | Method, Apparatus and System for Determining Terminal That is to Share Real-Time Video | |
| WO2012019517A1 (en) | Method, device and system for processing video in video communication | |
| CN108765115A (en) | A kind of refund method, system, device, mobile terminal and service server | |
| CN104038697A (en) | Mobile terminal multi-person photographing method and mobile terminal | |
| US20140105519A1 (en) | Computer-implemented image composition method and apparatus using the same | |
| CN109688321A (en) | Electronic equipment and its image display method, the device with store function | |
| US7450157B2 (en) | Remote high resolution photography and video recording using a streaming video as a view-finder | |
| CN108694389A (en) | Safe verification method based on preposition dual camera and electronic equipment | |
| CN106156108A (en) | The transfer method of a kind of virtual resource, device and system | |
| US11373052B2 (en) | Data interaction method and device, storage medium, and mobile terminal | |
| CN109389550B (en) | Data processing method, device and computing equipment | |
| CN106651340A (en) | Settlement method and device | |
| CN107707830A (en) | Panoramic video based on one-way communication plays camera system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171124 |