CN107147824A - The output intent and device of multi-angle video - Google Patents
The output intent and device of multi-angle video Download PDFInfo
- Publication number
- CN107147824A CN107147824A CN201610458288.6A CN201610458288A CN107147824A CN 107147824 A CN107147824 A CN 107147824A CN 201610458288 A CN201610458288 A CN 201610458288A CN 107147824 A CN107147824 A CN 107147824A
- Authority
- CN
- China
- Prior art keywords
- video
- frequency range
- aphorama
- visual angle
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
Abstract
The present invention relates to a kind of output intent of multi-angle video and device, methods described includes：Obtain panoramic video；Panoramic video is divided into multiple first aphorama frequency ranges along reproduction time；For each first aphorama frequency range, each visual angle is as main perspective using in multiple visual angles, keep the picture size of image-region in the main perspective constant, reduction is by the picture size of the image-region outside the main perspective, each self-corresponding second aphorama frequency range when generating multiple visual angles respectively as main perspective；Obtain current visual angle and current play time；Search the second aphorama frequency range corresponding with current play time during using current visual angle as main perspective；Export the second aphorama frequency range found.The output intent and device for the multi-angle video that the present invention is provided, need to only export find using current visual angle as main perspective when the second aphorama frequency range corresponding with current play time, the less network transmission resource of transmission consuming of the second aphorama frequency range in transmitting procedure.
Description
Technical field
The present invention relates to the output intent and dress of the technical field of Video processing, more particularly to multi-angle video
Put.
Background technology
In the technical field of Video processing, with the development of various video techniques, the requirement of Video processing is more next
It is higher.At present, in panoramic video treatment technology, whole panoramic video is parsed, and plays parsing
Whole panoramic video afterwards.
However, spectators can only see the video image in angular field of view when watching panoramic video, it is impossible to
See complete full-view video image.So, but spectators only see the video image in visual angle so that whole
Panoramic video is not fully utilized, reduces the utilization rate of panoramic video, while transmitting whole panoramic video
When, panoramic video occupies larger memory space, it is necessary to expend substantial amounts of network transmission resource.
The content of the invention
Based on this, it is necessary to the problem of needing to expend substantial amounts of network transmission resource for transmission panoramic video,
The output intent and device of multi-angle video are provided.
A kind of output intent of multi-angle video, methods described includes：
Obtain panoramic video；
The panoramic video is divided into multiple first aphorama frequency ranges along reproduction time；
For each first aphorama frequency range, using in multiple visual angles each visual angle as main perspective,
Keep the picture size of image-region in the main perspective constant, reduce image-region outside the main perspective
Picture size, each self-corresponding second aphorama frequency range when generating the multiple visual angle respectively as main perspective；
Obtain current visual angle and current play time；
Search the second aphorama frequency range corresponding with current play time during using current visual angle as main perspective；
Export the second aphorama frequency range found.
In one of the embodiments, the picture size for keeping the image-region in the main perspective is constant,
The picture size of the image-region outside the main perspective is reduced, including：
Calculate the subtense angle between multiple visual angle Zhong Ge visual angles and main perspective；
The corresponding picture size in each visual angle, the subtense angle and described image size are calculated according to the subtense angle
It is negatively correlated；
Image chi of the corresponding picture size in each visual angle obtained according to calculating to the image-region in corresponding visual angle
It is very little to be adjusted.
In one of the embodiments, the second aphorama frequency range that the output is found, including：
The the second aphorama frequency range found is sent to playback terminal, makes the playback terminal described second
Image corresponding with current play time is searched in aphorama frequency range and is played.
In one of the embodiments, the second aphorama frequency range that the output is found, including：
The video code flow of the second aphorama frequency range found is sent to playback terminal, the playback terminal pair
The video code flow carries out decoding and obtains original image size, by the image chi of image in the second aphorama frequency range
Very little recovery is to the original image size and plays.
In one of the embodiments, the panoramic video includes right eye panoramic video and left eye panoramic video；
The first aphorama frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range；Second aphorama
Frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range；It is described to export the second panoramic video found
Section, including：
The the second aphorama frequency range found is exported to virtual reality device.
The output intent of above-mentioned multi-angle video, multiple first panoramas are divided into by panoramic video along reproduction time
Video-frequency band, for each first aphorama frequency range, using in multiple visual angles each visual angle as main perspective,
The picture size of the image-region outside the main perspective is reduced, it is each when generating multiple visual angles respectively as main perspective
Self-corresponding second aphorama frequency range, while the definition of image-region in main perspective is ensured, is reduced
The required memory space of second aphorama frequency range.Search when current visual angle is main perspective and current play time pair
The the second aphorama frequency range answered, exports the second aphorama frequency range found.So, ensureing in main perspective
During the definition of image, without overall output panoramic video, need to only export find using current visual angle as
During main perspective needed for the second aphorama frequency range corresponding with current play time, the capacity of the second aphorama frequency range
Memory space is smaller, relative to the transmission of panoramic video, the transmission of the second aphorama frequency range in transmitting procedure
Expend less network transmission resource.
A kind of output device of multi-angle video, described device includes：
Video acquiring module, for obtaining panoramic video；
Video segmentation module, for the panoramic video to be divided into multiple first panoramic videos along reproduction time
Section；
Video-frequency band adjusting module, for for each first aphorama frequency range, with each in multiple visual angles
Visual angle is kept the picture size of image-region in the main perspective constant, reduces the master respectively as main perspective
The picture size of image-region outside visual angle is each right when generating the multiple visual angle respectively as main perspective
The the second aphorama frequency range answered；
Visual angle acquisition module, for obtaining current visual angle and current play time；
Video-frequency band searching modul, it is corresponding with current play time during for searching using current visual angle as main perspective
Second aphorama frequency range；
Video-frequency band output module, for exporting the second aphorama frequency range found.
In one of the embodiments, the video-frequency band adjusting module includes：
Subtense angle computing module, for calculating the subtense angle between multiple visual angle Zhong Ge visual angles and main perspective；
Picture size computing module, for calculating the corresponding picture size in each visual angle, institute according to the subtense angle
State subtense angle negatively correlated with described image size；
Picture size adjusting module, for according to calculating the obtained corresponding picture size in each visual angle to accordingly regarding
The picture size of image-region in angle is adjusted.
In one of the embodiments, the video-frequency band output module is additionally operable to the second aphorama that will be found
Frequency range is sent to playback terminal, the playback terminal is searched in the second aphorama frequency range with currently broadcasting
Put time corresponding image and play.
In one of the embodiments, the video-frequency band output module is additionally operable to the second aphorama that will be found
The video code flow of frequency range is sent to playback terminal, and the playback terminal carries out decoding acquisition to the video code flow
Original image size, the picture size of image in the second aphorama frequency range is recovered to the original image size
And play.
In one of the embodiments, the panoramic video includes right eye panoramic video and left eye panoramic video；
The first aphorama frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range；Second aphorama
Frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range；
The second aphorama frequency range that the video-frequency band output module is additionally operable to find, which is exported to virtual reality, to be set
It is standby.
The output device of above-mentioned multi-angle video, multiple first panoramas are divided into by panoramic video along reproduction time
Video-frequency band, for each first aphorama frequency range, using in multiple visual angles each visual angle as main perspective,
The picture size of the image-region outside the main perspective is reduced, it is each when generating multiple visual angles respectively as main perspective
Self-corresponding second aphorama frequency range, while the definition of image-region in main perspective is ensured, is reduced
The required memory space of second aphorama frequency range.Search when current visual angle is main perspective and current play time pair
The the second aphorama frequency range answered, exports the second aphorama frequency range found.So, ensureing in main perspective
During the definition of image, without overall output panoramic video, need to only export find using current visual angle as
During main perspective needed for the second aphorama frequency range corresponding with current play time, the capacity of the second aphorama frequency range
Memory space is smaller, relative to the transmission of panoramic video, the transmission of the second aphorama frequency range in transmitting procedure
Expend less network transmission resource.
Brief description of the drawings
Fig. 1 is the schematic flow sheet of the output intent of multi-angle video in one embodiment；
Fig. 2 is the schematic diagram of generation panoramic video in one embodiment；
Fig. 3 is to play the schematic diagram of full panoramic video in one embodiment；
Fig. 4 is the schematic diagram of viewing panoramic video in one embodiment；
The schematic flow sheet of Fig. 5 is splits panoramic video in one embodiment the step of；
Fig. 6 be one embodiment according to subtense angle to adjust picture size the step of schematic flow sheet；
Fig. 7 is schematic flow sheet the step of whether detection main perspective changes in one embodiment；
Fig. 8 is the schematic diagram of the angular field of view of segmentation panoramic video in one embodiment；
Fig. 9 is the structured flowchart of the output device of multi-angle video in one embodiment；
Figure 10 is the structured flowchart of video-frequency band adjusting module in one embodiment；
Figure 11 is the structured flowchart of the output device of multi-angle video in one embodiment.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, below in conjunction with accompanying drawing and reality
Example is applied, the present invention will be described in further detail.It should be appreciated that specific embodiment described herein is only
Only to explain the present invention, it is not intended to limit the present invention.
As shown in figure 1, there is provided a kind of output intent of multi-angle video, this method in one embodiment
Apply in Video processing terminal for example, operation has the defeated of implementation multi-angle video in Video processing terminal
Go out the program of method.Wherein, Video processing terminal can be specifically server, PC and mobile terminal
At least one of, this method specifically includes following steps：
Step 102, panoramic video is obtained.
Specifically, Fig. 2 is refer to, panoramic video includes left eye panoramic video and right eye panoramic video, left eye
Panoramic video is corresponding by reproduction time with right eye panoramic video, wherein the frame of video of left eye panoramic video and
The frame of video of right eye panoramic video carries out arrangement generation panoramic video according to preset order, and panoramic video is uploaded
To the memory space of Video processing terminal 202.Video processing terminal 202 extracts aphorama from memory space
Frequently.
In one embodiment, Fig. 3 is refer to, panoramic video is distributed to broadcasting eventually by Video processing terminal 202
On end 204, playback terminal 204 to panoramic video decode obtaining left eye panoramic video and right eye panoramic is regarded
Frequently, playback terminal projects left eye panoramic video and right eye panoramic video the left eye and right eye of beholder respectively.
Fig. 4 is refer to, playback terminal 204 is in playing panoramic video, and playback terminal is parsed panoramic video,
Beholder can only see slash part in the image in its angular field of view, figure for can in the angular field of view of beholder
With the image-region seen.
Step 104, panoramic video is divided into multiple first aphorama frequency ranges along reproduction time.
Specifically, reproduction time can be the play time on the reproduction time axle of panoramic video.It refer to
Fig. 5, Video processing terminal obtains preset play time length, according to pre- after panoramic video 502 is got
If panoramic video is divided into multiple by the broadcasting total length of the reproduction time of reproduction time length and panoramic video
One aphorama frequency range 504.For example, preset play time length is 10 seconds, the reproduction time of panoramic video
Total length is 65 seconds, when the length of the reproduction time of panoramic video often reaches 10 seconds, is partitioned into one first
Aphorama frequency range, until panoramic video is segmented, may finally be divided into 7 the first aphorama frequency ranges,
The reproduction time length of preceding 6 the first aphorama frequency ranges is 10 seconds, and last the first aphorama frequency range is broadcast
Time span is put for 5 seconds.
In one embodiment, the total length of the reproduction time of panoramic video is obtained, default first is obtained complete
The number of scape video-frequency band, according to the total length of reproduction time and the number of default first aphorama frequency range, broadcasts
Put the total length of time divided by the number of default first aphorama frequency range obtains the broadcasting of the first aphorama frequency range
The length of time, according to the length of the reproduction time of the first aphorama frequency range, panoramic video is divided into multiple
First aphorama frequency range of the equal length of reproduction time.
In one embodiment, the play time of segmentation is determined according to the content of panoramic video, it is determined that dividing
After the play time cut, panoramic video is divided into multiple first aphoramas according to the play time of segmentation
Frequency range, the length of the reproduction time of multiple first aphorama frequency ranges be able to can not also be waited with equal.
Step 106, for each first aphorama frequency range, using in multiple visual angles each visual angle as
Main perspective, keeps the picture size of image-region in the main perspective constant, reduces the figure outside the main perspective
As the picture size in region, each self-corresponding second panorama when generating the multiple visual angle respectively as main perspective
Video-frequency band.
Specifically, picture size is the width of image and height represented in units of pixel, specifically can be with
W × H form mark, representing the width of image has W pixel, and the height of image has H pixel.
For each first aphorama frequency range, each visual angle can have corresponding image district in the first aphorama frequency range
Domain, using different visual angles as main perspective, the corresponding image-region of main perspective is also different.In Video processing eventually
End is so that each visual angle is as main perspective in multiple visual angles, to the figure in main perspective in the first aphorama frequency range
As the picture size of the image-region outside region and main perspective is adjusted, ensureing the image in main perspective
The picture size in region is constant, the picture size of the image-region outside reduction main perspective, will adjust image chi
The first aphorama frequency range after very little is stored as the corresponding second aphorama frequency range in visual angle as main perspective, finally
Each self-corresponding multiple second panoramic videos when generating multiple visual angles respectively as main perspective.
In one embodiment, the corresponding preset image sizes of main perspective are obtained corresponding with visual angle outside main perspective
Preset image sizes, the picture size of the image-region in main perspective is adjusted corresponding default to main perspective
Picture size, adjusts to outside main perspective visual angle corresponding by the picture size of the image-region outside main perspective
Preset image sizes.
In one embodiment, the picture size of the image-region in holding main perspective is constant, respectively adjustment master
The picture size of the corresponding image-region in each visual angle, the visual angle for making the angle of deviation main perspective bigger outside visual angle
The picture size of corresponding image-region is smaller.
Step 108, current visual angle and current play time are obtained.
Specifically, Video processing terminal has the function of playing panoramic video, and Video processing terminal obtains current
Visual angle and current play time.
In one embodiment, Video processing terminal sends to the playback terminal for playing panoramic video and obtained
The request of current visual angle and current play time, playback terminal returns to current visual angle and current play time
Video processing terminal.
Step 110, the second panoramic video corresponding with current play time during using current visual angle as main perspective is searched
Section.
Specifically, Video processing terminal is searched with current after current visual angle and current play time is got
Visual angle is the corresponding multiple second aphorama frequency ranges of main perspective, is determined and current in multiple second aphorama frequency ranges
Corresponding second panoramic video of reproduction time.
Step 112, the second aphorama frequency range found is exported.
In one embodiment, step 112 specifically also includes：The the second aphorama frequency range found is sent
To playback terminal, playback terminal is set to search image corresponding with current play time in the second aphorama frequency range
And play.
In one embodiment, Video processing terminal can be searched and current play time in the second panoramic video
Corresponding image is simultaneously played；When Video processing terminal can also search in the second panoramic video and be currently playing
Between image after corresponding image or current play time, and the image found is sent out according to reproduction time
Playback terminal is delivered to play out.
In one embodiment, step 112 specifically also includes：The the second aphorama frequency range found is sent
To playback terminal, playback terminal is set to recover the picture size of the image in the second aphorama frequency range to original graph
As size and play.
Specifically, Video processing terminal is after the second aphorama frequency range is found, with the second aphorama frequency range
The corresponding original image size in each visual angle and present image size are as code stream header information to the second panoramic video
Duan Jinhang coding generation video code flows, video code flow is sent to playback terminal.Playback terminal is to receiving
Video code flow parse obtaining code stream header information and the second aphorama frequency range, is carried from code stream header information
The corresponding original image size in each visual angle and present image size are taken, according to the corresponding original image chi in each visual angle
It is very little to recover the picture size of the corresponding image-region in each visual angle in the second aphorama frequency range with present image size
To original image size.The original image size of image-region, up-sampling can specifically be recovered by up-sampling
It can specifically use interpolation method to insert the original image size that pixel recovers image-region, can specifically calculate
The average pixel value of two adjacent pixels, two phases are inserted by pixel value for the pixel of average pixel value
Between adjacent pixel；The average pixel value of multiple pixels can also be calculated, is inserted in multiple pixels
Pixel value is the pixel of average pixel value.
In the present embodiment, panoramic video is divided into multiple first aphorama frequency ranges along reproduction time, for every
Individual first aphorama frequency range, each visual angle is as main perspective using in multiple visual angles, outside the main perspective
The picture size of image-region be adjusted to picture size less than the image-region in the main perspective, generate many
Each self-corresponding second aphorama frequency range when individual visual angle is respectively as main perspective, is ensureing image district in main perspective
While the definition in domain, the required memory space of the second aphorama frequency range is reduced.Searching current visual angle is
The second aphorama frequency range corresponding with current play time during main perspective, exports the second panoramic video found
Section.So, when ensureing the definition of image in main perspective, without overall output panoramic video, only need defeated
Go out find using current visual angle as main perspective when the second aphorama frequency range corresponding with current play time,
Memory space needed for the capacity of second aphorama frequency range is smaller, relative to the transmission of panoramic video, is being transmitted across
The transmission of the second aphorama frequency range expends less network transmission resource in journey.
As shown in fig. 6, in one embodiment, step 106 includes adjusting picture size according to subtense angle
The step of, the step specifically includes herein below：
Step 602, the subtense angle between multiple visual angle Zhong Ge visual angles and main perspective is calculated.
Specifically, the angular field of view of panoramic video is divided into multiple visual angles by Video processing terminal, specifically can root
The angular field of view of panoramic video is divided into the equal visual angle of multiple angles according to predetermined angle；Can also be according to panorama
The content of video, is divided into the visual angle that multiple angles are not waited, each visual angle correspondence by the angular field of view of panoramic video
Complete image.Wherein, specifically the angular field of view of panoramic video can be divided into 30 to 40 visual angles.With
The original position at one of visual angle is as standard, and the original position through the visual angle is set to 0 degree, each regarded
Angle all corresponds to an angular range, and angular range includes the angle upper limit and angle lower limit, chooses in angular range
The angle upper limit or angle lower limit calculate the subtense angle between each visual angle and main perspective.Specifically will can respectively it regard
The angle upper limit at angle obtains the subtense angle of each visual angle and main perspective with subtracting each other in the angle as main perspective.
In one embodiment, the original position at the one of visual angle of Video processing terminal rising as each visual angle
Beginning position, the angle at each visual angle is obtained according to the center line at each visual angle and original position, with the angle at each visual angle
Subtract each other the subtense angle for obtaining each visual angle and main perspective with the angle as main perspective.
Step 604, the corresponding picture size in each visual angle, subtense angle and picture size negative are calculated according to subtense angle
Close.
Specifically, Video processing terminal is set up subtense angle and the negative correlativing relation of picture size, i.e. subtense angle and got over
Greatly, picture size is smaller.Subtense angle between each visual angle and main perspective is substituted into subtense angle and picture size
Calculated in negative correlativing relation and obtain the corresponding picture size in each visual angle.
Step 606, the corresponding picture size in each visual angle obtained according to calculating is to the image-region in corresponding visual angle
Picture size be adjusted.
Specifically, Video processing terminal adjusts the image-region in each visual angle by down-sampled picture size
To the corresponding picture size in each visual angle.It is down-sampled to be specifically averaged by calculating the pixel of neighbor pixel
The picture size of image-region in each visual angle is adjusted picture size corresponding to each visual angle by value, can be with
By image-region piecemeal, calculate in every piece pixel average to adjust the picture size of image-region.
In the present embodiment, each visual angle pair is calculated according to the subtense angle between multiple visual angle Zhong Ge visual angles and main perspective
The picture size answered, and subtense angle is negatively correlated with picture size, subtense angle is bigger, and picture size is lower, and
The picture size of the corresponding image-region in each visual angle is adjusted to the corresponding image chi in each visual angle obtained to calculating
It is very little.So, the picture size corresponding to the bigger visual angle of the angle of deviation main perspective is lower, is not influenceing complete
During the viewing effect of scape video, reduce by the second aphorama frequency range institute by reducing picture size to greatest extent
The size of memory space is accounted for, the transmission speed of the second aphorama frequency range is improved.
As shown in fig. 7, also including whether detection main perspective changes in one embodiment, after step 112
The step of, the particular content of the step is as follows：
Step 702, whether detection main perspective changes.
Specifically, Video processing terminal-pair main perspective is detected, by current visual angle and currently playing second
Whether the corresponding main perspective of brand-new video-frequency band is identical, if identical, detect main perspective and does not change；If no
It is identical, then detect main perspective change.
Step 704, when detecting main perspective change, current visual angle and current play time are obtained.
Step 706, the second panoramic video corresponding with current play time during using current visual angle as main perspective is searched
Section.
Step 708, the second aphorama frequency range found is exported.
Specifically, Video processing terminal sends the second aphorama frequency range found to playback terminal, plays
Terminal searches the corresponding image of current play time in the second panoramic video found, will be currently playing
Image, which is switched to the image found, to be continued to play.
In the present embodiment, when detecting visual angle and changing, the second aphorama frequency range is searched again, it is ensured that
Current visual angle is corresponding with the second aphorama frequency range, it is ensured that the definition of current visual angle correspondence image, it is ensured that regarding
The viewing effect of the second panorama screen during angular transformation.
In one embodiment, Fig. 8 is refer to, the angular field of view of panoramic video is divided into N number of visual angle,
Wherein the angular field of view of panoramic video is 360 degree.The original position at visual angle 0 is set to 0 degree, each regarded
Angle all corresponds to an angle with the original position at visual angle 0, and angle can be the original position at visual angle 0 and respectively regard
The angle of the center line at angle, visual angle m angle represents that visual angle n angle is represented with d (n) with d (m), if
Using visual angle m as main perspective, then visual angle n and visual angle m subtense angle represents that Δ (n-m's) takes with Δ (n-m)
Be worth scope for (0,180], as d (n)-d (m)≤180, Δ (n-m)=d (n)-d (m)；As d (n)-d (m) ＞ 180
When, Δ (n-m)=360-d (n)+d (m).
Assuming that original image size W × H of panoramic video, W represent picture traverse, H represents picture altitude,
Calculate the corresponding picture sizes of visual angle n, WnRepresent the corresponding picture traverses of visual angle n, HnRepresent n pairs of visual angle
The picture altitude calculation formula answered is as follows：
Wn=W/aΔ(n-m)
Hn=H/aΔ(n-m)
Calculated according to above formula and obtain the corresponding picture sizes of visual angle n for Wn×Hn, wherein a is more than 1, a
It can be specifically natural constant.
In one embodiment, panoramic video includes right eye panoramic video and left eye panoramic video；First panorama
Video-frequency band includes right eye panoramic video-frequency band and left eye aphorama frequency range；Second aphorama frequency range includes right eye panoramic
Video-frequency band and left eye aphorama frequency range；Step 112 also includes：By the second aphorama frequency range found output
To virtual reality device.
Specifically, panoramic video be by the frame of video of right eye panoramic video and the frame of video of left eye panoramic video by
According to certain order arrangement generation, the first aphorama frequency range is to obtain panoramic video along reproduction time segmentation
, the first aphorama frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range, the second panoramic video
Section is adjusted to the picture size of the right eye panoramic video-frequency band in the first aphorama frequency range and left eye aphorama frequency range
Generation after whole, the second aphorama frequency range includes adjusting the right eye panoramic video-frequency band after picture size and adjustment
Left eye aphorama frequency range after picture size.Video processing service device is defeated by the second aphorama frequency range found
Go out to virtual reality device, virtual reality device is used to show the second aphorama frequency range.Virtual reality device is
A kind of playback terminal.
In the present embodiment, the second aphorama frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range,
Second aphorama frequency range is exported to virtual reality device, virtual reality device can extract right eye panoramic video
Section and left eye aphorama frequency range, project beholder's right eye, by left eye panoramic video by right eye panoramic video-frequency band
Section projects beholder's left eye, beholder is watched the panoramic video of virtual reality.
As described in Figure 9, there is provided a kind of output device 900 of multi-angle video, the dress in one embodiment
Put and specifically include：Video acquiring module 902, Video segmentation module 904, video-frequency band adjusting module 906, regard
Angle acquisition module 908, video-frequency band searching modul 910 and video-frequency band output module 912.
Video acquiring module 902, for obtaining panoramic video.
Video segmentation module 904, for panoramic video to be divided into multiple first panoramic videos along reproduction time
Section.
Video-frequency band adjusting module 906, for for each first aphorama frequency range, each to be regarded in multiple visual angles
Angle keeps that the picture size of image-region in the main perspective is constant respectively as main perspective, and reduction leads this
The picture size resolution adjustment of image-region outside visual angle is point less than the image-region in the main perspective
Resolution, each self-corresponding second aphorama frequency range when generating multiple visual angles respectively as main perspective.
Visual angle acquisition module 908, for obtaining current visual angle and current play time.
Video-frequency band searching modul 910, it is corresponding with current play time during for searching using current visual angle as main perspective
The second aphorama frequency range.
Video-frequency band output module 912, for exporting the second aphorama frequency range found.
In the present embodiment, panoramic video is divided into multiple first aphorama frequency ranges along reproduction time, for every
Individual first aphorama frequency range, each visual angle is kept in the main perspective as main perspective using in multiple visual angles
Image-region picture size it is constant, reduce the picture size of the image-region outside the main perspective, generate
Each self-corresponding second aphorama frequency range when multiple visual angles are respectively as main perspective, is ensureing image in main perspective
While the definition in region, the required memory space of the second aphorama frequency range is reduced.Search current visual angle
The second aphorama frequency range corresponding with current play time during for main perspective, exports the second aphorama found
Frequency range.So, when ensureing the definition of image in main perspective, without overall output panoramic video, only need
Export find using current visual angle as main perspective when the second panoramic video corresponding with current play time
Section, memory space needed for the capacity of the second aphorama frequency range is smaller, relative to the transmission of panoramic video, is passing
The transmission of second aphorama frequency range expends less network transmission resource during defeated.
In one embodiment, video-frequency band adjusting module 906 is additionally operable to keep the image-region in main perspective
Picture size is constant, and the picture size of the image-region outside the main perspective is adjusted to less than in the main perspective
Image-region picture size.
As shown in Figure 10, in one embodiment, video-frequency band adjusting module 906 is specifically included：Subtense angle meter
Calculate module 906a, picture size computing module 906b and picture size adjusting module 906c.
Subtense angle computing module 906a, for calculating the subtense angle between multiple visual angle Zhong Ge visual angles and main perspective.
Picture size computing module 906b, for calculating the corresponding picture size in each visual angle according to subtense angle, depending on
Angular difference is negatively correlated with picture size.
Picture size adjusting module 906c, for according to calculating the obtained corresponding picture size in each visual angle to phase
The picture size of the image-region in visual angle is answered to be adjusted.
In the present embodiment, each visual angle pair is calculated according to the subtense angle between multiple visual angle Zhong Ge visual angles and main perspective
The picture size answered, and subtense angle is negatively correlated with picture size, subtense angle is bigger, and picture size is lower, and
The picture size of the corresponding image-region in each visual angle is adjusted to the corresponding image chi in each visual angle obtained to calculating
It is very little.So, the picture size that can deviate corresponding to the bigger visual angle of main perspective is lower, is not influenceing panorama
During the viewing effect of video, reduced by reducing picture size to greatest extent shared by the second aphorama frequency range
The size of memory space, improves the efficiency of transmission of the second aphorama frequency range.
In one embodiment, panoramic video includes right eye panoramic video and left eye panoramic video；First panorama
Video-frequency band includes right eye panoramic video-frequency band and left eye aphorama frequency range；Second aphorama frequency range includes right eye panoramic
Video-frequency band and left eye aphorama frequency range；Video-frequency band output module 912 is additionally operable to the second aphorama that will be found
Frequency range is exported to virtual reality device.
In the present embodiment, the second aphorama frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range,
Second aphorama frequency range is exported to virtual reality device, virtual reality device can extract right eye panoramic video
Section and left eye aphorama frequency range, project beholder's right eye, by left eye panoramic video by right eye panoramic video-frequency band
Section projects beholder's left eye, beholder is watched the panoramic video of virtual reality.
In one embodiment, video-frequency band output module 912 is additionally operable to the second aphorama frequency range that will be found
Send to playback terminal, playback terminal is searched in the second aphorama frequency range corresponding with current play time
Image is simultaneously played.
In one embodiment, video-frequency band output module 912 is additionally operable to the second aphorama frequency range that will be found
Video code flow send to playback terminal, playback terminal carries out decoding to video code flow and obtains original image size,
The picture size of image in second aphorama frequency range is recovered to the original image size and played.
As shown in figure 11, in one embodiment, the output device 900 of multi-angle video specifically also includes：
Visual angle detection module 914.
Visual angle detection module 914, for detecting whether visual angle changes.
Visual angle acquisition module 908 is additionally operable to, when detecting visual angle change, obtain current visual angle and currently playing
Time.
In the present embodiment, when detecting visual angle and changing, the second aphorama frequency range is searched again, it is ensured that
The correspondence of current visual angle and the second aphorama frequency range, it is ensured that the definition of the corresponding image of current visual angle, it is ensured that
The viewing effect of the second panorama screen in view transformation.
Each technical characteristic of embodiment described above can be combined arbitrarily, not right to make description succinct
The all possible combination of each technical characteristic in above-described embodiment is all described, as long as however, these skills
Contradiction is not present in the combination of art feature, is all considered to be the scope of this specification record.
Embodiment described above only expresses the several embodiments of the present invention, and it describes more specific and detailed,
But can not therefore it be construed as limiting the scope of the patent.It should be pointed out that for this area
For those of ordinary skill, without departing from the inventive concept of the premise, some deformations can also be made and changed
Enter, these belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be with appended power
Profit requires to be defined.
Claims (10)
1. a kind of output intent of multi-angle video, methods described includes：
Obtain panoramic video；
The panoramic video is divided into multiple first aphorama frequency ranges along reproduction time；
For each first aphorama frequency range, using in multiple visual angles each visual angle as main perspective,
Keep the picture size of image-region in the main perspective constant, reduce image-region outside the main perspective
Picture size, each self-corresponding second aphorama frequency range when generating the multiple visual angle respectively as main perspective；
Obtain current visual angle and current play time；
Search the second aphorama frequency range corresponding with current play time during using current visual angle as main perspective；
Export the second aphorama frequency range found.
2. according to the method described in claim 1, it is characterised in that the image kept in the main perspective
The picture size in region is constant, reduces the picture size of the image-region outside the main perspective, including：
Calculate the subtense angle between multiple visual angle Zhong Ge visual angles and main perspective；
The corresponding picture size in each visual angle, the subtense angle and described image size are calculated according to the subtense angle
It is negatively correlated；
Image chi of the corresponding picture size in each visual angle obtained according to calculating to the image-region in corresponding visual angle
It is very little to be adjusted.
3. according to the method described in claim 1, it is characterised in that described to export the second panorama found
Video-frequency band, including：
The the second aphorama frequency range found is sent to playback terminal, makes the playback terminal described second
Image corresponding with current play time is searched in aphorama frequency range and is played.
4. according to the method described in claim 1, it is characterised in that described to export the second panorama found
Video-frequency band, including：
The video code flow of the second aphorama frequency range found is sent to playback terminal, the playback terminal pair
The video code flow carries out decoding and obtains original image size, by the image chi of image in the second aphorama frequency range
Very little recovery is to the original image size and plays.
5. according to the method described in claim 1, it is characterised in that the panoramic video includes right eye panoramic
Video and left eye panoramic video；The first aphorama frequency range includes right eye panoramic video-frequency band and left eye aphorama
Frequency range；The second aphorama frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range；The output
The the second aphorama frequency range found, including：
The the second aphorama frequency range found is exported to virtual reality device.
6. a kind of output device of multi-angle video, it is characterised in that described device includes：
Video acquiring module, for obtaining panoramic video；
Video segmentation module, for the panoramic video to be divided into multiple first panoramic videos along reproduction time
Section；
Video-frequency band adjusting module, for for each first aphorama frequency range, with each in multiple visual angles
Visual angle is kept the picture size of image-region in the main perspective constant, reduces the master respectively as main perspective
The picture size of image-region outside visual angle is each right when generating the multiple visual angle respectively as main perspective
The the second aphorama frequency range answered；
Visual angle acquisition module, for obtaining current visual angle and current play time；
Video-frequency band searching modul, it is corresponding with current play time during for searching using current visual angle as main perspective
Second aphorama frequency range；
Video-frequency band output module, for exporting the second aphorama frequency range found.
7. device according to claim 6, it is characterised in that the video-frequency band adjusting module includes：
Subtense angle computing module, for calculating the subtense angle between multiple visual angle Zhong Ge visual angles and main perspective；
Picture size computing module, for calculating the corresponding picture size in each visual angle, institute according to the subtense angle
State subtense angle negatively correlated with described image size；
Picture size adjusting module, for according to calculating the obtained corresponding picture size in each visual angle to accordingly regarding
The picture size of image-region in angle is adjusted.
8. device according to claim 6, it is characterised in that the video-frequency band output module is additionally operable to
The the second aphorama frequency range found is sent to playback terminal, makes the playback terminal in second panorama
Image corresponding with current play time is searched in video-frequency band and is played.
9. device according to claim 6, it is characterised in that the video-frequency band output module is additionally operable to
The video code flow of the second aphorama frequency range found is sent to playback terminal, the playback terminal is to described
Video code flow carries out decoding and obtains original image size, and the picture size of image in the second aphorama frequency range is extensive
The multiple extremely original image size is simultaneously played.
10. device according to claim 6, it is characterised in that it is complete that the panoramic video includes right eye
Scape video and left eye panoramic video；The first aphorama frequency range includes right eye panoramic video-frequency band and left eye panorama
Video-frequency band；The second aphorama frequency range includes right eye panoramic video-frequency band and left eye aphorama frequency range；
The second aphorama frequency range that the video-frequency band output module is additionally operable to find, which is exported to virtual reality, to be set
It is standby.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610458288.6A CN107147824A (en) | 2016-06-22 | 2016-06-22 | The output intent and device of multi-angle video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610458288.6A CN107147824A (en) | 2016-06-22 | 2016-06-22 | The output intent and device of multi-angle video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107147824A true CN107147824A (en) | 2017-09-08 |
Family
ID=59783494
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610458288.6A Pending CN107147824A (en) | 2016-06-22 | 2016-06-22 | The output intent and device of multi-angle video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107147824A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107613338A (en) * | 2017-09-25 | 2018-01-19 | 中兴通讯股份有限公司 | Video transmission method, server, VR playback terminals and computer-readable recording medium |
| CN107896333A (en) * | 2017-11-29 | 2018-04-10 | 北京未来媒体科技股份有限公司 | The method and device that a kind of remote control panoramic video based on intelligent terminal plays |
| CN108156467A (en) * | 2017-11-16 | 2018-06-12 | 腾讯科技(成都)有限公司 | Data transmission method and device, storage medium and electronic device |
| CN109587516A (en) * | 2018-11-01 | 2019-04-05 | 深圳威尔视觉传媒有限公司 | Method for processing video frequency, device and storage medium |
| CN110929056A (en) * | 2018-09-19 | 2020-03-27 | 宏碁股份有限公司 | Multimedia file generating method, multimedia file playing method, multimedia file generating device and multimedia file playing device |
| WO2020097750A1 (en) * | 2018-11-12 | 2020-05-22 | Intel Corporation | Automated field of view estimation from game participant perspectives |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102740154A (en) * | 2011-04-14 | 2012-10-17 | 联发科技股份有限公司 | Method for adjusting playback of multimedia content according to detection result of user status and related apparatus thereof |
| CN104735464A (en) * | 2015-03-31 | 2015-06-24 | 华为技术有限公司 | Panorama video interactive transmission method, server and client end |
| CN104767992A (en) * | 2015-04-13 | 2015-07-08 | 北京集创北方科技有限公司 | Head-wearing type display system and image low-bandwidth transmission method |
| CN105323552A (en) * | 2015-10-26 | 2016-02-10 | 北京时代拓灵科技有限公司 | Method and system for playing panoramic video |
-
2016
- 2016-06-22 CN CN201610458288.6A patent/CN107147824A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102740154A (en) * | 2011-04-14 | 2012-10-17 | 联发科技股份有限公司 | Method for adjusting playback of multimedia content according to detection result of user status and related apparatus thereof |
| CN104735464A (en) * | 2015-03-31 | 2015-06-24 | 华为技术有限公司 | Panorama video interactive transmission method, server and client end |
| CN104767992A (en) * | 2015-04-13 | 2015-07-08 | 北京集创北方科技有限公司 | Head-wearing type display system and image low-bandwidth transmission method |
| CN105323552A (en) * | 2015-10-26 | 2016-02-10 | 北京时代拓灵科技有限公司 | Method and system for playing panoramic video |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107613338A (en) * | 2017-09-25 | 2018-01-19 | 中兴通讯股份有限公司 | Video transmission method, server, VR playback terminals and computer-readable recording medium |
| CN108156467A (en) * | 2017-11-16 | 2018-06-12 | 腾讯科技(成都)有限公司 | Data transmission method and device, storage medium and electronic device |
| CN108156467B (en) * | 2017-11-16 | 2021-05-11 | 腾讯科技(成都)有限公司 | Data transmission method and device, storage medium and electronic device |
| CN107896333A (en) * | 2017-11-29 | 2018-04-10 | 北京未来媒体科技股份有限公司 | The method and device that a kind of remote control panoramic video based on intelligent terminal plays |
| CN110929056A (en) * | 2018-09-19 | 2020-03-27 | 宏碁股份有限公司 | Multimedia file generating method, multimedia file playing method, multimedia file generating device and multimedia file playing device |
| CN110929056B (en) * | 2018-09-19 | 2023-04-07 | 宏碁股份有限公司 | Multimedia file generating method, multimedia file playing method, multimedia file generating device and multimedia file playing device |
| CN109587516A (en) * | 2018-11-01 | 2019-04-05 | 深圳威尔视觉传媒有限公司 | Method for processing video frequency, device and storage medium |
| WO2020097750A1 (en) * | 2018-11-12 | 2020-05-22 | Intel Corporation | Automated field of view estimation from game participant perspectives |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107147824A (en) | The output intent and device of multi-angle video | |
| US9363542B2 (en) | Techniques to provide an enhanced video replay | |
| EP2269371B1 (en) | A method of adapting video images to small screen sizes | |
| CN103856806B (en) | Video stream switching method, apparatus and system | |
| US9030534B2 (en) | Apparatus and method of displaying 3-dimensional image | |
| US8942427B2 (en) | Method and an apparatus for displaying a 3-dimensional image | |
| US8798151B2 (en) | Video display device, interpolated image generation circuit and interpolated image generation method | |
| US8531597B2 (en) | Video processing apparatus that stores input viewpoint information and control method thereof | |
| CN106792150B (en) | A kind of poster generation method and device | |
| US20120086779A1 (en) | Image processing apparatus, image processing method, and program | |
| US20110243474A1 (en) | Video image processing apparatus and video image processing method | |
| US8724912B2 (en) | Method, apparatus, and program for compressing images, and method, apparatus, and program for decompressing images | |
| CN107835424A (en) | A kind of media sync transmission player method based on data perception | |
| CN102265607A (en) | image scaling curve generation | |
| CN104104952A (en) | Audio/video processing method and system adapted to storage and play of mobile device | |
| US20110311207A1 (en) | Playback apparatus, method for controlling the same, and storage medium | |
| US8941718B2 (en) | 3D video processing apparatus and 3D video processing method | |
| KR101834934B1 (en) | Transferring of 3d image data | |
| CN1937779A (en) | Method for improving television terminal device digital caption data processing efficiency | |
| CN110087116B (en) | Multi-rate live video stream editing method and device, terminal and storage medium | |
| WO2010021665A1 (en) | Hypothetical reference decoder | |
| CN105635715A (en) | Video format identification method and device | |
| JP7128036B2 (en) | VIDEO SIGNAL RECEIVER AND VIDEO SIGNAL RECEIVING METHOD | |
| WO2018196530A1 (en) | Video information processing method, terminal, and computer storage medium | |
| CN105959770A (en) | Communication method using data line |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170908 |