CN106507094A - The method and device of correction panoramic video display view angle - Google Patents
The method and device of correction panoramic video display view angle Download PDFInfo
- Publication number
- CN106507094A CN106507094A CN201610930116.4A CN201610930116A CN106507094A CN 106507094 A CN106507094 A CN 106507094A CN 201610930116 A CN201610930116 A CN 201610930116A CN 106507094 A CN106507094 A CN 106507094A
- Authority
- CN
- China
- Prior art keywords
- attitude angle
- panoramic picture
- panoramic
- picture
- display body
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a kind of method and device of correction panoramic video display view angle, methods described includes obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；For each frame panoramic picture of panoramic video, the surface that panoramic picture is attached to predetermined three-dimension geometry solid, panorama display body is obtained, and the corresponding attitude angle of panoramic picture is found out from attitude angle data sequence；The panorama display body of panoramic picture is rotated according to the attitude angle for finding, the image for causing rotation is rocked to eliminate to shoot.The present invention will can pan video when the picture weave, shake or the rotation that produce etc. balance out, make the video pictures of broadcasting remain steady, increased the viewing experience of beholder.
Description
Technical field
The present invention relates to virtual reality technology, espespecially a kind of method and device of correction panoramic video display view angle.
Background technology
Pan-shot can shoot the video of upper and lower 360 degree of left and right in camera site, allow beholder to have a kind of on the spot in person
Sensation.In prior art, panorama shooting device gathers external image by two fish eye lenses or multiple wide-angle lens, then
Spliced by algorithm, formed panoramic video.
During actual photographed is carried out, especially under motion state, capture apparatus can occur some and rock or tremble
Dynamic, this results in shoot the video out display picture when showing identical can occur and rocks or shake, and causes the picture that plays
Face is unstable, and the viewing experience of beholder is substantially reduced.
Content of the invention
In order to solve above-mentioned technical problem, this application provides a kind of method of correction panoramic video display view angle and dress
Put, the undesirable picture weave for introducing as capture apparatus are rocked in shooting process can be eliminated.
In order to reach the object of the invention, the invention provides a kind of method of correction panoramic video display view angle, including：
Obtain panoramic video and the corresponding attitude angle data sequence of panoramic video；
For each frame panoramic picture of panoramic video, the surface that panoramic picture is attached to predetermined three-dimension geometry solid,
Panorama display body is obtained, and the corresponding attitude angle of panoramic picture is found out from the attitude angle data sequence；
The panorama display body of panoramic picture is rotated according to the attitude angle for finding, caused with eliminating to shoot to rock
Image is rotated.
Present invention also offers a kind of device of correction panoramic video display view angle, including：
One acquiring unit, for obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；
Panoramic picture, for each frame panoramic picture for panoramic video, is attached to predetermined three-dimensional by one panorama unit
The surface of geometrical body, obtains panorama display body；
One searching unit, for finding out the corresponding attitude angle of panoramic picture from the attitude angle data sequence；
One correction unit, for being rotated to the panorama display body of panoramic picture according to the attitude angle for finding, to disappear
The image rotation for causing is rocked except shooting.
Compared with prior art, the present invention includes obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video
Row；For each frame panoramic picture of panoramic video, the surface that panoramic picture is attached to predetermined three-dimension geometry solid, obtain complete
Scape display body, and the corresponding attitude angle of panoramic picture is found out from attitude angle data sequence；According to the attitude angle pair for finding
The panorama display body of panoramic picture is rotated, and rocks the image for causing rotation to eliminate to shoot.The present invention will can shoot complete
Picture weave, shake or rotation for producing during scape video etc. are balanced out, and are made the video pictures of broadcasting remain steady, be increased
The viewing experience of beholder.
Other features and advantages of the present invention will be illustrated in the following description, also, partly be become from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages can pass through in specification, right
In claim and accompanying drawing, specifically noted structure is realizing and obtain.
Description of the drawings
Accompanying drawing is used for providing further understanding technical solution of the present invention, and constitutes a part for specification, with this
The embodiment of application for explaining technical scheme, does not constitute the restriction to technical solution of the present invention together.
Flow charts of the Fig. 1 for the method for the correction panoramic video display view angle of the application；
Organization Charts of the Fig. 2 for the device of the correction panoramic video display view angle of the application.
Specific embodiment
For making the object, technical solutions and advantages of the present invention become more apparent, below in conjunction with accompanying drawing to the present invention
Embodiment be described in detail.It should be noted that in the case where not conflicting, in the embodiment and embodiment in the application
Feature mutually can be combined.
Can be in the such as computer system of one group of computer executable instructions the step of the flow process of accompanying drawing is illustrated
Execute.And, although show logical order in flow charts, but in some cases, can be suitable be different from herein
Sequence executes shown or described step.
In prior art, capture apparatus are during the video that pans as the impact of actual photographed scene can occur
Situations such as rocking or shake, this result in shoot the picture of panoramic video for obtaining can exist rock with capture apparatus identical or
Shake, so that picture is unstable, in playing panoramic video, this picture is rocked or shake and can even make beholder's generation dizziness,
Greatly reduce the viewing experience of beholder.
Consider in the application that the attitude transducer of capture apparatus can be with real time record capture apparatus in the video that pans
When attitude angle, therefore, when panoramic video is obtained, also simultaneously get the corresponding attitude angle data sequence of panoramic video.Appearance
Comprising the corresponding attitude angle of panoramic picture in panoramic video in state angular data sequence, again panoramic picture is attached to afterwards predetermined
The surface of three-dimension geometry solid obtains panorama display body, and the attitude angle further according to panoramic picture is rotated to panorama display body.
Attitude when can characterize shooting video capture panoramic picture due to the corresponding attitude angle of panoramic picture, that is, characterize capture apparatus
The degree for whether shaking in photographing panorama picture and rocking, the attitude angle according to panoramic picture are entered to panorama display body
As the image for causing that rocks of capture apparatus is rocked when row rotation can eliminate photographing panorama picture so that panoramic video can
The carrying out of frame stabilization shows.
As shown in figure 1, the method for correcting panoramic video display view angle that one embodiment of the application is provided, including：
Step 101：Obtain panoramic video and the corresponding attitude angle data sequence of panoramic video；
Step 102：For each frame panoramic picture of panoramic video, panoramic picture is attached to predetermined three-dimension geometry solid
Surface, obtain panorama display body, and find out the corresponding attitude angle of panoramic picture from attitude angle data sequence；
Step 103：The panorama display body of panoramic picture is rotated according to the attitude angle for finding, shaken with eliminating to shoot
The dynamic image for causing is rotated.
The method of the correction panoramic video display view angle of the application can apply to shoot panorama camera, moving camera etc.
Panoramic video correction display view angle, or system is shot by professional equipment to cinerama, panorama animation etc. that equipment shoots
Panorama content correction display view angle of work etc..Panoramic video can both be the video file that preserves of the Video coding for collecting with
For playing, or the real-time video processing that collects live going out later.
The method of the correction panoramic video display view angle of the application can be applied in display devices such as mobile phone, the aobvious equipment of head
In, the correction to panoramic video display view angle is realized when panoramic video is shown by display device.Can also apply in panorama phase
In the capture apparatus such as machine, moving camera, the display view angle of panoramic video is entered after capture apparatus shooting obtains panoramic video
Row correction so that the display device for subsequently acquiring panoramic video can directly display out calibrated after panoramic video.Certainly,
Can also equally be applied in the professional video equipment of panorama content, the display of panoramic video be regarded during the later stage is processed
Angle is corrected.
First, the problem unstable in order to eliminate the picture that causes to panoramic video due to rocking, shake etc. when shooting, need
Panoramic video to be got and the corresponding attitude angle data sequence of panoramic video.For example, pass through the application on the display device
Method correction display view angle when, for the panoramic video that capture apparatus shoot, display device directly can be obtained from capture apparatus
Take panoramic video and corresponding attitude angle data sequence.When correcting display view angle on capture apparatus, can be from capture apparatus
Image acquisition units obtain the panoramic video for shooting, obtain attitude angle data sequence from the attitude transducer of capture apparatus.
The attitude angle of each frame panoramic picture comprising panoramic video in attitude angle data sequence.Capture apparatus are shooting entirely
During scape video, Real-time Collection attitude angle can be sensed by attitude, be recorded as carrying out according to the collection moment or frame number etc.
The attitude angle data sequence of index, attitude angle data sequence can together be preserved with panoramic video or individually be transmitted by network.
Attitude transducer including but not limited to gravity sensor, acceleration transducer, gyro sensor, and they
Any combination.Attitude transducer can be built in inside capture apparatus, it is also possible to by conducting wire rigid-connecting device and capture apparatus phase
Connection so that the attitude angle which collects can reflect the attitude angle of capture apparatus in real time.
The form of attitude angle could be for any mathematical of expression three dimensions rotation transformation and represent, including but not limited to
Spin matrix, quaternary number, Eulerian angles etc., or original angular speed or acceleration add the form of time information.Appearance
The method that state angle transducer obtains attitude angle, includes the necessary working process to initial data, is allowed to become any one
Can be used to indicate that the data under the mathematical form of three dimensions rotation transformation.
As described above, can be carried out to attitude angle by the collection moment of attitude angle or frame number in attitude angle data sequence
Index, to search corresponding attitude angle for panoramic picture according to index.The collection moment of attitude angle is equal to attitude angle
The shooting moment of corresponding panoramic picture, that is, the timestamp of panoramic picture, by timestamp can set up attitude angle with
The corresponding relation of panoramic picture.Frame number is the unique mark of panoramic picture, can recognize that by frame number every in panoramic video
One frame panoramic picture.Using frame number as the index of attitude angle, the corresponding relation of panoramic picture and attitude angle can be equally set up.
The preservation of attitude angle data sequence or transmission means are not limited to attitude angle data sequence as individually number
Factually body is preserved or is transmitted, for example, preserve into independent disk file, but also include direct in the form of additional data
It is added on the panoramic video data modes of itself.For example, it is possible to attitude angle data is converted to text, in the captions of video file
Corresponding to the above-mentioned text of interpolation at the collection moment of the attitude angle as caption information in passage.Any can by attitude angle with adopt
The corresponding relation at collection moment is recorded and is preserved or the method transmitted can be seen as the side for preserving and transmitting attitude angle data sequence
Method, the application are not construed as limiting to concrete mode.
Secondly, after panoramic video and corresponding attitude angle data sequence is got, for each frame of panoramic video
Panoramic picture, the surface that panoramic picture is attached to predetermined three-dimension geometry solid obtains panorama display body.In order to pass through to revolve
Turn to eliminate to shoot and rock the unstable problem of the video pictures for causing, on display device or capture apparatus, whether realize this Shen
Method please, is required to the surface that each frame panoramic picture of panoramic video is attached to predetermined three geometrical body, obtains complete
The panorama display body of scape image, then panorama display body is rotated accordingly.
Certainly, for display device, it is to show aphorama by the surface that panoramic picture is attached to predetermined three geometrical body
One of step of frequency.Display device is storage medium is passed through or Network Capture is to panoramic video and corresponding attitude angle data
After sequence, panoramic video is decoded, obtains the panoramic image sequence for constituting panoramic video, then panoramic picture is attached to predetermined
Three-dimension geometry solid surface, obtain panorama display body.For panorama display body, then by the virtual video camera direction in imagination
Panorama display body is mapped as two dimensional image according to certain projective transformation by panorama display body, is achieved that the display of panorama content.
Above-mentioned projective transformation includes but is not limited to perspective transform, orthogonal projection transformation etc..Above-mentioned predetermined three-dimension geometry solid include but
It is not limited to spheroid, cube, Rhizoma Sparganii cone etc..
In the application, after the panorama display body for obtaining panoramic picture, need to find out from attitude angle data sequence entirely
The corresponding attitude angle of scape image, to be rotated to the panorama display body of panoramic picture according to the attitude angle for finding, so as to
Eliminate the float for shooting that shake brings.
As described above, being the rope using the timestamp or frame number of panoramic picture as attitude angle in attitude angle data sequence
Draw, therefore, when corresponding attitude angle is searched for each frame panoramic picture, can be by the timestamp of panoramic picture or frame number in appearance
Mated in state angular data sequence, the attitude angle corresponding to the identical timestamp for matching or frame number is panoramic picture pair
The attitude angle that answers.
Again, obtaining the panorama display body of panoramic picture, and find after corresponding attitude angle for panoramic picture, so that it may
To rotate to the panorama display body of panoramic picture according to the attitude angle for finding, the image for causing turn is rocked to eliminate to shoot
Dynamic.
Attitude angle in the application in attitude angle data sequence can both be that the attitude angle transducer of capture apparatus is shooting
The attitude angle of the attitude angle of the capture apparatus collected during equipment photographing panorama picture, or capture apparatus is relative to benchmark
The rotationally-varying amount of attitude angle.
If in attitude angle data sequence record be capture apparatus photographing panorama picture when attitude angle, to complete
When the panorama display body of scape image is rotated, need to calculate first the corresponding attitude angle of panoramic picture relative to reference attitude
The rotationally-varying amount at angle, according still further to the rotationally-varying amount, carries out shooting with capture apparatus to the panorama display body of panoramic picture
During the frame panoramic picture, made rotation identical rotation, reaches the purpose for eliminating that image is rocked.
For panoramic video, on the surface that panoramic picture is attached to predetermined three-dimension geometry solid after, show on screen
Be virtual video camera centered on the centre of sphere of panorama display body, the picture that collects in panorama display body.For not according to
The situation rotated to panorama display body according to the corresponding attitude angle of panoramic picture by method in the application, due to shooting entirely
During scape image, the shooting visual angle of capture apparatus there occurs rocks, and this is resulted in when showing, virtual video camera collection image also can
Shake, cause the angle of view for showing to change, picture is unstable.In the present processes, panorama display body is carried out and bat
Take the photograph and rock identical rotation, in the case where virtual video camera is constant, virtual video camera is remained able to according to complete with former frame
Scape image identical visual angle gathers image, and so as to eliminate as shooting is rocked, the display view angle for bringing changes and display picture is shaken
Dynamic.
Said reference attitude angle can be capture apparatus start to pan video when attitude angle.The shape at reference attitude angle
Formula can be that the attitude angle data of video capture start time can be used for table through converted any one of necessary processing
Show the mathematical form of three dimensions rotation transformation.The rotationally-varying amount of panoramic picture is the corresponding attitude angle of panoramic picture and benchmark
The difference result of attitude angle.
If in attitude angle data sequence record be shoot the panoramic picture when capture apparatus attitude angle relative to
The rotationally-varying amount at reference attitude angle, then need after the attitude angle for collecting each frame panoramic picture, i.e., to panoramic picture
Difference is done at attitude angle and reference attitude angle, obtains rotationally-varying amount, and by corresponding for each frame panoramic picture rotationally-varying amount with
The timestamp of panoramic picture or frame number generate attitude angle data sequence.
In this case, when being rotated to the panorama display body of panoramic picture according to attitude angle, directly can press
According to the corresponding attitude angle of the panoramic picture that finds from attitude angle data sequence, the panorama display body of panoramic picture is carried out with
Capture apparatus made rotation identical rotation when the frame panoramic picture is shot, eliminates and is rocked the display for bringing and regarded due to shooting
Angle changes and display picture is rocked.
When rotationally-varying amount is photographing panorama picture, the attitude angle of capture apparatus is relative to the rotationally-varying of reference attitude angle
Amount, this rotationally-varying is applied on the three-dimension geometry solid is attached to by panoramic picture so as to make to gather the frame with capture apparatus
Identical rotation during panoramic picture, the then rotation introduced when shooting are cancelled, the visual angle of the panoramic video shown on display device
Will not rock because of shooting and change, having reached prevents frame stabilization, strengthen the effect of frame stabilization.
Further, in an alternative embodiment of the application, according to the attitude angle that finds to the complete of panoramic picture
After scape display body is rotated, the correction panorama of panoramic video can also be obtained by reinflated for panorama display body for panoramic picture
Image.The quantity of correction panoramic picture is identical with the quantity of the original panoramic images of panoramic video, and corresponds.Correction panorama
Image can be kept separately and can also only preserve correction panoramic picture, and no longer retain the original panoramic images of panoramic video.School
The presence of positive panoramic picture can enable the equipment for subsequently getting correction panoramic picture directly show that frame out is smoothly complete
Scape video, and without the need for doing other process work again.
As described above, the method for the correction panoramic video display view angle of the application both may apply to the display devices such as mobile phone
On, it is also possible to it is applied on the capture apparatus such as panorama camera.In the case where display device is applied to, panorama displaying is being obtained
Body, and after being rotated to panorama display body according to attitude angle, have been realized in the perspective correction to panoramic video, and complete
Show.Subsequently, then by panorama display body panoramic picture is expanded into, the correction panoramic picture for obtaining can be by display device point
Network is enjoyed, and viewing is downloaded for other beholders, or is directly shared to other display equipment and is watched for beholder.In the application
Method be applied to capture apparatus in the case of, for the capture apparatus with display function, which is similar to display device；
For the capture apparatus without display function, obtaining panorama display body, and panorama display body is revolved according to attitude angle
After turning, need for panorama display body to expand into panoramic picture, obtain correcting panoramic picture, then correction panoramic picture is exported
Show for display device, realize that panorama realizes the correction of display view angle.
What deserves to be explained is, in the method for the correction panoramic video display view angle that the application is provided, getting aphorama
After frequency and the corresponding attitude angle data sequence of panoramic video, panoramic picture is found out from the attitude angle data sequence corresponding
Attitude angle before, attitude angle data sequence can also be filtered, retain numerical value change frequency in attitude angle data sequence high
In the component of frequency threshold, component of the numerical value change frequency less than frequency threshold is filtered, to rock to panoramic picture during to shooting
The rotation that causes of panorama display body offset, retain photographer and change panorama exhibition of the action of shooting visual angle to panoramic picture
Show the rotation that body is caused.
The shooting of the panoramic picture in panoramic video can be rocked above by filtering algorithm and divide into two kinds of situations：
(1) rocking for introducing is not intended to, as capture apparatus shoot occurred shake at the volley, rock；(2) photographer's active
Change the rotation of the capture apparatus caused by shooting visual angle.
For situation (one), the frequency of the change of the attitude angle for rocking caused capture apparatus in this case is relative
Higher, one frequency threshold can be set according to actual conditions, for attitude angle data sequence in, numerical value change frequency is higher than frequency
The component of rate threshold value, it can be assumed that for being the corresponding attitude of the panoramic picture captured in the case where there is undesirable rocking
Angle.For these panoramic pictures are to need to rock the visual angle change for causing by rotating elimination, so in attitude angle data sequence
Retain the corresponding attitude angle of these panoramic pictures in row, that is, numerical value change frequency is higher than the component of frequency threshold, so that
The panorama display body of panoramic picture is adjusted according to attitude angle.
For situation (two), it is change that photographer actively changes display view angle caused by shooting visual angle in this case.
In actual photographed, due to photographed scene, the change of photographic subjects, need in many cases to change shooting visual angle.This feelings
Under condition, on the display device and need to reflect the shooting visual angle of the wanted presentation of photographer, therefore need not be by complete
Scape display body carries out rotation to correct display view angle.In the case of photographer's active accommodation shooting visual angle, capture apparatus shoot
Attitude angle frequently can't change, and therefore, filter numerical value change frequency less than frequency threshold from attitude angle data sequence
After component, that is, photographer's active accommodation, the corresponding attitude angle of the panoramic picture of shooting, filters from attitude angle data sequence
After this partial data component, also again the panorama display body of the panoramic picture of photographer's active accommodation shooting visual angle would not be carried out
Rotation, remains the shooting visual angle of photographer.
Above by being filtered to attitude angle data sequence, area is carried out the reason for change to capture apparatus shooting visual angle
Point, more targetedly eliminate by the undesirable visual angle change that rocks and cause, by distinguishing to panoramic picture
The process of property, can reach more preferable display effect, enhance the experience of user.
What deserves to be explained is, in the method for the correction panoramic video display view angle of the application, if to attitude angle data
Sequence is filtered and can be selected according to actual needs.If be not filtered to attitude angle data sequence, can be to clapping
Take the photograph to rock the angle of view that the angle of view that brings changes and photographer's active accommodation shooting visual angle is brought and change and shown
Show the correction at visual angle.Namely display view angle is remained on visual angle when starting to pan video, is whether occurred
Shooting is rocked or photographer actively changes shooting visual angle and is maintained at display view angle on the visual angle shot when starting.This side
In formula, display view angle is remained on same visual angle, adjusted the visual angle of viewing completely by beholder, picture remains steady
Fixed visual angle.
Additionally, in the method for the correction panoramic video display view angle of the application, for the attitude in attitude angle data sequence
Angle, can also receive the modification to attitude angle by interactive man-machine interface, be that attitude angle adds side-play amount, make panoramic video
Show according to artificial expected visual angle.For example, in practice, people may want to video and be shown with a certain visual angle, pass through
Add side-play amount for attitude angle data, adjust the size of attitude angle, meet the demand of manual control panoramic video display view angle,
Panoramic video can be shown in the way of more personalized.
As shown in Fig. 2 present invention also provides a kind of correction panoramic video display view angle device, including：
One acquiring unit, for obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；
Panoramic picture, for each frame panoramic picture for panoramic video, is attached to predetermined three-dimensional by one panorama unit
The surface of geometrical body, obtains panorama display body；
One searching unit, for finding out the corresponding attitude angle of panoramic picture from attitude angle data sequence；
One correction unit, for being rotated to the panorama display body of panoramic picture according to the attitude angle for finding, to disappear
The image rotation for causing is rocked except shooting.
Further, said apparatus also include：
One launches unit, for being carried out to the panorama display body of panoramic picture according to the attitude angle for finding in correction unit
After rotation, panorama display body is expanded into panoramic picture, obtain the correction panoramic picture of panoramic video, so as to subsequently get complete
The equipment of the correction panoramic picture of scape video can show the stable panoramic video of picture.
Further, said apparatus also include：
One filter unit, for getting panoramic video and the corresponding attitude angle data sequence of panoramic video in acquiring unit
After row, before searching unit finds out the corresponding attitude angle of panoramic picture from attitude angle data sequence, to attitude angle data sequence
It is filtered, retains numerical value change frequency in attitude angle data sequence and, higher than the component of frequency threshold, filter numerical value change frequency
Less than the component of frequency threshold, the rotation caused with rocking the panorama display body to panoramic picture during to shooting is offset, is protected
Photographer is stayed to change the rotation that the action of shooting visual angle is caused to the panorama display body of panoramic picture.
Further, the corresponding attitude angle of panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture；
Correction unit is rotated to the panorama display body of panoramic picture according to the attitude angle for finding, including：Calculate complete
Rotationally-varying amount of the corresponding attitude angle of scape image relative to reference attitude angle, according to the rotationally-varying amount, to panoramic picture
Panorama display body carries out the made rotation identical rotation when the frame panoramic picture is shot with capture apparatus.
Further, when the corresponding attitude angle of panoramic picture is the shooting panoramic picture, the attitude angle of capture apparatus is relative to base
The rotationally-varying amount of quasi- attitude angle；
Correction unit is rotated to the panorama display body of panoramic picture according to the attitude angle for finding, including：According to complete
The corresponding attitude angle of scape image, carries out shooting the frame panoramic picture when institute with capture apparatus to the panorama display body of panoramic picture
Make rotation identical rotation.
Although disclosed herein embodiment as above, described content is only to readily appreciate the present invention and adopt
Embodiment, is not limited to the present invention.Technical staff in any art of the present invention, is being taken off without departing from the present invention
On the premise of the spirit and scope of dew, any modification and change, but the present invention can be carried out in the form and details that implements
Scope of patent protection, still must be defined by the scope of which is defined in the appended claims.
Claims (10)
1. a kind of correction panoramic video display view angle method, it is characterised in that include：
Obtain panoramic video and the corresponding attitude angle data sequence of panoramic video；
For each frame panoramic picture of panoramic video, the surface that panoramic picture is attached to predetermined three-dimension geometry solid obtains
Panorama display body, and the corresponding attitude angle of panoramic picture is found out from the attitude angle data sequence；
The panorama display body of panoramic picture is rotated according to the attitude angle for finding, the image for causing is rocked to eliminate to shoot
Rotate.
2. method according to claim 1, it is characterised in that methods described also includes：
After being rotated to the panorama display body of panoramic picture according to the attitude angle for finding, also by the panorama display body exhibition
Open as panoramic picture, obtain the correction panoramic picture of panoramic video, so as to subsequently get the correction panoramic picture of panoramic video
Equipment can show the stable panoramic video of picture.
3. method according to claim 1 and 2, it is characterised in that methods described also includes：
After panoramic video and the corresponding attitude angle data sequence of panoramic video is got, from the attitude angle data sequence
Before finding out the corresponding attitude angle of panoramic picture, also the attitude angle data sequence is filtered, retains the attitude angle number
According to numerical value change frequency in sequence higher than the component of frequency threshold, component of the numerical value change frequency less than frequency threshold is filtered, with
The rotation caused to rocking the panorama display body to panoramic picture during shooting is offset, and retains photographer and changes shooting visual angle
The rotation that action is caused to the panorama display body of panoramic picture.
4. method according to claim 1 and 2, it is characterised in that：
The corresponding attitude angle of the panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture；
The attitude angle that the basis finds is rotated to the panorama display body of panoramic picture, including：Calculate panoramic picture pair
Rotationally-varying amount of the attitude angle that answers relative to reference attitude angle, according to the rotationally-varying amount, shows to the panorama of panoramic picture
Body carries out the made rotation identical rotation when the frame panoramic picture is shot with capture apparatus.
5. method according to claim 1 and 2, it is characterised in that：
The corresponding attitude angle of the panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture relative to reference attitude
The rotationally-varying amount at angle；
The attitude angle that the basis finds is rotated to the panorama display body of panoramic picture, including：According to the panorama sketch
As corresponding attitude angle, revolve made when the frame panoramic picture is shot with capture apparatus is carried out to the panorama display body of panoramic picture
Turn identical rotation.
6. a kind of correction panoramic video display view angle device, it is characterised in that include：
One acquiring unit, for obtaining panoramic video and the corresponding attitude angle data sequence of panoramic video；
Panoramic picture, for each frame panoramic picture for panoramic video, is attached to predetermined three-dimensional geometry by one panorama unit
The surface of body, obtains panorama display body；
One searching unit, for finding out the corresponding attitude angle of panoramic picture from the attitude angle data sequence；
One correction unit, for being rotated to the panorama display body of panoramic picture according to the attitude angle for finding, to eliminate bat
Take the photograph and rock the image rotation for causing.
7. device according to claim 6, it is characterised in that described device also includes：
One launches unit, for being carried out to the panorama display body of panoramic picture according to the attitude angle for finding in the correction unit
After rotation, the panorama display body is expanded into panoramic picture, obtain the correction panoramic picture of panoramic video, so that follow-up obtain
Equipment to the correction panoramic picture of panoramic video can show the stable panoramic video of picture.
8. the device according to claim 6 or 7, it is characterised in that described device also includes：
One filter unit, for getting panoramic video and the corresponding attitude angle data sequence of panoramic video in the acquiring unit
After row, before the searching unit finds out the corresponding attitude angle of panoramic picture from the attitude angle data sequence, to the appearance
State angular data sequence is filtered, and retains component of the numerical value change frequency higher than frequency threshold in the attitude angle data sequence,
Component of the numerical value change frequency less than frequency threshold is filtered, to rock what the panorama display body to panoramic picture was caused during to shooting
Rotation is offset, and retains photographer and changes the rotation that the action of shooting visual angle is caused to the panorama display body of panoramic picture.
9. the device according to claim 6 or 7, it is characterised in that：
The corresponding attitude angle of the panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture；
The correction unit is rotated to the panorama display body of panoramic picture according to the attitude angle for finding, including：Calculate complete
Rotationally-varying amount of the corresponding attitude angle of scape image relative to reference attitude angle, according to the rotationally-varying amount, to panoramic picture
Panorama display body carries out the made rotation identical rotation when the frame panoramic picture is shot with capture apparatus.
10. the device according to claim 6 or 7, it is characterised in that：
The corresponding attitude angle of the panoramic picture is the attitude angle of capture apparatus when shooting the panoramic picture relative to reference attitude
The rotationally-varying amount at angle；
The correction unit is rotated to the panorama display body of panoramic picture according to the attitude angle for finding, including：According to institute
The corresponding attitude angle of panoramic picture is stated, and the panorama display body of panoramic picture is carried out the frame panoramic picture to be shot with capture apparatus
Shi Suozuo rotation identical rotations.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610930116.4A CN106507094B (en) | 2016-10-31 | 2016-10-31 | Correct the method and device of panoramic video display view angle |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610930116.4A CN106507094B (en) | 2016-10-31 | 2016-10-31 | Correct the method and device of panoramic video display view angle |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106507094A true CN106507094A (en) | 2017-03-15 |
| CN106507094B CN106507094B (en) | 2019-01-04 |
Family
ID=58319714
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610930116.4A Active CN106507094B (en) | 2016-10-31 | 2016-10-31 | Correct the method and device of panoramic video display view angle |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106507094B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107040694A (en) * | 2017-04-07 | 2017-08-11 | 深圳岚锋创视网络科技有限公司 | A kind of method, system and the portable terminal of panoramic video stabilization |
| CN107071279A (en) * | 2017-04-01 | 2017-08-18 | 深圳市圆周率软件科技有限责任公司 | A kind of method and system of panoramic picture frame stabilization |
| CN107665250A (en) * | 2017-09-26 | 2018-02-06 | 百度在线网络技术（北京）有限公司 | High definition road overlooks construction method, device, server and the storage medium of map |
| CN108366243A (en) * | 2018-01-23 | 2018-08-03 | 微幻科技(北京)有限公司 | A kind of video jitter removing method and device |
| CN109391755A (en) * | 2017-08-03 | 2019-02-26 | 佳能株式会社 | Picture pick-up device and the method wherein executed |
| WO2019037656A1 (en) * | 2017-08-23 | 2019-02-28 | Mediatek Inc. | Method and apparatus of signalling syntax for immersive video coding |
| CN110022439A (en) * | 2019-01-29 | 2019-07-16 | 威盛电子股份有限公司 | Full-view video image stabilising arrangement, coding method and playback method and appraisal procedure |
| CN110430411A (en) * | 2019-08-08 | 2019-11-08 | 青岛一舍科技有限公司 | A kind of display methods and device of panoramic video |
| CN110850977A (en) * | 2019-11-06 | 2020-02-28 | 成都威爱新经济技术研究院有限公司 | Stereoscopic image interaction method based on 6DOF head-mounted display |
| CN110944727A (en) * | 2017-09-19 | 2020-03-31 | 佳能株式会社 | System and method for controlling virtual camera |
| CN111524230A (en) * | 2020-04-01 | 2020-08-11 | 中南大学 | Linkage browsing method for three-dimensional model and unfolded panoramic image and computer system |
| CN111541850A (en) * | 2020-07-13 | 2020-08-14 | 南京泓众电子科技有限公司 | Panoramic electronic pan-tilt correction method and device |
| US10827159B2 (en) | 2017-08-23 | 2020-11-03 | Mediatek Inc. | Method and apparatus of signalling syntax for immersive video coding |
| CN113301249A (en) * | 2021-05-07 | 2021-08-24 | 影石创新科技股份有限公司 | Panoramic video processing method and device, computer equipment and storage medium |
| CN113436113A (en) * | 2021-07-22 | 2021-09-24 | 黑芝麻智能科技有限公司 | Anti-shake image processing method, device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101231456A (en) * | 2008-01-31 | 2008-07-30 | 北京航空航天大学 | Method for correcting panorama video jitter using angle sensor |
| CN104333675A (en) * | 2014-10-20 | 2015-02-04 | 长春理工大学 | Panoramic electronic image stabilization method based on spherical projection |
| US20150181114A1 (en) * | 2013-12-24 | 2015-06-25 | Fxgear Inc. | Apparatus and method for processing wide viewing angle image |
| EP2933605A1 (en) * | 2014-04-17 | 2015-10-21 | Nokia Technologies OY | A device orientation correction method for panorama images |
| CN105208247A (en) * | 2015-09-02 | 2015-12-30 | 长春理工大学 | Quaternion-based panoramic image stabilizing method |
| US9277122B1 (en) * | 2015-08-13 | 2016-03-01 | Legend3D, Inc. | System and method for removing camera rotation from a panoramic video |
| CN105975172A (en) * | 2015-12-11 | 2016-09-28 | 乐视网信息技术（北京）股份有限公司 | Method and device for adjustment of panoramic video and mobile terminal |
-
2016
- 2016-10-31 CN CN201610930116.4A patent/CN106507094B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101231456A (en) * | 2008-01-31 | 2008-07-30 | 北京航空航天大学 | Method for correcting panorama video jitter using angle sensor |
| US20150181114A1 (en) * | 2013-12-24 | 2015-06-25 | Fxgear Inc. | Apparatus and method for processing wide viewing angle image |
| EP2933605A1 (en) * | 2014-04-17 | 2015-10-21 | Nokia Technologies OY | A device orientation correction method for panorama images |
| CN104333675A (en) * | 2014-10-20 | 2015-02-04 | 长春理工大学 | Panoramic electronic image stabilization method based on spherical projection |
| US9277122B1 (en) * | 2015-08-13 | 2016-03-01 | Legend3D, Inc. | System and method for removing camera rotation from a panoramic video |
| CN105208247A (en) * | 2015-09-02 | 2015-12-30 | 长春理工大学 | Quaternion-based panoramic image stabilizing method |
| CN105975172A (en) * | 2015-12-11 | 2016-09-28 | 乐视网信息技术（北京）股份有限公司 | Method and device for adjustment of panoramic video and mobile terminal |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107071279A (en) * | 2017-04-01 | 2017-08-18 | 深圳市圆周率软件科技有限责任公司 | A kind of method and system of panoramic picture frame stabilization |
| CN107040694A (en) * | 2017-04-07 | 2017-08-11 | 深圳岚锋创视网络科技有限公司 | A kind of method, system and the portable terminal of panoramic video stabilization |
| WO2018184423A1 (en) * | 2017-04-07 | 2018-10-11 | 深圳岚锋创视网络科技有限公司 | Method and system for panoramic video stabilization, and portable terminal |
| US10812718B2 (en) | 2017-04-07 | 2020-10-20 | Arashi Vision Inc. | Method and system for panoramic video stabilization, and portable terminal |
| CN109391755A (en) * | 2017-08-03 | 2019-02-26 | 佳能株式会社 | Picture pick-up device and the method wherein executed |
| CN109391755B (en) * | 2017-08-03 | 2021-09-14 | 佳能株式会社 | Image pickup apparatus and method executed therein |
| WO2019037656A1 (en) * | 2017-08-23 | 2019-02-28 | Mediatek Inc. | Method and apparatus of signalling syntax for immersive video coding |
| US10827159B2 (en) | 2017-08-23 | 2020-11-03 | Mediatek Inc. | Method and apparatus of signalling syntax for immersive video coding |
| CN110944727A (en) * | 2017-09-19 | 2020-03-31 | 佳能株式会社 | System and method for controlling virtual camera |
| CN107665250A (en) * | 2017-09-26 | 2018-02-06 | 百度在线网络技术（北京）有限公司 | High definition road overlooks construction method, device, server and the storage medium of map |
| CN108366243B (en) * | 2018-01-23 | 2019-10-29 | 微幻科技(北京)有限公司 | A kind of video jitter removing method and device |
| CN108366243A (en) * | 2018-01-23 | 2018-08-03 | 微幻科技(北京)有限公司 | A kind of video jitter removing method and device |
| CN110022439B (en) * | 2019-01-29 | 2021-09-28 | 威盛电子股份有限公司 | Panoramic video image stabilizing device, encoding method, playing method and evaluation method |
| US11627390B2 (en) | 2019-01-29 | 2023-04-11 | Via Technologies, Inc. | Encoding method, playing method and apparatus for image stabilization of panoramic video, and method for evaluating image stabilization algorithm |
| CN110022439A (en) * | 2019-01-29 | 2019-07-16 | 威盛电子股份有限公司 | Full-view video image stabilising arrangement, coding method and playback method and appraisal procedure |
| CN110430411A (en) * | 2019-08-08 | 2019-11-08 | 青岛一舍科技有限公司 | A kind of display methods and device of panoramic video |
| CN110850977A (en) * | 2019-11-06 | 2020-02-28 | 成都威爱新经济技术研究院有限公司 | Stereoscopic image interaction method based on 6DOF head-mounted display |
| CN110850977B (en) * | 2019-11-06 | 2023-10-31 | 成都威爱新经济技术研究院有限公司 | Stereoscopic image interaction method based on 6DOF head-mounted display |
| CN111524230A (en) * | 2020-04-01 | 2020-08-11 | 中南大学 | Linkage browsing method for three-dimensional model and unfolded panoramic image and computer system |
| CN111541850A (en) * | 2020-07-13 | 2020-08-14 | 南京泓众电子科技有限公司 | Panoramic electronic pan-tilt correction method and device |
| CN113301249A (en) * | 2021-05-07 | 2021-08-24 | 影石创新科技股份有限公司 | Panoramic video processing method and device, computer equipment and storage medium |
| CN113301249B (en) * | 2021-05-07 | 2023-06-30 | 影石创新科技股份有限公司 | Panoramic video processing method, device, computer equipment and storage medium |
| CN113436113A (en) * | 2021-07-22 | 2021-09-24 | 黑芝麻智能科技有限公司 | Anti-shake image processing method, device, electronic equipment and storage medium |
| US11770613B2 (en) | 2021-07-22 | 2023-09-26 | Black Sesame Technologies Inc. | Anti-shake image processing method, apparatus, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106507094B (en) | 2019-01-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106507094B (en) | Correct the method and device of panoramic video display view angle | |
| CN109615703B (en) | Augmented reality image display method, device and equipment | |
| CN107169924B (en) | Method and system for establishing three-dimensional panoramic image | |
| CN107079141B (en) | Image mosaic for 3 D video | |
| JP4351996B2 (en) | Method for generating a stereoscopic image from a monoscope image | |
| CN105939481A (en) | Interactive three-dimensional virtual reality video program recorded broadcast and live broadcast method | |
| JP2019511016A (en) | Stitching into a frame panorama frame | |
| CN106296589B (en) | Panoramic image processing method and device | |
| JP7303754B2 (en) | Method and system for integrating user-specific content into video production | |
| CN107844190B (en) | Image display method and device based on virtual reality VR equipment | |
| US9756260B1 (en) | Synthetic camera lenses | |
| WO2017032336A1 (en) | System and method for capturing and displaying images | |
| TWI584050B (en) | Panoramic stereoscopic image synthesis method, apparatus and mobile terminal | |
| CN106357966A (en) | Panoramic image photographing device and panoramic image acquiring method | |
| CN108347505B (en) | Mobile terminal with 3D imaging function and image generation method | |
| TW201351959A (en) | Method of stereo 3D image synthesis and related camera | |
| CN104021585A (en) | Three-dimensional exhibition method based on real scene | |
| CN108600729B (en) | Dynamic 3D model generation device and image generation method | |
| CN108614636A (en) | A kind of 3D outdoor scenes VR production methods | |
| CN108391116B (en) | Whole body scanning device and method based on 3D imaging technology | |
| CN116168076A (en) | Image processing method, device, equipment and storage medium | |
| CN108012160B (en) | A kind of logo insertion method based on panoramic video | |
| CN108513122B (en) | Model adjusting method and model generating device based on 3D imaging technology | |
| CN115550563A (en) | Video processing method, video processing device, computer equipment and storage medium | |
| JP2006309612A (en) | Image display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |